We develop the system which automatically carries out Go-record from the image of the Go-game situation. For the Go-record, Go-stone has to decide its position on the 19x19 cells of the Go-board which we call Go-coordinates. In our system, the Go-board is shot in various directions with the CCD camera for simple operation. In this case, it is difficult to directly extract accurate Go-coordinates in the image. However, we are able to extract accurate Go-coordinates if the area of the Go-board is recognized accurately. Consequently, in the first step, the contour of the Go-board has to be recognized from the image which includes unrelated objects. In this paper, we propose the pattern matching algorithm for the extraction of the accurate Go-coordinates in the image using the genetic algorithm (GA). We evaluated the proposed algorithm on the prototype using the proposed algorithm by dealing with the image which includes unrelated objects. As a result, it has been verified that the prototype generates the correct Go-record.