In this paper, we propose a new method for image analysis by using the natural language information extracted from the explanation text of image data. First, we describe the method of extraction of color information from the explanation text. Then, we describe how this color information is used for the extraction of objects from the image data. Our experiments with pictures and text in pictorial book of flora showed the effectiveness of our method.