The comparison of traditional architectures between countries makes the characteristics be more objectively. This paper is a synthesis of the image of the appearances for Japanese/Korean and Japanese/Taiwanese traditional architectures through the their subjects' cognitive structure. The images for all architectures in this research were mainly in modesty-order, strictness-hardness, and looseness-softness. The members which strongly influenced on the image are roof and column/wall with various layouts, shapes and colors. The common image in those architectures is modesty and order, representing harmony of nature. Japanese subjectives are represented as to be stricter and harder than Korean or Taiwanese. On the other hand, Korean or Taiwanese as to be looser and softer than Japanese, which was considered as related with the idea of their high level at that period.