Improvement of Retrieval Process for Similar Outfit Portraits in Prototype Fashion Chatbot

We have proposed a prototype fashion chatbot designed to retrieve similar outfit portraits and recommend reference users based on user-submitted outfit portraits. This chatbot uses a body part segmentation method to extract regions of body parts and calculates color feature values for the extracted body parts. This chatbot also employs an item segmentation method to extract fashion items present in the outfit portrait. Despite its capabilities, this chatbot showed limitations, notably retrieving portraits featuring incorrect types of outerwear. Furthermore, its retrieval process did not fully utilize the extracted results of the fashion item segmentation method. Thus, in this study, we aimed to address these issues by incorporating specific enhancements. We performed an initial validation experiment for the enhancements using outfit portraits posted on a Japanese fashion website.