Image Classification for the Automatic Feature Extraction in Human Worn Fashion Data

• Main Authors: Stefan Rohrmanstorfer, Mikhail Komarov, Felix Mödritscher
• Format: Article
• Language: English
• Published: MDPI AG 2021-03-01
• Series: Mathematics
• Subjects: image classification; neural network; convolutional; machine learning; fashion; apparel
• Online Access: https://www.mdpi.com/2227-7390/9/6/624

With the always increasing amount of image data, it has become a necessity to automatically look for and process information in these images. As fashion is captured in images, the fashion sector provides the perfect foundation to be supported by the integration of a service or application that is built on an image classification model. In this article, the state of the art for image classification is analyzed and discussed. Based on the elaborated knowledge, four different approaches will be implemented to successfully extract features out of fashion data. For this purpose, a human-worn fashion dataset with 2567 images was created, but it was significantly enlarged by the performed image operations. The results show that convolutional neural networks are the undisputed standard for classifying images, and that TensorFlow is the best library to build them. Moreover, through the introduction of dropout layers, data augmentation and transfer learning, model overfitting was successfully prevented, and it was possible to incrementally improve the validation accuracy of the created dataset from an initial 69% to a final validation accuracy of 84%. More distinct apparel like trousers, shoes and hats were better classified than other upper body clothes.