Automatic Classification of Web Images as UML Static Diagrams Using Machine Learning Techniques

• Main Authors: Valentín Moreno, Gonzalo Génova, Manuela Alejandres, Anabel Fraga
• Format: Article
• Language: English
• Published: MDPI AG 2020-04-01
• Series: Applied Sciences
• Subjects: UML diagram recognition; image processing; image classification; rule induction; classification tool
• Online Access: https://www.mdpi.com/2076-3417/10/7/2406

Our purpose in this research is to develop a method to automatically and efficiently classify web images as Unified Modeling Language (UML) static diagrams, and to produce a computer tool that implements this function. The tool receives a bitmap file (in different formats) as an input and communicates whether the image corresponds to a diagram. For pragmatic reasons, we restricted ourselves to the simplest kinds of diagrams that are more useful for automated software reuse: computer-edited 2D representations of static diagrams. The tool does not require that the images are explicitly or implicitly tagged as UML diagrams. The tool extracts graphical characteristics from each image (such as grayscale histogram, color histogram and elementary geometric forms) and uses a combination of rules to classify it. The rules are obtained with machine learning techniques (rule induction) from a sample of 19,000 web images manually classified by experts. In this work, we do not consider the textual contents of the images. Our tool reaches nearly 95% of agreement with manually classified instances, improving the effectiveness of related research works. Moreover, using a training dataset 15 times bigger, the time required to process each image and extract its graphical features (0.680 s) is seven times lower.