A new parallel data geometry analysis algorithm to select training data for support vector machine

• Main Authors: Yunfeng Shi, Shu Lv, Kaibo Shi
• Format: Article
• Language: English
• Published: AIMS Press 2021-09-01
• Series: AIMS Mathematics
• Subjects: support vector machine; sample reduction; geometry analysis; mahalanobis distance; parallel
• Online Access: https://www.aimspress.com/article/doi/10.3934/math.2021806?viewType=HTML

Support vector machine (SVM) is one of the most powerful technologies of machine learning, which has been widely concerned because of its remarkable performance. However, when dealing with the classification problem of large-scale datasets, the high complexity of SVM model leads to low efficiency and become impractical. Due to the sparsity of SVM in the sample space, this paper presents a new parallel data geometry analysis (PDGA) algorithm to reduce the training set of SVM, which helps to improve the efficiency of SVM training. The PDGA introduce Mahalanobis distance to measure the distance from each sample to its centroid. And based on this, proposes a method that can identify non support vectors and outliers at the same time to help remove redundant data. When the training set is further reduced, cosine angle distance analysis method is proposed to determine whether the samples are redundant data, ensure that the valuable data are not removed. Different from the previous data geometry analysis methods, the PDGA algorithm is implemented in parallel, which greatly saving the computational cost. Experimental results on artificial dataset and 6 real datasets show that the algorithm can adapt to different sample distributions. Which significantly reduce the training time and memory requirements without sacrificing the classification accuracy, and its performance is obviously better than the other five competitive algorithms.