Multi-Objective Feature Selection Method Based on Hybrid MI and PSO Algorithm

• Main Author: WANG Jinjie, LI Wei
• Format: Article
• Language: zho
• Published: Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press 2020-01-01
• Series: Jisuanji kexue yu tansuo
• Subjects: multi-objective optimization; feature selection; mutual information (mi); particle swarm optimization(pso); pareto front; archive
• Online Access: http://fcst.ceaj.org/CN/abstract/abstract2090.shtml

Feature selection is an important pre-processing in data mining, due to a lot of redundant and irrelevant features in datasets. A filter-wrapper multi-objective feature selection method based on hybrid mutual information and particle swarm optimization algorithm (HMIPSO) is proposed. Based on the number of iterations of the pbest of the particle from the last update, an adaptive mutation strategy is proposed to disturb the population and avoid the population falling into local optimum. Meanwhile, a new set concept based on the Pareto front and archive is proposed. Combining mutual information and the new set knowledge, a local search strategy is proposed, which enables particles in Pareto front to delete irrelevant and redundant features, and then the Pareto front before and after learning is updated by Elite. Finally, this paper compares the effectiveness of HMIPSO with other 4 multi-objective algorithms on 15 UCI datasets. The experimental results show that HMIPSO can reduce the number of features and classification error rate efficiently.