DE-ELM-SSC+:Semi-supervised Classification Algorithm

The combinations of evolutionary algorithms (EA) and analytical methods have been extensively studied in the fields of machine learning in recent years. This paper focuses on how to combine a differential evolution (DE) algorithm with the semi-supervised classification algorithm based on extreme lea...

Full description

Bibliographic Details
Main Author: PANG Jun, HUANG Heng, ZHANG Shou, SHU Zhiliang, ZHAO Yuhai
Format: Article
Language:zho
Published: Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press 2020-12-01
Series:Jisuanji kexue yu tansuo
Subjects:
Online Access:http://fcst.ceaj.org/CN/abstract/abstract2482.shtml
id doaj-6f69f33d5f8b41c5913d25424f3386cb
record_format Article
spelling doaj-6f69f33d5f8b41c5913d25424f3386cb2021-08-10T09:33:08ZzhoJournal of Computer Engineering and Applications Beijing Co., Ltd., Science PressJisuanji kexue yu tansuo1673-94182020-12-0114122014202710.3778/j.issn.1673-9418.1912001DE-ELM-SSC+:Semi-supervised Classification AlgorithmPANG Jun, HUANG Heng, ZHANG Shou, SHU Zhiliang, ZHAO Yuhai01. School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan 430070, China 2. Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System, Wuhan 430070, China 3. School of Computer Science and Engineering, Northeastern University, Shenyang 110169, ChinaThe combinations of evolutionary algorithms (EA) and analytical methods have been extensively studied in the fields of machine learning in recent years. This paper focuses on how to combine a differential evolution (DE) algorithm with the semi-supervised classification algorithm based on extreme learning machine (ELM). Firstly, this paper proposes a semi-supervised classification algorithm based on DE and ELM (DE-ELM-SSC) with roughly three steps. Firstly, multiple differential evolution strategies are adopted to optimize the input weights and hidden biases of extreme learning machine, and an optimal strategy for the target data set is selected according to the root mean square error (RMSE). Secondly, the optimal evolutionary strategy selected in the previous step is applied to the DE algorithm to optimize the ELM network parameters. Thirdly, in order to construct a semi-supervised classification model, tri-training technology is used to realize the cooperative training of three improved ELM base classifiers. Then, a nonlinear method is adopted to improve the existing inertial strategy method and realize adaptive adjustment of scaling factor, so as to optimize the DE-ELM-SSC algorithm to obtain the DE-ELM-SSC+ algorithm. Lastly, a large number of experimental results on UCI data sets show that the DE-ELM-SSC+ algorithm outperforms the baseline methods with higher classification accuracy because of evolution strategy selection and improved scaling factor adaptive adjustment.http://fcst.ceaj.org/CN/abstract/abstract2482.shtmlextreme learning machine (elm)semi-supervised classificationstrategy selectiondifferential evolution (de)scaling factor
collection DOAJ
language zho
format Article
sources DOAJ
author PANG Jun, HUANG Heng, ZHANG Shou, SHU Zhiliang, ZHAO Yuhai
spellingShingle PANG Jun, HUANG Heng, ZHANG Shou, SHU Zhiliang, ZHAO Yuhai
DE-ELM-SSC+:Semi-supervised Classification Algorithm
Jisuanji kexue yu tansuo
extreme learning machine (elm)
semi-supervised classification
strategy selection
differential evolution (de)
scaling factor
author_facet PANG Jun, HUANG Heng, ZHANG Shou, SHU Zhiliang, ZHAO Yuhai
author_sort PANG Jun, HUANG Heng, ZHANG Shou, SHU Zhiliang, ZHAO Yuhai
title DE-ELM-SSC+:Semi-supervised Classification Algorithm
title_short DE-ELM-SSC+:Semi-supervised Classification Algorithm
title_full DE-ELM-SSC+:Semi-supervised Classification Algorithm
title_fullStr DE-ELM-SSC+:Semi-supervised Classification Algorithm
title_full_unstemmed DE-ELM-SSC+:Semi-supervised Classification Algorithm
title_sort de-elm-ssc+:semi-supervised classification algorithm
publisher Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
series Jisuanji kexue yu tansuo
issn 1673-9418
publishDate 2020-12-01
description The combinations of evolutionary algorithms (EA) and analytical methods have been extensively studied in the fields of machine learning in recent years. This paper focuses on how to combine a differential evolution (DE) algorithm with the semi-supervised classification algorithm based on extreme learning machine (ELM). Firstly, this paper proposes a semi-supervised classification algorithm based on DE and ELM (DE-ELM-SSC) with roughly three steps. Firstly, multiple differential evolution strategies are adopted to optimize the input weights and hidden biases of extreme learning machine, and an optimal strategy for the target data set is selected according to the root mean square error (RMSE). Secondly, the optimal evolutionary strategy selected in the previous step is applied to the DE algorithm to optimize the ELM network parameters. Thirdly, in order to construct a semi-supervised classification model, tri-training technology is used to realize the cooperative training of three improved ELM base classifiers. Then, a nonlinear method is adopted to improve the existing inertial strategy method and realize adaptive adjustment of scaling factor, so as to optimize the DE-ELM-SSC algorithm to obtain the DE-ELM-SSC+ algorithm. Lastly, a large number of experimental results on UCI data sets show that the DE-ELM-SSC+ algorithm outperforms the baseline methods with higher classification accuracy because of evolution strategy selection and improved scaling factor adaptive adjustment.
topic extreme learning machine (elm)
semi-supervised classification
strategy selection
differential evolution (de)
scaling factor
url http://fcst.ceaj.org/CN/abstract/abstract2482.shtml
work_keys_str_mv AT pangjunhuanghengzhangshoushuzhiliangzhaoyuhai deelmsscsemisupervisedclassificationalgorithm
_version_ 1721212365159006208