A New Two-Stage Algorithm for Solving Optimization Problems
Optimization seeks to find inputs for an objective function that result in a maximum or minimum. Optimization methods are divided into exact and approximate (algorithms). Several optimization algorithms imitate natural phenomena, laws of physics, and behavior of living organisms. Optimization based...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-04-01
|
Series: | Entropy |
Subjects: | |
Online Access: | https://www.mdpi.com/1099-4300/23/4/491 |
id |
doaj-c98a1c52ea1749fe865612e7babfb8fb |
---|---|
record_format |
Article |
spelling |
doaj-c98a1c52ea1749fe865612e7babfb8fb2021-04-20T23:03:07ZengMDPI AGEntropy1099-43002021-04-012349149110.3390/e23040491A New Two-Stage Algorithm for Solving Optimization ProblemsSajjad Amiri Doumari0Hadi Givi1Mohammad Dehghani2Zeinab Montazeri3Victor Leiva4Josep M. Guerrero5Department of Mathematics and Computer Science, Sirjan University of Technology, Sirjan, Kerman, IranDepartment of Electrical Engineering, Shahreza Campus, University of Isfahan, Isfahan, IranDepartment of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz, IranDepartment of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz, IranSchool of Industrial Engineering, Pontificia Universidad Católica de Valparaíso, Valparaíso 2362807, ChileCROM Center for Research on Microgrids, Department of Energy Technology, Aalborg University, 9220 Aalborg, DenmarkOptimization seeks to find inputs for an objective function that result in a maximum or minimum. Optimization methods are divided into exact and approximate (algorithms). Several optimization algorithms imitate natural phenomena, laws of physics, and behavior of living organisms. Optimization based on algorithms is the challenge that underlies machine learning, from logistic regression to training neural networks for artificial intelligence. In this paper, a new algorithm called two-stage optimization (TSO) is proposed. The TSO algorithm updates population members in two steps at each iteration. For this purpose, a group of good population members is selected and then two members of this group are randomly used to update the position of each of them. This update is based on the first selected good member at the first stage, and on the second selected good member at the second stage. We describe the stages of the TSO algorithm and model them mathematically. Performance of the TSO algorithm is evaluated for twenty-three standard objective functions. In order to compare the optimization results of the TSO algorithm, eight other competing algorithms are considered, including genetic, gravitational search, grey wolf, marine predators, particle swarm, teaching-learning-based, tunicate swarm, and whale approaches. The numerical results show that the new algorithm is superior and more competitive in solving optimization problems when compared with other algorithms.https://www.mdpi.com/1099-4300/23/4/491Friedman testmachine learningpopulation-based optimizationswarm intelligence |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Sajjad Amiri Doumari Hadi Givi Mohammad Dehghani Zeinab Montazeri Victor Leiva Josep M. Guerrero |
spellingShingle |
Sajjad Amiri Doumari Hadi Givi Mohammad Dehghani Zeinab Montazeri Victor Leiva Josep M. Guerrero A New Two-Stage Algorithm for Solving Optimization Problems Entropy Friedman test machine learning population-based optimization swarm intelligence |
author_facet |
Sajjad Amiri Doumari Hadi Givi Mohammad Dehghani Zeinab Montazeri Victor Leiva Josep M. Guerrero |
author_sort |
Sajjad Amiri Doumari |
title |
A New Two-Stage Algorithm for Solving Optimization Problems |
title_short |
A New Two-Stage Algorithm for Solving Optimization Problems |
title_full |
A New Two-Stage Algorithm for Solving Optimization Problems |
title_fullStr |
A New Two-Stage Algorithm for Solving Optimization Problems |
title_full_unstemmed |
A New Two-Stage Algorithm for Solving Optimization Problems |
title_sort |
new two-stage algorithm for solving optimization problems |
publisher |
MDPI AG |
series |
Entropy |
issn |
1099-4300 |
publishDate |
2021-04-01 |
description |
Optimization seeks to find inputs for an objective function that result in a maximum or minimum. Optimization methods are divided into exact and approximate (algorithms). Several optimization algorithms imitate natural phenomena, laws of physics, and behavior of living organisms. Optimization based on algorithms is the challenge that underlies machine learning, from logistic regression to training neural networks for artificial intelligence. In this paper, a new algorithm called two-stage optimization (TSO) is proposed. The TSO algorithm updates population members in two steps at each iteration. For this purpose, a group of good population members is selected and then two members of this group are randomly used to update the position of each of them. This update is based on the first selected good member at the first stage, and on the second selected good member at the second stage. We describe the stages of the TSO algorithm and model them mathematically. Performance of the TSO algorithm is evaluated for twenty-three standard objective functions. In order to compare the optimization results of the TSO algorithm, eight other competing algorithms are considered, including genetic, gravitational search, grey wolf, marine predators, particle swarm, teaching-learning-based, tunicate swarm, and whale approaches. The numerical results show that the new algorithm is superior and more competitive in solving optimization problems when compared with other algorithms. |
topic |
Friedman test machine learning population-based optimization swarm intelligence |
url |
https://www.mdpi.com/1099-4300/23/4/491 |
work_keys_str_mv |
AT sajjadamiridoumari anewtwostagealgorithmforsolvingoptimizationproblems AT hadigivi anewtwostagealgorithmforsolvingoptimizationproblems AT mohammaddehghani anewtwostagealgorithmforsolvingoptimizationproblems AT zeinabmontazeri anewtwostagealgorithmforsolvingoptimizationproblems AT victorleiva anewtwostagealgorithmforsolvingoptimizationproblems AT josepmguerrero anewtwostagealgorithmforsolvingoptimizationproblems AT sajjadamiridoumari newtwostagealgorithmforsolvingoptimizationproblems AT hadigivi newtwostagealgorithmforsolvingoptimizationproblems AT mohammaddehghani newtwostagealgorithmforsolvingoptimizationproblems AT zeinabmontazeri newtwostagealgorithmforsolvingoptimizationproblems AT victorleiva newtwostagealgorithmforsolvingoptimizationproblems AT josepmguerrero newtwostagealgorithmforsolvingoptimizationproblems |
_version_ |
1721517303894376448 |