ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary Algorithms

In multi-objective optimization, standard evolutionary algorithms, such as NSGA-II, are computationally expensive, particularly when handling complex constraints. Constraint evaluations, often the bottleneck, require substantial resources. Pre-trained surrogate models have been used to improve compu...

Full description

Bibliographic Details
Published in:Applied Sciences
Main Authors: Karanpreet Singh, Rakesh K. Kapania
Format: Article
Language:English
Published: MDPI AG 2024-10-01
Subjects:
Online Access:https://www.mdpi.com/2076-3417/14/21/9975
_version_ 1850309740926599168
author Karanpreet Singh
Rakesh K. Kapania
author_facet Karanpreet Singh
Rakesh K. Kapania
author_sort Karanpreet Singh
collection DOAJ
container_title Applied Sciences
description In multi-objective optimization, standard evolutionary algorithms, such as NSGA-II, are computationally expensive, particularly when handling complex constraints. Constraint evaluations, often the bottleneck, require substantial resources. Pre-trained surrogate models have been used to improve computational efficiency, but they often rely heavily on the model’s accuracy and require large datasets. In this study, we use active learning to accelerate multi-objective optimization. Active learning is a machine learning approach that selects the most informative data points to reduce the computational cost of labeling data. It is employed in this study to reduce the number of constraint evaluations during optimization by dynamically querying new data points only when the model is uncertain. Incorporating machine learning into this framework allows the optimization process to focus on critical areas of the search space adaptively, leveraging predictive models to guide the algorithm. This reduces computational overhead and marks a significant advancement in using machine learning to enhance the efficiency and scalability of multi-objective optimization tasks. This method is applied to six challenging benchmark problems and demonstrates more than a 50% reduction in constraint evaluations, with varying savings across different problems. This adaptive approach significantly enhances the computational efficiency of multi-objective optimization without requiring pre-trained models.
format Article
id doaj-art-791dc1846d9d4e4eba2a03342d1b5bb7
institution Directory of Open Access Journals
issn 2076-3417
language English
publishDate 2024-10-01
publisher MDPI AG
record_format Article
spelling doaj-art-791dc1846d9d4e4eba2a03342d1b5bb72025-08-19T23:27:35ZengMDPI AGApplied Sciences2076-34172024-10-011421997510.3390/app14219975ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary AlgorithmsKaranpreet Singh0Rakesh K. Kapania1Independent Researcher, Toronto, ON M4W 3W6, CanadaKevin T. Crofton Department of Aerospace and Ocean Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA 24061, USAIn multi-objective optimization, standard evolutionary algorithms, such as NSGA-II, are computationally expensive, particularly when handling complex constraints. Constraint evaluations, often the bottleneck, require substantial resources. Pre-trained surrogate models have been used to improve computational efficiency, but they often rely heavily on the model’s accuracy and require large datasets. In this study, we use active learning to accelerate multi-objective optimization. Active learning is a machine learning approach that selects the most informative data points to reduce the computational cost of labeling data. It is employed in this study to reduce the number of constraint evaluations during optimization by dynamically querying new data points only when the model is uncertain. Incorporating machine learning into this framework allows the optimization process to focus on critical areas of the search space adaptively, leveraging predictive models to guide the algorithm. This reduces computational overhead and marks a significant advancement in using machine learning to enhance the efficiency and scalability of multi-objective optimization tasks. This method is applied to six challenging benchmark problems and demonstrates more than a 50% reduction in constraint evaluations, with varying savings across different problems. This adaptive approach significantly enhances the computational efficiency of multi-objective optimization without requiring pre-trained models.https://www.mdpi.com/2076-3417/14/21/9975active learningmulti-objective optimizationmulti-disciplinary optimizationmachine learningevolutionary algorithmsoptimization
spellingShingle Karanpreet Singh
Rakesh K. Kapania
ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary Algorithms
active learning
multi-objective optimization
multi-disciplinary optimization
machine learning
evolutionary algorithms
optimization
title ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary Algorithms
title_full ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary Algorithms
title_fullStr ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary Algorithms
title_full_unstemmed ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary Algorithms
title_short ALMO: Active Learning-Based Multi-Objective Optimization for Accelerating Constrained Evolutionary Algorithms
title_sort almo active learning based multi objective optimization for accelerating constrained evolutionary algorithms
topic active learning
multi-objective optimization
multi-disciplinary optimization
machine learning
evolutionary algorithms
optimization
url https://www.mdpi.com/2076-3417/14/21/9975
work_keys_str_mv AT karanpreetsingh almoactivelearningbasedmultiobjectiveoptimizationforacceleratingconstrainedevolutionaryalgorithms
AT rakeshkkapania almoactivelearningbasedmultiobjectiveoptimizationforacceleratingconstrainedevolutionaryalgorithms