A Method for Transforming Non-Convex Optimization Problem to Distributed Form

We propose a novel distributed method for non-convex optimization problems with coupling equality and inequality constraints. This method transforms the optimization problem into a specific form to allow distributed implementation of modified gradient descent and Newton’s methods so that they operat...

Full description

Bibliographic Details
Published in:	Mathematics
Main Authors:	Oleg O. Khamisov, Oleg V. Khamisov, Todor D. Ganchev, Eugene S. Semenkin
Format:	Article
Language:	English
Published:	MDPI AG 2024-09-01
Subjects:	distributed optimization non-convex optimization gradient descent Newton’s method
Online Access:	https://www.mdpi.com/2227-7390/12/17/2796

Similar Items

Adaptive Stochastic Gradient Descent Method for Convex and Non-Convex Optimization
by: Ruijuan Chen, et al.
Published: (2022-11-01)

An Efficient Algorithm for Convex Biclustering
by: Jie Chen, et al.
Published: (2021-11-01)

Automatic Convexity Deduction for Efficient Function’s Range Bounding
by: Mikhail Posypkin, et al.
Published: (2021-01-01)

Damped Newton Stochastic Gradient Descent Method for Neural Networks Training
by: Jingcheng Zhou, et al.
Published: (2021-06-01)

Hybrid Distributed Optimization for Learning Over Networks With Heterogeneous Agents
by: Mohammad H. Nassralla, et al.
Published: (2023-01-01)

Analysis of a Two-Step Gradient Method with Two Momentum Parameters for Strongly Convex Unconstrained Optimization
by: Gerasim V. Krivovichev, et al.
Published: (2024-03-01)

Convergence Rates of Gradient Methods for Convex Optimization in the Space of Measures
by: Chizat, Lénaïc
Published: (2023-01-01)

Variance Reduction Optimization Algorithm Based on Random Sampling
by: GUO Zhenhua, YAN Ruidong, QIU Zhiyong, ZHAO Yaqian, LI Rengang
Published: (2025-03-01)

GRADIENT DESCENT METHOD AND PARAMETER SELECTION FOR IMAGE RESTORATION PROBLEM
by: Nguyen Dinh Dung
Published: (2025-03-01)

Application of the Parabola Method in Nonconvex Optimization
by: Anton Kolosnitsyn, et al.
Published: (2024-03-01)

A new Newton method for convex optimization problems with singular Hessian matrices
by: Tianji Wang, et al.
Published: (2023-07-01)

R-DOCO: Resilient Distributed Online Convex Optimization Against Adversarial Attacks
by: Zhixiang Kong, et al.
Published: (2024-11-01)

The Improved Stochastic Fractional Order Gradient Descent Algorithm
by: Yang Yang, et al.
Published: (2023-08-01)

Allocation of Starting Points in Global Optimization Problems
by: Oleg Khamisov, et al.
Published: (2024-02-01)

A distributed proximal gradient method with time-varying delays for solving additive convex optimizations
by: Sakrapee Namsak, et al.
Published: (2023-05-01)

Distributed Newton Step Projection Algorithm for Online Convex Optimization Over Time-Varying Unbalanced Networks
by: Jiayi Wu, et al.
Published: (2024-01-01)

An Improved Modification of Accelerated Double Direction and Double Step-Size Optimization Schemes
by: Milena J. Petrović, et al.
Published: (2022-01-01)

The global rate of convergence for optimal tensor methods in smooth convex optimization
by: Alexander Vladimirovich Gasnikov, et al.
Published: (2018-12-01)

A New Method Based on Locally Optimal Step Length in Accelerated Gradient Descent for Quantum State Tomography
by: Mohammad Dolatabadi, et al.
Published: (2024-08-01)

On One Problem of the Nonlinear Convex Optimization
by: Robert Vrabel
Published: (2022-09-01)

Consensus and Diffusion for First-Order Distributed Optimization Over Multi-Hop Network
by: Mou Wu, et al.
Published: (2023-01-01)

Machine Learning and Deep Learning Optimization Algorithms for Unconstrained Convex Optimization Problem
by: Kainat Naeem, et al.
Published: (2025-01-01)

Research and Study of the Hybrid Algorithms Based on the Collective Behavior of Fish Schools and Classical Optimization Methods
by: Liliya A. Demidova, et al.
Published: (2020-04-01)

Optimal skill distribution under convex skill costs
by: Tin Cheuk Leung, et al.
Published: (2018-03-01)

An Extended Gradient Method for Smooth and Strongly Convex Functions
by: Xuexue Zhang, et al.
Published: (2023-11-01)

Comparative Analysis of Accelerated Models for Solving Unconstrained Optimization Problems with Application of Khan’s Hybrid Rule
by: Vladimir Rakočević, et al.
Published: (2022-11-01)

Convergence of a distributed method for minimizing sum of convex functions with fixed point constraints
by: Nawarat Ekkarntrong, et al.
Published: (2021-12-01)

Application of a novel metaheuristic algorithm inspired by Adam gradient descent in distributed permutation flow shop scheduling problem and continuous engineering problems
by: Yiqiang Xia, et al.
Published: (2025-07-01)

A new approach to training neural networks using natural gradient descent with momentum based on Dirichlet distributions
by: R.I. Abdulkadirov, et al.
Published: (2023-02-01)

An infeasible interior point methods for convex quadratic problems
by: Hayet Roumili, et al.
Published: (2018-12-01)

A numerical study of an infeasible interior-point algorithm for convex quadratic semi-definite optimization
by: Yasmina Bendaas, et al.
Published: (2024-12-01)

Accelerating Extreme Search of Multidimensional Functions Based on Natural Gradient Descent with Dirichlet Distributions
by: Ruslan Abdulkadirov, et al.
Published: (2022-09-01)

Distributed online constrained convex optimization with edge-based event-triggered communication mechanisms
by: MAO Shuai; DUAN Bing; HU Pan; ZHANG Xinsong
Published: (2024-09-01)

Approximation Algorithm Variants for Convex Multiobjective Optimization Problems
by: Firdevs ULUS
Published: (2020-03-01)

A Fixed-Point of View on Gradient Methods for Big Data
by: Alexander Jung
Published: (2017-09-01)

Incremental Weak Subgradient Methods for Non-Smooth Non-Convex Optimization Problems
by: Narges Araboljadidi, et al.
Published: (2025-06-01)

Convex Optimization Techniques for High-Dimensional Data Clustering Analysis: A Review
by: Ahmed Yacoub Yousif
Published: (2024-07-01)

Nonlinear optimization algorithm using monotonically increasing quantization resolution
by: Jinwuk Seok, et al.
Published: (2023-02-01)

Solving Spatial Optimization Problems via Lagrangian Relaxation and Automatic Gradient Computation
by: Zhen Lei, et al.
Published: (2025-01-01)

Hybrid Modified Accelerated Gradient Method for Optimization Processes
by: Milena J. Petrović, et al.
Published: (2024-02-01)