Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of Multipliers
Conventional centralized methods use entire data to estimate the projection matrix of dimensionality reduction problem, which are not suitable for the network environment where the sensitive or private data are stored or there is no fusion center. In this paper, we develop a decentralized principal...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9218987/ |
id |
doaj-45430dbef1ec4c41b39879135ec74ac6 |
---|---|
record_format |
Article |
spelling |
doaj-45430dbef1ec4c41b39879135ec74ac62021-03-30T04:22:53ZengIEEEIEEE Access2169-35362020-01-01818284218285210.1109/ACCESS.2020.29817949218987Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of MultipliersZhonghua Ye0https://orcid.org/0000-0001-5197-3257Hong Zhu1https://orcid.org/0000-0003-2993-1928School of Automation and Information Engineering, Xi’an University of Technology, Xi’an, ChinaSchool of Automation and Information Engineering, Xi’an University of Technology, Xi’an, ChinaConventional centralized methods use entire data to estimate the projection matrix of dimensionality reduction problem, which are not suitable for the network environment where the sensitive or private data are stored or there is no fusion center. In this paper, we develop a decentralized principal component analysis (DPCA) method to deal with the distributed data without sharing or collecting them together. The main contributions of this paper are as follows: i) The proposed DPCA method only needs the projection vector information communications among neighboring nodes other than the communications of the distributed data; ii) The decentralized projection vector determination problem is replaced by a set of subproblems with consensus constraints and the excellent processing capability of alternating direction method of multipliers (ADMM) is used to obtain the consistent projection vectors; iii) Especially, the integrating Lagrange programming neural networks (LPNN) is introduced to solve the projection vectors determination problem with the complex unitary and orthogonal constraints, and iv) the converge analysis of the proposed optimization problem is provided to ensure that the obtained projection vectors of the distributed method converge to those of the centralized one. Some simulations and experiments are given to show that the proposed algorithm is an alternative decentralized principal component analysis approach, and is suitable for the network environment.https://ieeexplore.ieee.org/document/9218987/Decentralized principal component analysis (DPCA)distributed dataalternating-direction method of multipliers (ADMM)Lagrange programming neural networks (LPNN) |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Zhonghua Ye Hong Zhu |
spellingShingle |
Zhonghua Ye Hong Zhu Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of Multipliers IEEE Access Decentralized principal component analysis (DPCA) distributed data alternating-direction method of multipliers (ADMM) Lagrange programming neural networks (LPNN) |
author_facet |
Zhonghua Ye Hong Zhu |
author_sort |
Zhonghua Ye |
title |
Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of Multipliers |
title_short |
Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of Multipliers |
title_full |
Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of Multipliers |
title_fullStr |
Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of Multipliers |
title_full_unstemmed |
Decentralized Principal Component Analysis by Integrating Lagrange Programming Neural Networks With Alternating Direction Method of Multipliers |
title_sort |
decentralized principal component analysis by integrating lagrange programming neural networks with alternating direction method of multipliers |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
Conventional centralized methods use entire data to estimate the projection matrix of dimensionality reduction problem, which are not suitable for the network environment where the sensitive or private data are stored or there is no fusion center. In this paper, we develop a decentralized principal component analysis (DPCA) method to deal with the distributed data without sharing or collecting them together. The main contributions of this paper are as follows: i) The proposed DPCA method only needs the projection vector information communications among neighboring nodes other than the communications of the distributed data; ii) The decentralized projection vector determination problem is replaced by a set of subproblems with consensus constraints and the excellent processing capability of alternating direction method of multipliers (ADMM) is used to obtain the consistent projection vectors; iii) Especially, the integrating Lagrange programming neural networks (LPNN) is introduced to solve the projection vectors determination problem with the complex unitary and orthogonal constraints, and iv) the converge analysis of the proposed optimization problem is provided to ensure that the obtained projection vectors of the distributed method converge to those of the centralized one. Some simulations and experiments are given to show that the proposed algorithm is an alternative decentralized principal component analysis approach, and is suitable for the network environment. |
topic |
Decentralized principal component analysis (DPCA) distributed data alternating-direction method of multipliers (ADMM) Lagrange programming neural networks (LPNN) |
url |
https://ieeexplore.ieee.org/document/9218987/ |
work_keys_str_mv |
AT zhonghuaye decentralizedprincipalcomponentanalysisbyintegratinglagrangeprogrammingneuralnetworkswithalternatingdirectionmethodofmultipliers AT hongzhu decentralizedprincipalcomponentanalysisbyintegratinglagrangeprogrammingneuralnetworkswithalternatingdirectionmethodofmultipliers |
_version_ |
1724181861757878272 |