Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis
This paper is focused on the efficient algorithm design for affine rank minimization (ARM) and compressed robust principal component analysis (CRPCA). Given the proliferation of the literature on the ARM and CRPCA problems, the existing algorithms mostly take a model-based approach in the algorithm...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2019-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8843989/ |
id |
doaj-f1c73ba57dbb4657bac0b293c387e125 |
---|---|
record_format |
Article |
spelling |
doaj-f1c73ba57dbb4657bac0b293c387e1252021-03-30T00:29:49ZengIEEEIEEE Access2169-35362019-01-01714060614061710.1109/ACCESS.2019.29422048843989Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component AnalysisXuehai He0Zhipeng Xue1Xiaojun Yuan2https://orcid.org/0000-0002-0433-6535Center for Intelligent Networking and Communications, National Key Laboratory of Science and Technology on Communications, University of Electronic Science and Technology of China, Chengdu, ChinaSchool of Information Science and Technology, ShanghaiTech University, Shanghai, ChinaCenter for Intelligent Networking and Communications, National Key Laboratory of Science and Technology on Communications, University of Electronic Science and Technology of China, Chengdu, ChinaThis paper is focused on the efficient algorithm design for affine rank minimization (ARM) and compressed robust principal component analysis (CRPCA). Given the proliferation of the literature on the ARM and CRPCA problems, the existing algorithms mostly take a model-based approach in the algorithm design, and so are sensitive to the generation model of the linear measurement operator or to the generation model of the low-rank matrix to be recovered. It is known that, all these algorithms do not work well, e.g., when the low-rank matrix is ill-conditioned. As inspired by the success of learned iterative soft-thresholding (LIST) and learned approximate message passing (LAMP), we develop learning-based message passing algorithms, namely, the learned turbo message passing (LTMP) algorithm for affine rank minimization to cope with the ARM problem and the LTMP algorithm for the CRPCA problem. The LTMP algorithms learn their parameters from data, and hence are robust to the generation models of the linear operator and the low-rank matrix. We derive analytical expressions for the partial derivatives involved in training the LTMP network. Given the large size of the low-rank matrix in a typical ARM/CRPCA problem, these analytical expressions are of essential importance for the development of computationally feasible network training. Numerical results demonstrate that LTMP significantly outperforms the state-of-the-art counterparts for various generation models of the linear operator and the low-rank matrix, especially when the low-rank matrix is ill-conditioned.https://ieeexplore.ieee.org/document/8843989/Learned turbo message passing (LTMP)affine rank minimization (ARM)matrix completionlow-rank matrix recoverycompressed robust principal component analysis (CRPCA) |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Xuehai He Zhipeng Xue Xiaojun Yuan |
spellingShingle |
Xuehai He Zhipeng Xue Xiaojun Yuan Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis IEEE Access Learned turbo message passing (LTMP) affine rank minimization (ARM) matrix completion low-rank matrix recovery compressed robust principal component analysis (CRPCA) |
author_facet |
Xuehai He Zhipeng Xue Xiaojun Yuan |
author_sort |
Xuehai He |
title |
Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis |
title_short |
Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis |
title_full |
Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis |
title_fullStr |
Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis |
title_full_unstemmed |
Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis |
title_sort |
learned turbo message passing for affine rank minimization and compressed robust principal component analysis |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2019-01-01 |
description |
This paper is focused on the efficient algorithm design for affine rank minimization (ARM) and compressed robust principal component analysis (CRPCA). Given the proliferation of the literature on the ARM and CRPCA problems, the existing algorithms mostly take a model-based approach in the algorithm design, and so are sensitive to the generation model of the linear measurement operator or to the generation model of the low-rank matrix to be recovered. It is known that, all these algorithms do not work well, e.g., when the low-rank matrix is ill-conditioned. As inspired by the success of learned iterative soft-thresholding (LIST) and learned approximate message passing (LAMP), we develop learning-based message passing algorithms, namely, the learned turbo message passing (LTMP) algorithm for affine rank minimization to cope with the ARM problem and the LTMP algorithm for the CRPCA problem. The LTMP algorithms learn their parameters from data, and hence are robust to the generation models of the linear operator and the low-rank matrix. We derive analytical expressions for the partial derivatives involved in training the LTMP network. Given the large size of the low-rank matrix in a typical ARM/CRPCA problem, these analytical expressions are of essential importance for the development of computationally feasible network training. Numerical results demonstrate that LTMP significantly outperforms the state-of-the-art counterparts for various generation models of the linear operator and the low-rank matrix, especially when the low-rank matrix is ill-conditioned. |
topic |
Learned turbo message passing (LTMP) affine rank minimization (ARM) matrix completion low-rank matrix recovery compressed robust principal component analysis (CRPCA) |
url |
https://ieeexplore.ieee.org/document/8843989/ |
work_keys_str_mv |
AT xuehaihe learnedturbomessagepassingforaffinerankminimizationandcompressedrobustprincipalcomponentanalysis AT zhipengxue learnedturbomessagepassingforaffinerankminimizationandcompressedrobustprincipalcomponentanalysis AT xiaojunyuan learnedturbomessagepassingforaffinerankminimizationandcompressedrobustprincipalcomponentanalysis |
_version_ |
1724188256554188800 |