Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis

This paper is focused on the efficient algorithm design for affine rank minimization (ARM) and compressed robust principal component analysis (CRPCA). Given the proliferation of the literature on the ARM and CRPCA problems, the existing algorithms mostly take a model-based approach in the algorithm...

Full description

Bibliographic Details
Main Authors: Xuehai He, Zhipeng Xue, Xiaojun Yuan
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8843989/
id doaj-f1c73ba57dbb4657bac0b293c387e125
record_format Article
spelling doaj-f1c73ba57dbb4657bac0b293c387e1252021-03-30T00:29:49ZengIEEEIEEE Access2169-35362019-01-01714060614061710.1109/ACCESS.2019.29422048843989Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component AnalysisXuehai He0Zhipeng Xue1Xiaojun Yuan2https://orcid.org/0000-0002-0433-6535Center for Intelligent Networking and Communications, National Key Laboratory of Science and Technology on Communications, University of Electronic Science and Technology of China, Chengdu, ChinaSchool of Information Science and Technology, ShanghaiTech University, Shanghai, ChinaCenter for Intelligent Networking and Communications, National Key Laboratory of Science and Technology on Communications, University of Electronic Science and Technology of China, Chengdu, ChinaThis paper is focused on the efficient algorithm design for affine rank minimization (ARM) and compressed robust principal component analysis (CRPCA). Given the proliferation of the literature on the ARM and CRPCA problems, the existing algorithms mostly take a model-based approach in the algorithm design, and so are sensitive to the generation model of the linear measurement operator or to the generation model of the low-rank matrix to be recovered. It is known that, all these algorithms do not work well, e.g., when the low-rank matrix is ill-conditioned. As inspired by the success of learned iterative soft-thresholding (LIST) and learned approximate message passing (LAMP), we develop learning-based message passing algorithms, namely, the learned turbo message passing (LTMP) algorithm for affine rank minimization to cope with the ARM problem and the LTMP algorithm for the CRPCA problem. The LTMP algorithms learn their parameters from data, and hence are robust to the generation models of the linear operator and the low-rank matrix. We derive analytical expressions for the partial derivatives involved in training the LTMP network. Given the large size of the low-rank matrix in a typical ARM/CRPCA problem, these analytical expressions are of essential importance for the development of computationally feasible network training. Numerical results demonstrate that LTMP significantly outperforms the state-of-the-art counterparts for various generation models of the linear operator and the low-rank matrix, especially when the low-rank matrix is ill-conditioned.https://ieeexplore.ieee.org/document/8843989/Learned turbo message passing (LTMP)affine rank minimization (ARM)matrix completionlow-rank matrix recoverycompressed robust principal component analysis (CRPCA)
collection DOAJ
language English
format Article
sources DOAJ
author Xuehai He
Zhipeng Xue
Xiaojun Yuan
spellingShingle Xuehai He
Zhipeng Xue
Xiaojun Yuan
Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis
IEEE Access
Learned turbo message passing (LTMP)
affine rank minimization (ARM)
matrix completion
low-rank matrix recovery
compressed robust principal component analysis (CRPCA)
author_facet Xuehai He
Zhipeng Xue
Xiaojun Yuan
author_sort Xuehai He
title Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis
title_short Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis
title_full Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis
title_fullStr Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis
title_full_unstemmed Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis
title_sort learned turbo message passing for affine rank minimization and compressed robust principal component analysis
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description This paper is focused on the efficient algorithm design for affine rank minimization (ARM) and compressed robust principal component analysis (CRPCA). Given the proliferation of the literature on the ARM and CRPCA problems, the existing algorithms mostly take a model-based approach in the algorithm design, and so are sensitive to the generation model of the linear measurement operator or to the generation model of the low-rank matrix to be recovered. It is known that, all these algorithms do not work well, e.g., when the low-rank matrix is ill-conditioned. As inspired by the success of learned iterative soft-thresholding (LIST) and learned approximate message passing (LAMP), we develop learning-based message passing algorithms, namely, the learned turbo message passing (LTMP) algorithm for affine rank minimization to cope with the ARM problem and the LTMP algorithm for the CRPCA problem. The LTMP algorithms learn their parameters from data, and hence are robust to the generation models of the linear operator and the low-rank matrix. We derive analytical expressions for the partial derivatives involved in training the LTMP network. Given the large size of the low-rank matrix in a typical ARM/CRPCA problem, these analytical expressions are of essential importance for the development of computationally feasible network training. Numerical results demonstrate that LTMP significantly outperforms the state-of-the-art counterparts for various generation models of the linear operator and the low-rank matrix, especially when the low-rank matrix is ill-conditioned.
topic Learned turbo message passing (LTMP)
affine rank minimization (ARM)
matrix completion
low-rank matrix recovery
compressed robust principal component analysis (CRPCA)
url https://ieeexplore.ieee.org/document/8843989/
work_keys_str_mv AT xuehaihe learnedturbomessagepassingforaffinerankminimizationandcompressedrobustprincipalcomponentanalysis
AT zhipengxue learnedturbomessagepassingforaffinerankminimizationandcompressedrobustprincipalcomponentanalysis
AT xiaojunyuan learnedturbomessagepassingforaffinerankminimizationandcompressedrobustprincipalcomponentanalysis
_version_ 1724188256554188800