Light Field Image Super-Resolution via Mutual Attention Guidance
Deep learning-based methods have prompted light field image super-resolution to achieve significant progress. However, most of them ignore aligning different sub-aperture features of light field image before aggregation, resulting in sub-optimal super-resolution results. We aim to propose an efficie...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9536737/ |
id |
doaj-7d3c0b55aaf14802a1c50ed8a3cf0068 |
---|---|
record_format |
Article |
spelling |
doaj-7d3c0b55aaf14802a1c50ed8a3cf00682021-09-23T23:00:18ZengIEEEIEEE Access2169-35362021-01-01912902212903110.1109/ACCESS.2021.31124889536737Light Field Image Super-Resolution via Mutual Attention GuidanceZijian Wang0https://orcid.org/0000-0001-5777-9594Yao Lu1Beijing Laboratory of Intelligent Information Technology, School of Computer Science, Beijing Institute of Technology, Beijing, ChinaBeijing Laboratory of Intelligent Information Technology, School of Computer Science, Beijing Institute of Technology, Beijing, ChinaDeep learning-based methods have prompted light field image super-resolution to achieve significant progress. However, most of them ignore aligning different sub-aperture features of light field image before aggregation, resulting in sub-optimal super-resolution results. We aim to propose an efficient feature alignment method for sub-aperture feature aggregation. To this end, we develop a mutual attention mechanism for sub-aperture feature alignment and propose a mutual attention guidance block (MAG). MAG achieves the mutual attention mechanism between the center feature and surrounding feature with the center attention guidance module (CAG) and the surrounding attention guidance module (SAG). CAG aligns the center-view feature with the surrounding-view feature and generates the refined surrounding-view feature, while SAG aligns the refined surrounding-view feature with the original surrounding-view feature to implement bidirectional center-view, and surrounding view features alignment. Based on MAG, we build a Light Field Mutual Attention Guidance Network (LF-MAGNet) constructed by multiple MAGs in a cascade manner. Experiments are performed on commonly-used light field image super-resolution benchmarks. Our method achieves superior qualitative and quantitative results to other state-of-the-art methods, which demonstrate the effectiveness of our LF-MAGNet.https://ieeexplore.ieee.org/document/9536737/Light-field image super-resolutionvisual attention mechanismfeature alignment |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Zijian Wang Yao Lu |
spellingShingle |
Zijian Wang Yao Lu Light Field Image Super-Resolution via Mutual Attention Guidance IEEE Access Light-field image super-resolution visual attention mechanism feature alignment |
author_facet |
Zijian Wang Yao Lu |
author_sort |
Zijian Wang |
title |
Light Field Image Super-Resolution via Mutual Attention Guidance |
title_short |
Light Field Image Super-Resolution via Mutual Attention Guidance |
title_full |
Light Field Image Super-Resolution via Mutual Attention Guidance |
title_fullStr |
Light Field Image Super-Resolution via Mutual Attention Guidance |
title_full_unstemmed |
Light Field Image Super-Resolution via Mutual Attention Guidance |
title_sort |
light field image super-resolution via mutual attention guidance |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
Deep learning-based methods have prompted light field image super-resolution to achieve significant progress. However, most of them ignore aligning different sub-aperture features of light field image before aggregation, resulting in sub-optimal super-resolution results. We aim to propose an efficient feature alignment method for sub-aperture feature aggregation. To this end, we develop a mutual attention mechanism for sub-aperture feature alignment and propose a mutual attention guidance block (MAG). MAG achieves the mutual attention mechanism between the center feature and surrounding feature with the center attention guidance module (CAG) and the surrounding attention guidance module (SAG). CAG aligns the center-view feature with the surrounding-view feature and generates the refined surrounding-view feature, while SAG aligns the refined surrounding-view feature with the original surrounding-view feature to implement bidirectional center-view, and surrounding view features alignment. Based on MAG, we build a Light Field Mutual Attention Guidance Network (LF-MAGNet) constructed by multiple MAGs in a cascade manner. Experiments are performed on commonly-used light field image super-resolution benchmarks. Our method achieves superior qualitative and quantitative results to other state-of-the-art methods, which demonstrate the effectiveness of our LF-MAGNet. |
topic |
Light-field image super-resolution visual attention mechanism feature alignment |
url |
https://ieeexplore.ieee.org/document/9536737/ |
work_keys_str_mv |
AT zijianwang lightfieldimagesuperresolutionviamutualattentionguidance AT yaolu lightfieldimagesuperresolutionviamutualattentionguidance |
_version_ |
1717370321092214784 |