Anchored neighborhood deep network for single-image super-resolution

Abstract Real-time image and video processing is a challenging problem in smart surveillance applications. It is necessary to trade off between high frame rate and high resolution to meet the limited bandwidth requirement in many specific applications. Thus, image super-resolution become one commonl...

Full description

Bibliographic Details
Main Authors: Wuzhen Shi, Shaohui Liu, Feng Jiang, Debin Zhao, Zhihong Tian
Format: Article
Language:English
Published: SpringerOpen 2018-05-01
Series:EURASIP Journal on Image and Video Processing
Subjects:
Online Access:http://link.springer.com/article/10.1186/s13640-018-0269-7
id doaj-aa142ff1751a40a6b11b437a0861b6d9
record_format Article
spelling doaj-aa142ff1751a40a6b11b437a0861b6d92020-11-25T02:01:47ZengSpringerOpenEURASIP Journal on Image and Video Processing1687-52812018-05-012018111210.1186/s13640-018-0269-7Anchored neighborhood deep network for single-image super-resolutionWuzhen Shi0Shaohui Liu1Feng Jiang2Debin Zhao3Zhihong Tian4Harbin Institute of TechnologyHarbin Institute of TechnologyHarbin Institute of TechnologyHarbin Institute of TechnologyCyberspace Institute of Advanced Technology, Guangzhou UniversityAbstract Real-time image and video processing is a challenging problem in smart surveillance applications. It is necessary to trade off between high frame rate and high resolution to meet the limited bandwidth requirement in many specific applications. Thus, image super-resolution become one commonly used techniques in surveillance platform. The existing image super-resolution methods have demonstrated that making full use of image prior can improve the algorithm performance. However, the previous deep-learning-based image super-resolution methods rarely take image prior into account. Therefore, how to make full use of image prior is one of the unsolved problems for deep-network-based single image super-resolution methods. In this paper, we establish the relationship between the traditional sparse-representation-based single-image super-resolution methods and the deep-learning-based ones and use transfer learning to make our proposed deep network take the image prior into account. Another unresolved problem of the deep-learning-based single-image super-resolution method is how to avoid neurons compromise to different image contents. In this paper, the image patches are anchored to the dictionary atoms to group into various categories. As a result, each neuron will work on the same types of image patches that have similar details, which makes the network more accurate to recover high-frequency details. By solving these two problems, we propose an anchored neighborhood deep network for single-image super-resolution. Experimental results show that our proposed method outperforms many state-of-the-art single-image super-resolution methods.http://link.springer.com/article/10.1186/s13640-018-0269-7Image super-resolutionAnchored neighborhood regressionDeep learningTransfer learningConvolutional neural network
collection DOAJ
language English
format Article
sources DOAJ
author Wuzhen Shi
Shaohui Liu
Feng Jiang
Debin Zhao
Zhihong Tian
spellingShingle Wuzhen Shi
Shaohui Liu
Feng Jiang
Debin Zhao
Zhihong Tian
Anchored neighborhood deep network for single-image super-resolution
EURASIP Journal on Image and Video Processing
Image super-resolution
Anchored neighborhood regression
Deep learning
Transfer learning
Convolutional neural network
author_facet Wuzhen Shi
Shaohui Liu
Feng Jiang
Debin Zhao
Zhihong Tian
author_sort Wuzhen Shi
title Anchored neighborhood deep network for single-image super-resolution
title_short Anchored neighborhood deep network for single-image super-resolution
title_full Anchored neighborhood deep network for single-image super-resolution
title_fullStr Anchored neighborhood deep network for single-image super-resolution
title_full_unstemmed Anchored neighborhood deep network for single-image super-resolution
title_sort anchored neighborhood deep network for single-image super-resolution
publisher SpringerOpen
series EURASIP Journal on Image and Video Processing
issn 1687-5281
publishDate 2018-05-01
description Abstract Real-time image and video processing is a challenging problem in smart surveillance applications. It is necessary to trade off between high frame rate and high resolution to meet the limited bandwidth requirement in many specific applications. Thus, image super-resolution become one commonly used techniques in surveillance platform. The existing image super-resolution methods have demonstrated that making full use of image prior can improve the algorithm performance. However, the previous deep-learning-based image super-resolution methods rarely take image prior into account. Therefore, how to make full use of image prior is one of the unsolved problems for deep-network-based single image super-resolution methods. In this paper, we establish the relationship between the traditional sparse-representation-based single-image super-resolution methods and the deep-learning-based ones and use transfer learning to make our proposed deep network take the image prior into account. Another unresolved problem of the deep-learning-based single-image super-resolution method is how to avoid neurons compromise to different image contents. In this paper, the image patches are anchored to the dictionary atoms to group into various categories. As a result, each neuron will work on the same types of image patches that have similar details, which makes the network more accurate to recover high-frequency details. By solving these two problems, we propose an anchored neighborhood deep network for single-image super-resolution. Experimental results show that our proposed method outperforms many state-of-the-art single-image super-resolution methods.
topic Image super-resolution
Anchored neighborhood regression
Deep learning
Transfer learning
Convolutional neural network
url http://link.springer.com/article/10.1186/s13640-018-0269-7
work_keys_str_mv AT wuzhenshi anchoredneighborhooddeepnetworkforsingleimagesuperresolution
AT shaohuiliu anchoredneighborhooddeepnetworkforsingleimagesuperresolution
AT fengjiang anchoredneighborhooddeepnetworkforsingleimagesuperresolution
AT debinzhao anchoredneighborhooddeepnetworkforsingleimagesuperresolution
AT zhihongtian anchoredneighborhooddeepnetworkforsingleimagesuperresolution
_version_ 1724955810624176128