Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and Geometry
The multiview low dynamic range images captured with sparse camera arrangement under ill-lighting conditions contain highlighted and shadow regions due to over-exposed and under-exposed regions. The processing of these images produces contrast distortion, and it is challenging to maintain relative b...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9347418/ |
id |
doaj-6126a72bf3b34701807d6ef599dab7e8 |
---|---|
record_format |
Article |
spelling |
doaj-6126a72bf3b34701807d6ef599dab7e82021-03-30T14:56:08ZengIEEEIEEE Access2169-35362021-01-019242052422010.1109/ACCESS.2021.30571679347418Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and GeometryRizwan Khan0Adeel Akram1https://orcid.org/0000-0001-9901-0716Atif Mehmood2https://orcid.org/0000-0002-8905-8510School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, ChinaSchool of Information Engineering (Big Data), Xuzhou University of Technology, Xuzhou, ChinaSchool of Artificial Intelligence, Xidian University, Xi’an, ChinaThe multiview low dynamic range images captured with sparse camera arrangement under ill-lighting conditions contain highlighted and shadow regions due to over-exposed and under-exposed regions. The processing of these images produces contrast distortion, and it is challenging to maintain relative brightness with color consistency. Moreover, the disparity map estimation faces the challenges of holes and artifacts due to a wide baseline and poor visibility, with a shared view of vision. In this article, we propose a multiview ghost-free image enhancement strategy for in-the-wild images with unknown exposure and geometry. We address the complex geometric alignment problem for a wide variational baseline among multiple sparsely arranged cameras. The features among multiple viewpoints are detected and matched for the image restoration. The restored image contains highlighted and shadow regions with a color imbalance problem. We synthesize virtual images following the intensity mapping function, which compensates for the relative brightness and color distortions. Finally, we fuse all the images to obtain high-quality images. The proposed method is more frequent and feasible for future multiview systems with varying baselines without relying on disparity maps. The experimental results demonstrate that the proposed method outperformed the state-of-the-art approaches.https://ieeexplore.ieee.org/document/9347418/Multi-view imagesfeature matchingvirtual imagesexposure fusion |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Rizwan Khan Adeel Akram Atif Mehmood |
spellingShingle |
Rizwan Khan Adeel Akram Atif Mehmood Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and Geometry IEEE Access Multi-view images feature matching virtual images exposure fusion |
author_facet |
Rizwan Khan Adeel Akram Atif Mehmood |
author_sort |
Rizwan Khan |
title |
Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and Geometry |
title_short |
Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and Geometry |
title_full |
Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and Geometry |
title_fullStr |
Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and Geometry |
title_full_unstemmed |
Multiview Ghost-Free Image Enhancement for In-the-Wild Images With Unknown Exposure and Geometry |
title_sort |
multiview ghost-free image enhancement for in-the-wild images with unknown exposure and geometry |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
The multiview low dynamic range images captured with sparse camera arrangement under ill-lighting conditions contain highlighted and shadow regions due to over-exposed and under-exposed regions. The processing of these images produces contrast distortion, and it is challenging to maintain relative brightness with color consistency. Moreover, the disparity map estimation faces the challenges of holes and artifacts due to a wide baseline and poor visibility, with a shared view of vision. In this article, we propose a multiview ghost-free image enhancement strategy for in-the-wild images with unknown exposure and geometry. We address the complex geometric alignment problem for a wide variational baseline among multiple sparsely arranged cameras. The features among multiple viewpoints are detected and matched for the image restoration. The restored image contains highlighted and shadow regions with a color imbalance problem. We synthesize virtual images following the intensity mapping function, which compensates for the relative brightness and color distortions. Finally, we fuse all the images to obtain high-quality images. The proposed method is more frequent and feasible for future multiview systems with varying baselines without relying on disparity maps. The experimental results demonstrate that the proposed method outperformed the state-of-the-art approaches. |
topic |
Multi-view images feature matching virtual images exposure fusion |
url |
https://ieeexplore.ieee.org/document/9347418/ |
work_keys_str_mv |
AT rizwankhan multiviewghostfreeimageenhancementforinthewildimageswithunknownexposureandgeometry AT adeelakram multiviewghostfreeimageenhancementforinthewildimageswithunknownexposureandgeometry AT atifmehmood multiviewghostfreeimageenhancementforinthewildimageswithunknownexposureandgeometry |
_version_ |
1724180335876374528 |