Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features
When traditional 3D reconstruction techniques were used to reconstruct a scene with hidden and disguised heat source targets, the reconstructed scene could not contain these targets; thus, we could not recognize them. The disadvantages of such problems are particularly acute in the military and remo...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2019-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8628979/ |
id |
doaj-e650ddaa804f460ca2d30e58f39a70b4 |
---|---|
record_format |
Article |
spelling |
doaj-e650ddaa804f460ca2d30e58f39a70b42021-03-29T22:33:44ZengIEEEIEEE Access2169-35362019-01-017191991921110.1109/ACCESS.2019.28959058628979Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed FeaturesYong Ma0Yuchen Wang1Xiaoguang Mei2https://orcid.org/0000-0002-0239-8580Chengyin Liu3Xiaobing Dai4Fan Fan5https://orcid.org/0000-0002-7507-1810Jun Huang6Electronic Information School, Wuhan University, Wuhan, ChinaElectronic Information School, Wuhan University, Wuhan, ChinaElectronic Information School, Wuhan University, Wuhan, ChinaAir Force Early Warning Academy, Wuhan, ChinaElectronic Information School, Wuhan University, Wuhan, ChinaElectronic Information School, Wuhan University, Wuhan, ChinaElectronic Information School, Wuhan University, Wuhan, ChinaWhen traditional 3D reconstruction techniques were used to reconstruct a scene with hidden and disguised heat source targets, the reconstructed scene could not contain these targets; thus, we could not recognize them. The disadvantages of such problems are particularly acute in the military and remote-sensing areas. For this application problem, the authors proposed a visible/infrared combined 3D reconstruction scheme. The 3D scene containing thermal radiation information could be reconstructed by fusing the data from RGB optical and infrared images combined with computer vision passive optical 3D scene reconstruction technique. Meanwhile, the authors proposed the nonrigid registration of multi-modality images with mixed features to solve the problem that the registration algorithm, which is widely used in traditional passive reconstruction technology, cannot accurately match visible and infrared images. Registration accuracy was improved by approximately 40%, experimental results showed that the visible/infrared combined 3D reconstruction scenes retain the visual reality of the traditional 3D reconstruction, and the hidden targets are highlighted in the scenes, which is conducive to the detection and recognition of interesting targets.https://ieeexplore.ieee.org/document/8628979/3D reconstructionmixed featuresnonrigid registrationvisible/infrared combined |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Yong Ma Yuchen Wang Xiaoguang Mei Chengyin Liu Xiaobing Dai Fan Fan Jun Huang |
spellingShingle |
Yong Ma Yuchen Wang Xiaoguang Mei Chengyin Liu Xiaobing Dai Fan Fan Jun Huang Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features IEEE Access 3D reconstruction mixed features nonrigid registration visible/infrared combined |
author_facet |
Yong Ma Yuchen Wang Xiaoguang Mei Chengyin Liu Xiaobing Dai Fan Fan Jun Huang |
author_sort |
Yong Ma |
title |
Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features |
title_short |
Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features |
title_full |
Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features |
title_fullStr |
Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features |
title_full_unstemmed |
Visible/Infrared Combined 3D Reconstruction Scheme Based on Nonrigid Registration of Multi-Modality Images With Mixed Features |
title_sort |
visible/infrared combined 3d reconstruction scheme based on nonrigid registration of multi-modality images with mixed features |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2019-01-01 |
description |
When traditional 3D reconstruction techniques were used to reconstruct a scene with hidden and disguised heat source targets, the reconstructed scene could not contain these targets; thus, we could not recognize them. The disadvantages of such problems are particularly acute in the military and remote-sensing areas. For this application problem, the authors proposed a visible/infrared combined 3D reconstruction scheme. The 3D scene containing thermal radiation information could be reconstructed by fusing the data from RGB optical and infrared images combined with computer vision passive optical 3D scene reconstruction technique. Meanwhile, the authors proposed the nonrigid registration of multi-modality images with mixed features to solve the problem that the registration algorithm, which is widely used in traditional passive reconstruction technology, cannot accurately match visible and infrared images. Registration accuracy was improved by approximately 40%, experimental results showed that the visible/infrared combined 3D reconstruction scenes retain the visual reality of the traditional 3D reconstruction, and the hidden targets are highlighted in the scenes, which is conducive to the detection and recognition of interesting targets. |
topic |
3D reconstruction mixed features nonrigid registration visible/infrared combined |
url |
https://ieeexplore.ieee.org/document/8628979/ |
work_keys_str_mv |
AT yongma visibleinfraredcombined3dreconstructionschemebasedonnonrigidregistrationofmultimodalityimageswithmixedfeatures AT yuchenwang visibleinfraredcombined3dreconstructionschemebasedonnonrigidregistrationofmultimodalityimageswithmixedfeatures AT xiaoguangmei visibleinfraredcombined3dreconstructionschemebasedonnonrigidregistrationofmultimodalityimageswithmixedfeatures AT chengyinliu visibleinfraredcombined3dreconstructionschemebasedonnonrigidregistrationofmultimodalityimageswithmixedfeatures AT xiaobingdai visibleinfraredcombined3dreconstructionschemebasedonnonrigidregistrationofmultimodalityimageswithmixedfeatures AT fanfan visibleinfraredcombined3dreconstructionschemebasedonnonrigidregistrationofmultimodalityimageswithmixedfeatures AT junhuang visibleinfraredcombined3dreconstructionschemebasedonnonrigidregistrationofmultimodalityimageswithmixedfeatures |
_version_ |
1724191443590840320 |