Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition

For multi-view convolutional neural network based 3D object recognition, how to fuse the information of multiple views is a key factor affecting the recognition performance. Most traditional methods use max-pooling algorithm to obtain the final 3D object feature, which does not take into account the...

Full description

Bibliographic Details
Main Authors: Hui Zeng, Tianmeng Zhao, Ruting Cheng, Fuzhou Wang, Jiwei Liu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9355182/
id doaj-4768f9e6e74c4ebd9ca571404f57486e
record_format Article
spelling doaj-4768f9e6e74c4ebd9ca571404f57486e2021-03-30T15:02:49ZengIEEEIEEE Access2169-35362021-01-019333233333510.1109/ACCESS.2021.30598539355182Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object RecognitionHui Zeng0https://orcid.org/0000-0002-4137-7424Tianmeng Zhao1https://orcid.org/0000-0003-4554-1583Ruting Cheng2https://orcid.org/0000-0002-1442-7166Fuzhou Wang3Jiwei Liu4https://orcid.org/0000-0001-6255-7849Beijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, ChinaBeijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, ChinaBeijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, ChinaBeijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, ChinaBeijing Engineering Research Center of Industrial Spectrum Imaging, School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, ChinaFor multi-view convolutional neural network based 3D object recognition, how to fuse the information of multiple views is a key factor affecting the recognition performance. Most traditional methods use max-pooling algorithm to obtain the final 3D object feature, which does not take into account the correlative information between different views. To make full use of the effective information of multiple views, this paper introduces the hierarchical graph attention based multi-view convolutional neural network for 3D object recognition. At first, the view selection module is proposed to reduce redundant view information in multiple views, which can select the projective views with more effective information. Then, the correlation weighted feature aggregation module is proposed to better fuse multiple view features. Finally, the hierarchical feature aggregation network structure is designed to further to make full use of the correlation information of multiple views. Extensive experimental results have validated the effectiveness of the proposed method.https://ieeexplore.ieee.org/document/9355182/3D object recognitionmulti-view convolutional neural networkgraph attention networkfeature aggregation
collection DOAJ
language English
format Article
sources DOAJ
author Hui Zeng
Tianmeng Zhao
Ruting Cheng
Fuzhou Wang
Jiwei Liu
spellingShingle Hui Zeng
Tianmeng Zhao
Ruting Cheng
Fuzhou Wang
Jiwei Liu
Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition
IEEE Access
3D object recognition
multi-view convolutional neural network
graph attention network
feature aggregation
author_facet Hui Zeng
Tianmeng Zhao
Ruting Cheng
Fuzhou Wang
Jiwei Liu
author_sort Hui Zeng
title Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition
title_short Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition
title_full Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition
title_fullStr Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition
title_full_unstemmed Hierarchical Graph Attention Based Multi-View Convolutional Neural Network for 3D Object Recognition
title_sort hierarchical graph attention based multi-view convolutional neural network for 3d object recognition
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description For multi-view convolutional neural network based 3D object recognition, how to fuse the information of multiple views is a key factor affecting the recognition performance. Most traditional methods use max-pooling algorithm to obtain the final 3D object feature, which does not take into account the correlative information between different views. To make full use of the effective information of multiple views, this paper introduces the hierarchical graph attention based multi-view convolutional neural network for 3D object recognition. At first, the view selection module is proposed to reduce redundant view information in multiple views, which can select the projective views with more effective information. Then, the correlation weighted feature aggregation module is proposed to better fuse multiple view features. Finally, the hierarchical feature aggregation network structure is designed to further to make full use of the correlation information of multiple views. Extensive experimental results have validated the effectiveness of the proposed method.
topic 3D object recognition
multi-view convolutional neural network
graph attention network
feature aggregation
url https://ieeexplore.ieee.org/document/9355182/
work_keys_str_mv AT huizeng hierarchicalgraphattentionbasedmultiviewconvolutionalneuralnetworkfor3dobjectrecognition
AT tianmengzhao hierarchicalgraphattentionbasedmultiviewconvolutionalneuralnetworkfor3dobjectrecognition
AT rutingcheng hierarchicalgraphattentionbasedmultiviewconvolutionalneuralnetworkfor3dobjectrecognition
AT fuzhouwang hierarchicalgraphattentionbasedmultiviewconvolutionalneuralnetworkfor3dobjectrecognition
AT jiweiliu hierarchicalgraphattentionbasedmultiviewconvolutionalneuralnetworkfor3dobjectrecognition
_version_ 1724180086720036864