RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings
Coarse registration of 3D point clouds plays an indispensable role for parametric, semantically rich, and realistic digital twin buildings (DTBs) in the practice of GIScience, manufacturing, robotics, architecture, engineering, and construction. However, the existing methods have prominently been ch...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-05-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | https://www.mdpi.com/2072-4292/13/10/1882 |
id |
doaj-ab81d3048f9843768bfb0b09a30302e3 |
---|---|
record_format |
Article |
spelling |
doaj-ab81d3048f9843768bfb0b09a30302e32021-05-31T23:43:56ZengMDPI AGRemote Sensing2072-42922021-05-01131882188210.3390/rs13101882RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin BuildingsYijie Wu0Jianga Shang1Fan Xue2Department of Real Estate and Construction, The University of Hong Kong, Pokfulam, Hong Kong, ChinaSchool of Geography and Information Engineering, China University of Geosciences, Wuhan 430000, ChinaDepartment of Real Estate and Construction, The University of Hong Kong, Pokfulam, Hong Kong, ChinaCoarse registration of 3D point clouds plays an indispensable role for parametric, semantically rich, and realistic digital twin buildings (DTBs) in the practice of GIScience, manufacturing, robotics, architecture, engineering, and construction. However, the existing methods have prominently been challenged by (i) the high cost of data collection for numerous existing buildings and (ii) the computational complexity from self-similar layout patterns. This paper studies the registration of two low-cost data sets, i.e., colorful 3D point clouds captured by smartphones and 2D CAD drawings, for resolving the first challenge. We propose a novel method named ‘Registration based on Architectural Reflection Detection’ (RegARD) for transforming the self-symmetries in the second challenge from a barrier of coarse registration to a facilitator. First, RegARD detects the innate architectural reflection symmetries to constrain the rotations and reduce degrees of freedom. Then, a nonlinear optimization formulation together with advanced optimization algorithms can overcome the second challenge. As a result, high-quality coarse registration and subsequent low-cost DTBs can be created with semantic components and realistic appearances. Experiments showed that the proposed method outperformed existing methods considerably in both effectiveness and efficiency, i.e., 49.88% less error and 73.13% less time, on average. The RegARD presented in this paper first contributes to coarse registration theories and exploitation of symmetries and textures in 3D point clouds and 2D CAD drawings. For practitioners in the industries, RegARD offers a new automatic solution to utilize ubiquitous smartphone sensors for massive low-cost DTBs.https://www.mdpi.com/2072-4292/13/10/1882digital twin building3D point cloudarchitectural symmetrycoarse registrationcomputer-aided designbuilding interior |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Yijie Wu Jianga Shang Fan Xue |
spellingShingle |
Yijie Wu Jianga Shang Fan Xue RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings Remote Sensing digital twin building 3D point cloud architectural symmetry coarse registration computer-aided design building interior |
author_facet |
Yijie Wu Jianga Shang Fan Xue |
author_sort |
Yijie Wu |
title |
RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings |
title_short |
RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings |
title_full |
RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings |
title_fullStr |
RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings |
title_full_unstemmed |
RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings |
title_sort |
regard: symmetry-based coarse registration of smartphone’s colorful point clouds with cad drawings for low-cost digital twin buildings |
publisher |
MDPI AG |
series |
Remote Sensing |
issn |
2072-4292 |
publishDate |
2021-05-01 |
description |
Coarse registration of 3D point clouds plays an indispensable role for parametric, semantically rich, and realistic digital twin buildings (DTBs) in the practice of GIScience, manufacturing, robotics, architecture, engineering, and construction. However, the existing methods have prominently been challenged by (i) the high cost of data collection for numerous existing buildings and (ii) the computational complexity from self-similar layout patterns. This paper studies the registration of two low-cost data sets, i.e., colorful 3D point clouds captured by smartphones and 2D CAD drawings, for resolving the first challenge. We propose a novel method named ‘Registration based on Architectural Reflection Detection’ (RegARD) for transforming the self-symmetries in the second challenge from a barrier of coarse registration to a facilitator. First, RegARD detects the innate architectural reflection symmetries to constrain the rotations and reduce degrees of freedom. Then, a nonlinear optimization formulation together with advanced optimization algorithms can overcome the second challenge. As a result, high-quality coarse registration and subsequent low-cost DTBs can be created with semantic components and realistic appearances. Experiments showed that the proposed method outperformed existing methods considerably in both effectiveness and efficiency, i.e., 49.88% less error and 73.13% less time, on average. The RegARD presented in this paper first contributes to coarse registration theories and exploitation of symmetries and textures in 3D point clouds and 2D CAD drawings. For practitioners in the industries, RegARD offers a new automatic solution to utilize ubiquitous smartphone sensors for massive low-cost DTBs. |
topic |
digital twin building 3D point cloud architectural symmetry coarse registration computer-aided design building interior |
url |
https://www.mdpi.com/2072-4292/13/10/1882 |
work_keys_str_mv |
AT yijiewu regardsymmetrybasedcoarseregistrationofsmartphonescolorfulpointcloudswithcaddrawingsforlowcostdigitaltwinbuildings AT jiangashang regardsymmetrybasedcoarseregistrationofsmartphonescolorfulpointcloudswithcaddrawingsforlowcostdigitaltwinbuildings AT fanxue regardsymmetrybasedcoarseregistrationofsmartphonescolorfulpointcloudswithcaddrawingsforlowcostdigitaltwinbuildings |
_version_ |
1721416755033669632 |