ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSION
Visual perception is regularly used by humans and robots for navigation. By either implicitly or explicitly mapping the environment, ego-motion can be determined and a path of actions can be planned. The process of mapping and navigation are delicately intertwined; therefore, improving one can often...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2018-09-01
|
Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-1/93/2018/isprs-archives-XLII-1-93-2018.pdf |
id |
doaj-6a9d0bac10074121a772e959550622da |
---|---|
record_format |
Article |
spelling |
doaj-6a9d0bac10074121a772e959550622da2020-11-24T22:01:11ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342018-09-01XLII-1939910.5194/isprs-archives-XLII-1-93-2018ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSIONJ. C. K. Chow0J. C. K. Chow1J. C. K. Chow2I. Detchev3K. D. Ang4K. D. Ang5K. Morin6K. Mahadevan7N. Louie8Department of Medicine, Cumming School of Medicine, University of Calgary, Calgary, Alberta, CanadaSchool of Earth and Planetary Sciences, Faculty of Science and Engineering, Curtin University, Perth, WA, AustraliaDepartment of Research and Development, Vusion Technologies, Calgary, Alberta, CanadaDepartment of Geomatics Engineering, Schulich School of Engineering, University of Calgary, Calgary, Alberta, CanadaDepartment of Research and Development, Vusion Technologies, Calgary, Alberta, CanadaDepartment of Computer Science, Faculty of Science, University of Calgary, Calgary, Alberta, CanadaLeica Geosystems, Heerbrugg, Canton of St. Gallen, SwitzerlandDepartment of Electrical and Computer Engineering, Faculty of Engineering, University of Alberta, Edmonton, Alberta, CanadaDepartment of Research and Development, Vusion Technologies, Calgary, Alberta, CanadaVisual perception is regularly used by humans and robots for navigation. By either implicitly or explicitly mapping the environment, ego-motion can be determined and a path of actions can be planned. The process of mapping and navigation are delicately intertwined; therefore, improving one can often lead to an improvement of the other. Both processes are sensitive to the interior orientation parameters of the camera system and mathematically modelling these systematic errors can often improve the precision and accuracy of the overall solution. This paper presents an automatic camera calibration method suitable for any lens, without having prior knowledge about the sensor. Statistical inference is performed to map the environment and localize the camera simultaneously. K-nearest neighbour regression is used to model the geometric distortions of the images. A normal-angle lens Nikon camera and wide-angle lens GoPro camera were calibrated using the proposed method, as well as the conventional bundle adjustment with self-calibration method (for comparison). Results showed that the mapping error was reduced from an average of 14.9 mm to 1.2 mm (i.e. a 92 % improvement) and 66.6 mm to 1.5 mm (i.e. a 98 % improvement) using the proposed method for the Nikon and GoPro cameras, respectively. In contrast, the conventional approach achieved an average 3D error of 0.9 mm (i.e. 94 % improvement) and 6 mm (i.e. 91 % improvement) for the Nikon and GoPro cameras, respectively. Thus, the proposed method performs more consistently, irrespective of the lens/sensor used: it yields results that are comparable to the conventional approach for normal-angle lens cameras, and it has the additional benefit of improving calibration results for wide-angle lens cameras.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-1/93/2018/isprs-archives-XLII-1-93-2018.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
J. C. K. Chow J. C. K. Chow J. C. K. Chow I. Detchev K. D. Ang K. D. Ang K. Morin K. Mahadevan N. Louie |
spellingShingle |
J. C. K. Chow J. C. K. Chow J. C. K. Chow I. Detchev K. D. Ang K. D. Ang K. Morin K. Mahadevan N. Louie ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSION The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
author_facet |
J. C. K. Chow J. C. K. Chow J. C. K. Chow I. Detchev K. D. Ang K. D. Ang K. Morin K. Mahadevan N. Louie |
author_sort |
J. C. K. Chow |
title |
ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSION |
title_short |
ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSION |
title_full |
ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSION |
title_fullStr |
ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSION |
title_full_unstemmed |
ROBOT VISION: CALIBRATION OF WIDE-ANGLE LENS CAMERAS USING COLLINEARITY CONDITION AND K-NEAREST NEIGHBOUR REGRESSION |
title_sort |
robot vision: calibration of wide-angle lens cameras using collinearity condition and k-nearest neighbour regression |
publisher |
Copernicus Publications |
series |
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
issn |
1682-1750 2194-9034 |
publishDate |
2018-09-01 |
description |
Visual perception is regularly used by humans and robots for navigation. By either implicitly or explicitly mapping the environment, ego-motion can be determined and a path of actions can be planned. The process of mapping and navigation are delicately intertwined; therefore, improving one can often lead to an improvement of the other. Both processes are sensitive to the interior orientation parameters of the camera system and mathematically modelling these systematic errors can often improve the precision and accuracy of the overall solution. This paper presents an automatic camera calibration method suitable for any lens, without having prior knowledge about the sensor. Statistical inference is performed to map the environment and localize the camera simultaneously. K-nearest neighbour regression is used to model the geometric distortions of the images. A normal-angle lens Nikon camera and wide-angle lens GoPro camera were calibrated using the proposed method, as well as the conventional bundle adjustment with self-calibration method (for comparison). Results showed that the mapping error was reduced from an average of 14.9 mm to 1.2 mm (i.e. a 92 % improvement) and 66.6 mm to 1.5 mm (i.e. a 98 % improvement) using the proposed method for the Nikon and GoPro cameras, respectively. In contrast, the conventional approach achieved an average 3D error of 0.9 mm (i.e. 94 % improvement) and 6 mm (i.e. 91 % improvement) for the Nikon and GoPro cameras, respectively. Thus, the proposed method performs more consistently, irrespective of the lens/sensor used: it yields results that are comparable to the conventional approach for normal-angle lens cameras, and it has the additional benefit of improving calibration results for wide-angle lens cameras. |
url |
https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLII-1/93/2018/isprs-archives-XLII-1-93-2018.pdf |
work_keys_str_mv |
AT jckchow robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT jckchow robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT jckchow robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT idetchev robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT kdang robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT kdang robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT kmorin robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT kmahadevan robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression AT nlouie robotvisioncalibrationofwideanglelenscamerasusingcollinearityconditionandknearestneighbourregression |
_version_ |
1725841250611888128 |