Distance-Dependent Multimodal Image Registration for Agriculture Tasks

Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal se...

Full description

Bibliographic Details
Main Authors: Ron Berenstein, Marko Hočevar, Tone Godeša, Yael Edan, Ohad Ben-Shahar
Format: Article
Language:English
Published: MDPI AG 2015-08-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/15/8/20845
Description
Summary:Image registration is the process of aligning two or more images of the same scene taken at different times; from different viewpoints; and/or by different sensors. This research focuses on developing a practical method for automatic image registration for agricultural systems that use multimodal sensory systems and operate in natural environments. While not limited to any particular modalities; here we focus on systems with visual and thermal sensory inputs. Our approach is based on pre-calibrating a distance-dependent transformation matrix (DDTM) between the sensors; and representing it in a compact way by regressing the distance-dependent coefficients as distance-dependent functions. The DDTM is measured by calculating a projective transformation matrix for varying distances between the sensors and possible targets. To do so we designed a unique experimental setup including unique Artificial Control Points (ACPs) and their detection algorithms for the two sensors. We demonstrate the utility of our approach using different experiments and evaluation criteria.
ISSN:1424-8220