Improved stixels towards efficient traffic-scene representations

• Main Author: Al-Ani, Noor (Author)
• Other Authors: Klette, Reinhard (Contributor), Rezaei, Mahdi (Contributor)
• Format: Others
• Published: Auckland University of Technology, 2019-06-09T21:41:16Z.
• Subjects: Stixels; ground manifold; v-disparity; y-disparit; ,monocular; binocula; trinocular; obstacle heigh; dynamic programming; LiDAR; height segmentation; multi-layer stixels; Thesis
• Online Access: Get fulltext

 Stixels are medium-level data representations used for the development of computer vision modules for self-driving cars. A stixel is a column of stacked space cubes ranging from the road surface to the visual end of an obstacle. A stixel represents object height at a distance. It supports object detection and recognition regardless of their specific appearance. Stixel calculations are commonly based on binocular vision; these calculations map millions of pixel disparities into a few hundred stixels. Depending on applied stereo vision, this binocular approach is sometimes incapable to deal with low-textured road information or noisy data. The main objectiveofthisworkistoevaluateandproposeapproachesforcalculatingstixels using different camera configurations and,possibly,also a LiDAR range sensor. This study also highlights the role of ground manifold modelling for stixel calculations. By using simplifying ground manifold models, calculated stixels may suffer from noise, inconsistency, and false-detection rates for obstacles, especially in challenging datasets. Stixel calculations can be improved with respect to accuracy and robustness by using more adaptive ground manifold approximations. A comparative study of stixel results, obtained for different ground-manifold models, also defines a main contribution of this thesis. We also consider multi-layer stixel calculations. Comprehensive experiments are performed on two publicly available challenging datasets. We also use a novel way for comparing calculated stixels with ground truth. We compare depth information, as given by extracted stixels, with ground-truth depth, provided by depth measurements using a highly accurate LiDAR range sensor (as available in one of the public datasets). Experimental results also include quantitative evaluations of the trade-off between accuracy and run time. The results show significant improvements for particular ways of calculating stixels.