A Fast and Reliable Solution to PnP, Using Polynomial Homogeneity and a Theorem of Hilbert

One of the most-extensively studied problems in three-dimensional Computer Vision is “Perspective-n-Point” (PnP), which concerns estimating the pose of a calibrated camera, given a set of 3D points in the world and their corresponding 2D projections in an image captured by the camera. One solution m...

Full description

Bibliographic Details
Published in:Sensors
Main Authors: Daniel Keren, Margarita Osadchy, Amit Shahar
Format: Article
Language:English
Published: MDPI AG 2023-06-01
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/12/5585
Description
Summary:One of the most-extensively studied problems in three-dimensional Computer Vision is “Perspective-n-Point” (PnP), which concerns estimating the pose of a calibrated camera, given a set of 3D points in the world and their corresponding 2D projections in an image captured by the camera. One solution method that ranks as very accurate and robust proceeds by reducing PnP to the minimization of a fourth-degree polynomial over the three-dimensional sphere <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msup><mi>S</mi><mn>3</mn></msup></semantics></math></inline-formula>. Despite a great deal of effort, there is no known fast method to obtain this goal. A very common approach is solving a convex relaxation of the problem, using “Sum Of Squares” (SOS) techniques. We offer two contributions in this paper: a faster (by a factor of roughly 10) solution with respect to the state-of-the-art, which relies on the polynomial’s homogeneity; and a fast, guaranteed, easily parallelizable approximation, which makes use of a famous result of Hilbert.
ISSN:1424-8220