Inverse depth parametrization explained

In computer vision, the inverse depth parametrization is a parametrization used in methods for 3D reconstruction from multiple images such as simultaneous localization and mapping (SLAM).^{[1] [2]} Given a point

p in 3D space observed by a monocular pinhole camera from multiple views, the inverse depth parametrization of the point's position is a 6D vector that encodes the optical centre of the camera c _{0} when in first observed the point, and the position of the point along the ray passing through p and c _{0} .^[3]

Inverse depth parametrization generally improves numerical stability and allows to represent points with zero parallax. Moreover, the error associated to the observation of the point's position can be modelled with a Gaussian distribution when expressed in inverse depth. This is an important property required to apply methods, such as Kalman filters, that assume normality of the measurement error distribution. The major drawback is the larger memory consumption, since the dimensionality of the point's representation is doubled.

Definition

Given 3D point

p = (x, y, z) with world coordinates in a reference frame (e _{1,} e _{2,} e _{3)} , observed from different views, the inverse depth parametrization y of p is given by:y = (x _{0,} y _{0,} z _{0,} \theta, \phi, \rho) where the first five components encode the camera pose in the first observation of the point, being c _{0} = (x _{0,} y _{0,} z _{0)} the optical centre, \phi the azimuth, \theta the elevation angle, and \rho = (1)/(\left\Vert p - c _{0\right\Vert}) the inverse depth of p at the first observation.

References

1. Piniés et al. (2007)
2. Sunderhauf et al. (2007)
3. Civiera et al. (2008)

Bibliography

• Montiel . J. M. M. . Civera . Javier . Davison . Andrew J. . Sukhatme . Gaurav S. . Schaal . Stefan . Burgard . Wolfram . Fox . Dieter . Unified Inverse Depth Parametrization for Monocular SLAM . https://www.roboticsproceedings.org/rss02/p11.html . 10.15607/RSS.2006.II.011 . The MIT Press . Robotics: Science and Systems II, August 16-19, 2006. University of Pennsylvania, Philadelphia, Pennsylvania, USA . 2006.
• Inverse depth parametrization for monocular SLAM. 2008. IEEE Transactions on Robotics. 24. 932–945. 5. IEEE. Civera. Javier. Davison. Andrew J. Montiel. JM Martínez. 10.1109/TRO.2008.2003276. 345360. 10.1.1.175.1380.
• Book: Piniés. Pedro. Lupton. Todd. Sukkarieh. Salah. Tardós. Juan D. Proceedings 2007 IEEE International Conference on Robotics and Automation . Inertial Aiding of Inverse Depth SLAM using a Monocular Camera . 2797–2802. 2007. IEEE. 10.1109/ROBOT.2007.363895. 978-1-4244-0602-9. 10474338.
• Using the unscented Kalman filter in mono-SLAM with inverse depth parametrization for autonomous airship control. Sunderhauf. Niko. Lange. Sven. Protzel. Peter. 2007 IEEE International Workshop on Safety, Security and Rescue Robotics. 1–6. 2007. IEEE.