A theory of multi-layer flat refractive geometry
- 1 June 2012
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3346-3353
- https://doi.org/10.1109/cvpr.2012.6248073
Abstract
Flat refractive geometry corresponds to a perspective camera looking through single/multiple parallel flat refractive mediums. We show that the underlying geometry of rays corresponds to an axial camera. This realization, while missing from previous works, leads us to develop a general theory of calibrating such systems using 2D-3D correspondences. The pose of 3D points is assumed to be unknown and is also recovered. Calibration can be done even using a single image of a plane. We show that the unknown orientation of the refracting layers corresponds to the underlying axis, and can be obtained independently of the number of layers, their distances from the camera and their refractive indices. Interestingly, the axis estimation can be mapped to the classical essential matrix computation and 5-point algorithm [15] can be used. After computing the axis, the thicknesses of layers can be obtained linearly when refractive indices are known, and we derive analytical solutions when they are unknown. We also derive the analytical forward projection (AFP) equations to compute the projection of a 3D point via multiple flat refractions, which allows non-linear refinement by minimizing the reprojection error. For two refractions, AFP is either 4th or 12th degree equation depending on the refractive indices. We analyze ambiguities due to small field of view, stability under noise, and show how a two layer system can be well approximated as a single layer system. Real experiments using a water tank validate our theory.Keywords
This publication has 12 references indexed in Scilit:
- Multi-view 3D reconstruction for scenes under the refractive plane with known vertical directionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- Multi-View Geometry of the Refractive PlanePublished by British Machine Vision Association and Society for Pattern Recognition ,2009
- Calibration of Cameras with Radially Symmetric DistortionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Flat refractive geometryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- A Theory of Refractive and Specular 3D Shape by Light-Path TriangulationInternational Journal of Computer Vision, 2007
- Dynamic refraction stereoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Multi-view geometry of 1D radial cameras and its application to omnidirectional camera calibrationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- An efficient solution to the five-point relative pose problemIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Using many cameras as onePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Quantitative photogrammetric analysis of digital underwater video imageryIEEE Journal of Oceanic Engineering, 1997