Deep-inverse correlography: towards real-time high-resolution non-line-of-sight imaging
Top Cited Papers
- 16 January 2020
- journal article
- research article
- Published by Optica Publishing Group in Optica
- Vol. 7 (1), 63-71
- https://doi.org/10.1364/optica.374026
Abstract
Due to the quartic attenuation of intensity with distance, low signal-to-noise ratios are arguably the fundamental barrier to real-time, high-resolution, non-line-of-sight (NLoS) imaging at long stand-offs. We use results from spectral estimation theory to derive a noise model for NLoS correlography; a speckle correlation-based technique for recovering occluded objects from indirect reflections. Then, using only synthetic data sampled from the proposed noise model, and without knowledge of the experimental scenes nor their geometry, we train a deep convolutional neural network (CNN) to solve the noisy phase retrieval (PR) problem associated with correlography. We validate that the resulting CNN is exceptionally robust to noise, far exceeding the capabilities of existing algorithms in low-flux regimes. We use the proposed technique to demonstrate NLoS imaging with 300um resolution at a 1m standoff, using just two 1/8-th second exposure-length images from a standard CMOS detector. This lifts two critical restrictions of existing NLoS imaging methods: (1) Typical NLoS reconstruction methods that utilize transients produce resolutions on the order of 3-10 mm; our results are an order of magnitude improvement. (2) Typical NLoS capture times are of the order of tens of minutes to hours; our results represent a 2 orders of magnitude improvement.Keywords
Funding Information
- Defense Advanced Research Projects Agency (Reveal: HR0011-16-C-0028.)
This publication has 59 references indexed in Scilit:
- PhaseLift: Exact and Stable Signal Recovery from Magnitude Measurements via Convex ProgrammingCommunications on Pure and Applied Mathematics, 2012
- Alternating direction methods for classical and ptychographic phase retrievalInverse Problems, 2012
- Relaxed averaged alternating reflections for diffraction imagingInverse Problems, 2004
- Hybrid projection–reflection method for phase retrievalJournal of the Optical Society of America A, 2003
- Looking through walls and around cornersPhysica A: Statistical Mechanics and its Applications, 1990
- Image synthesis from nonimaged laser-speckle patterns: experimental verificationOptics Letters, 1989
- Memory Effects in Propagation of Optical Waves through Disordered MediaPhysical Review Letters, 1988
- Image synthesis from nonimaged laser-speckle patternsOptics Letters, 1987
- Phase retrieval algorithms: a comparisonApplied Optics, 1982
- Light-in-flight recording by holographyOptics Letters, 1978