EGOF-Net: epipolar guided optical flow network for unrectified stereo matching
- 1 October 2021
- journal article
- research article
- Published by Optica Publishing Group in Optics Express
- Vol. 29 (21), 33874-33889
- https://doi.org/10.1364/oe.440241
Abstract
It is challenging to realize stereo matching in dynamic stereo vision systems. We present an epipolar guided optical flow network (EGOF-Net) for unrectified stereo matching by estimating robust epipolar geometry with a deep cross-checking-based fundamental matrix estimation method (DCCM) and then surpassing false matches with a 4D epipolar modulator (4D-EM) module. On synthetic and real-scene datasets, our network outperforms the state-of-the-art methods by a substantial margin. Also, we test the network in an existing dynamic stereo system and successfully reconstruct the 3D point clouds. The technique can simplify the stereo vision pipeline by ticking out rectification operations. Moreover, it suggests a new opportunity for combining heuristic algorithms with neural networks. The code is available on https://github.com/psyrocloud/EGOF-Net.Funding Information
- National Natural Science Foundation of China (61535008)
This publication has 28 references indexed in Scilit:
- Deep Residual Learning for Image RecognitionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow EstimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2016
- FlowNet: Learning Optical Flow with Convolutional NetworksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- High-Resolution Stereo Datasets with Subpixel-Accurate Ground TruthLecture Notes in Computer Science, 2014
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013
- TV-L1 Optical Flow EstimationImage Processing On Line, 2013
- Robust Monocular Epipolar Flow EstimationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Multiple View Geometry in Computer VisionPublished by Cambridge University Press (CUP) ,2004
- In defense of the eight-point algorithmIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Random sample consensusCommunications of the ACM, 1981