Moving obstacle detection in highly dynamic scenes
- 1 May 2009
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
We address the problem of vision-based multi-person tracking in busy pedestrian zones using a stereo rig mounted on a mobile platform. Specifically, we are interested in the application of such a system for supporting path planning algorithms in the avoidance of dynamic obstacles. The complexity of the problem calls for an integrated solution, which extracts as much visual information as possible and combines it through cognitive feedback. We propose such an approach, which jointly estimates camera position, stereo depth, object detections, and trajectories based only on visual information. The interplay between these components is represented in a graphical model. For each frame, we first estimate the ground surface together with a set of object detections. Based on these results, we then address object interactions and estimate trajectories. Finally, we employ the tracking results to predict future motion for dynamic objects and fuse this information with a static occupancy map estimated from dense stereo. The approach is experimentally evaluated on several long and challenging video sequences from busy inner-city locations recorded with different mobile setups. The results show that the proposed integration makes stable tracking and motion prediction possible, and thereby enables path planning in complex and highly dynamic scenes.Keywords
This publication has 22 references indexed in Scilit:
- Safe Vehicle Navigation in Dynamic Urban ScenariosPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Coupled Object Detection and Tracking from Static Cameras and Moving VehiclesIeee Transactions On Pattern Analysis and Machine Intelligence, 2008
- Global data association for multi-object tracking using network flowsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Robust Object Detection with Interleaved Categorization and SegmentationInternational Journal of Computer Vision, 2007
- Detection and Tracking of Multiple, Partially Occluded Humans by Bayesian Combination of Edgelet based Part DetectorsInternational Journal of Computer Vision, 2007
- Multi-cue Pedestrian Detection and Tracking from a Moving VehicleInternational Journal of Computer Vision, 2006
- Putting Objects in PerspectivePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Efficient Belief Propagation for Early VisionInternational Journal of Computer Vision, 2006
- Stereo- and neural network-based pedestrian detectionIEEE Transactions on Intelligent Transportation Systems, 2000
- Sonar tracking of multiple targets using joint probabilistic data associationIEEE Journal of Oceanic Engineering, 1983