A mobile vision system for robust multi-person tracking
Top Cited Papers
- 1 June 2008
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
We present a mobile vision system for multi-person tracking in busy environments. Specifically, the system integrates continuous visual odometry computation with tracking-by-detection in order to track pedestrians in spite of frequent occlusions and egomotion of the camera rig. To achieve reliable performance under real-world conditions, it has long been advocated to extract and combine as much visual information as possible. We propose a way to closely integrate the vision modules for visual odometry, pedestrian detection, depth estimation, and tracking. The integration naturally leads to several cognitive feedback loops between the modules. Among others, we propose a novel feedback connection from the object detector to visual odometry which utilizes the semantic knowledge of detection to stabilize localization. Feedback loops always carry the danger that erroneous feedback from one module is amplified and causes the entire system to become instable. We therefore incorporate automatic failure detection and recovery, allowing the system to continue when a module becomes unreliable. The approach is experimentally evaluated on several long and difficult video sequences from busy inner-city locations. Our results show that the proposed integration makes it possible to deliver stable tracking performance in scenes of previously infeasible complexity.Keywords
This publication has 18 references indexed in Scilit:
- Projective Factorization of Multiple Rigid-Body MotionsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Dynamic 3D Scene Analysis from a Moving VehiclePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Coupled Detection and Trajectory Estimation for Multi-Object TrackingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Simultaneous Segmentation and 3D Reconstruction of Monocular Image SequencesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Approximate Bayesian multibody trackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Radon-Based Structure from Motion without CorrespondencesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Pedestrian Detection in Crowded ScenesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Visual odometryPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Multiple View Geometry in Computer VisionPublished by Cambridge University Press (CUP) ,2004
- Map building with mobile robots in dynamic environmentsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004