Tracking and Activity Recognition Through Consensus in Distributed Camera Networks
- 14 June 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 19 (10), 2564-2579
- https://doi.org/10.1109/tip.2010.2052823
Abstract
Camera networks are being deployed for various applications like security and surveillance, disaster response and environmental modeling. However, there is little automated processing of the data. Moreover, most methods for multicamera analysis are centralized schemes that require the data to be present at a central server. In many applications, this is prohibitively expensive, both technically and economically. In this paper, we investigate distributed scene analysis algorithms by leveraging upon concepts of consensus that have been studied in the context of multiagent systems, but have had little applications in video analysis. Each camera estimates certain parameters based upon its own sensed data which is then shared locally with the neighboring cameras in an iterative fashion, and a final estimate is arrived at in the network using consensus algorithms. We specifically focus on two basic problems - tracking and activity recognition. For multitarget tracking in a distributed camera network, we show how the Kalman-Consensus algorithm can be adapted to take into account the directional nature of video sensors and the network topology. For the activity recognition problem, we derive a probabilistic consensus scheme that combines the similarity scores of neighboring cameras to come up with a probability for each action at the network level. Thorough experimental results are shown on real data along with a quantitative analysis.Keywords
This publication has 38 references indexed in Scilit:
- Flocking for Multi-Agent Dynamic Systems: Algorithms and TheoryIEEE Transactions on Automatic Control, 2006
- Distributed Embedded Smart Cameras for Surveillance ApplicationsComputer, 2006
- Consensus Problems in Networks of Agents With Switching Topology and Time-DelaysIEEE Transactions on Automatic Control, 2004
- Local Control Strategies for Groups of Mobile Autonomous AgentsIEEE Transactions on Automatic Control, 2004
- Coordination of groups of mobile autonomous agents using nearest neighbor rulesIEEE Transactions on Automatic Control, 2003
- Formation constrained multi-agent controlIEEE Transactions on Robotics and Automation, 2001
- Learning and classification of complex dynamicsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Limited communication controlSystems & Control Letters, 1999
- Distributed asynchronous deterministic and stochastic gradient optimization algorithmsIEEE Transactions on Automatic Control, 1986
- Reaching a ConsensusJournal of the American Statistical Association, 1974