Automatic player labeling, tracking and field registration and trajectory mapping in broadcast soccer video
- 24 February 2011
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 2 (2), 1-32
- https://doi.org/10.1145/1899412.1899419
Abstract
In this article, we present a method to perform automatic player trajectories mapping based on player detection, unsupervised labeling, efficient multi-object tracking, and playfield registration in broadcast soccer videos. Player detector determines the players' positions and scales by combining the ability of dominant color based background subtraction and a boosting detector with Haar features. We first learn the dominant color with accumulate color histogram at the beginning of processing, then use the player detector to collect hundreds of player samples, and learn player appearance codebook by unsupervised clustering. In a soccer game, a player can be labeled as one of four categories: two teams, referee or outlier. The learning capability enables the method to be generalized well to different videos without any manual initialization. With the dominant color and player appearance model, we can locate and label each player. After that, we perform multi-object tracking by using Markov Chain Monte Carlo (MCMC) data association to generate player trajectories. Some data driven dynamics are proposed to improve the Markov chain's efficiency, such as label consistency, motion consistency, and track length, etc. Finally, we extract key-points and find the mapping from an image plane to the standard field model, and then map players' position and trajectories to the field. A large quantity of experimental results on FIFA World Cup 2006 videos demonstrate that this method can reach high detection and labeling precision, reliably tracking in scenes of player occlusion, moderate camera motion and pose variation, and yield promising field registration results.Keywords
This publication has 15 references indexed in Scilit:
- Real-time camera tracking using sports pitch markingsJournal of Real-Time Image Processing, 2007
- Visual Event Recognition in News Video using Kernel Methods with Multi-Level Temporal AlignmentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Object trackingACM Computing Surveys, 2006
- Multi-Target Tracking - Linking Identities using Bayesian Network InferencePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2006
- Tracking and Labelling of Interacting Multiple TargetsLecture Notes in Computer Science, 2006
- TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and SegmentationLecture Notes in Computer Science, 2006
- 3D reconstruction and enrichment of broadcast soccer videoPublished by Association for Computing Machinery (ACM) ,2004
- BraMBLe: a Bayesian multiple-blob trackerPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Random sample consensusCommunications of the ACM, 1981
- An algorithm for tracking multiple targetsIEEE Transactions on Automatic Control, 1979