A New Approach for Overlay Text Detection and Extraction From Complex Video Scene
- 16 December 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 18 (2), 401-411
- https://doi.org/10.1109/tip.2008.2008225
Abstract
Overlay text brings important semantic clues in video content analysis such as video information retrieval and summarization, since the content of the scene or the editor's intention can be well represented by using inserted text. Most of the previous approaches to extracting overlay text from videos are based on low-level features, such as edge, color, and texture information. However, existing methods experience difficulties in handling texts with various contrasts or inserted in a complex background. In this paper, we propose a novel framework to detect and extract the overlay text from the video scene. Based on our observation that there exist transient colors between inserted text and its adjacent background, a transition map is first generated. Then candidate regions are extracted by a reshaping method and the overlay text regions are determined based on the occurrence of overlay text in each candidate. The detected overlay text regions are localized accurately using the projection of overlay text pixels in the transition map and the text extraction is finally conducted. The proposed method is robust to different character size, position, contrast, and color. It is also language independent. Overlay text region update between frames is also employed to reduce the processing time. Experiments are performed on diverse videos to confirm the efficiency of the proposed method.Keywords
This publication has 15 references indexed in Scilit:
- Effective video text detection using line featuresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Scene text extraction in natural scene images using hierarchical feature combining and verificationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Automatic text detection in complex color imagePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Text detection for video analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Video OCR for digital news archivePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robust extraction of text in videoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIeee Transactions On Pattern Analysis and Machine Intelligence, 2002
- Automatic caption localization in videos using salient pointsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- A comparative performance study of several global thresholding techniques for segmentationComputer Vision, Graphics, and Image Processing, 1990
- A Threshold Selection Method from Gray-Level HistogramsIEEE Transactions on Systems, Man, and Cybernetics, 1979