INTEGRATED HANDWRITING RECOGNITION AND INTERPRETATION USING FINITE-STATE MODELS
Open Access
- 1 June 2004
- journal article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
- Vol. 18 (4), 519-539
- https://doi.org/10.1142/s0218001404003344
Abstract
The interpretation of handwritten sentences is carried out using a holistic approach in which both text image recognition and the interpretation itself are tightly integrated. Conventional approaches follow a serial, first-recognition then-interpretation scheme which cannot adequately use semantic–pragmatic knowledge to recover from recognition errors. Stochastic finite-sate transducers are shown to be suitable models for this integration, permitting a full exploitation of the final interpretation constraints. Continuous-density hidden Markov models are embedded in the edges of the transducer to account for lexical and morphological constraints. Robustness with respect to stroke vertical variability is achieved by integrating tangent vectors into the emission densities of these models. Experimental results are reported on a syntax-constrained interpretation task which show the effectiveness of the proposed approaches. These results are also shown to be comparatively better than those achieved with other conventional, N-gram-based techniques which do not take advantage of full integration.Keywords
This publication has 9 references indexed in Scilit:
- Equivalence of different methods for slant and skew corrections in word recognition applicationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Twenty years of document image analysis in PAMIIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Online and off-line handwriting recognition: a comprehensive surveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- An omnifont open-vocabulary OCR system for English and ArabicIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- SEGMENTATION OF OFF-LINE CURSIVE HANDWRITING USING LINEAR PROGRAMMINGPattern Recognition, 1998
- Transformation Invariance in Pattern Recognition — Tangent Distance and Tangent PropagationPublished by Springer Science and Business Media LLC ,1998
- Learning subsequential transducers for pattern recognition interpretation tasksIEEE Transactions on Pattern Analysis and Machine Intelligence, 1993
- Recognition of handwritten sentences using a restricted lexiconPattern Recognition, 1993
- Transductions and Context-Free LanguagesPublished by Springer Science and Business Media LLC ,1979