Eye Movement Analysis for Activity Recognition Using Electrooculography
Top Cited Papers
- 8 April 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 33 (4), 741-753
- https://doi.org/10.1109/tpami.2010.86
Abstract
In this work, we investigate eye movement analysis as a new sensing modality for activity recognition. Eye movement data were recorded using an electrooculography (EOG) system. We first describe and evaluate algorithms for detecting three eye movement characteristics from EOG signals-saccades, fixations, and blinks-and propose a method for assessing repetitive patterns of eye movements. We then devise 90 different features based on these characteristics and select a subset of them using minimum redundancy maximum relevance (mRMR) feature selection. We validate the method using an eight participant study in an office environment using an example set of five activity classes: copying a text, reading a printed paper, taking handwritten notes, watching a video, and browsing the Web. We also include periods with no specific activity (the NULL class). Using a support vector machine (SVM) classifier and person-independent (leave-one-person-out) training, we obtain an average precision of 76.1 percent and recall of 70.5 percent over all classes and participants. The work demonstrates the promise of eye-based activity recognition (EAR) and opens up discussion on the wider applicability of EAR to other activities that are difficult, or even impossible, to detect using common sensing modalities.Keywords
This publication has 38 references indexed in Scilit:
- Real-world visionACM Transactions on Applied Perception, 2009
- Blinks and saccades as indicators of fatigue in sleepiness warnings: looking tired?Ergonomics, 2008
- A gaze-based study for investigating the perception of visual realism in simulated scenesACM Transactions on Applied Perception, 2008
- A Wavelet Packets Approach to Electrocardiograph Baseline Drift CancellationInternational Journal of Biomedical Imaging, 2006
- ISCEV Standard for Clinical Electro-oculography (EOG) 2006Documenta Ophthalmologica, 2006
- Eye movements in natural behaviorTrends in Cognitive Sciences, 2005
- System for assisted mobility using eye movements based on electrooculographyIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2002
- The use of visual search for knowledge gathering in image decision supportIEEE Transactions on Medical Imaging, 2002
- De-noising by soft-thresholdingIEEE Transactions on Information Theory, 1995
- Visual perception and sequences of eye movement fixations: a stochastic modeling approachIEEE Transactions on Systems, Man, and Cybernetics, 1992