Imaging Time Series of Eye Tracking Data to Classify Attentional States
Open Access
- 28 May 2021
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neuroscience
Abstract
It has been shown that conclusions about the human mental state can be drawn from eye gaze behavior by several previous studies. For this reason, eye tracking recordings are suitable as input data for attentional state classifiers. In current state-of-the-art studies, the extracted eye tracking feature set usually consists of descriptive statistics about specific eye movement characteristics (i.e. fixations, saccades, blinks, vergence, and pupil dilation). We suggest an Imaging Time Series approach for eye tracking data followed by classification using a convolutional neural net to improve the classification accuracy. We compared multiple algorithms that used the one-dimensional statistical summary feature set as input with two different implementations of the newly suggested method for three different data sets that target different aspects of attention. The results show that our two-dimensional image features with the convolutional neural net outperform the classical classifiers for most analyses, especially regarding generalization over participants and tasks. We conclude that current attentional state classifiers that are based on eye tracking can be optimized by adjusting the feature set while requiring less feature engineering and our future work will focus on a more detailed and suited investigation of this approach for other scenarios and data sets.Keywords
Funding Information
- Austrian Science Fund
This publication has 58 references indexed in Scilit:
- Microsaccade and drift dynamics reflect mental fatigueEuropean Journal of Neuroscience, 2013
- Mind wandering in sentence reading: Decoupling the link between mind and eye.Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale, 2013
- A Role of Eye Vergence in Covert AttentionPLOS ONE, 2013
- The timing and temporal patterns of eye blinking are dynamically modulated by attentionHuman Movement Science, 2012
- A Taxonomy of External and Internal AttentionAnnual Review of Psychology, 2011
- Fixation identification: The optimum threshold for a dispersion algorithmAttention, Perception, & Psychophysics, 2009
- A Review of Eye-Tracking Research in MarketingReview of Marketing Research, 2008
- The restless mind.Psychological Bulletin, 2006
- A theory of reading: From eye fixations to comprehension.Psychological Review, 1980
- A theory of reading: From eye fixations to comprehension.Psychological Review, 1980