Review and Evaluation of Eye Movement Event Detection Algorithms
Open Access
- 15 November 2022
- Vol. 22 (22), 8810
- https://doi.org/10.3390/s22228810
Abstract
Eye tracking is a technology aimed at understanding the direction of the human gaze. Event detection is a process of detecting and classifying eye movements that are divided into several types. Nowadays, event detection is almost exclusively done by applying a detection algorithm to the raw recorded eye-tracking data. However, due to the lack of a standard procedure for how to perform evaluations, evaluating and comparing various detection algorithms in eye-tracking signals is very challenging. In this paper, we used data from a high-speed eye-tracker SMI HiSpeed 1250 system and compared event detection performance. The evaluation focused on fixations, saccades and post-saccadic oscillation classification. It used sample-by-sample comparisons to compare the algorithms and inter-agreement between algorithms and human coders. The impact of varying threshold values on threshold-based algorithms was examined and the optimum threshold values were determined. This evaluation differed from previous evaluations by using the same dataset to evaluate the event detection algorithms and human coders. We evaluated and compared the different algorithms from threshold-based, machine learning-based and deep learning event detection algorithms. The evaluation results show that all methods perform well for fixation and saccade detection; however, there are substantial differences in classification results. Generally, CNN (Convolutional Neural Network) and RF (Random Forest) algorithms outperform threshold-based methods.Keywords
Funding Information
- Silesian University of Technology, Poland, Statutory Research funds of the Department of Applied Informatics (02/100/BK22/0017)
This publication has 36 references indexed in Scilit:
- Automated classification and scoring of smooth pursuit eye movements in the presence of fixations and saccadesBehavior Research Methods, 2012
- An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking dataBehavior Research Methods, 2010
- Fixation identification: The optimum threshold for a dispersion algorithmAttention, Perception, & Psychophysics, 2009
- Fourth Purkinje image signals reveal eye-lens deviations and retinal image distortions during saccadesVision Research, 1995
- The Initial Direction and Landing Position of SaccadesPublished by Elsevier BV ,1995
- Smooth pursuit eye movements under open-loop and closed-loop conditionsVision Research, 1983
- An advanced eye-movement measuring and recording system.American Psychologist, 1975
- Saccadic suppression: A review and an analysis.Psychological Bulletin, 1974
- Corrective movements following refixation saccades: Type and control system analysisVision Research, 1972
- METHODS OF INVESTIGATING EYE MOVEMENTSBritish Journal of Ophthalmology, 1948