Eye Tracking for Everyone
Top Cited Papers
Open Access
- 1 June 2016
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2176-2184
- https://doi.org/10.1109/cvpr.2016.239
Abstract
From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of eye tracking in everyone's palm by building eye tracking software that works on commodity hardware such as mobile phones and tablets, without the need for additional sensors or devices. We tackle this problem by introducing GazeCapture, the first large-scale dataset for eye tracking, containing data from over 1450 people consisting of almost 2:5M frames. Using GazeCapture, we train iTracker, a convolutional neural network for eye tracking, which achieves a significant reduction in error over previous approaches while running in real time (10-15fps) on a modern mobile device. Our model achieves a prediction error of 1.71cm and 2.53cm without calibration on mobile phones and tablets respectively. With calibration, this is reduced to 1.34cm and 2.12cm. Further, we demonstrate that the features learned by iTracker generalize well to other datasets, achieving state-of-the-art results. The code, data, and models are available at http://gazecapture.csail.mit.edu.Keywords
This publication has 28 references indexed in Scilit:
- Eye Tracking and Eye-Based Human–Computer InteractionPublished by Springer Science and Business Media LLC ,2014
- Adaptive Linear Regression for Appearance-Based Gaze EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Learning gaze biases with head motion for head pose-free gaze estimationImage and Vision Computing, 2014
- A neural-based remote eye gaze tracker under natural head motionComputer Methods and Programs in Biomedicine, 2008
- An Incremental Learning Method for Unconstrained Gaze EstimationLecture Notes in Computer Science, 2008
- Eye gaze tracking techniques for interactive applicationsComputer Vision and Image Understanding, 2005
- Eye tracking in the wildComputer Vision and Image Understanding, 2005
- A novel non-intrusive eye gaze estimation using cross-ratio under large head motionComputer Vision and Image Understanding, 2005
- Eye movements in reading and information processing: 20 years of research.Psychological Bulletin, 1998
- Eye-Tracking Dysfunctions in Schizophrenic Patients and Their RelativesArchives of General Psychiatry, 1974