Smartphone eye-tracking with deep learning: Data quality and field testing.

Journal: Behavior research methods
Published Date:

Abstract

Eye-tracking is widely used to measure human attention in research, commercial, and clinical applications. With the rapid advancements in artificial intelligence and mobile computing, deep learning algorithms for computer vision-based eye tracking have become feasible for smartphones. This paper presents a real-time smartphone eye-tracking system built upon a deep neural network trained on a dataset of 7.4 million facial images. The tracking performance of the system was benchmarked against an industrial gold-standard EyeLink eye tracker using a reasonably large sample (N = 32). The benchmark test showed that, while the smartphone eye-tracking system was less precise (0.177° vs. 0.028°), its tracking accuracy was comparable to the EyeLink tracker (1.32° vs. 1.20°). To evaluate whether the smartphone eye-tracking system is sensitive enough for real-world application, a field test involving 98 volunteers assessed depressive symptoms using three simple visual tasks on a smartphone: fixation stability, free-viewing, and smooth pursuit. The results showed that using the smartphone eye-tracking system can achieve an accuracy of 76.67% in predicting depressive symptoms. These results demonstrate that smartphone eye-tracking can deliver quality data and has potential in scientific and clinical applications.

Authors

  • Gancheng Zhu
    Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, 130012, China; College of Computer Science and Technology, Jilin University, Changchun, Jilin, 130012, China.
  • Zehao Huang
    Center for Psychological Sciences, Zhejiang University, 148 Tianmushan Rd., Hangzhou, 310028, China.
  • Xiaoting Duan
    Center for Psychological Sciences, Zhejiang University, 148 Tianmushan Rd., Hangzhou, 310028, China.
  • Shuai Zhang
    School of Information, Zhejiang University of Finance and Economics, Hangzhou, China.
  • Rong Wang
    College of Food Science and Engineering, Northwest A&F University, Yangling 712100, Shanxi, China. Electronic address: wangrong91@nwsuaf.edu.cn.
  • Yongkai Li
    Center for Psychological Sciences, Zhejiang University, 148 Tianmushan Rd., Hangzhou, 310028, China.
  • Zhiguo Wang
    Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang, 110169, Liaoning, China.