research-article

Task-embedded online eye-tracker calibration for improving robustness to head motion

Authors:

Bertram E. ShiAuthors Info & Claims

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Article No.: 8, Pages 1 - 9

https://doi.org/10.1145/3314111.3319845

Published: 25 June 2019 Publication History

Abstract

Remote eye trackers are widely used for screen-based interactions. They are less intrusive than head mounted eye trackers, but are generally quite sensitive to head movement. This leads to the requirement for frequent recalibration, especially in applications requiring accurate eye tracking. We propose here an online calibration method to compensate for head movements if estimates of the gaze targets are available. For example, in dwell-time based gaze typing it is reasonable to assume that for correct selections, the user's gaze target during the dwell-time was at the key center. We use this assumption to derive an eye-position dependent linear transformation matrix for correcting the measured gaze. Our experiments show that the proposed method significantly reduces errors over a large range of head movements.

References

[1]

Jixu Chen and Qiang Ji. 2015. A probabilistic approach to online eye gaze tracking without explicit personal calibration. IEEE Transactions on Image Processing 24, 3 (2015), 1076--1086.

Digital Library

[2]

Zhaokang Chen and Bertram E Shi. 2018. Using Variable Dwell Time to Accelerate Gaze-Based Web Browsing with Two-Step Selection. International Journal of Human-Computer Interaction (2018), 1--16.

[3]

Peter M Corcoran, Florin Nanu, Stefan Petrescu, and Petronel Bigioi. 2012. Real-time eye gaze tracking for gaming design and consumer electronics systems. IEEE Transactions on Consumer Electronics 58, 2 (2012).

[4]

Flavio L Coutinho and Carlos H Morimoto. 2013. Improving head movement tolerance of cross-ratio based eye trackers. International journal of computer vision 101, 3 (2013), 459--481.

Digital Library

[5]

Xujiong Dong, Haofei Wang, Zhaokang Chen, and Bertram E Shi. 2015. Hybrid brain computer interface via Bayesian integration of EEG and eye gaze. In 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE, 150--153.

[6]

EyeFollower. 2019. EyeFollower @ONLINE. https://www.interactive-minds.com/eye-tracker/eyefollower

[7]

Dan Witzner Hansen, Javier San Agustin, and Arantxa Villanueva. 2010. Homography normalization for robust gaze estimation in uncalibrated setups. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications. ACM, 13--20.

Digital Library

[8]

Dan Witzner Hansen and Qiang Ji. 2010. In the eye of the beholder: A survey of models for eyes and gaze. IEEE transactions on pattern analysis and machine intelligence 32, 3 (2010), 478--500.

Digital Library

[9]

Roy S. Hessels, Tim H. W. Cornelissen, Chantal Kemner, and Ignace T. C. Hooge. 2015. Qualitative tests of remote eyetracker recovery and performance during head rotation. Behavior Research Methods 47, 3 (01 Sep 2015), 848--859.

[10]

Anthony J Hornof and Tim Halverson. 2002. Cleaning up systematic error in eye-tracking data by using required fixation locations. Behavior Research Methods, Instruments, & Computers 34, 4 (2002), 592--604.

[11]

Michael Xuelin Huang, Tiffany CK Kwok, Grace Ngai, Stephen CF Chan, and Hong Va Leong. 2016. Building a personalized, auto-calibrating eye tracker from user interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5169--5179.

Digital Library

[12]

Qiang Ji and Xiaojie Yang. 2002. Real-time eye, gaze, and face pose tracking for monitoring driver vigilance. Real-time imaging 8, 5 (2002), 357--377.

Digital Library

[13]

Dongwook Jung, Jong Lee, Su Gwon, Weiyuan Pan, Hyeon Lee, Kang Park, and Hyun-Cheol Kim. 2016. Compensation method of natural head movement for gaze tracking system using an ultrasonic sensor for distance measurement. Sensors 16, 1 (2016), 110.

[14]

Anuradha Kar and Peter Corcoran. 2017. A review and analysis of eye-gaze estimation systems, algorithms and performance evaluation methods in consumer platforms. IEEE Access 5 (2017), 16495--16519.

[15]

Hyeon Chang Lee, Duc Thien Luong, Chul Woo Cho, Eui Chul Lee, and Kang Ryoung Park. 2010. Gaze tracking system at a distance for controlling IPTV. IEEE Transactions on Consumer Electronics 56, 4 (2010).

Digital Library

[16]

I Scott MacKenzie and R William Soukoreff. 2003. Phrase sets for evaluating text entry techniques. In CHI'03 extended abstracts on Human factors in computing systems. ACM, 754--755.

Digital Library

[17]

Päivi Majaranta, Ulla-Kaija Ahola, and Oleg Špakov. 2009. Fast gaze typing with an adjustable dwell time. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 357--360.

Digital Library

[18]

Takashi Nagamatsu, Michiya Yamamoto, and Hiroshi Sato. 2010. MobiGaze: Development of a gaze interface for handheld mobile devices. In CHI'10 Extended Abstracts on Human Factors in Computing Systems. ACM, 3349--3354.

Digital Library

[19]

Diederick C Niehorster, Tim HW Cornelissen, Kenneth Holmqvist, Ignace TC Hooge, and Roy S Hessels. 2018. What to expect from your remote eye-tracker when participants are unrestrained. Behavior research methods 50, 1 (2018), 213--227.

[20]

Takehiko Ohno and Naoki Mukawa. 2004. A free-head, simple calibration, gaze tracking system that enables gaze-based interaction. In Proceedings of the 2004 symposium on Eye tracking research & applications. ACM, 115--122.

Digital Library

[21]

Jimin Pi and Bertram E Shi. 2017. Probabilistic adjustment of dwell time for eye typing. In Human System Interactions (HSI), 2017 10th International Conference on. IEEE, 251--257.

[22]

Wayne J Ryan, Andrew T Duchowski, and Stan T Birchfield. 2008. Limbus/pupil switching for wearable eye tracking under variable lighting conditions. In Proceedings of the 2008 symposium on Eye tracking research & applications. ACM, 61--64.

Digital Library

[23]

Yusuke Sugano, Yasuyuki Matsushita, Yoichi Sato, and Hideki Koike. 2015. Appearance-based gaze estimation with online calibration from mouse operations. IEEE Transactions on Human-Machine Systems 45, 6 (2015), 750--760.

[24]

Tobiipro. 2019. Does head movement affect eye tracking results? @ON-LINE. https://www.tobiipro.com/learn-and-support/learn/eye-tracking-essentials/does-head-movements-affect-eye-tracking-results/

[25]

Haofei Wang, Jimin Pi, Tong Qin, Shaojie Shen, and Bertram E Shi. 2018. SLAM-based localization of 3D gaze using a mobile eye tracker. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications. ACM, 65.

Digital Library

[26]

Dong Hyun Yoo and Myung Jin Chung. 2005. A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Computer Vision and Image Understanding 98, 1 (2005), 25--51.

[27]

Yunfeng Zhang and Anthony J Hornof. 2011. Mode-of-disparities error correction of eye-tracking data. Behavior research methods 43, 3 (2011), 834--842.

Cited By

Hamid AKristensson P(2024)40 Years of Eye Typing: Challenges, Gaps, and Emergent StrategiesProceedings of the ACM on Human-Computer Interaction10.1145/36555968:ETRA(1-19)Online publication date: 28-May-2024
https://dl.acm.org/doi/10.1145/3655596
Ghosh SDhall AHayat MKnibbe JJi Q(2024)Automatic Gaze Analysis: A Survey of Deep Learning Based ApproachesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332133746:1(61-84)Online publication date: Jan-2024
https://doi.org/10.1109/TPAMI.2023.3321337
Shamy MFeitelson D(2023)Identifying Lines and Interpreting Vertical Jumps in Eye Tracking Studies of Reading Text and CodeACM Transactions on Applied Perception10.1145/357935720:2(1-20)Online publication date: 6-Apr-2023
https://dl.acm.org/doi/10.1145/3579357
Show More Cited By

Index Terms

Task-embedded online eye-tracker calibration for improving robustness to head motion
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices

Recommendations

Head movement estimation for wearable eye tracker
ETRA '04: Proceedings of the 2004 symposium on Eye tracking research & applications

In the study of eye movements in natural tasks, where subjects are able to freely move in their environment, it is desirable to capture a video of the surroundings of the subject not limited to a small field of view as obtained by the scene camera of an ...
Eye&Head: Synergetic Eye and Head Movement for Gaze Pointing and Selection
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Eye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and ...
Measuring the task-evoked pupillary response with a remote eye tracker
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applications

The pupil-measuring capability of video eye trackers can detect the task-evoked pupillary response: subtle changes in pupil size which indicate cognitive load. We performed several experiments to measure cognitive load using a remote video eye tracker, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

June 2019

623 pages

ISBN:9781450367097

DOI:10.1145/3314111

Conference Chairs:
Krzysztof Krejtz
SWPS University, Poland
,
Bonita Sharif
University of Nebraska-Lincoln

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Hong Kong Research Grants Council

Conference

ETRA '19

Sponsor:

ETRA '19: 2019 Symposium on Eye Tracking Research and Applications

June 25 - 28, 2019

Colorado, Denver

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
247
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hamid AKristensson P(2024)40 Years of Eye Typing: Challenges, Gaps, and Emergent StrategiesProceedings of the ACM on Human-Computer Interaction10.1145/36555968:ETRA(1-19)Online publication date: 28-May-2024
https://dl.acm.org/doi/10.1145/3655596
Ghosh SDhall AHayat MKnibbe JJi Q(2024)Automatic Gaze Analysis: A Survey of Deep Learning Based ApproachesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332133746:1(61-84)Online publication date: Jan-2024
https://doi.org/10.1109/TPAMI.2023.3321337
Shamy MFeitelson D(2023)Identifying Lines and Interpreting Vertical Jumps in Eye Tracking Studies of Reading Text and CodeACM Transactions on Applied Perception10.1145/357935720:2(1-20)Online publication date: 6-Apr-2023
https://dl.acm.org/doi/10.1145/3579357
Chen ZShi B(2023)Towards High Performance Low Complexity Calibration in Appearance Based Gaze EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2022.314838645:1(1174-1188)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TPAMI.2022.3148386
Siegfried ROdobez J(2022)Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention PriorsACM Transactions on Multimedia Computing, Communications, and Applications10.1145/347262218:1(1-27)Online publication date: 27-Jan-2022
https://dl.acm.org/doi/10.1145/3472622
Poy IWu LShi B(2021)A Multimodal Direct Gaze Interface for Wheelchairs and Teleoperated Robots2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)10.1109/EMBC46164.2021.9630471(4796-4800)Online publication date: 1-Nov-2021
https://doi.org/10.1109/EMBC46164.2021.9630471
Chen ZShi B(2020)Offset Calibration for Appearance-Based Gaze Estimation via Gaze Decomposition2020 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV45572.2020.9093419(259-268)Online publication date: Mar-2020
https://doi.org/10.1109/WACV45572.2020.9093419
Pi JKoljonen PHu YShi B(2020)Dynamic Bayesian Adjustment of Dwell Time for Faster Eye TypingIEEE Transactions on Neural Systems and Rehabilitation Engineering10.1109/TNSRE.2020.301674728:10(2315-2324)Online publication date: Oct-2020
https://doi.org/10.1109/TNSRE.2020.3016747

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents

-