research-article

Screen corner detection using polarization camera for cross-ratio based gaze estimation

Authors:

Takashi Nagamatsu,

Kentaro TakemuraAuthors Info & Claims

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Article No.: 24, Pages 1 - 9

https://doi.org/10.1145/3314111.3319814

Published: 25 June 2019 Publication History

Abstract

Eye tracking, which measures line of sight, is expected to advance as an intuitive and rapid input method for user interfaces, and a cross-ratio based method that calculates the point-of-gaze using homography matrices has attracted attention because it does not require hardware calibration to determine the geometric relationship between an eye camera and a screen. However, this method requires near-infrared (NIR) light-emitting diodes (LEDs) attached to the display in order to detect screen corners. Consequently, LEDs must be installed around the display to estimate the point-of-gaze. Without these requirements, cross-ratio based gaze estimation can be distributed smoothly. Therefore, we propose the use of a polarization camera for detecting the screen area reflected on a corneal surface. The reflection area of display light is easily detected by the polarized image because the light radiated from the display is polarized linearly by the internal polarization filter. With the proposed method, the screen corners can be determined without using NIR LEDs, and the point-of-gaze can be estimated using the detected corners on the corneal surface. We investigated the accuracy of the estimated point-of-gaze based on a cross-ratio method under various illumination and display conditions. Cross-ratio based gaze estimation is expected to be utilized widely in commercial products because the proposed method does not require infrared light sources at display corners.

References

[1]

Nuri Murat Arar, Hua Gao, and Jean-Philippe Thiran. 2015a. Towards Convenient Calibration for Cross-Ratio Based Gaze Estimation. In Proceedings of 2015 IEEE Winter Conference on Applications of Computer Vision. 642--648.

Digital Library

[2]

Nuri Murat Arar, Hua Gao, and Jean-Philippe Thiran. 2015b. Robust gaze estimation based on adaptive fusion of multiple cameras. In Proceedings of 2015 11th IEEE International Conference Workshops on Automatic Face and Gesture Recognition. 1--7.

[3]

David Beymer and Myron Flickner. 2003. Eye gaze tracking using an active stereo head. In in Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2. II-451--8.

[4]

Flavio Coutinho and Carlos Morimoto. 2006. Free head motion eye gaze tracking using a single camera and multiple light sources. In Proceedings of 2006 19th Brazilian Symposium Computer Graphics and Image. IEEE, 171--178.

[5]

Flavio L. Coutinho and Carlos H. Morimoto. 2013. Improving head movement tolerance of cross-ratio based eye trackers. International Journal of Computer Vision 101, 3 (2013), 459--481.

Digital Library

[6]

Elias Daniel Guestrin and Moshe Eizenman. 2006. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Transactions Biomedical Engineering 53, 6 (2006), 1124--1133.

[7]

Dan Witzner Hansen, Javier San Agustin, and Arantxa Villanueva. 2010. Homography Normalization for Robust Gaze Estimation in Uncalibrated Setups. In Proceedings 2010 Symposium Eye-Tracking Research & Applications - ETRA '10, Vol. 1. 13--20.

Digital Library

[8]

Dan Witzner Hansen and Qiang Ji. 2010. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze. IEEE Transactions Pattern Analysis and Machine Intelligence 32, 3 (2010), 478--500.

Digital Library

[9]

Richard Hartley and Andrew Zisserman. 2000. Multiple View Geometry in Computer Vision. Cambridge: Cambridge University Press.

[10]

Jia-bin Huang, Qin Cai, Zicheng Liu, Narendra Ahuja, and Zhengyou Zhang. 2014. Towards Accurate and Robust Cross-Ratio based Gaze Trackers Through Learning From Simulation. In Proceedings of Symposium Eye-Tracking Research & Applications - ETRA '14. 75--82.

Digital Library

[11]

Qiang Ji and Xiaojie Yang. 2002. Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance. Real-Time Imaging 8, 5 (2002), 357--377.

Digital Library

[12]

Jeffrey J. Kang, Elias D. Guestrin, W. James Maclean, and Moshe Eizenman. 2007. Simplifying the Cross-Ratios Method of Point-of-Gaze Estimation. In Proceedings of 30th Canadian medical and biological Engineering Conference (CMBEC30). 1--4.

[13]

Anuradha Kar and Peter Corcoran. 2017. A Review and Analysis of Eye-Gaze Estimation Systems, Algorithms and Performance Evaluation Methods in Consumer Platforms. IEEE Access 5, c (2017), 16495--16519.

[14]

Carlos H. Morimoto and Marcio R.M. Mimica. 2005. Eye gaze tracking techniques for interactive applications. Computer Vision and Image Understanding 98, 1 (2005), 4--24.

[15]

Takashi Nagamatsu, Junzo Kamahara, and Naoki Tanaka. 2009. Calibration-free Gaze Tracking Using a Binocular 3D Eye Model. In Proceedings of CHI '09 Extended Abstracts on Human Factors in Computing Systems (CHI EA '09). 3613--3618.

Digital Library

[16]

Roman Rädle, Hans-Christian Jetter, Jonathan Fischer, Inti Gabriel, Clemens Nylandsted Klokmose, Harald Reiterer, and Christian Holz. 2018. PolarTrack: Optical Outside-In Device Tracking that Exploits Display Polarization. In Proceedings of 2018 CHI Conference Human Factors in Computing Systems - CHI '18. 1--9.

Digital Library

[17]

Masato Sasaki, Takashi Nagamatsu, and Kentaro Takemura. 2018. Cross-Ratio Based Gaze Estimation using Polarization Camera System. In Proceedings of 2018 ACM International Conference Interactive Surfaces and Spaces - ISS '18. 333--338.

Digital Library

[18]

Richard S. Snell and Michael A. Lemp. 1989. Clinical Anatomy of the Eye. Blackwell Scientific Publications.

[19]

Kentaro Takemura, Tomohisa Yamakawa, Jun Takamatsu, and Tsukasa Ogasawara. 2014. Estimation of a focused object using a corneal surface image for eye-based interaction. 2014 Journal of Eye Movement Research 7, 3 (2014), 1--9.

[20]

Dong Hyun Yoo and Myung Jin Chung. 2005. A novel non-intrusive eye gaze estimation using cross-ratio under large head motion. Computer Vision and Image Understanding 98, 1 (2005), 25--51.

[21]

Dong Hyun Yoo, Jae Heon Kim, Bang Rae Lee, and Myoung Jin Chung. 2002. Non-contact eye gaze tracking system by mapping of corneal reflections. In Proceedings of 5th IEEE International Conference on Automatic Face Gesture Recognition. 101--106.

[22]

Zhengyou Zhang and Qin Cai. 2014. Improving cross-ratio-based eye tracking techniques by leveraging the binocular fixation constraint. In Proceedings of Symposium Eye-Tracking Research & Applications - ETRA '14. 267--270.

Digital Library

Cited By

Liu JChi JYang Z(2024)A review on personal calibration issues for video-oculographic-based gaze trackingFrontiers in Psychology10.3389/fpsyg.2024.130904715Online publication date: 20-Mar-2024
https://doi.org/10.3389/fpsyg.2024.1309047
Prabha RJeevitha KBebisha DVenusri S(2024)Eye Controlled Smart Pain Reliever2024 International Conference on Communication, Computing and Internet of Things (IC3IoT)10.1109/IC3IoT60841.2024.10550254(1-8)Online publication date: 17-Apr-2024
https://doi.org/10.1109/IC3IoT60841.2024.10550254
Koshikawa KNagamatsu TTakemura K(2022)Model-based Gaze Estimation with Transparent Markers on Large ScreensProceedings of the ACM on Human-Computer Interaction10.1145/35308886:ETRA(1-16)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530888
Show More Cited By

Index Terms

Screen corner detection using polarization camera for cross-ratio based gaze estimation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Gaze Estimation with Imperceptible Marker Displayed Dynamically using Polarization
ETRA '22: 2022 Symposium on Eye Tracking Research and Applications

Conventional eye-tracking methods require NIR-LEDs at the corners and edges of displays as references. However, extensive eyeball rotation results in the loss of reflections. Therefore, we propose imperceptible markers that can be dynamically displayed ...
Cross-Ratio Based Gaze Estimation for Multiple Displays using a Polarization Camera
UIST '19 Adjunct: Adjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

While eye tracking has been typically used for achieving intuitive user interfaces, it is not sufficient when it comes to dealing with multiple-display environments. In such environments, which have become popular recently, the point-of-gaze should be ...
Eye Gaze Estimation using Imperceptible Marker Presented on High-Speed Display
ETRA '21 Short Papers: ACM Symposium on Eye Tracking Research and Applications

Advanced eye-tracking methods require a dedicated display equipped with near-infrared LEDs (light-emitting diodes). However, this requirement hinders the widespread adoption of such methods. Additionally, some glints may pass undetected when a large ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

June 2019

623 pages

ISBN:9781450367097

DOI:10.1145/3314111

Conference Chairs:
Krzysztof Krejtz
SWPS University, Poland
,
Bonita Sharif
University of Nebraska-Lincoln

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Japan Society for the Promotion of Science

Conference

ETRA '19

Sponsor:

ETRA '19: 2019 Symposium on Eye Tracking Research and Applications

June 25 - 28, 2019

Colorado, Denver

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
274
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu JChi JYang Z(2024)A review on personal calibration issues for video-oculographic-based gaze trackingFrontiers in Psychology10.3389/fpsyg.2024.130904715Online publication date: 20-Mar-2024
https://doi.org/10.3389/fpsyg.2024.1309047
Prabha RJeevitha KBebisha DVenusri S(2024)Eye Controlled Smart Pain Reliever2024 International Conference on Communication, Computing and Internet of Things (IC3IoT)10.1109/IC3IoT60841.2024.10550254(1-8)Online publication date: 17-Apr-2024
https://doi.org/10.1109/IC3IoT60841.2024.10550254
Koshikawa KNagamatsu TTakemura K(2022)Model-based Gaze Estimation with Transparent Markers on Large ScreensProceedings of the ACM on Human-Computer Interaction10.1145/35308886:ETRA(1-16)Online publication date: 13-May-2022
https://dl.acm.org/doi/10.1145/3530888
Inoue YKoshikawa KTakemura K(2022)Gaze Estimation with Imperceptible Marker Displayed Dynamically using Polarization2022 Symposium on Eye Tracking Research and Applications10.1145/3517031.3529640(1-5)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3517031.3529640
Tesfamikael HFray AMengsteab ISemere AAmanuel Z(2021)Simulation of Eye Tracking Control based Electric Wheelchair Construction by Image Segmentation AlgorithmJournal of Innovative Image Processing10.36548/jiip.2021.1.0033:1(21-35)Online publication date: 8-Apr-2021
https://doi.org/10.36548/jiip.2021.1.003
Dahmani MChowdhury MKhandakar ARahman TAl-Jayyousi KHefny AKiranyaz S(2020)An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair ControlSensors10.3390/s2014393620:14(3936)Online publication date: 15-Jul-2020
https://doi.org/10.3390/s20143936
Koshikawa KSasaki MUtsu TTakemura K(2020)Polarized Near-Infrared Light Emission for Eye Gaze EstimationACM Symposium on Eye Tracking Research and Applications10.1145/3379156.3391342(1-4)Online publication date: 2-Jun-2020
https://dl.acm.org/doi/10.1145/3379156.3391342
Sasaki MNagamatsu TTakemura KGuimbretière FBernstein MReinecke K(2019)Cross-Ratio Based Gaze Estimation for Multiple Displays using a Polarization CameraAdjunct Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332167.3357095(1-3)Online publication date: 14-Oct-2019
https://dl.acm.org/doi/10.1145/3332167.3357095

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents

-