skip to main content
10.1145/2857491.2857512acmconferencesArticle/Chapter ViewAbstractPublication PagesetraConference Proceedingsconference-collections
research-article

Bayesian identification of fixations, saccades, and smooth pursuits

Published: 14 March 2016 Publication History
  • Get Citation Alerts
  • Abstract

    Smooth pursuit eye movements provide meaningful insights and information on subject's behavior and health and may, in particular situations, disturb the performance of typical fixation/saccade classification algorithms. Thus, an automatic and efficient algorithm to identify these eye movements is paramount for eye-tracking research involving dynamic stimuli. In this paper, we propose the Bayesian Decision Theory Identification (I-BDT) algorithm, a novel algorithm for ternary classification of eye movements that is able to reliably separate fixations, saccades, and smooth pursuits in an online fashion, even for low-resolution eye trackers. The proposed algorithm is evaluated on four datasets with distinct mixtures of eye movements, including fixations, saccades, as well as straight and circular smooth pursuits; data was collected with a sample rate of 30 Hz from six subjects, totaling 24 evaluation datasets. The algorithm exhibits high and consistent performance across all datasets and movements relative to a manual annotation by a domain expert (recall: μ = 91.42%, σ = 9.52%; precision: μ = 95.60%, σ = 5.29%; specificity μ = 95.41%, σ = 7.02%) and displays a significant improvement when compared to I-VDT, an state-of-the-art algorithm (recall: μ = 87.67%, σ = 14.73%; precision: μ = 89.57%, σ = 8.05%; specificity μ = 92.10%, σ = 11.21%). Algorithm implementation and annotated datasets are openly available at www.ti.uni-tuebingen.de/perception

    Supplementary Material

    MP4 File (p163-santini.mp4)

    References

    [1]
    Ben-David, A. 2007. A lot of randomness is hiding in accuracy. Engineering Applications of Artificial Intelligence 20, 7, 875--885.
    [2]
    Berg, D. J., Boehnke, S. E., Marino, R. A., Munoz, D. P., and Itti, L. 2009. Free viewing of dynamic stimuli by humans and monkeys. Journal of Vision 9, 5, 19.
    [3]
    Braunagel, C., Kasneci, E., Stolzmann, W., and Rosenstiel, W. 2015. Driver-activity recognition in the context of conditionally autonomous driving. In IEEE 18th International Conference on Intelligent Transportation Systems (ITSC).
    [4]
    Fletcher, W. A., and Sharpe, J. A. 1988. Smooth pursuit dysfunction in alzheimer's disease. Neurology 38, 2, 272--272.
    [5]
    Fuhl, W., Kübler, T., Sippel, K., Rosenstiel, W., and Kasneci, E. 2015. Excuse: Robust pupil detection in real-world scenarios. In Computer Analysis of Images and Patterns 2015. CAIP 2015. 16th International Conference, IEEE.
    [6]
    Galar, M., Fernández, A., Barrenechea, E., Bustince, H., and Herrera, F. 2011. An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes. Pattern Recognition 44, 8, 1761--1776.
    [7]
    Gyllensten, O. C. 2014. Evaluating current algorithms for smooth pursuit detection on Tobii Eye Trackers. Master's thesis, Royal Institute of Technology, Sweden.
    [8]
    Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., and Van de Weijer, J. 2011. Eye tracking: A comprehensive guide to methods and measures. Oxford University Press.
    [9]
    Kasneci, E., Kasneci, G., Kübler, T., and Rosenstiel, W. 2015. Online recognition of fixations, saccades, and smooth pursuits for automated analysis of traffic hazard perception. In Artificial Neural Networks, P. Koprinkova-Hristova, V. Mladenov, and N. K. Kasabov, Eds., vol. 4 of Springer Series in Bio-/Neuroinformatics. Springer International Publishing, 411--434.
    [10]
    Kasneci, E. 2013. Towards the automated recognition of assistance need for drivers with impaired visual field. PhD thesis, Universität Tübingen, Germany.
    [11]
    Kleiner, M., Brainard, D., Pelli, D., Ingling, A., Murray, R., and Broussard, C. 2007. Whats new in psychtoolbox-3. Perception 36, 14, 1.
    [12]
    Knuth, D. E. 1992. Two notes on notation. American Mathematical Monthly, 403--422.
    [13]
    Komogortsev, O. V., and Karpov, A. 2013. Automated classification and scoring of smooth pursuit eye movements in the presence of fixations and saccades. Behavior research methods 45, 1, 203--215.
    [14]
    Komogortsev, O. V., and Khan, J. I. 2007. Kalman filtering in the design of eye-gaze-guided computer interfaces. In Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments. Springer, 679--689.
    [15]
    Komogortsev, O. V., Gobert, D. V., Jayarathna, S., Koh, D. H., and Gowda, S. M. 2010. Standardization of automated analyses of oculomotor fixation and saccadic behaviors. Biomedical Engineering, IEEE Transactions on 57, 11, 2635--2645.
    [16]
    Larsson, L., Nystrom, M., and Stridh, M. 2013. Detection of saccades and postsaccadic oscillations in the presence of smooth pursuit. Biomedical Engineering, IEEE Transactions on 60, 9, 2484--2493.
    [17]
    Larsson, L., Nyström, M., Andersson, R., and Stridh, M. 2015. Detection of fixations and smooth pursuit movements in high-speed eye-tracking data. Biomedical Signal Processing and Control 18, 145--152.
    [18]
    Larsson, L. 2010. Event detection in eye-tracking data. Master's thesis, Lund University, Sweden.
    [19]
    Leigh, R. J., and Zee, D. S. 2015. The neurology of eye movements. Oxford University Press.
    [20]
    Lopez, J. S. A. 2009. Off-the-shelf Gaze Interaction. PhD thesis, IT University of Copenhagen, Denmark.
    [21]
    Meyer, C. H., Lasker, A. G., and Robinson, D. A. 1985. The upper limit of human smooth pursuit velocity. Vision Research 25, 4, 561--563.
    [22]
    ODriscoll, G. A., and Callahan, B. L. 2008. Smooth pursuit in schizophrenia: a meta-analytic review of research since 1993. Brain and cognition 68, 3, 359--370.
    [23]
    Salvucci, D. D., and Goldberg, J. H. 2000. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 symposium on Eye tracking research & applications, ACM, 71--78.
    [24]
    Santini, T., Fuhl, W., Kübler, T., and Kasneci, E. 2016. Eyerec: An open-source data acquisition software for head-mounted eye-tracking. In International Conference on Vision Theory and Applications (VISAPP). Forthcoming.
    [25]
    Sauter, D., Martin, B., Di Renzo, N., and Vomscheid, C. 1991. Analysis of eye tracking movements using innovations generated by a kalman filter. Medical and biological Engineering and Computing 29, 1, 63--69.
    [26]
    Stampe, D. M. 1993. Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems. Behavior Research Methods, Instruments, & Computers 25, 2, 137--142.
    [27]
    Tafaj, E., Kasneci, G., Rosenstiel, W., and Bogdan, M. 2012. Bayesian online clustering of eye movement data. In Proceedings of the Symposium on Eye Tracking Research and Applications, ACM, New York, NY, USA, ETRA '12, 285--288.
    [28]
    Vidal, M., Bulling, A., and Gellersen, H. 2011. Analysing eog signal features for the discrimination of eye movements with wearable devices. In Proceedings of the 1st international workshop on pervasive eye tracking & mobile eye-based interaction, ACM, 15--20.
    [29]
    Vidal, M., Bulling, A., and Gellersen, H. 2012. Detection of smooth pursuits using eye movement shape features. In Proceedings of the symposium on eye tracking research and applications, ACM, 177--180.
    [30]
    Vidal, M., Bulling, A., and Gellersen, H. 2013. Pursuits: spontaneous interaction with displays based on smooth pursuit eye movement and moving targets. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing, ACM, 439--448.

    Cited By

    View all
    • (2024)Strategies for enhancing automatic fixation detection in head-mounted eye trackingBehavior Research Methods10.3758/s13428-024-02360-0Online publication date: 9-Apr-2024
    • (2024)A review of machine learning in scanpath analysis for passive gaze-based interactionFrontiers in Artificial Intelligence10.3389/frai.2024.13917457Online publication date: 5-Jun-2024
    • (2024)Detection of visual pursuits using 1D convolutional neural networksPattern Recognition Letters10.1016/j.patrec.2024.01.020179:C(45-51)Online publication date: 1-Mar-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ETRA '16: Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications
    March 2016
    378 pages
    ISBN:9781450341257
    DOI:10.1145/2857491
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 March 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. classification
    2. dynamic stimuli
    3. eye-tracking
    4. model
    5. online
    6. open-source
    7. probabilistic
    8. smooth pursuit

    Qualifiers

    • Research-article

    Conference

    ETRA '16
    ETRA '16: 2016 Symposium on Eye Tracking Research and Applications
    March 14 - 17, 2016
    South Carolina, Charleston

    Acceptance Rates

    Overall Acceptance Rate 69 of 137 submissions, 50%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)77
    • Downloads (Last 6 weeks)10

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Strategies for enhancing automatic fixation detection in head-mounted eye trackingBehavior Research Methods10.3758/s13428-024-02360-0Online publication date: 9-Apr-2024
    • (2024)A review of machine learning in scanpath analysis for passive gaze-based interactionFrontiers in Artificial Intelligence10.3389/frai.2024.13917457Online publication date: 5-Jun-2024
    • (2024)Detection of visual pursuits using 1D convolutional neural networksPattern Recognition Letters10.1016/j.patrec.2024.01.020179:C(45-51)Online publication date: 1-Mar-2024
    • (2024)Gaze analysisImage and Vision Computing10.1016/j.imavis.2024.104961144:COnline publication date: 1-Apr-2024
    • (2023)An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile DevicesACM Computing Surveys10.1145/360694756:2(1-38)Online publication date: 15-Sep-2023
    • (2023)A Practical, Robust, Accurate Gaze-Based Intention Inference Method for Everyday Human-Robot Interaction2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53992.2023.10394422(2054-2061)Online publication date: 1-Oct-2023
    • (2023)Improving Deep Learning-Based Eye Movements Classification Using Bayesian Optimization2023 IEEE International Biomedical Instrumentation and Technology Conference (IBITeC)10.1109/IBITeC59006.2023.10390966(197-202)Online publication date: 9-Nov-2023
    • (2023)Eye Movement Detection Using Self-Supervised Deep Learning2023 China Automation Congress (CAC)10.1109/CAC59555.2023.10451516(1799-1804)Online publication date: 17-Nov-2023
    • (2023)‘Labelling the Gaps’: A Weakly Supervised Automatic Eye Gaze EstimationComputer Vision – ACCV 202210.1007/978-3-031-26316-3_44(745-763)Online publication date: 2-Mar-2023
    • (2022)Online eye-movement classification with temporal convolutional networksBehavior Research Methods10.3758/s13428-022-01978-255:7(3602-3620)Online publication date: 11-Oct-2022
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media

    -