article

Eye-blink detection system for human---computer interaction

Authors:

Aleksandra Królak and

Paweł StrumiłłoAuthors Info & Claims

Universal Access in the Information Society, Volume 11, Issue 4

Pages 409 - 419

https://doi.org/10.1007/s10209-011-0256-6

Published: 01 November 2012 Publication History

Abstract

A vision-based human--computer interface is presented in the paper. The interface detects voluntary eye-blinks and interprets them as control commands. The employed image processing methods include Haar-like features for automatic face detection, and template matching based eye tracking and eye-blink detection. Interface performance was tested by 49 users (of which 12 were with physical disabilities). Test results indicate interface usefulness in offering an alternative mean of communication with computers. The users entered English and Polish text (with average time of less than 12s per character) and were able to browse the Internet. The interface is based on a notebook equipped with a typical web camera and requires no extra light sources. The interface application is available on-line as open-source software.

References

[1]

Starner, T., Weaver, J., Pentland, A.: A wearable computer based American sign language recognizer. Assist. Technol. Artif. Intell. 84---96 (1998)

[2]

Materka, A., Byczuk, M.: Alternate half-field simulation technique for SSVEP-based brain---computer interfaces. Electron. Lett. 42(6), 321---322 (2006)

[3]

Ghaoui, C.: Encyclopedia of Human Computer Interaction. Idea Group Reference (2006)

[4]

Thoumies, P., Charlier, J.R., Alecki, M., d'Erceville, D., Heurtin, A., Mathe, J.F., Nadeau, G., Wiart, L.: Clinical and functional evaluation of a gaze controlled system for the severely handicapped. Spinal Cord. 36, 104---109 (1998)

[5]

Gips, J., DiMattia, P., Curran, F., Olivieri, P.: Using EagleEyes-an electrodes based device for controlling the computer with your eyes-to help people with special needs. In: Proceedings of the 5th International Conference on Computers Helping People with Special Needs, vol. 1, pp. 77---83 (1996)

[6]

Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society, vol. 1, pp. 511---518 (2001)

[7]

Oguz, O.: The proportion of the face in younger adults using the thumb rule of Leonardo da Vinci. J. Surg. Radiol. Anat. 18(2), 111---114 (1996)

[8]

Seki, M., Shimotani, M., Nishida, M.: A study of blink detection using bright pupils. JSAE Rev. 19, 49---67 (1998)

[9]

Kocejko, T., Bujnowski, A., Wtorek, J.: Eye mouse for disabled. Conference on Human System Interactions, pp. 199---202 (2008)

[10]

Horng, W.B., Chen, C.Y., Chang, Y., Fan, C.H.: Driver fatigue detection based on eye tracking and dynamic template matching. In: Proceedings of of IEEE International Conference on Networking, Sensing and Control, pp. 7---12 (2004)

[11]

Królak, A., Strumiłło, P.: Fatigue monitoring by means of eye blink analysis in image sequences. ICSES 1, 219---222 (2006)

[12]

Zhou, Z.H., Geng, X.: Projection functions for eye detection. Pattern Recognit. 37(5), 1049---1056 (2004)

[13]

Kawaguchi, T., Hidaka, D., Rizon, M.: Detection of eyes from human faces by Hough transform and separability filters. In: Proceedings of International Conference on Image Processing, vol. 1, pp. 49---52 (2000)

[14]

Li, J.-W.: Eye blink detection based on multiple Gabor response waves. In: Proceedings of the 7th International Conference on Machine Learning and Cybernetics, pp. 2852---2856 (2008)

[15]

Bradski, G., Keahler, A., Pisarevsky, V.: Learning-based computer vision with intel's open source computer vision library. Intel Technol. J. 9(2), 119---130 (2005)

[16]

Królak, A., Strumiłło, P.: Eye-blink controlled human---computer interface for the disabled. Advances Intell. Soft Comput. 60, 133---144 (2009)

[17]

Yuille, A.L., Cohen, D.S., Hallinan, P.W.: Feature extraction from faces using deformable template. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 104---109 (1989)

[18]

http://www.a-s-l.co. Last visited May 2009

[19]

Magee, J.J., Scott, M.R., Waber, B.N., Betke, M.: EyeKeys: A real-time vision interface based on gaze detection from a low-grade video camera. Conference on Computer Vision and Pattern Recognition Workshop, CVPRW '04., pp. 159---159 (2004)

[20]

Yow, K.C., Cipolla, R.: Feature-based human face detection. Image Vis. Comput. 15(9), 713---735 (1997)

[21]

McKenna, S., Gong, S., Raja, Y.: Modelling facial colour and identity with gaussian mixtures. Pattern Recognit. 31(12), 1883---1892 (1998)

[22]

Lanitis, C.J., Taylor, T.F.C.: An automatic face identification system using flexible appearance models. Image Vis. Comput. 13(5), 393---401 (1995)

[23]

Rowley, H.A., Baluja, S., Kanade, T.: Neural network-based face detection. IEEE Trans. Pattern Anal. Mach. Intell. 20(1), 23---38 (1998)

Digital Library

[24]

Osuna, E., Freund, R., Girosi, F.: Training support vector machines: An application to face detection. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 130---136 (1997)

Digital Library

[25]

Rajagopalan, K., Kumar, J., Karlekar, R., Manivasakan, M., Patil, U., Desai, P., Poonacha, S., Chaudhuri: Finding faces in photographs. In: Proceedings of Sixth IEEE International Conference on Computer Vision, pp. 640---645 (1998)

Digital Library

[26]

Leinhart, R., Maydt, J.: An extended set of Haar-like features. In: Proceedings of International Conference on Image Processing, pp. 900---903 (2002)

[27]

Freund, Y., Schapire, R.E.: A short introduction to boosting. J. Jap. Soci. Artif. Intell. 14(5), 771---780 (1999)

[28]

Yang G., Huang, T.S.: Human face detection in complex background. Pattern Recognit. 27(1), 53---63 (1994)

[29]

Grauman, K., Betke, M., Lombardi, J., Gips, J., Bradski, G.R.: Communication via eye blinks and eyebrow raises: Video-based human---computer interfaces. Universal Access in the Information Society, 2(4), 359---373 (2002)

[30]

MacKenzie, I.S., Ashtiani, B.: BlinkWrite: efficient text entry using eye blinks. Universal Access in the Information Society, Online First (2010)

[31]

Magee, J.J., Scott, M.R., Waber, B.N., Betke, M.: EyeKeys: A real-time vision interface based on gaze detection from a low-grade video camera. Conference on Computer Vision and Pattern Recognition Workshop, pp.159---159 (2004)

[32]

Safety of laser products--Part 1: Equipment classification and requirements (2nd ed.), International Electrotechnical Commission (2007)

Cited By

Zhang CChen TShaffer ESoltanaghai E(2024)FocusFlow: 3D Gaze-Depth Interaction in Virtual Reality Leveraging Active Visual Depth ManipulationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642589(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642589
Grootjen JWeingärtner HMayer S(2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642086
Ghosh SDhall AHayat MKnibbe JJi Q(2024)Automatic Gaze Analysis: A Survey of Deep Learning Based ApproachesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332133746:1(61-84)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TPAMI.2023.3321337
Show More Cited By

Index Terms

Eye-blink detection system for human---computer interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Scene understanding
2. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Eyelid contour detection and tracking for startle research related eye-blink measurements from high-speed video records

Using the positions of the eyelids is an effective and contact-free way for the measurement of startle induced eye-blinks, which plays an important role in human psychophysiological research. To the best of our knowledge, no methods for an efficient ...
Read More
An eye detection and localization system for natural human and robot interaction without face detection
TAROS'11: Proceedings of the 12th Annual conference on Towards autonomous robotic systems

There were many eye localization algorithms depending on face detection in the literature. Differently this paper presents a novel eye detection and localization system not depending on face detection for natural human and robot interaction using both ...
Read More
Eye Blink Detection for Smart Glasses
ISM '13: Proceedings of the 2013 IEEE International Symposium on Multimedia

Eye blink is a quick action of closing and opening of the eyelids. Eye blink detection has a wide range of applications in human computer interaction and human vision health care research. Existing approaches to eye blink detection often cannot suit ...
Read More

Comments

Information & Contributors

Information

Published In

cover image Universal Access in the Information Society

Universal Access in the Information Society Volume 11, Issue 4

November 2012

84 pages

ISSN:1615-5289

EISSN:1615-5297

Issue’s Table of Contents

Copyright © Copyright © 2012 Springer-Verlag Berlin Heidelberg.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 November 2012

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Zhang CChen TShaffer ESoltanaghai E(2024)FocusFlow: 3D Gaze-Depth Interaction in Virtual Reality Leveraging Active Visual Depth ManipulationProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642589(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642589
Grootjen JWeingärtner HMayer S(2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642086
Ghosh SDhall AHayat MKnibbe JJi Q(2024)Automatic Gaze Analysis: A Survey of Deep Learning Based ApproachesIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.332133746:1(61-84)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TPAMI.2023.3321337
Chhimpa GKumar AGarhwal SDhiraj (2024)Empowering individuals with disabilities: a real-time, cost-effective, calibration-free assistive system utilizing eye trackingJournal of Real-Time Image Processing10.1007/s11554-024-01478-w21:3Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1007/s11554-024-01478-w
Wan TShi RXu WLi YAtkinson KYu LLiang H(2024)Hands-free multi-type character text entry in virtual realityVirtual Reality10.1007/s10055-023-00902-z28:1Online publication date: 3-Jan-2024
https://dl.acm.org/doi/10.1007/s10055-023-00902-z
Gizatdinova YŠpakov OTuisku OTurk MSurakka V(2023)Vision-Based Interfaces for Character-Based Text EntryAdvances in Human-Computer Interaction10.1155/2023/88557642023Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1155/2023/8855764
Cheng HLou WYang YChen YZhang X(2023)TwinkleTwinkleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35962387:2(1-30)Online publication date: 12-Jun-2023
https://dl.acm.org/doi/10.1145/3596238
Wang YLu WZhao HJiang XZheng BAtkins S(2023)Detecting Blinks from Wearable Cameras using Spatial-Temporal-Aware Deep Network LearningProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3589668(1-7)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3589668
Grootjen JWeingärtner HMayer S(2023)Highlighting the Challenges of Blinks in Eye Tracking for Interactive SystemsProceedings of the 2023 Symposium on Eye Tracking Research and Applications10.1145/3588015.3589202(1-7)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.1145/3588015.3589202
Huang LEladhari MMagnússon SChen HGuo R(2023)Improving and Analyzing Sketchy High-Fidelity Free-Eye DrawingProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596121(856-870)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596121
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents

-