research-article

Assessing surgeons' skill level in laparoscopic cholecystectomy using eye metrics

Authors:

Nishan Gunawardena,

Michael Matscheko,

Bernhard Anzengruber,

Martin Schobesberger,

Andreas Shamiyeh,

Bettina Klugsberger,

Peter SollederAuthors Info & Claims

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Article No.: 30, Pages 1 - 8

https://doi.org/10.1145/3314111.3319832

Published: 25 June 2019 Publication History

Abstract

Laparoscopic surgery has revolutionised state of the art in surgical health care. However, its complexity puts a significant burden on the surgeon's cognitive resources resulting in major biliary injuries. With the increasing number of laparoscopic surgeries, it is crucial to identify surgeons' cognitive loads (CL) and levels of focus in real time to give them unobtrusive feedback when detecting the suboptimal level of attention. Assuming that the experts appear to be more focused on attention, we investigate how the skill level of surgeons during live surgery is reflected through eye metrics. Forty-two laparoscopic surgeries have been conducted with four surgeons who have different expertise levels. Concerning eye metrics, we have used six metrics which belong to fixation and pupillary based metrics. With the use of mean, standard deviation and ANOVA test we have proven three reliable metrics which we can use to differentiate the skill level during live surgeries. In future studies, these three metrics will be used to classify the surgeons' cognitive load and level of focus during the live surgery using machine learning techniques.

References

[1]

Riaz Agha and Gordon Muir. 2003. Does laparoscopic surgery spell the end of the open surgeon? Journal of the Royal Society of Medicine 96, 11 (nov 2003), 544--6. http://www.ncbi.nlm.nih.gov/ /14594961http://www.central.nih.gov/articlerender.fcgi?artid=PMC539626

[2]

Waheeb R Al-Kubati. 2010. Bile duct injuries following laparoscopic cholecystectomy: A clinical study. Saudi journal of gastroenterology: official journal of the Saudi Gastroenterology Association 16, 2 (2010), 100--4.

[3]

James R. Antes. 1974. The time course of picture viewing. Journal of Experimental Psychology 103, 1 (1974), 62--70.

[4]

Francis Aveling and Robert John Stewart McDowall. 1925. The effect of the circulation on the electrical resistance of the skin. The Journal of physiology 60, 4 (1925), 316--321.

[5]

Raymond Bertram, Laura Helle, Johanna K. Kaakinen, and Erkki Svedström. 2013. The Effect of Expertise on Eye Movement Behaviour in Medical Image Perception. PLoS ONE 8, 6 (2013).

[6]

Magdalena Borys and Malgorzata Plechawska-Wójcik. 2017. Eye-tracking metrics in perception and visual attention research. Technical Report 16. 11--23 pages. www.medical-technologies.eu

[7]

Andreas Brocher, Raphael Harbecke, Tim Graf, Daniel Memmert, and Stefanie Hüttermann. 2018. Using task effort and pupil size to track covert shifts of visual attention independently of a pupillary light reflex. Behavior Research Methods 50, 6 (01 Dec 2018), 2551--2567.

[8]

Jacob T. Brown, Mark Connelly, Caitlin Nickols, and Kathleen A. Neville. 2015. Developmental Changes of Normal Pupil Size and Reactivity in Children. Journal of Pediatric Ophthalmology & Strabismus 52, 3 (2015), 147--151.

[9]

Marc Brysbaert, Denis Drieghe, and Françoise Vitu. 1998. Word skipping: implication for theories of eye movement control in reading. September (1998).

[10]

G.T Buswell. 1935. How People Look at Pictures. University of Chicago Press. http://wexler.free.fr/library/files/buswell(1935)howpeoplelookatpictures.pdf

[11]

Zoya Bylinskii and Michelle Borkin. 2015. Eye Fixation Metrics for Large Scale Analysis of Information Visualizations.

[12]

Neil Charness, Eyal M Reingold, Marc Pomplun, and Dave M Stampe. 2001. The perceptual aspect of skilled performance in chess: Evidence from eye movements. Technical Report 8. 1146--1152 pages.

[13]

Denis Drieghe, Marc Brysbaert, Timothy Desmet, and Constantijn De Baecke. 2004. Word skipping in reading: On the interplay of linguistic and visual factors. European Journal of Cognitive Psychology 16, 1--2 (2004), 79--103.

[14]

Andrew T Duchowski, Krzysztof Krejtz, Izabela Krejtz, Cezary Biele, Anna Niedzielska, Peter Kiefer, Martin Raubal, and Ioannis Giannopoulos. 2018. The Index of Pupillary Activity Measuring Cognitive Load vis-à-vis Task Difficulty with Pupil Oscillation. (2018).

Digital Library

[15]

K. Anders Ericsson. 2007. An expert-performance perspective of research on medical expertise: The study of clinical performance. Medical Education 41, 12 (2007), 1124--1130.

[16]

Rahul Gavas, Debatri Chatterjee, and Aniruddha Sinha. 2017. Estimation of cognitive load based on the pupil size dilation. 2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017 2017-Janua (2017), 1499--1504.

Digital Library

[17]

J. M. Hamdorf and J. C. Hall. 2000. Acquiring surgical skills. British Journal of Surgery 87, 1 (jan 2000), 28--37.

[18]

Taylor R Hayes and Alexander A Petrov. 2015. Pupil Diameter Tracks the Exploration-Exploitation Trade-off during Analogical Reasoning and Explains Individual Differences in Fluid Intelligence. (2015).

Digital Library

[19]

Daniel Kahneman. 1973. Attention and Effort Englewood Cliffs, New Jersey. Englewood Cliffs, NJ. 17--24 pages.

[20]

William E. Kelley. 2008. The evolution of laparoscopy and the revolution in surgery in the decade of the 1990s. JSLS: Journal of the Society of Laparoendoscopic Surgeons 12, 4 (2008), 351--7. http://www.ncbi.nlm.nih.gov/ /19275847

[21]

Panos Konstantopoulos, Peter Chapman, and David Crundall. 2010. Driver's visual attention as a function of driving experience and visibility. Accident Analysis and Prevention 42 (2010), 825--832.

[22]

Jan-Louis Kruger, Esté Hefer, and Gordon Matthew. 2013. Measuring the impact of subtitles on cognitive load. Proceedings of the 2013 Conference on Eye Tracking South Africa - ETSA '13 November 2015 (2013), 62--66.

Digital Library

[23]

David Manning, Susan Ethell, Tim Donovan, and Trevor Crawford. 2006. How do radiologists do it? The influence of experience and training on searching for chest nodules. Radiography 12, 2 (2006), 134--142.

[24]

Sandra Marshall. 2000. Method And Apparatus For Eye Tracking And Monitoring Pupil Dilation To Evaluate Cognitive Activity.

[25]

Sandra P Marshall. 2002. The Index of Cognitive Activity: Measuring Cognitive Workload. In Proceedings of the 2002 IEEE 7th Conference on Human Factors and Power Plants. IEEE, New York, 7.5 -- 7.9.

[26]

Geoff Norman, Kevin Eva, Lee Brooks, and Stan Hamstra. 2018. Expertise in Medicine and Surgery. May (2018).

[27]

Gennaro Nuzzo. 2005. Bile Duct Injury During Laparoscopic Cholecystectomy. Archives of Surgery 140, 10 (2005), 986.

[28]

Erik Peper, Rick Harvey, I-mei Lin, Hana Tylova, and Donald Moss. 2007. Is There More to Blood Volume Pulse Than Heart Rate Variability, Respiratory Sinus Arrhythmia, and Cardiorespiratory Synchrony? Biofedback 35, 2 (2007), 54--61.

[29]

Vsevolod Peysakhovich, Frédéric Dehais, and Mickaël Causse. 2015. ScienceDirect Pupil diameter as a measure of cognitive load during auditory-visual interference in a simple piloting task. Procedia Manufacturing 3 (2015), 5199--5205.

[30]

G. Picod, A. C. Jambon, D. Vinatier, and P. Dubois. 2005. What can the operator actually feel when performing a laparoscopy? Surgical Endoscopy 19,1 (jan 2005), 95--100.

[31]

Marc Pomplun and Sindhura Sunkara. 2003. Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction. Proceedings of the 10th International Conference on Human-Computer Interaction January 2003 (2003), 542--546.

[32]

Alex Poole and Linden J. Ball. 2004. Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects.

[33]

William Poynter, Megan Barber, Jason Inman, and Coral Wiggins. 2013. Individuals exhibit idiosyncratic eye-movement behavior profiles across tasks. (2013).

[34]

Keith Rayner and George W. McConkie. 1976. What guides a reader's eye movements? Vision Research 16, 8 (1976), 829--837.

[35]

Lee Richstone, Michael J. Schwartz, Casey Seideman, Jeffrey Cadeddu, Sandra Marshall, and Louis R. Kavoussi. 2010. Eye metrics as an objective assessment of surgical skill. Annals of Surgery 252, 1 (2010), 177--182.

[36]

Maximilian Schwalm, Andreas Keinath, and Hubert D Zimmer. 2008. Pupillometry as a method for measuring mental workload within a simulated driving task. Human Factors for assistance and automation January (2008), 1--13.

[37]

Nathaniel J Soper, L Michael Brunt, and Kurt Kerbl. 1994. Laparoscopic general surgery. New England Journal of Medicine 330 (1994), 409--419.

[38]

Ibnauf Suliman, Thanos Athanasiou, D Ph, Roger Kneebone, and Ara Darzi. 2009. What makes a competent surgeon?: Experts ' and trainees ' perceptions of the roles of a surgeon. AJS 198, 5 (2009), 726--732.

[39]

Pieter J.A. Unema, Sebastian Pannasch, Markus Joos, and Boris M. Velichkovsky. 2005. Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration. Visual Cognition 12, 3 (2005), 473--494.

[40]

Nereo Vettoretto, Cristiano Saronni, Asaf Harbi, Luca Balestra, Lucio Taglietti, and Maurizio Giovanetti. 2011. Critical view of safety during laparoscopic cholecystectomy. JSLS: Journal of the Society of Laparoendoscopic Surgeons 15, 3 (2011), 322--5.

Cited By

Grootjen JWeingärtner HMayer S(2024)Investigating the Effects of Eye-Tracking Interpolation Methods on Model Performance of LSTMProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656353(1-6)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3656353
Grootjen JWeingärtner HMayer S(2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642086
Popov VChen XWang JKemp MSandhu GKantor TMateju NWang X(2024)Looking Together ≠ Seeing the Same Thing: Understanding Surgeons' Visual Needs During Intra-operative Coordination and InstructionProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641929(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641929
Show More Cited By

Index Terms

Assessing surgeons' skill level in laparoscopic cholecystectomy using eye metrics
1. Applied computing
  1. Life and medical sciences
    1. Health care information systems
2. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Empirical studies in ubiquitous and mobile computing

Recommendations

Lean Six Sigma approach to the study of the LOS of patients who undergo laparoscopic cholecystectomy: a bicentric study
ICMHI '22: Proceedings of the 6th International Conference on Medical and Health Informatics

Laparoscopic cholecystectomy (LC) is considered the standard procedure for the treatment of gallstone. Compared to traditional surgery with the introduction of this procedure reduces the recovery time for a patient. According to literature, the ...
Deformable mesh simulation for virtual laparoscopic cholecystectomy training

Virtual simulation of laparoscopic surgery is getting attention for training novice surgeons and medical residents for practice. Virtual surgical simulation has many advantages because it can provide users with a safe environment without animal or ...
Detection of unsafe action from laparoscopic cholecystectomy video
IHI '12: Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium

Wellness and healthcare are central to the lives of all people, young or old, healthy or ill, rich or poor. New computing and behavioral research can lead to transformative changes in the cost-effective delivery of quality and personalized healthcare. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

June 2019

623 pages

ISBN:9781450367097

DOI:10.1145/3314111

Conference Chairs:
Krzysztof Krejtz
SWPS University, Poland
,
Bonita Sharif
University of Nebraska-Lincoln

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ETRA '19

Sponsor:

ETRA '19: 2019 Symposium on Eye Tracking Research and Applications

June 25 - 28, 2019

Colorado, Denver

Acceptance Rates

Overall Acceptance Rate 69 of 137 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
275
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Grootjen JWeingärtner HMayer S(2024)Investigating the Effects of Eye-Tracking Interpolation Methods on Model Performance of LSTMProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3656353(1-6)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3656353
Grootjen JWeingärtner HMayer S(2024)Uncovering and Addressing Blink-Related Challenges in Using Eye Tracking for Interactive SystemsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642086(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642086
Popov VChen XWang JKemp MSandhu GKantor TMateju NWang X(2024)Looking Together ≠ Seeing the Same Thing: Understanding Surgeons' Visual Needs During Intra-operative Coordination and InstructionProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641929(1-12)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641929
Vrzáková HTapiala JIso‐Mustajärvi MTimonen TDietz A(2024)Estimating Cognitive Workload Using Task‐Related Pupillary Responses in Simulated Drilling in Cochlear ImplantationThe Laryngoscope10.1002/lary.31612Online publication date: 11-Jul-2024
https://doi.org/10.1002/lary.31612
Lee ATorkamani-Azar MZheng BBednarik R(2023)Unpacking the Broad Landscape of Intraoperative Stressors for Clinical Personnel: A Mixed-Methods Systematic ReviewJournal of Multidisciplinary Healthcare10.2147/JMDH.S401325Volume 16(1953-1977)Online publication date: Jul-2023
https://doi.org/10.2147/JMDH.S401325
Gunawardena NGinige JJavadi B(2022)Eye-tracking Technologies in Mobile Devices Using Edge Computing: A Systematic ReviewACM Computing Surveys10.1145/354693855:8(1-33)Online publication date: 23-Dec-2022
https://dl.acm.org/doi/10.1145/3546938
Laube MHaslgrübler MAzadi BAnzengruber-Tánase BFerscha AMakedon F(2022)Skill Level Detection in Arc Welding towards an Assistance System for WorkersProceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3529190.3529206(73-82)Online publication date: 29-Jun-2022
https://dl.acm.org/doi/10.1145/3529190.3529206
Gunawardena NGinige AJavadi BLui G(2022)Mobile Device Eye Tracking on Dynamic Visual Contents using Edge Computing and Deep Learning2022 Symposium on Eye Tracking Research and Applications10.1145/3517031.3532198(1-3)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3517031.3532198
Popov VChen XKemp MSandhu GKantor TMateju NWang X(2022)Towards Supporting Intraoperative Coordination and Entrustment in Surgical Faculty-Resident Dyads: Looking Together ≠ Seeing the Same ThingExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519791(1-6)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519791

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents

-