Evaluating gesture user interfaces: : Quantitative measures, qualitative scales, and method
References
[1]
Archer D., Unspoken diversity: Cultural differences in gestures, Qual. Sociol. 20 (1) (1997) 79–105,.
[2]
Bachmann D., Weichert F., Rinkenauer G., Review of three-dimensional human-computer interaction with focus on the leap motion controller, Sensors 18 (7) (2018) 2194,.
[3]
Barclay K., Wei D., Lutteroth C., Sheehan R., A quantitative quality model for gesture based user interfaces, in: Proceedings of the 23rd Australian Computer-Human Interaction Conference, OzCHI ’11, Association for Computing Machinery, New York, NY, USA, 2011, pp. 31–39,.
[4]
van Beurden M.H.P.H., Ijsselsteijn W.A., de Kort Y.A.W., User experience of gesture based interfaces: A comparison with traditional interaction methods on pragmatic and hedonic qualities, in: Efthimiou E., Kouroupetroglou G., Fotinea S.-E. (Eds.), Gesture and Sign Language in Human-Computer Interaction and Embodied Communication, Proc. of Gesture and Sign Language in Human-Computer Interaction and Embodied Communication, in: Lecture Notes in Computer Science, vol. 7206, GW’11, Springer, Berlin, Heidelberg, 2012, pp. 36–47,. URL: https://link.springer.com/chapter/10.1007/978-3-642-34182-3_4.
[5]
Bhuiyan M., Picking R., A gesture controlled user interface for inclusive design and evaluative study of its usability, J. Softw. Eng. Appl. 4 (9) (2011) 513–521,.
[6]
Boyatzis R.E., Transforming Qualitative Information: Thematic Analysis and Code Development, SAGE, 1998, ZSCC: 0017594 Google-Books-ID: _rfClWRhIKAC.
[7]
Braun V., Clarke V., Using thematic analysis in psychology, Qual. Res. Psychol. 3 (2) (2006) 77–101,. URL: https://www.tandfonline.com/doi/abs/10.1191/1478088706qp063oa. Number: 2 ZSCC: 0099387 Publisher: Routledge _eprint: https://www.tandfonline.com/doi/pdf/10.1191/1478088706qp063oa.
[8]
Brooke J., SUS-A ’quick and dirty’ usability scale, in: Usability Evaluation in Industry, CRC Press, London, UK, 1996, pp. 189–194,. URL: https://www.taylorfrancis.com/chapters/edit/10.1201/9781498710411-35/sus-quick-dirty-usability-scale-john-brooke.
[9]
Calvary G., Coutaz J., Thevenin D., Limbourg Q., Bouillon L., Vanderdonckt J., A Unifying Reference Framework for multi-target user interfaces, Interact. Comput. 15 (3) (2003) 289–308,.
[10]
Chuan N.K., Sivaji A., Ahmad W.F.W., Proposed usability heuristics for testing gestural interaction, in: Proceedings of 4th International Conference on Artificial Intelligence with Applications in Engineering and Technology, ICAIET ’14, IEEE Computer Society Press, Los Alamitos, 2014, pp. 233–238,. URL: https://ieeexplore.ieee.org/document/7351840.
[11]
Chuan N.K., Sivaji A., Ahmad W.F.W., Usability heuristics for heuristic evaluation of gestural interaction in HCI, in: Marcus A. (Ed.), Design, User Experience, and Usability: Design Discourse, in: Lecture Notes in Computer Science, vol. 9186, Springer International Publishing, Cham, 2015, pp. 138–148,. URL: https://link.springer.com/chapter/10.1007/978-3-319-20886-2_14.
[12]
Cockburn A., Gutwin C., Scarr J., Malacria S., Supporting novice to expert transitions in user interfaces, ACM Comput. Surv. 47 (2) (2014),.
[13]
Dix A., Finlay J., Abowd G., Beale R., Evaluation techniques, in: Human-Computer Interaction, Pearson Education Limited England, 2004.
[14]
Farhadi-Niaki F., Etemad S.A., Arya A., Design and usability analysis of gesture-based control for common desktop tasks, in: Kurosu M. (Ed.), Proceedings of International Conference on Human-Computer Interaction HCI ’13, Human-Computer Interaction. Interaction Modalities and Techniques, in: Lecture Notes in Computer Science, vol. 8007, Springer, Berlin, Heidelberg, 2013, pp. 215–224,.
[15]
Fonseca Brandao A., Casseb R., Almeida S., Assis G., Camargo A., Min L.L., Castellano G., Investigation of fMRI protocol for evaluation of gestural interaction applied to upper-limb motor improvement, SBC J. Interact. Syst. 10 (1) (2019) URL: https://seer.ufrgs.br/index.php/jis/article/view/84779.
[16]
Graichen L., Graichen M., Krems J.F., Evaluation of gesture-based in-vehicle interaction: User experience and the potential to reduce driver distraction, Hum. Fact. 61 (5) (2019) 774–792,. PMID: 30694705.
[17]
Grossman T., Fitzmaurice G., Attar R., A survey of software learnability: metrics, methodologies and guidelines, in: Proceedings of the ACM Conference on Human Factors in Computing Systems, CHI ’09, Association for Computing Machinery, New York, NY, USA, 2009, pp. 649–658,.
[18]
Guerino G.C., Valentim N.M.C., Usability and user experience evaluation of natural user interfaces: a systematic mapping study, IET Softw. 14 (5) (2020) 451–467,. arXiv:https://ietresearch.onlinelibrary.wiley.com/doi/pdf/10.1049/iet-sen.2020.0051. URL: https://ietresearch.onlinelibrary.wiley.com/doi/abs/10.1049/iet-sen.2020.0051.
[19]
Hart S.G., Staveland L.E., Development of NASA-TLX (task load index): Results of empirical and theoretical research, in: Hancock P.A., Meshkati N. (Eds.), Human Mental Workload, in: Advances in Psychology, vol. 52, North-Holland, 1988, pp. 139–183,. URL: http://www.sciencedirect.com/science/article/pii/S0166411508623869.
[20]
Hassenzahl M., The interplay of beauty, goodness, and usability in interactive products, Hum.-Comput. Interact. 19 (4) (2008) 319–349,.
[21]
Hinderks A., Winter D., Schrepp M., Thomaschewski J., Applicability of user experience and usability questionnaires, J. Univers. Comput. Sci. 25 (13) (2019) 1717–1735. URL: http://www.jucs.org/jucs_25_13/applicability_of_user_experience.
[22]
Holbrook M.B., Hirschman E.C., The experiential aspects of consumption consumer fantasies, feelings, and fun, J. Consum. Res. 9 (2) (1982) 132–140,. Number: 2 ZSCC: 0009838.
[23]
ISO M.B., ISO/IEC 9241, Ergonomics of Human-System Interaction — Part 11: Usability: Definitions and Concepts, International Standard Organization, Geneva, 2018, URL: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:en.
[24]
ISO M.B., ISO/IEC 25010 - Software Quality Product Standard, International Standard Organization, Geneva, 2019, URL: https://iso25000.com/index.php/en/iso-25000-standards/iso-25010?limit=3&limitstart=0.
[25]
Kendall M., Babington Smith B., The problem of m rankings, Ann. Math. Stat. 10 (3) (1939) 275–287. URL: http://www.jstor.org/stable/2235668.
[26]
Lewis J.R., Sauro J., The factor structure of the system usability scale, in: Kurosu M. (Ed.), Human Centered Design, Springer Berlin Heidelberg, Berlin, Heidelberg, 2009, pp. 94–103.
[27]
Likert R., A technique for the measurement of attitudes, Arch. Psychol. 22 (140) (1932) 55. URL: http://psycnet.apa.org/record/1933-01885-001.
[28]
Mackamul E., Improving the discoverability of interactions in interactive systems, in: Extended Abstracts of the ACM CHI Conference on Human Factors in Computing Systems, in: CHI EA ’22, Association for Computing Machinery, New York, NY, USA, 2022, pp. 1–5,.
[29]
Magal S.R., Levenburg N.M., Using importance-performance analysis to evaluate E-business strategies among small businesses, in: Proceedings of 38th Hawaii International Conference on System Sciences, in: HICSS-38, IEEE Computer Society, 2005, p. 176a,.
[30]
Martilla J.A., James J.C., Importance-performance analysis, J. Mark. 41 (1) (1977) 77–79,.
[31]
Montero C.S., Alexander J., Marshall M.T., Subramanian S., Would you do that? Understanding social acceptance of gestural interfaces, in: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI ’10, Association for Computing Machinery, New York, NY, USA, 2010, pp. 275–278,.
[32]
Nacenta M.A., Kamber Y., Qiang Y., Kristensson P.O., Memorability of pre-designed and user-defined gesture sets, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’13, Association for Computing Machinery, New York, NY, USA, 2013, pp. 1099–1108,.
[33]
Neca J., Duarte C., Evaluation of gestural interaction with and without voice commands, in: Proceedings of IADIS International Conference Interfaces and Human Computer Interaction, in: IHCI 2011, 2011, pp. 69–76. URL: http://www.iadisportal.org/digital-library/evaluation-of-gestural-interaction-with-and-without-voice-commands.
[34]
Nielsen J., Usability Engineering, in: Interactive Technologies, Elsevier Science, 1994, URL: https://books.google.be/books?id=95As2OF67f0C.
[35]
Norman D.A., Nielsen J., Gestural interfaces: A step backward in usability, Interactions 17 (5) (2010) 46–49,.
[36]
Parthiban V., Maes P., Sellier Q., Sluÿters A., Vanderdonckt J., Gestural-vocal coordinated interaction on large displays, in: Companion of the 2022 ACM SIGCHI Symposium on Engineering Interactive Computing Systems, in: EICS ’22 Companion, Association for Computing Machinery, New York, NY, USA, 2022, pp. 26–32,.
[37]
Rico J., Brewster S., Gestures all around us: User differences in social acceptability perceptions of gesture based interfaces, in: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’09, Association for Computing Machinery, New York, NY, USA, 2009, pp. 1–2,.
[38]
Riedel A.S., Weeks C.S., Beatson A.T., Am I intruding? Developing a conceptualisation of advertising intrusiveness, J. Mark. Manag. 34 (9–10) (2018) 750–774,.
[39]
Rohrer C., When to use which user-experience research methods, 2014, URL: https://www.nngroup.com/articles/which-ux-research-methods/.
[40]
Schrepp M., Hinderks A., Thomaschewski J., Construction of a benchmark for the user experience questionnaire (UEQ), Int. J. Interact. Multim. Artif. Intell. 4 (4) (2017) 40–44,.
[41]
Schrepp M., Thomaschewski J., Design and validation of a framework for the creation of user experience questionnaires, Int. J. Interact. Multim. Artif. Intell. 5 (7) (2019) 88–95,.
[42]
Siean A., Pamparau C., Sluÿters A., Vatavu R., Vanderdonckt J., Flexible gesture input with radars: systematic literature review and taxonomy of radar sensing integration in ambient intelligence environments, J. Ambient Intell. Humaniz. Comput. 14 (6) (2023) 7967–7981,.
[43]
Sluÿters A., Sellier Q., Vanderdonckt J., Parthiban V., Maes P., Consistent, continuous, and customizable mid-air gesture interaction for browsing multimedia objects on large displays, Int. J. Hum.-Comput. Interact. 39 (12) (2022) 2492–2523,.
[44]
Valos M.J., Maplestone V.L., Polonsky M.J., Ewing M., Integrating social media within an integrated marketing communication decision-making framework, J. Mark. Manag. 33 (17–18) (2017) 1522–1558,. Number: 17-18 ZSCC: 0000044 Publisher: Routledge _eprint: DOI: 10.1080/0267257X.2017.1410211.
[45]
Vatavu R.-D., Wobbrock J.O., Formalizing agreement analysis for elicitation studies: New measures, significance test, and toolkit, in: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, Association for Computing Machinery, New York, NY, USA, 2015, pp. 1325–1334,.
[46]
Vermeeren A.P.O.S., Law E.L.-C., Roto V., Obrist M., Hoonhout J., Väänänen-Vainio-Mattila K., User experience evaluation methods: Current state and development needs, in: Proceedings of the 6th Nordic Conference on Human-Computer Interaction, NordiCHI ’10, Association for Computing Machinery, New York, NY, USA, 2010, pp. 521–530,.
[47]
Villarreal-Narvaez S., Sluÿters A., Vanderdonckt J., Vatavu R.-D., Brave new GES world: A systematic literature review of gestures and referents in gesture elicitation studies, ACM Comput. Surv. 56 (5) (2024),.
[48]
Vogiatzidakis P., Koutsabasis P., ‘Address and command’: Two-handed mid-air interactions with multiple home devices, Int. J. Hum.-Comput. Stud. 159 (2022),. URL: https://www.sciencedirect.com/science/article/pii/S1071581921001737.
[49]
Wachs J.P., Kölsch M., Stern H., Edan Y., Vision-based hand-gesture applications, Commun. ACM 54 (2) (2011) 60–71,.
[50]
Walter R., Bailly G., Müller J., StrikeAPose: Revealing mid-air gestures on public displays, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’13, Association for Computing Machinery, New York, NY, USA, 2013, pp. 841–850,.
[51]
Wickeroth D., Benölken P., Lang U., Manipulating 3D content using gestures in design review scenarios, Int. J. Inf. Stud. 1 (2009) 242–250,. URL: https://www.semanticscholar.org/paper/Manipulating-3D-Content-using-Gestures-in-Design-Wickeroth-Ben36lken.
[52]
Wigdor D., Wixon D., Brave NUI World: Designing Natural User Interfaces for Touch and Gesture, Morgan Kaufmann, 2011,. Accessible at https://www.sciencedirect.com/book/9780123822314/brave-nui-world.
[53]
Williamson J.R., User Experience, Performance, and Social Acceptability: Usable Multimodal Mobile Interaction, (Ph.D. thesis) University of Glasgow, 2012, URL: https://eleanor.lib.gla.ac.uk/record=b2922742. ZSCC: 0000014.
[54]
Wobbrock J.O., Morris M.R., Wilson A.D., User-defined gestures for surface computing, in: Proc. of the ACM Int. Conf. on Human Factors in Computing Systems, CHI ’09, ACM, New York, NY, USA, 2009, pp. 1083–1092,. URL: http://doi.acm.org/10.1145/1518701.1518866.
[55]
Xia H., Glueck M., Annett M., Wang M., Wigdor D., Iteratively designing gesture vocabularies: A survey and analysis of best practices in the hci literature, ACM Trans. Comput.-Hum. Interact. 29 (4) (2022) 1–54,. URL: https://dl.acm.org/doi/10.1145/3503537.
[56]
Yee W., Potential limitations of multi-touch gesture vocabulary: Differentiation, adoption, fatigue, in: Jacko J.A. (Ed.), Proc. of 13th International Conference on Human-Computer Interaction, Novel Interaction Methods and Techniques, HCI’ International 2009, in: Lecture Notes in Computer Science, vol. 5611, Springer, 2009, pp. 291–300,.
Recommendations
Towards a human-computer interaction model for voice user interfaces
CLIHC '19: Proceedings of the IX Latin American Conference on Human Computer InteractionThe user interaction with computer systems has evolved over the years, from Command Line Interfaces (CLIs), Graphics User Interfaces (GUIs), Natural User Interfaces (NUIs) and actually Voice User Interfaces (VUIs). The use of VUIs is increasingly common,...
Designing, Engineering, and Evaluating Gesture User Interfaces
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsThis course will introduce participants to the three main stages of the development life cycle of gesture-based interactions: (ul) how to design a gesture user interface (UI) by carefully considering key aspects, such as gesture recognition techniques, ...
Hard-to-use interfaces considered beneficial (some of the time)
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsResearchers in HCI share a common understanding that 'easy-to-use', 'easy-to-learn' and 'intuitive' interfaces are beneficial to users. Designing such interfaces raises challenges and often requires multiple iterations. While we are generally prompt to ...
Comments
Information & Contributors
Information
Published In
Elsevier Ltd.
Publisher
Academic Press, Inc.
United States
Publication History
Published: 25 June 2024
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in