research-article

Touchless gestural interaction with small displays: a case study

Authors:

Franca Garzotto and

Matteo ValorianiAuthors Info & Claims

CHItaly '13: Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI

September 2013

Article No.: 26, Pages 1 - 10

https://doi.org/10.1145/2499149.2499154

Published: 16 September 2013 Publication History

Abstract

Touchless gestural interaction enables users to interact with digital devices using body movements and gestures, and without the burden of a physical contact with technology (e.g., data gloves, body markers, or remote controllers). Most gesture-based touchless applications are designed for interaction with medium or, more often, large displays. Our research instead explores touchless gestural interaction "in-the- small", where the user interacts with small displays, of the size, for example, of a smart phone screen. Our work applies this to the domain of household appliances. We describe the design and evaluation of MOTIC (MOtion-based Touchless Interactive Cooking system), and highlight the complexity of employing touchless gestures to interact with visual interfaces constrained in size. This case study shows how existing design guidelines, mostly conceived for touchless gestural interaction "in the large", can be adapted and applied for gestural interaction in-the-small, and high-lights that touchless gestures have the potential of forming a valuable addition to our repertoire of interaction techniques with small displays.

References

[1]

Ali Bigdelou, Loren Arthur Schwarz, N. N. An adaptive solution for intra-operative gesture-based human-machine interaction. Proc. IUI 2012, ACM (2012), 75--84

Digital Library

[2]

Ashbrook, D., Starner, T. Magic: a motion gesture design tool. Proc. CHI 2010, ACM (2010), 2159--2168.

Digital Library

[3]

Baudel, T., and Beaudouin-Lafon, M. Charade: remote control of objects using free-hand gestures. CACM 36, 7 (1993), 28--35.

Digital Library

[4]

Bellucci, A., Malizia, A., Diaz, P., Aedo, I. Humandisplay interaction technology: Emerging remote interfaces for pervasive display environments. Pervasive Computing, IEEE 9, 2 (2010), 72--76.

Digital Library

[5]

Benavidez, P., and Jamshidi, M. Mobile robot navigation and target tracking system. Proc. SoSE 2011, (2011), 299--304.

[6]

Beyer, G., Alt, F., Müller, J., Schmidt, A., Isakovic, K., Klose, S., Schiewe, M., and Haulsen, I. Audience behavior around large interactive cylindrical screens. Proc. CHI 2011, ACM (2011), 1021--1030.

Digital Library

[7]

Cassell, J. A framework for gesture generation and interpretation. Computer Vision in Human-Machine Interaction (1998), 191--215.

[8]

De la Barré, R., Chojecki, P., Leiner, U., Mühlbach, L., and Ruschin, D. Touchless interaction-novel chances and challenges. In Human-Computer Interaction. Novel Interaction Methods and Techniques, J. Jacko, (ed.), LNCS 5611Springer (2009) 161--169.

Digital Library

[9]

Döring, T., Kern, D., Marshall, P., Pfeiffer, M., Schöning, S., Gruhn, V, Schmidt, A. Gestural interaction on the steering wheel: reducing the visual demand. Proc. CHI 2011, ACM (2011), 483--492

Digital Library

[10]

Grandhi, S. A., Joue, G., and Mittelberg, I. Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. Proc. CHI 2011, ACM (2011), 821--824.

Digital Library

[11]

http://www.microsoft.com/enus/kinectforwindows/

[12]

http://www.xbox.com/en us/kinect

[13]

Johnson, R., O'Hara, K., Sellen, A., Cousins, C., and Criminisi, A. Exploring the potential for touchless interaction in image-guided interventional radiology. Proc. CHI 2011, ACM (2011), 3323--3332.

Digital Library

[14]

Heydekorn, J., Frisch, M., Dachselt, R.: Prospects of user elicited gestural interaction techniques. CHI 2010 Workshop on Natural User Interfaces: The Prospect and Challenge of Touch and Gestural Computing.

[15]

Kuikkaniemi, K., Jacucci, G., Turpeinen, M., Hoggan, E., and Muandller, J. From space to stage: How interactive screens will change urban life. Computer 44, 6 (2011), 40--47.

Digital Library

[16]

Kurtenbach, G., and Hulteen., E. Gestures in Human-Computer Communication. Addison-Wesley(1990).

[17]

Maged N., Kamel B., Bryan J., Blanchard, C. W. J. M. A. T., and Gutierrez-Osuna, R. Web gis in practice: a microsoft kinect natural user interface for google earth navigation. Int. J. health geographics (2011), 10--45.

[18]

Malizia, A. and Bellucci, A. The artificiality of natural user interfaces. CACM 55, 3 (March 2012), 36--38.

Digital Library

[19]

Ng, J., Sim, T.-J., Foo, Y.-S., and Yeo, V. Gesture-based interaction with virtual 3d objects on large display: what makes it fun? Proc. CHI EA 2009, ACM (2009), 3751--3756.

Digital Library

[20]

Nielsen, M., et al. Moeslund, T., Storring, M. and Granum, E. A Procedure for developing intuitive and ergonomic gesture interfaces for HCI. Proc. Gesture-Based Communication in Human-Computer Interaction: 5th Int. Gesture Workshop, GW 2003, LNCS 2915, Springer, Berlin (2004), 409--420.

[21]

Norman, D. A, Natural user interfaces are not natural. interactions, v.17 n.3, May + June 2010

Digital Library

[22]

Norman, D. A, Nielsen, J. Gestural interfaces: a step backward in usability. interactions, v.17 n.5, September + October 2010

Digital Library

[23]

Pickering, C. A, Burnham, K. J, Richardson, M. J. A Research Study of Hand Gesture Recognition Technologies and Applications for Human Vehicle Interaction. Proc. Automotive Electronics, 3rd Institution of Engineering and Technology Conference (2007), 1--15

[24]

Riener A. Gestural Interaction in Vehicular Applications. IEEE Computer, 42--47

Digital Library

[25]

Scoditti, A., Blanch, R., and Coutaz.J. A novel taxonomy for gestural interaction techniques based on accelerometers. Proc. IUI 2011, ACM (2011), 63--72

Digital Library

[26]

Shan, C. Gesture control for consumer electronics. In Multimedia Interaction and Intelligent User Interfaces, L. Shao, C. Shan, J. Luo, and M. Etoh, (eds.), Advances in Pattern Recognition. Springer, 2010, pp. 107--128.

[27]

Sven, G., Markus L., F. D. M. B. A. K. Using intelligent natural user interfaces to support sales conversations. Proc. IUI 2012, ACM (2012), 97--100

Digital Library

[28]

Vatavu, R.,. 2012. User-defined gestures for free-hand TV control. In Proceedings of the 10th European conference on Interactive tv and video (EuroiTV '12). ACM, 45--48.

Digital Library

[29]

Wachs, J. P., Kölsch, M., Stern, H., and Edan, Y. Vision-based hand-gesture applications. CACM 54, 2 (2011), 60--71.

Digital Library

[30]

Wei, J., Wang, X., Peiris, R. L., Choi, Y., Martinez, X. R., Tache, R., Koh, J. T. K. V., Halupka, V., and Cheok, A. D. Codine: an interactive multi-sensory system for remote dining. Proc. UbiComp 2011, ACM (2011), 21--30.

Digital Library

[31]

Wobbrock, J. O., Morris, M. R., and Wilson, A. D. 2009. User-defined gestures for surface computing. In Proc. CHI '09. ACM (2009), 1083--1092.

Digital Library

Cited By

Sun LZhang HChen PJiang ZXie XZhou ZLiu XChen X(2024)Elicitation and Evaluation of Hand-based Interaction Language for 3D Conceptual Design in Mixed RealityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103198183:COnline publication date: 14-Mar-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103198
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Brunetti DGena CVernero F(2022)Smart Interactive Technologies in the Human-Centric Factory 5.0: A SurveyApplied Sciences10.3390/app1216796512:16(7965)Online publication date: 9-Aug-2022
https://doi.org/10.3390/app12167965
Show More Cited By

Index Terms

Touchless gestural interaction with small displays: a case study
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Biting, Whirling, Crawling - Children's Embodied Interaction with Walk-through Displays
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I

Understanding of embodied interaction in the context of walk-through displays and designing for it is very limited. This study examined children's intuitive embodied interaction with a large, semi-visible, projective walk-through display and space ...
Read More
Demonstrating Proxemic Cursor Input for Touchless Displays
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User Interaction

Touchless gesture interfaces often use cursor-based interactions, where widgets are targeted by a movable cursor and activated with a mid-air gesture. Proxemic cursor interactions are a novel alternative that facilitate faster selection without the need ...
Read More
"Don't touch the oven": motion-based touchless interaction with household appliances
AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

Motion-based touchless interaction empowers users to interact using movements and gestures, and without the burden of physical contact with technology (e.g., data gloves, body markers, or remote controllers). Most motion-based touchless applications are ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHItaly '13: Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI

September 2013

215 pages

ISBN:9781450320610

DOI:10.1145/2499149

Conference Chairs:
Franca Garzotto,
Massimo Zancanaro,
Program Chairs:
Antonella De Angeli,
Fabio Paternò

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Fondazione Bruno Kessler
ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 September 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHItaly '13

Sponsor:

ACM

CHItaly '13: Biannual conference of the Italian chapter of SIGCHI

September 16 - 20, 2013

Trento, Italy

Acceptance Rates

Overall Acceptance Rate 109 of 242 submissions, 45%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
640
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)6

Other Metrics

View Author Metrics

Citations

Cited By

Sun LZhang HChen PJiang ZXie XZhou ZLiu XChen X(2024)Elicitation and Evaluation of Hand-based Interaction Language for 3D Conceptual Design in Mixed RealityInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103198183:COnline publication date: 14-Mar-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103198
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Brunetti DGena CVernero F(2022)Smart Interactive Technologies in the Human-Centric Factory 5.0: A SurveyApplied Sciences10.3390/app1216796512:16(7965)Online publication date: 9-Aug-2022
https://doi.org/10.3390/app12167965
Remizova VGizatdinova YSurakka V(2022)Midair Gestural Techniques for Translation Tasks in Large-Display InteractionAdvances in Human-Computer Interaction10.1155/2022/93629162022(1-13)Online publication date: 9-Jul-2022
https://doi.org/10.1155/2022/9362916
Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Verweij DEsteves ABakker SKhan VKuznetsov SSaakes DWakkary RGeurts LHayes LLau M(2019)Designing Motion Matching for Real-World ApplicationsProceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3294109.3295628(645-656)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3294109.3295628
Surale HMatulic FVogel DBrewster SFitzpatrick GCox AKostakos V(2019)Experimental Analysis of Barehand Mid-air Mode-Switching Techniques in Virtual RealityProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300426(1-14)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300426
Celentano ADubois EPaternò FSpano LArdito CSantoro C(2017)Interaction-in-the-large vs interaction-in-the-small in multi-device systemsProceedings of the 12th Biannual Conference on Italian SIGCHI Chapter10.1145/3125571.3125577(1-10)Online publication date: 18-Sep-2017
https://dl.acm.org/doi/10.1145/3125571.3125577
Groenewald CAnslow CIslam JRooney CPassmore PWong WFaily SJiang NDogan HJacqui T(2016)Understanding 3D mid-air hand gestures with interactive surfaces and displaysProceedings of the 30th International BCS Human Computer Interaction Conference: Fusion!10.14236/ewic/HCI2016.43(1-13)Online publication date: 11-Jul-2016
https://dl.acm.org/doi/10.14236/ewic/HCI2016.43
Carter MVelloso EDowns JSellen AO'Hara KVetere FKaye JDruin ALampe CMorris DHourcade J(2016)PathSyncProceedings of the 2016 CHI Conference on Human Factors in Computing Systems10.1145/2858036.2858284(3415-3427)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2858036.2858284
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents

-