research-article

To touch or not to touch?: comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces

Authors:

Frank Steinicke, and

Wolfgang SturzlingerAuthors Info & Claims

SUI '13: Proceedings of the 1st symposium on Spatial user interaction

July 2013

Pages 9 - 16

https://doi.org/10.1145/2491367.2491369

Published: 20 July 2013 Publication History

Abstract

Recent developments in touch and display technologies have laid the groundwork to combine touch-sensitive display systems with stereoscopic three-dimensional (3D) display. Although this combination provides a compelling user experience, interaction with objects stereoscopically displayed in front of the screen poses some fundamental challenges: Traditionally, touch-sensitive surfaces capture only direct contacts such that the user has to penetrate the visually perceived object to touch the 2D surface behind the object. Conversely, recent technologies support capturing finger positions in front of the display, enabling users to interact with intangible objects in mid-air 3D space. In this paper we perform a comparison between such 2D touch and 3D mid-air interactions in a Fitts' Law experiment for objects with varying stereoscopical parallax. The results show that the 2D touch technique is more efficient close to the screen, whereas for targets further away from the screen, 3D selection outperforms 2D touch. Based on the results, we present implications for the design and development of future touch-sensitive interfaces for stereoscopic displays.

Supplementary Material

suppl.mov (sui0103-file3.mov)

Supplemental video

Download
17.48 MB

References

[1]

iMUTS - Interscopic Multi-Touch Surfaces. http://imuts.uni-muenster.de/, 2013.

[2]

InSTInCT - Touch-based interfaces for Interaction with 3D Content. http://anr-instinct.cap-sciences.net/, 2013.

[3]

Leap Motion. http://www.leapmotion.com/, 2013.

[4]

Nintendo 3DS. http://www.nintendo.com/, 2013.

[5]

H. Benko and S. Feiner. Balloon selection: A multi-finger technique for accurate low-fatigue 3D selection. In Proc. of IEEE 3DUI, pages 79--86, 2007.

[6]

H. Benko, A. D. Wilson, and R. Balakrishnan. Sphere: multi-touch interactions on a spherical display. In Proc. of ACM UIST, pages 77--86, 2008.

Digital Library

[7]

H. Benko, A. D. Wilson, and P. Baudisch. Precise selection techniques for multi-touch screens. In Proc. of ACM CHI, pages 1263--1272, 2006.

Digital Library

[8]

F. Berard, J. Ip, M. Benovoy, D. El-Shimy, J. R. Blum, and J. R. Cooperstock. Did "minority report" get it wrong? Superiority of the mouse over 3D input devices in a 3D placement task. In Proc. of INTERACT, pages 400--414, 2011.

Digital Library

[9]

G. Bruder, F. Steinicke, and W. Stuerzlinger. Touching the void revisited: Analyses of touch behavior on and above tabletop surfaces. In Proc. of INTERACT, 17 pages, 2013.

[10]

G. Bruder, F. Steinicke, and W. Stuerzlinger. Effects of visual conflicts on 3D selection task performance in stereoscopic display environments. In Proc. of ACM 3DUI, pages 115--118, 2013.

[11]

L.-W. Chan, H.-S. Kao, M. Y. Chen, M.-S. Lee, J. Hsu, and Y.-P. Hung. Touching the void: Direct-touch interaction for intangible displays. In Proc. of ACM CHI, pages 2625--2634, 2010.

Digital Library

[12]

B. R. De Araújo, G. Casiez, J. A. Jorge, and M. Hachet. Mockup builder: 3D modeling on and above the surface. Computers & Graphics, 37:165--178, 2013.

Digital Library

[13]

J.-B. de la Rivière, C. Kervégant, E. Orvain, and N. Dittlo. Cubtile: a multi-touch cubic interface. In Proc. of ACM VRST, pages 69--72, 2008.

Digital Library

[14]

A. Y. Dvorkin, R. V. Kenyon, and E. A. Keshner. Reaching within a dynamic virtual environment. J. NeuroEng. Rehabil., 4(23):182--186, 2007.

[15]

P. M. Fitts. The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psych., 47:381--391, 1954.

[16]

L. Geniva, R. Chua, and J. T. Enns. Attention for perception and action: task interference for action planning, but not for online control. Exp. Brain Res., 185(4):709--717, 2008.

[17]

M. Hachet, B. Bossavit, A. Cohe, and J.-B. de la Rivière. Toucheo: multitouch and stereo combined in a seamless workspace. In Proc. of ACM UIST, pages 587--592, 2011.

Digital Library

[18]

M. Hancock, S. Carpendale, and A. Cockburn. Shallow-depth 3D interaction: design and evaluation of one-, two- and three-touch techniques. In Proc. of ACM CHI, pages 1147--1156, 2007.

Digital Library

[19]

O. Hilliges, S. Izadi, A. D. Wilson, S. Hodges, A. Garcia-Mendoza, and A. Butz. Interactions in the air: Adding further depth to interactive tabletops. In Proc. of ACM UIST, pages 139--148, 2009.

Digital Library

[20]

International Organization for Standardization. ISO/DIS 9241--9 Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9: Requirements for non-keyboard input devices, 2000.

[21]

G. Liu, R. Chua, and J. T. Enns. Attention for perception and action: task interference for action planning, but not for online control. Exp. Brain Res., 185:709--717, 2008.

[22]

J. M. Loomis and J. M. Knapp. Visual perception of egocentric distance in real and virtual environments. In Virtual and adaptive environments, pages 21--46. 2003.

[23]

C. L. MacKenzie, R. G. Marteniuka, C. Dugasa, D. Liskea, and B. Eickmeiera. Three-dimensional movement trajectories in Fitts' task: Implications for control. Q.J. Exp. Psychology-A, 39(4):629--647, 1987.

[24]

I. S. MacKenzie and P. Isokoski. Fitts' throughput and the speed-accuracy tradeoff. In Proc. of ACM CHI, pages 1633--1636, 2008.

Digital Library

[25]

A. Martinet, G. Casiez, and G. Grisoni. The design and evaluation of 3D positioning techniques for multi-touch displays. In Proc. of IEEE 3DUI, pages 115--118, 2010.

Digital Library

[26]

J. P. McIntire, P. R. Havig, and E. E. Geiselman. What is 3D good for? A review of human performance on stereoscopic 3D displays. Proc. of the SPIE, Head- and Helmet-Mounted Displays XVII, 8383:1--13, 2012.

[27]

J. Pierce, A. Forsberg, M. Conway, S. Hong, R. Zeleznik, and M. Mine. Image plane interaction techniques in 3D immersive environments. In Proc. of ACM I3D, pages 39--44, 1997.

Digital Library

[28]

D. Pyryeskin, M. Hancock, and J. Hoey. Comparing elicited gestures to designer-created gestures for selection above a multitouch surface. In Proc. of ACM ITS, pages 1--10, 2012.

Digital Library

[29]

J. L. Reisman, P. L. Davidson, and J. Y. Han. A screen-space formulation for 2D and 3D direct manipulation. In Proc. of ACM UIST, pages 69--78, 2009.

Digital Library

[30]

J. Schöning, F. Steinicke, D. Valkov, A. Krüger, and K. H. Hinrichs. Bimanual interaction with interscopic multi-touch surfaces. In Proc. of INTERACT, pages 40--53, 2009.

Digital Library

[31]

M. Slater. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Phil. Trans. R. Soc. B, 364:3549--3557, 2009.

[32]

S. Strothoff, D. Valkov, and K. H. Hinrichs. Triangle cursor: Interactions with objects above the tabletop. In Proc. of ACM ITS, pages 111--119, 2011.

Digital Library

[33]

R. J. Teather and W. Stuerzlinger. Pointing at 3D target projections with one-eyed and stereo cursors. In Proc. of ACM CHI, 10 pages, 2013.

Digital Library

[34]

R. J. Teather and W. Stuerzlinger. Pointing at 3D targets in a stereo head-tracked virtual environment. In Proc. of IEEE 3DUI, pages 87--94, 2011.

Digital Library

[35]

D. Valkov, A. Giesler, and K. H. Hinrichs. Evaluation of depth perception for touch interaction with stereoscopic rendered objects. In Proc. of ACM ITS, pages 21--30, 2012.

Digital Library

[36]

D. Valkov, F. Steinicke, G. Bruder, and K. H. Hinrichs. 2D touching of 3D stereoscopic objects. In Proc. of ACM CHI, pages 1353--1362, 2011.

Digital Library

[37]

D. Valkov, F. Steinicke, G. Bruder, K. H. Hinrichs, J. Schöning, F. Daiber, and A. Krüger. Touching floating objects in projection-based virtual reality environments. In Proc. of JVRC, pages 17--24, 2010.

Digital Library

[38]

A. Viau, A. G. Feldman, B. J. McFadyen, and M. F. Levin. Reaching in reality and virtual reality: A comparison of movement kinematics in healthy subjects and in adults with hemiparesis. J. NeuroEng. Rehabil., 1(11), 2004.

[39]

D. Whitney, D. A. Westwood, and M. A. Goodale. The influence of visualmotion on fast reaching movements to a stationary object. Letters to Nature, 423:869--873, 2003.

[40]

P. Willemsen, A. A. Gooch, W. B. Thompson, and S. H. Creem-Regehr. Effects of stereo viewing conditions on distance perception in virtual environments. Presence-Teleop. Virt., 17(1):91--101, 2008.

Digital Library

[41]

A. D. Wilson, S. Izadi, O. Hilliges, A. Garcia-Mendoza, and D. Kirk. Bringing physics to the surface. In Proc. of ACM UIST, pages 67--76, 2008.

Digital Library

Cited By

Feld NZielasko DWeyers B(2024)Effects of Hand Occlusion in Radial Mid-Air Menu Interaction in Augmented Reality2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00106(551-558)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00106
Liebers CProchazka MPfützenreuter NLiebers JAuda JGruenefeld USchneegass S(2023)Pointing It Out! Comparing Manual Segmentation of 3D Point Clouds between Desktop, Tablet, and Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2238945(1-15)Online publication date: 31-Jul-2023
https://doi.org/10.1080/10447318.2023.2238945
Heinrich FBornemann KPolenz LLawonn KHansen C(2023)Clutch & GraspInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103117180:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103117
Show More Cited By

Index Terms

To touch or not to touch?: comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Novel interaction techniques using touch-sensitive tangibles in tabletop environments
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces

In this work, we propose techniques for interaction that use a touch-sensitive tangible to assist 3D manipulation in tabletop applications. The objective of this research is to investigate the effectiveness and user satisfaction with this combination ...
Read More
Void shadows: multi-touch interaction with stereoscopic objects on the tabletop
SUI '14: Proceedings of the 2nd ACM symposium on Spatial user interaction

In this paper we present the Void Shadows interaction - a novel stereoscopic 3D interaction paradigm in which each virtual object casts a shadow on a touch-enabled display surface. The user can conveniently interact with such a shadow, and her actions ...
Read More
Air+touch: interweaving touch & in-air gestures
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technology

We present Air+Touch, a new class of interactions that interweave touch events with in-air gestures, offering a unified input modality with expressiveness greater than each input modality alone. We demonstrate how air and touch are highly complementary: ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '13: Proceedings of the 1st symposium on Spatial user interaction

July 2013

108 pages

ISBN:9781450321419

DOI:10.1145/2491367

General Chair:
Evan Suma
USC Institute for Creative Technologies USA
,
Program Chairs:
Wolfgang Stuerzlinger
York University, Canada
,
Frank Steinicke
University of Würzburg, Germany

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SUI '13

Sponsor:

SUI '13: Symposium on Spatial User Interaction

July 20 - 21, 2013

California, Los Angeles, USA

Acceptance Rates

SUI '13 Paper Acceptance Rate 12 of 31 submissions, 39%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Upcoming Conference

SUI '24

Sponsor:
sigchi
sigchi

ACM Symposium on Spatial User Interaction

October 7 - 8, 2024

Trier , Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

51
Total Citations
View Citations
1,158
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)7

Other Metrics

View Author Metrics

Citations

Cited By

Feld NZielasko DWeyers B(2024)Effects of Hand Occlusion in Radial Mid-Air Menu Interaction in Augmented Reality2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00106(551-558)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00106
Liebers CProchazka MPfützenreuter NLiebers JAuda JGruenefeld USchneegass S(2023)Pointing It Out! Comparing Manual Segmentation of 3D Point Clouds between Desktop, Tablet, and Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2023.2238945(1-15)Online publication date: 31-Jul-2023
https://doi.org/10.1080/10447318.2023.2238945
Heinrich FBornemann KPolenz LLawonn KHansen C(2023)Clutch & GraspInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103117180:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103117
Windl MHiesinger AWelsch RSchmidt AFeger S(2022)SaferHome: Interactive Physical and Digital Smart Home Dashboards for Communicating Privacy Assessments to Owners and BystandersProceedings of the ACM on Human-Computer Interaction10.1145/35677396:ISS(680-699)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567739
Everitt ARoudaut AHornbæk KFraser MAlexander J(2022)Investigating Pointing Performance for Tangible Surfaces with Physical 3D TargetsProceedings of the ACM on Human-Computer Interaction10.1145/35677366:ISS(617-639)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567736
Tsuchida TFujita KIkematsu KSarcar STakashima KKitamura Y(2022)TetraForce: A Magnetic-Based Interface Enabling Pressure Force and Shear Force Input Applied to Front and Back of a SmartphoneProceedings of the ACM on Human-Computer Interaction10.1145/35677176:ISS(185-206)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567717
Alkayyali AIravantchi YHerskovitz JSample A(2022)UbiChromics: Enabling Ubiquitously Deployable Interactive Displays with Photochromic PaintProceedings of the ACM on Human-Computer Interaction10.1145/35677146:ISS(118-142)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567714
Cheng YLuong TFender AStreli PHolz C(2022)ComforTable User Interfaces: Surfaces Reduce Input Error, Time, and Exertion for Tabletop and Mid-air User Interfaces2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00029(150-159)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00029
Oyekoya O(2021)Usability Evaluation of Behind the Screen InteractionProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485295(1-5)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3485279.3485295
Batmaz ASun XTaskiran DStuerzlinger W(2020)Eye-Hand Coordination Training for Sports with Mid-air VRProceedings of the 26th ACM Symposium on Virtual Reality Software and Technology10.1145/3385956.3418971(1-10)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3385956.3418971
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents

-