Article

Bimanual Interaction with Interscopic Multi-Touch Surfaces

Authors:

Johannes Schöning,

Frank Steinicke,

Antonio Krüger,

Klaus Hinrichs,

Dimitar ValkovAuthors Info & Claims

INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

Pages 40 - 53

https://doi.org/10.1007/978-3-642-03658-3_8

Published: 20 August 2009 Publication History

Abstract

Multi-touch interaction has received considerable attention in the last few years, in particular for natural two-dimensional (2D) interaction. However, many application areas deal with three-dimensional (3D) data and require intuitive 3D interaction techniques therefore. Indeed, virtual reality (VR) systems provide sophisticated 3D user interface, but then lack efficient 2D interaction, and are therefore rarely adopted by ordinary users or even by experts. Since multi-touch interfaces represent a good trade-off between intuitive, constrained interaction on a touch surface providing tangible feedback, and unrestricted natural interaction without any instrumentation, they have the potential to form the foundation of the next generation user interface for 2D as well as 3D interaction. In particular, stereoscopic display of 3D data provides an additional depth cue, but until now the challenges and limitations for multi-touch interaction in this context have not been considered. In this paper we present new multi-touch paradigms and interactions that combine both traditional 2D interaction and novel 3D interaction on a touch surface to form a new class of multi-touch systems, which we refer to as <em>interscopic multi-touch surfaces</em> (iMUTS). We discuss iMUTS-based user interfaces that support interaction with 2D content displayed in monoscopic mode and 3D content usually displayed stereoscopically. In order to underline the potential of the proposed iMUTS setup, we have developed and evaluated two example interaction metaphors for different domains. First, we present intuitive navigation techniques for virtual 3D city models, and then we describe a natural metaphor for deforming volumetric datasets in a medical context.

References

[1]

Bowman, D., Kruijff, E., LaViola, J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley, Reading (2004).

[2]

Balakrishnan, R.: A Grant of 3D. Why aren't we using 3D user interfaces, and will we ever? (3D User Interfaces Keynote) (2006).

[3]

Myers, B.A.: A taxonomy of window manager user interfaces. IEEE Comput. Graph. Appl. 8(5), 65-84 (1988).

[4]

Chun, W.S., Napoli, J., Cossairt, O.S., Dorval, R.K., Hall, D.M., Purtell II, T.J., Schooler, J.F., Banker, Y., Favalora, G.E.: Spatial 3-D Infrastructure: Display-Independent Software Framework, High-Speed Rendering Electronics, and Several New Displays. In: Stereoscopic Displays and Virtual Reality Systems XII, vol. 5664, pp. 302-312 (2005).

[5]

Conner, D.B., Snibbe, S.C., Herndon, K.P., Robbins, D.C., Zeleznik, R.C., van Dam, A.: Three-Dimensional Widgets. In: Symposium on Interactive 3D Graphics (1992).

[6]

Hanson, A.J., Wernert, E.: Constrained 3D Navigation with 2D Controllers. In: Proceedings of Visualization 1997, pp. 175-182. IEEE Computer Society Press, Los Alamitos (1997).

[7]

Salzman, T., Stachniak, S., Stürzlinger, W.: Unconstrained vs. Constrained 3D scene manipulation. In: Nigay, L., Little, M.R. (eds.) EHCI 2001. LNCS, vol. 2254, p. 207. Springer, Heidelberg (2001).

[8]

Steinicke, F., Ropinski, T., Bruder, G., Hinrichs, K.: Interscopic User Interface Concepts for Fish Tank Virtual Reality Systems. In: Proceedings of the Virtual Reality, pp. 27-34 (2007).

[9]

Dietz, P., Leigh, D.: DiamondTouch: a multi-user touch technology. In: Proceedings of the 14th annual ACM symposium on User interface software and technology, pp. 219-226 (2001).

[10]

Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST 2005: Proceedings of the 18th annual ACM symposium on User interface software and technology, pp. 115-118. ACM, New York (2005).

[11]

Malik, S., Laszlo, J.: Visual touchpad: a two-handed gestural input device. In: Proceedings of the 6th international conference on Multimodal interfaces, pp. 289-296 (2004).

[12]

Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P.: It's mine, don't touch!: interactions at a large multi-touch display in a city centre. In: CHI 2008: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, pp. 1285-1294. ACM, New York (2008).

[13]

Schöning, J., Brandl, P., Daiber, F., Echtler, F., Hilliges, O., Hook, J., Löchtefeld, M., Motamedi, N., Muller, L., Olivier, P., Roth, T., von Zadow, U.: Multi-touch surfaces: A technical guide. Technical report, Technical University of Munich (2008).

[14]

Buxton, W., Myers, B.: A study in two-handed input. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 321-326 (1986).

[15]

Lee, S., Buxton, W., Smith, K.: A multi-touch three dimensional touch-sensitive tablet. ACM SIGCHI Bulletin 16(4), 21-25 (1985).

[16]

Matsushita, N., Rekimoto, J.: HoloWall: designing a finger, hand, body, and object sensitive wall. In: Proceedings of the 10th annual ACM symposium on User interface software and technology, pp. 209-210 (1997).

[17]

Epps, J., Lichman, S., Wu, M.: A study of hand shape use in tabletop gesture interaction. In: CHI 2006: CHI 2006 extended abstracts on Human factors in computing systems, pp. 748-753. ACM, New York (2006).

[18]

Wu, M., Balakrishnan, R.: Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays. In: Proceedings of the 16th annual ACM Symposium on User Interface Software and Technology, pp. 193-202 (2003).

[19]

Schöning, J., Hecht, B., Raubal, M., Krüger, A., Marsh, M., Rohs, M.: Improving Interaction with Virtual Globes through Spatial Thinking: Helping users Ask "Why?". In: IUI 2008: Proceedings of the 13th annual ACM conference on Intelligent User Interfaces. ACM Press, New York (2008).

[20]

Steinicke, F., Schöning, J., Krüger, A., Hinrichs, K.: Multi-touching cross-dimensional data: towards direct interaction in stereoscopic display environments coupled with mobile devices. In: AVI 2008: Workshop on designing multi-touch interaction techniques for coupled private and public displays (2008).

[21]

Grossman, T., Wigdor, D., Balakrishnan, R.: Multi-finger gestural interaction with 3d volumetric displays. In: SIGGRAPH 2005: ACM SIGGRAPH 2005 Papers, pp. 931-931. ACM, New York (2005).

[22]

Benko, H., Feiner, S.: Balloon selection: A multi-finger technique for accurate low-fatigue 3d selection. 3D User Interfaces (2007).

[23]

Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Systems Journal 39(3), 915-931 (2000).

[24]

Pierce, J., Forsberg, A., Conway, M., Hong, S., Zeleznik, R., Mine, M.: Image Plane Interaction Techniques in 3D Immersive Environments. In: ACM Symposium on Interactive 3D Graphics, pp. 39-44 (1997).

[25]

Mine, M.: Virtual Environments Interaction Technqiues. Technical Report TR95-018, UNC Chapel Hill Computer Science (1995).

[26]

Wilson, A.D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., Kirk, D.: Bringing physics to the surface. In: UIST 2008: Proceedings of the 21st annual ACM symposium on User interface software and technology, pp. 67-76. ACM, New York (2008).

[27]

Broll, W., Lindt, I., Ohlenburg, J., Wittkämper, M., Yuan, C., Novotny, T., Fatah, A., Mottram, C., Strothmann, A.: Arthur: A collaborative augmented environment for architectural design and urban planning. Journal of Virtual Reality and Broadcasting (JVRB) 1(1), 1-10 (2004).

[28]

Feiner, S., MacIntyre, B., Haupt, M., Solomon, E.: Windows on the world: 2D windows for 3D augmented reality. In: Proceedings of the 6th annual ACM symposium on User interface software and technology, pp. 145-155. ACM, New York (1993).

[29]

Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E.: TUIO: A protocol for table-top tangible user interfaces. In: Proc. of the The 6th Intl. Workshop on Gesture in Human-Computer Interaction and Simulation (2005).

[30]

Benko, H., Wilson, A.D., Balakrishnan, R.: Sphere: multi-touch interactions on a spherical display. In: UIST 2008: Proceedings of the 21st annual ACM symposium on User interface software and technology, pp. 77-86. ACM, New York (2008).

Cited By

Butkiewicz TStevens AWare CAndrews STatarchuk N(2019)Multi-touch 3D positioning with the pantograph techniqueProceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/3306131.3317014(1-9)Online publication date: 21-May-2019
https://dl.acm.org/doi/10.1145/3306131.3317014
Giesler AValkov DHinrichs KWilson ASteinicke FSuma EStuerzlinger W(2014)Void shadowsProceedings of the 2nd ACM symposium on Spatial user interaction10.1145/2659766.2659779(104-112)Online publication date: 4-Oct-2014
https://dl.acm.org/doi/10.1145/2659766.2659779
Bai HLee GBillinghurst MJones MPalanque PSchmidt AGrossman T(2014)Using 3D hand gestures and touch input for wearable AR interactionCHI '14 Extended Abstracts on Human Factors in Computing Systems10.1145/2559206.2581371(1321-1326)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2559206.2581371
Show More Cited By

Index Terms

Bimanual Interaction with Interscopic Multi-Touch Surfaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Combining bimanual interaction and teleportation for 3D manipulation on multi-touch wall-sized displays
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

While multi-touch devices are well established in our everyday life, they are currently becoming larger and larger. Large screens such as wall-sized displays are now equipped with multi-touch capabilities. Multi-touch wall-sized displays will become ...
Multi-touch interaction for tasking robots
HRI '10: Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction

The objective is to develop a mobile human-robot interface that is optimized for multi-touch input. Our existing interface was designed for mouse and keyboard input and was later adopted for voice and touch interaction. A new multi-touch interface ...
Multi-touch interaction for robot control
IUI '09: Proceedings of the 14th international conference on Intelligent user interfaces

Recent developments in multi-touch technologies have exposed fertile ground for research in enriched human-robot interaction. Although multi-touch technologies have been used for virtual 3D applications, to the authors' knowledge, ours is the first ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

August 2009

984 pages

ISBN:9783642036576

Editors:
Tom Gross
Faculty of Media, Bauhaus University Weimar, Weimar, Germany 99423
,
Jan Gulliksen
Department for Information Technology, Uppsala University, Uppsala, Sweden 75105
,
Paula Kotzé
Meraka Institute, Pretoria, South Africa 0001
,
Lars Oestreicher
Department of Information Science, Uppsala University, Uppsala, Sweden 75120
,
Philippe Palanque
University Paul Sabatier, Toulouse Cedex, France 31062
,
Raquel Oliveira Prates
Universidade Federal de Minas Gerais, Belo Horizonte, Brazil 31270010
,
Marco Winckler
Université Paul Sabatier, Toulouse Cedex, France 31062

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 20 August 2009

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Butkiewicz TStevens AWare CAndrews STatarchuk N(2019)Multi-touch 3D positioning with the pantograph techniqueProceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games10.1145/3306131.3317014(1-9)Online publication date: 21-May-2019
https://dl.acm.org/doi/10.1145/3306131.3317014
Giesler AValkov DHinrichs KWilson ASteinicke FSuma EStuerzlinger W(2014)Void shadowsProceedings of the 2nd ACM symposium on Spatial user interaction10.1145/2659766.2659779(104-112)Online publication date: 4-Oct-2014
https://dl.acm.org/doi/10.1145/2659766.2659779
Bai HLee GBillinghurst MJones MPalanque PSchmidt AGrossman T(2014)Using 3D hand gestures and touch input for wearable AR interactionCHI '14 Extended Abstracts on Human Factors in Computing Systems10.1145/2559206.2581371(1321-1326)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2559206.2581371
Valkov DGiesler AHinrichs KJones MPalanque PSchmidt AGrossman T(2014)Imperceptible depth shifts for touch interaction with stereoscopic objectsProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2556288.2557134(227-236)Online publication date: 26-Apr-2014
https://dl.acm.org/doi/10.1145/2556288.2557134
Sinclair MPahud MBenko HQuigley AJacucci GHorn MNacenta M(2013)TouchMoverProceedings of the 2013 ACM international conference on Interactive tabletops and surfaces10.1145/2512349.2512805(287-296)Online publication date: 6-Oct-2013
https://dl.acm.org/doi/10.1145/2512349.2512805
Sultanum NVital Brazil ECosta Sousa MQuigley AJacucci GHorn MNacenta M(2013)Navigating and annotating 3D geological outcrops through multi-touch interactionProceedings of the 2013 ACM international conference on Interactive tabletops and surfaces10.1145/2512349.2512396(345-348)Online publication date: 6-Oct-2013
https://dl.acm.org/doi/10.1145/2512349.2512396
Bruder GSteinicke FSturzlinger WSuma EStuerzlinger WSteinicke F(2013)To touch or not to touch?Proceedings of the 1st symposium on Spatial user interaction10.1145/2491367.2491369(9-16)Online publication date: 20-Jul-2013
https://dl.acm.org/doi/10.1145/2491367.2491369
Colley AHäkkilä JSchöning JDaiber FSteinicke FKrüger A(2013)Touch the 3rd Dimension! Understanding Stereoscopic 3D Touchscreen InteractionComputer-Human Interaction. Cognitive Effects of Spatial Interaction, Learning, and Ability10.1007/978-3-319-16940-8_3(47-67)Online publication date: 25-Nov-2013
https://dl.acm.org/doi/10.1007/978-3-319-16940-8_3
Yuan HĆalić JKondoz A(2012)Analysis of user requirements in interactive 3D video systemsAdvances in Human-Computer Interaction10.1155/2012/3431972012(21-21)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.1155/2012/343197
Valkov DGiesler AHinrichs KShaer OShen CMorris MHorn M(2012)Evaluation of depth perception for touch interaction with stereoscopic rendered objectsProceedings of the 2012 ACM international conference on Interactive tabletops and surfaces10.1145/2396636.2396640(21-30)Online publication date: 11-Nov-2012
https://dl.acm.org/doi/10.1145/2396636.2396640
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents

-