The ACM Symposium on User Interface Software and Technology (UIST) is the premier forum for innovations in human-computer interfaces. Sponsored by ACM special interest groups on computer-human interaction (SIGCHI) and computer graphics (SIGGRAPH), UIST brings together people from diverse areas including graphical & web user interfaces, tangible & ubiquitous computing, virtual & augmented reality, multimedia, new input & output devices, Human-Centered AI, and CSCW. The intimate size and intensive program make UIST an ideal opportunity to exchange research results and ideas.
| Updates |
| 11/1/2023 — Closing presentation slides available here. |
| 11/2/2023 — UIST 2024 will be held in Pittsburgh, PA, USA! |
Awards
Lasting Impact
Vizwiz: Nearly Real-Time Answers to Visual Questions
Jeffrey P Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, Tom Yeh. UIST 2010.
Papers - Best Papers
Going Incognito in the Metaverse: Achieving Theoretically Optimal Privacy-Usability Tradeoffs in VR
Vivek Nair, Gonzallo Munilla-Garrido, Dawn Song
GenAssist: Making Image Generation Accessible
Mina Huh, Yi-Hao Peng, Amy Pavel
Generative Agents: Interactive Simulacra of Human Behavior
Joon Sung Park, Joey O’Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein
Papers - Honorable Mentions
ecoEDA: Recycling E-waste During Electronics Design
Jasmine Lu, Beza Desta, K.D. Wu, Romain Nith, Joyce E. Passananti, Pedro Lopes
Sustainflatable: Harvesting, Storing and Utilizing Ambient energy for Pneumatic morphing Interfaces
Qiuyu Lu, Tianyu Yu, Semina Yi, Yuran Ding, Haipeng Mi, Lining Yao
Living Papers: A Language Toolkit for Augmented Scholarly Communication
Jeffrey Heer, Matthew Conlen, Vishal Devireddy, Tu Nguyen, Joshua Horowitz
Scene Responsiveness for Visuotactile Illusions in Mixed Reality
Mohamed Kari, Reinhard Schütte, Raj Sodhi
Demos - Best Demo
Constraint-Driven Robotic Surfaces, at Human-Scale
Jesse T Gonzalez, Sonia Prashant,Sapna Tayal, Juhi Kedia,
Alexandra Ion, and Scott E Hudson
Z-Ring: Context-Aware Subtle Input Using Single-Point Bio-Impedance Sensing
Anandghan Waghmare, Jiexin Ding, Ishan Chatterjee, and Shwetak Patel
Demos - Honorable Mention
Masonview: Content-Driven Viewport Management
Bryan Min, Matthew T Beaudouin-Lafon, Sangho Suh, and Haijun Xia
Biohybrid Devices: Prototyping Interactive Devices with Growable Materials
Madalina Luciana Nicolae, Vivien Roussel, Marion Koelle, Samuel Huron, Jürgen Steimle, and Marc Teyssier
SuperMagneShape: Interactive Usage of a Passive Pin-Based Shape-Changing Display
Kentaro Yasu
Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays
Vivian Shen, Tucker Rae-Grant, Joe Mullenbach, Chris Harrison, and Craig Shultz
Taste Retargeting via Chemical Taste Modulators
Jas Brooks, Noor Amin, and Pedro Lopes
Demos - People’s Choice
ChromaNails: Re-Programmable Multi-Colored High-Resolution On-Body Interfaces using Photochromic Nail Polish
Magnus Frisk, Mads Vejrup, Frederik Kjaer Soerensen, and Michael Wessely
Mo2Hap: Rendering VR Performance Motion Flow to Upper-body Vibrotactile Haptic Feedback
Kyungeun Jung, and Sang Ho Yoon
Demos - People’s Choice Honorable Mentions
Fluid Reality: High-Resolution, Untethered Haptic Gloves using
Electroosmotic Pump Arrays
Vivian Shen, Tucker Rae-Grant, Joe Mullenbach, Chris Harrison, and Craig Shultz
Double-Sided Tactile Interactions for Grasping in VR
Arata Jingu, Anusha Withana, and Jürgen Steimle
SuperMagneShape: Interactive Usage of a Passive Pin-Based Shape-Changing Display
Kentaro Yasu
Poster - People’s Choice Best Poster
Virtual Buddy: Redefining Conversational AI Interactions for Individuals with Hand Motor Disabilities
Atieh Taheri, Purav Bhardwaj, Arthur Caetano, Alice Zhong, Misha Sra
Poster - People’s Choice Honorable Mentions
SketchingRelatedWork: Finding and Organizing Papers through Inking a Node-Link Diagram
Donghyeok Ma, Joon Hyub Lee, Junwoo Yoon, Taegyu Jin, Seok-Hyung Bae
An Interactive System for Drawing Cars in Perspective
Seung-Jun Lee, Taegyu Jin, Joon Hyub Lee, Seok-Hyung Bae
Generative Facial Expressions and Eye Gaze Behavior from Prompts for Multi-Human-Robot Interaction
Gabriel J. Serfaty, Virgil O. Barnard IV, Joseph P. Salisbury
Student Innovation Contest (SIC) - Best SIC Award
LingoLand: An AI-Assisted Immersive Game for Language Learning
Olivia Seow (Harvard Univeristy)
Student Innovation Contest - SIC Honorable Mentions
AudiLens: Configurable LLM-Generated Audiences for Public Speech Practice
Jeongeon Park and DaEun Choi (KAIST)
Docent: Digital Operation-Centric Elicitation of Novice-friendly Tutorials
Yihao Zhu, Qinyi Zhou (Tsinghua University)
Student Innovation Contest - SIC People’s Choice
Smart-Pikachu: Extending Interactivity of Stuffed Animals with Large Language Models
Toma Itagaki (Columbia), Richard Li (U. Washington)
Student Innovation Contest - SIC People’s Choice Honorable Mentions
4-Frame Manga Drawing Support System
Yuto Nagao, Soichiro Fukuda (Kwansei Gakuin University)
ZINify: Transforming Research Papers into Engaging Zines with Large Language Models
Jaidev Shriram, S.P.K Sreekala (University of California - San Diego)
Sponsors
UIST 2023 is possible in part due to gracious support from our sponsors.
Platinum Sponsors
Silver Sponsors
Bronze Sponsors
David Holz (Opening Keynote)
Abstract
A wide-ranging conversation with David Holz, founder of Midjourney and Leap Motion, moderated by Jeff Han.
Bio
David Holz is the founder and CEO of Midjourney. Previously, he was co-founder and CTO of Leap Motion. David contracted for NASA’s Langley Research Center and conducted neuroscience research while at the Max Planck Institute. He studied Applied Math at the University of North Carolina at Chapel Hill, ultimately leaving his PhD program to co-found Leap Motion in 2010. David is based here in San Francisco, California.
Judy Fan (Closing Keynote)
Abstract
Cognitive tools for uncovering useful abstractions
In the 17th century, the Cartesian coordinate system was groundbreaking. It exposed the unity between algebra and geometry, accelerating the development of the math that took humans to the moon. It was not just another concept, but a cognitive tool that people could wield to express abstract ideas in visual form, thereby expanding their capacity to think and generate new insights about a variety of other problems. Research in my lab aims to uncover the psychological mechanisms that explain how people have come to deploy these technologies in such innovative ways to learn, share knowledge, and create new things. In the first part of this talk, I will provide an overview of our recent work investigating drawing — one of our most enduring and versatile tools. Across several empirical and computational studies, I’ll argue that drawing not only provides a window into how we perceive and understand the visual world, but also accelerates humans’ ability to learn and communicate useful abstractions. In the second part, I will describe an emerging line of work investigating how humans discover new abstractions when building physical structures, and externalize these abstractions to support planning and collaboration. I will close by noting the broader implications of embracing such complex, naturalistic behaviors for advancing theories of human cognition and enhancing real-world impact, including in AI and education.
Bio
Judy Fan is an Assistant Professor of Psychology at Stanford University. Research in her lab aims to reverse engineer the human cognitive toolkit, especially how people use physical representations of thought to learn, communicate, and solve problems. Towards this end, her lab employs converging approaches from cognitive science, computational neuroscience, and artificial intelligence. She previously held a faculty appointment at the University of California, San Diego, received her PhD in Psychology from Princeton University, and received her AB in Neurobiology and Statistics from Harvard College.
© Copyright 2023 ACM SIGCHI