HandPad: A Bimanual Hand Interface for Fluid Window Interactions in VR
2026-07-13 • Human-Computer Interaction
Human-Computer Interaction
AI summaryⓘ
The authors developed HandPad, a way to use both hands without extra devices to work in virtual reality (VR). One hand sets the context and controls broad actions, while the other hand makes precise movements. They use the palm of the non-dominant hand as a touch surface that gives a feel for control, helping with tasks like moving windows and interacting with content. Their study found this method to be comfortable and effective for doing knowledge work in VR without needing physical gadgets.
Virtual Reality (VR)bimanual coordinationself-haptic feedbacknon-dominant hand (NDH)dominant hand (DH)input modifierspatial remappingmulti-window navigationtouch surface
Authors
Wen Ying, Adil Rahman, Erzhen Hu, Seongkook Heo
Abstract
Virtual Reality (VR) offers potential for productivity work by creating expansive displays anywhere, yet current systems often rely on external input devices that limit the on-the-go use of mobile VR. We introduce HandPad, a suite of bare-hand interaction techniques that leverage the benefits of asymmetric bimanual coordination and self-haptic support. HandPad assigns the non-dominant hand (NDH) to establish spatial frames and interaction contexts, while the dominant hand (DH) performs fine-grained manipulation. Users can use NDH gestures as an input modifier to change the mode and target of DH interactions, including multi-window navigation, in-window content interaction, and window management. The palm surface of the NDH also serves as a physical touch surface, providing passive haptic feedback for effective DH touch interaction. Both hands and their interactions are spatially remapped to the window surface, enabling comfortable and direct interaction with virtual content. An exploratory study showed that HandPad enables efficient and ergonomic interaction, demonstrating its potential as a device-free approach for knowledge work in VR.