On Gesture Combination: An Exploration of a Solution to Augment Gesture Interaction

On Gesture Combination: An Exploration of a Solution to Augment Gesture Interaction
William Delamare, Chaklam Silpasuwanchai, Sayan Sarcar, Toshiaki Shiraki, Xiangshi Ren

ISS '19: ACM International Conference on Interactive Surfaces and Spaces
Session: Ultrasonic techniques and mid-air displays

Abstract
Current gesture interaction paradigm mainly involves a one-to-one gesture-command mapping. This leads to memorability issues regarding (1) the mapping - as each new command requires a new gesture, and (2) the gestures specifics (e.g., motion paths) - that can be complex to leverage the recognition of several gestures. We explore the concept of combining 3D gestures when interacting in smart environments. We first propose a design space to characterize the temporal and spatial combination aspects, and the gesture types used by the combination. We then report results from three user studies in the context of smart TV interaction. The first study reveals that end-users can create gesture sets with combinations fully optimized to reuse gestures. The second study shows that combining gestures can lead to improved memorability compared to single gestures. The third study reveals that preferences for gestures combination appear when single gestures have an abstract gesture-command mapping.

DOI::
WEB::

Recorded at the 2019 ACM International Conference on Interactive Surfaces and Spaces, Daejeon, South Korea, November 10 - 13 2019

SIGCHI,ISS 2019,freehand gestures,mid-air interaction,Gestural input,gestural interaction,gesture combination,two-handed interaction,