Datamancer: Bimanual Gesture Interaction in Multi-Display Ubiquitous Analytics Environments

TY - GEN

T1 - Datamancer

T2 - CHI '25: CHI Conference on Human Factors in Computing Systems

AU - Patnaik, Biswaksen

AU - Borowski, Marcel

AU - Peng, Huaishu

AU - Klokmose, Clemens Nylandsted

AU - Elmqvist, Niklas

PY - 2025/4/26

Y1 - 2025/4/26

N2 - We introduce Datamancer, a wearable device enabling bimanual gesture interaction across multi-display ubiquitous analytics environments. Datamancer addresses the gap in gesture-based interaction within data visualization settings, where current methods are often constrained by limited interaction spaces or the need for installing bulky tracking setups. Datamancer integrates a finger-mounted pinhole camera and a chest-mounted gesture sensor, allowing seamless selection and manipulation of visualizations on distributed displays. By pointing to a display, users can acquire the display and engage in various interactions, such as panning, zooming, and selection, using both hands. Our contributions include (1) an investigation of the design space of gestural interaction for physical ubiquitous analytics environments; (2) a prototype implementation of the Datamancer system that realizes this model; and (3) an evaluation of the prototype through demonstration of application scenarios, an expert review, and a user study.

AB - We introduce Datamancer, a wearable device enabling bimanual gesture interaction across multi-display ubiquitous analytics environments. Datamancer addresses the gap in gesture-based interaction within data visualization settings, where current methods are often constrained by limited interaction spaces or the need for installing bulky tracking setups. Datamancer integrates a finger-mounted pinhole camera and a chest-mounted gesture sensor, allowing seamless selection and manipulation of visualizations on distributed displays. By pointing to a display, users can acquire the display and engage in various interactions, such as panning, zooming, and selection, using both hands. Our contributions include (1) an investigation of the design space of gestural interaction for physical ubiquitous analytics environments; (2) a prototype implementation of the Datamancer system that realizes this model; and (3) an evaluation of the prototype through demonstration of application scenarios, an expert review, and a user study.

KW - Augmented Reality

KW - Gestural interaction

KW - immersive analytics

KW - situated analytics

KW - ubiquitous analytics

KW - visualizations

UR - https://www.scopus.com/pages/publications/105005766471

U2 - 10.1145/3706598.3713123

DO - 10.1145/3706598.3713123

M3 - Article in proceedings

BT - CHI 2025 - Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

CY - New York

Y2 - 26 April 2025 through 1 May 2025

ER -