Eye-Hand Movement of Objects in Near Space

TY - CONF

T1 - Eye-Hand Movement of Objects in Near Space

AU - Wagner, Uta

AU - Jacobsen, Andreas Asferg

AU - Feuchtner, Tiare

AU - Gellersen, Hans

AU - Pfeuffer, Ken

PY - 2024/8/2

Y1 - 2024/8/2

N2 - Hand-tracking in Extended Reality (XR) enables moving objects in near space with direct hand gestures, to pick, drag and drop objects in 3D. In this work, we investigate the use of eye-tracking to reduce the effort involved in this interaction. As the eyes naturally look ahead to the target for a drag operation, the principal idea is to map the translation of the object in the image plane to gaze, such that the hand only needs to control the depth component of the operation. We have implemented four techniques that explore two factors: the use of gaze only to move objects in X-Y vs.\ extra refinement by hand, and the use of hand input inthe Z axis to directly move objects vs.\ indirectly via a transfer function. We compared all four techniques in a user study (N=24) against baselines of direct and indirect hand input. We detail user performance, effort and experience trade-offs and show that all eye-hand techniques significantly reduce physical effort over direct gestures, pointing toward effortless drag-and-drop for XR environments.

AB - Hand-tracking in Extended Reality (XR) enables moving objects in near space with direct hand gestures, to pick, drag and drop objects in 3D. In this work, we investigate the use of eye-tracking to reduce the effort involved in this interaction. As the eyes naturally look ahead to the target for a drag operation, the principal idea is to map the translation of the object in the image plane to gaze, such that the hand only needs to control the depth component of the operation. We have implemented four techniques that explore two factors: the use of gaze only to move objects in X-Y vs.\ extra refinement by hand, and the use of hand input inthe Z axis to directly move objects vs.\ indirectly via a transfer function. We compared all four techniques in a user study (N=24) against baselines of direct and indirect hand input. We detail user performance, effort and experience trade-offs and show that all eye-hand techniques significantly reduce physical effort over direct gestures, pointing toward effortless drag-and-drop for XR environments.

KW - eye-tracking

KW - gaze interaction

KW - drag&drop

KW - object manipulation

KW - near space

M3 - Paper

SP - 1

EP - 13

T2 - UIST '24 - The 37th Annual ACM Symposium on User Interface Software and Technology

Y2 - 13 October 2024 through 16 October 2024

ER -