Eye-Hand Movement of Objects in Near Space

TY - GEN

T1 - Eye-Hand Movement of Objects in Near Space

AU - Wagner, Uta

AU - Jacobsen, Andreas Asferg

AU - Feuchtner, Tiare

AU - Gellersen, Hans

AU - Pfeuffer, Ken

PY - 2024/10/27

Y1 - 2024/10/27

N2 - Hand-Tracking in Extended Reality (XR) enables moving objects in near space with direct hand gestures, to pick, drag and drop objects in 3D. We explore the use of eye-Tracking to reduce the effort involved in this interaction. As the eyes naturally look ahead to the target for a drag operation, the principal idea is to map the translation of the object in the image plane to gaze, such that the hand only needs to control the depth component of the operation. We demo several applications we build for 3D manipulations, including area selection, 3D path specification, and a "Bejeweled"inspired game, showing potential for effortless drag-And-drop actions in 3D space. This demonstration includes the study apparatus and the applications from a paper that will be presented at UIST'24 with the same title [11].

AB - Hand-Tracking in Extended Reality (XR) enables moving objects in near space with direct hand gestures, to pick, drag and drop objects in 3D. We explore the use of eye-Tracking to reduce the effort involved in this interaction. As the eyes naturally look ahead to the target for a drag operation, the principal idea is to map the translation of the object in the image plane to gaze, such that the hand only needs to control the depth component of the operation. We demo several applications we build for 3D manipulations, including area selection, 3D path specification, and a "Bejeweled"inspired game, showing potential for effortless drag-And-drop actions in 3D space. This demonstration includes the study apparatus and the applications from a paper that will be presented at UIST'24 with the same title [11].

KW - drag&drop

KW - eye-tracking

KW - gaze interaction

KW - near space

KW - object manipulation

UR - https://www.scopus.com/pages/publications/85212583867

U2 - 10.1145/3696762.3698044

DO - 10.1145/3696762.3698044

M3 - Article in proceedings

SP - 18

EP - 21

BT - ISS Companion 2024 - Companion Proceedings of the Conference on Interactive Surfaces and Spaces

A2 - Ens, Barrett

A2 - Carpendale, Sheelagh

PB - Association for Computing Machinery

CY - New York

T2 - UIST '24 - The 37th Annual ACM Symposium on User Interface Software and Technology

Y2 - 13 October 2024 through 16 October 2024

ER -