A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces

Uta Wagner; Mathias Nørhede Lystbæk; Pavel Manakhov; Jens Emil Grønbæk; Ken Pfeuffer; Hans Gellersen

doi:10.1145/3544548.3581423

A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces

Uta Wagner, Mathias Nørhede Lystbæk, Pavel Manakhov, Jens Emil Grønbæk, Ken Pfeuffer, Hans Gellersen

Institut for Datalogi

Publikation: Bidrag til bog/antologi/rapport/proceeding › Konferencebidrag i proceedings › Forskning › peer review

41 Citationer (Scopus)

562 Downloads (Pure)

Abstract

Gaze-Hand Alignment has recently been proposed for multimodal selection in 3D. The technique takes advantage of gaze for target pre-selection, as it naturally precedes manual input. Selection is then completed when manual input aligns with gaze on the target, without need for an additional click method. In this work we evaluate two alignment techniques, Gaze&Finger and Gaze&Handray, combining gaze with image plane pointing versus raycasting, in comparison with hands-only baselines and Gaze&Pinch as established multimodal technique. We used Fitts' Law study design with targets presented at different depths in the visual scene, to assess effect of parallax on performance. The alignment techniques outperformed their respective hands-only baselines. Gaze&Finger is efficient when targets are close to the image plane but less performant with increasing target depth due to parallax.

Originalsprog	Engelsk
Titel	CHI '23 : Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Redaktører	Albrecht Schmidt, Kaisa Väänänen, Tesh Goyal, Per Ola Kristensson, Anicia Peters, Stefanie Mueller, Julie R. Williamson, Max L. Wilson
Udgivelsessted	New York
Forlag	Association for Computing Machinery
Publikationsdato	apr. 2023
Artikelnummer	252
ISBN (Elektronisk)	9781450394215
DOI	https://doi.org/10.1145/3544548.3581423
Status	Udgivet - apr. 2023

Adgang til dokumentet

10.1145/3544548.3581423

chi23_sub4213_A_Fitts_Law_Study_of_GHAAccepteret manuskript, 7,01 MB

Citationsformater

Wagner, U., Lystbæk, M. N., Manakhov, P., Grønbæk, J. E., Pfeuffer, K., & Gellersen, H. (2023). A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces. I A. Schmidt, K. Väänänen, T. Goyal, P. O. Kristensson, A. Peters, S. Mueller, J. R. Williamson, & M. L. Wilson (red.), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems Artikel 252 Association for Computing Machinery. https://doi.org/10.1145/3544548.3581423

Wagner, Uta ; Lystbæk, Mathias Nørhede ; Manakhov, Pavel et al. / A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces. CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. red. / Albrecht Schmidt ; Kaisa Väänänen ; Tesh Goyal ; Per Ola Kristensson ; Anicia Peters ; Stefanie Mueller ; Julie R. Williamson ; Max L. Wilson. New York : Association for Computing Machinery, 2023.

@inproceedings{67899d47095245ee96fe9bc057daa4b7,

title = "A Fitts{\textquoteright} Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces",

abstract = "Gaze-Hand Alignment has recently been proposed for multimodal selection in 3D. The technique takes advantage of gaze for target pre-selection, as it naturally precedes manual input. Selection is then completed when manual input aligns with gaze on the target, without need for an additional click method. In this work we evaluate two alignment techniques, Gaze&Finger and Gaze&Handray, combining gaze with image plane pointing versus raycasting, in comparison with hands-only baselines and Gaze&Pinch as established multimodal technique. We used Fitts' Law study design with targets presented at different depths in the visual scene, to assess effect of parallax on performance. The alignment techniques outperformed their respective hands-only baselines. Gaze&Finger is efficient when targets are close to the image plane but less performant with increasing target depth due to parallax.",

keywords = "augmented reality, eye-tracking, gaze interaction, menu selection, mid-air gestures, pointing",

author = "Uta Wagner and Lystb{\ae}k, {Mathias N{\o}rhede} and Pavel Manakhov and Gr{\o}nb{\ae}k, {Jens Emil} and Ken Pfeuffer and Hans Gellersen",

year = "2023",

month = apr,

doi = "10.1145/3544548.3581423",

language = "English",

editor = "Albrecht Schmidt and Kaisa V{\"a}{\"a}n{\"a}nen and Tesh Goyal and Kristensson, {Per Ola} and Anicia Peters and Stefanie Mueller and {R. Williamson}, Julie and {L. Wilson}, Max",

booktitle = "CHI '23",

publisher = "Association for Computing Machinery",

address = "United States",

}

Wagner, U , Lystbæk, MN , Manakhov, P , Grønbæk, JE , Pfeuffer, K & Gellersen, H 2023, A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces. i A Schmidt, K Väänänen, T Goyal, PO Kristensson, A Peters, S Mueller, J R. Williamson & M L. Wilson (red), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems., 252, Association for Computing Machinery, New York. https://doi.org/10.1145/3544548.3581423

A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces. / Wagner, Uta ; Lystbæk, Mathias Nørhede ; Manakhov, Pavel et al.
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. red. / Albrecht Schmidt; Kaisa Väänänen; Tesh Goyal; Per Ola Kristensson; Anicia Peters; Stefanie Mueller; Julie R. Williamson; Max L. Wilson. New York: Association for Computing Machinery, 2023. 252.

Publikation: Bidrag til bog/antologi/rapport/proceeding › Konferencebidrag i proceedings › Forskning › peer review

TY - GEN

T1 - A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces

AU - Wagner, Uta

AU - Lystbæk, Mathias Nørhede

AU - Manakhov, Pavel

AU - Grønbæk, Jens Emil

AU - Pfeuffer, Ken

AU - Gellersen, Hans

PY - 2023/4

Y1 - 2023/4

N2 - Gaze-Hand Alignment has recently been proposed for multimodal selection in 3D. The technique takes advantage of gaze for target pre-selection, as it naturally precedes manual input. Selection is then completed when manual input aligns with gaze on the target, without need for an additional click method. In this work we evaluate two alignment techniques, Gaze&Finger and Gaze&Handray, combining gaze with image plane pointing versus raycasting, in comparison with hands-only baselines and Gaze&Pinch as established multimodal technique. We used Fitts' Law study design with targets presented at different depths in the visual scene, to assess effect of parallax on performance. The alignment techniques outperformed their respective hands-only baselines. Gaze&Finger is efficient when targets are close to the image plane but less performant with increasing target depth due to parallax.

AB - Gaze-Hand Alignment has recently been proposed for multimodal selection in 3D. The technique takes advantage of gaze for target pre-selection, as it naturally precedes manual input. Selection is then completed when manual input aligns with gaze on the target, without need for an additional click method. In this work we evaluate two alignment techniques, Gaze&Finger and Gaze&Handray, combining gaze with image plane pointing versus raycasting, in comparison with hands-only baselines and Gaze&Pinch as established multimodal technique. We used Fitts' Law study design with targets presented at different depths in the visual scene, to assess effect of parallax on performance. The alignment techniques outperformed their respective hands-only baselines. Gaze&Finger is efficient when targets are close to the image plane but less performant with increasing target depth due to parallax.

KW - augmented reality

KW - eye-tracking

KW - gaze interaction

KW - menu selection

KW - mid-air gestures

KW - pointing

U2 - 10.1145/3544548.3581423

DO - 10.1145/3544548.3581423

M3 - Article in proceedings

BT - CHI '23

A2 - Schmidt, Albrecht

A2 - Väänänen, Kaisa

A2 - Goyal, Tesh

A2 - Kristensson, Per Ola

A2 - Peters, Anicia

A2 - Mueller, Stefanie

A2 - R. Williamson, Julie

A2 - L. Wilson, Max

PB - Association for Computing Machinery

CY - New York

ER -

Wagner U , Lystbæk MN , Manakhov P , Grønbæk JE , Pfeuffer K , Gellersen H. A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces. I Schmidt A, Väänänen K, Goyal T, Kristensson PO, Peters A, Mueller S, R. Williamson J, L. Wilson M, red., CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery. 2023. 252 doi: 10.1145/3544548.3581423

A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces

Abstract

Adgang til dokumentet

Fingeraftryk

Citationsformater