Design Principles and Challenges for Gaze + Pinch Interaction in XR

Ken Pfeuffer; Hans Gellersen; Mar Gonzalez-Franco

doi:10.1109/MCG.2024.3382961

Design Principles and Challenges for Gaze + Pinch Interaction in XR

Ken Pfeuffer^*, Hans Gellersen, Mar Gonzalez-Franco

^*Corresponding author for this work

Department of Computer Science

Research output: Contribution to journal/Conference contribution in journal/Contribution to newspaper › Journal article › Research › peer-review

Abstract

For Extended Reality (XR) headsets, a key aim is the natural interaction in 3-D space beyond what traditional methods of keyboard, mouse, and touchscreen can offer. With the release of the Apple Vision Pro, a novel interaction paradigm is now widely available where users seamlessly navigate content through the combined use of their eyes and hands. However, blending these modalities poses unique design challenges due to their dynamic nature and the absence of established principles and standards. In this article, we present five design principles and issues for the Gaze + Pinch interaction technique, informed by eye-hand research in the human-computer interaction field. The design principles encompass mechanisms like division of labor and minimalistic timing, which are crucial for usability, alongside enhancements for the manipulation of objects, indirect interactions, and drag & drop. Whether in design, technology, or research domains, this exploration offers valuable perspectives for navigating the evolving landscape of 3-D interaction.

Original language	English
Journal	IEEE Computer Graphics and Applications
Volume	44
Issue	3
Pages (from-to)	74-81
Number of pages	8
ISSN	0272-1716
DOIs	https://doi.org/10.1109/MCG.2024.3382961
Publication status	Published - May 2024

Access to Document

10.1109/MCG.2024.3382961

Cite this

@article{af77748b96ea472fa5f567f7a90f58c2,

title = "Design Principles and Challenges for Gaze + Pinch Interaction in XR",

abstract = "For Extended Reality (XR) headsets, a key aim is the natural interaction in 3-D space beyond what traditional methods of keyboard, mouse, and touchscreen can offer. With the release of the Apple Vision Pro, a novel interaction paradigm is now widely available where users seamlessly navigate content through the combined use of their eyes and hands. However, blending these modalities poses unique design challenges due to their dynamic nature and the absence of established principles and standards. In this article, we present five design principles and issues for the Gaze + Pinch interaction technique, informed by eye-hand research in the human-computer interaction field. The design principles encompass mechanisms like division of labor and minimalistic timing, which are crucial for usability, alongside enhancements for the manipulation of objects, indirect interactions, and drag & drop. Whether in design, technology, or research domains, this exploration offers valuable perspectives for navigating the evolving landscape of 3-D interaction.",

author = "Ken Pfeuffer and Hans Gellersen and Mar Gonzalez-Franco",

year = "2024",

month = may,

doi = "10.1109/MCG.2024.3382961",

language = "English",

volume = "44",

pages = "74--81",

journal = "IEEE Computer Graphics and Applications",

issn = "0272-1716",

publisher = "Institute of Electrical and Electronics Engineers",

number = "3",

}

TY - JOUR

T1 - Design Principles and Challenges for Gaze + Pinch Interaction in XR

AU - Pfeuffer, Ken

AU - Gellersen, Hans

AU - Gonzalez-Franco, Mar

PY - 2024/5

Y1 - 2024/5

N2 - For Extended Reality (XR) headsets, a key aim is the natural interaction in 3-D space beyond what traditional methods of keyboard, mouse, and touchscreen can offer. With the release of the Apple Vision Pro, a novel interaction paradigm is now widely available where users seamlessly navigate content through the combined use of their eyes and hands. However, blending these modalities poses unique design challenges due to their dynamic nature and the absence of established principles and standards. In this article, we present five design principles and issues for the Gaze + Pinch interaction technique, informed by eye-hand research in the human-computer interaction field. The design principles encompass mechanisms like division of labor and minimalistic timing, which are crucial for usability, alongside enhancements for the manipulation of objects, indirect interactions, and drag & drop. Whether in design, technology, or research domains, this exploration offers valuable perspectives for navigating the evolving landscape of 3-D interaction.

AB - For Extended Reality (XR) headsets, a key aim is the natural interaction in 3-D space beyond what traditional methods of keyboard, mouse, and touchscreen can offer. With the release of the Apple Vision Pro, a novel interaction paradigm is now widely available where users seamlessly navigate content through the combined use of their eyes and hands. However, blending these modalities poses unique design challenges due to their dynamic nature and the absence of established principles and standards. In this article, we present five design principles and issues for the Gaze + Pinch interaction technique, informed by eye-hand research in the human-computer interaction field. The design principles encompass mechanisms like division of labor and minimalistic timing, which are crucial for usability, alongside enhancements for the manipulation of objects, indirect interactions, and drag & drop. Whether in design, technology, or research domains, this exploration offers valuable perspectives for navigating the evolving landscape of 3-D interaction.

UR - http://www.scopus.com/inward/record.url?scp=85197557699&partnerID=8YFLogxK

U2 - 10.1109/MCG.2024.3382961

DO - 10.1109/MCG.2024.3382961

M3 - Journal article

AN - SCOPUS:85197557699

SN - 0272-1716

VL - 44

SP - 74

EP - 81

JO - IEEE Computer Graphics and Applications

JF - IEEE Computer Graphics and Applications

IS - 3

ER -

Design Principles and Challenges for Gaze + Pinch Interaction in XR

Abstract

Access to Document

Other files and links

Fingerprint

Cite this