Short answer

Prioritize intuitive gesture design and robust onboarding mechanisms to ensure users can easily learn and effectively interact with AR applications.

Field
User-Centred Design
Source
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (2023)
Method
Observational User Study & Expert Validation
Sample
25 novice users, 8 expert designers/engineers/researchers
Evidence
Strong effect

Novice users frequently struggle to discover and correctly execute gestural commands in augmented reality applications, indicating a significant gap in current interaction design. This user-centred design research insight is drawn from a 2023 study published in Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies. Using Observational user study & expert validation with 25 novice users, 8 expert designers/engineers/researchers, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Prioritize intuitive gesture design and robust onboarding mechanisms to ensure users can easily learn and effectively interact with AR applications.

Study
User-Centred DesignRecentStrong effect

Gesture Discovery in AR Headsets is a Major Usability Hurdle

Novice users frequently struggle to discover and correctly execute gestural commands in augmented reality applications, indicating a significant gap in current interaction design.

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 2023

01

Key Findings

  • 01Users struggled to discover correct gestures.
  • 02Majority of errors occurred due to inability to determine correct action sequences or evaluate actions.
02

Application

Design takeaway

Prioritize intuitive gesture design and robust onboarding mechanisms to ensure users can easily learn and effectively interact with AR applications.

How to apply

When designing AR interfaces, prototype and test gesture interactions with target users early and often, focusing on clarity and feedback.

Project actions

  • 01When designing for AR, think about how users will learn the controls.
  • 02Include clear visual or auditory feedback for every gesture.
03

Method & Evidence

AimHow do novice users discover gestural inputs and what interaction challenges do they encounter when using augmented reality applications on immersive headsets?
MethodObservational User Study & Expert Validation
ProcedureResearchers observed 25 novice users interacting with four different AR applications, analyzing their gesture input traces. This was followed by an expert validation study with eight AR professionals.
Sample25 novice users, 8 expert designers/engineers/researchers
ContextAugmented Reality (AR) applications on immersive headsets

Variables

IVType of AR application, interaction technique
DVGesture discovery success rate, types of user errors, time to discover gesture
CVUser background (technical knowledge, age), specific hardware used, AR application complexity
04

Strengths & Limitations

Strengths

  • +Inclusion of both novice user observation and expert validation provides a comprehensive perspective.
  • +Detailed analysis of interaction traces offers specific insights into error types.

Limitations

The specific gestures and AR applications tested might not represent all AR experiences. The diverse backgrounds of participants might lead to varied learning curves.

Reliability & validity

The use of multiple AR applications and a diverse user group enhances ecological validity. Reliability could be improved by standardizing the AR environment and task complexity across all participants.

Think critically

How might the design of the AR environment itself (e.g., visual cues, spatial layout) influence gesture discoverability and user success?

05

Design Principles

"Interaction discoverability is paramount for user adoption in novel interfaces."

For designers and engineers developing AR experiences, this highlights the critical need to prioritize intuitive gesture design and effective onboarding. Failing to address these challenges can lead to user frustration and abandonment of otherwise innovative products.

06

What This Means for Your Design

People find it hard to figure out how to control AR headsets with hand movements, often getting stuck or making mistakes because they don't know what to do or if they did it right.

How to use in your project

  • 1.Use this research to justify the need for user testing of gesture controls in your AR design project.
  • 2.Cite this study when discussing challenges in AR interaction design.
07

Add to My Project

08

Quick Cite

Paragraph starter

Research indicates that novice users face significant challenges in discovering and executing gestural inputs within augmented reality applications, often struggling with action sequencing and feedback evaluation. This highlights the critical need for design interventions that enhance gesture discoverability and provide clear onboarding, as explored by Khurana et al. (2023).

09

Source

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies

Do I Just Tap My Headset?

journal · 2023

View source

Questions About This Research

What does the research say about gesture discovery in ar headsets is a major usability hurdle?
Prioritize intuitive gesture design and robust onboarding mechanisms to ensure users can easily learn and effectively interact with AR applications. Evidence: Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (2023).
Why does "Gesture Discovery in AR Headsets is a Major Usability Hurdle" matter for design?
For designers and engineers developing AR experiences, this highlights the critical need to prioritize intuitive gesture design and effective onboarding. Failing to address these challenges can lead to user frustration and abandonment of otherwise innovative products.
How can designers apply this research?
Prioritize intuitive gesture design and robust onboarding mechanisms to ensure users can easily learn and effectively interact with AR applications.
What were the main findings?
Users struggled to discover correct gestures.. Majority of errors occurred due to inability to determine correct action sequences or evaluate actions.
What research method was used?
Observational User Study & Expert Validation with 25 novice users, 8 expert designers/engineers/researchers.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2023 journal from Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies.
What should I do differently in my next project?
When designing AR interfaces, prototype and test gesture interactions with target users early and often, focusing on clarity and feedback.
What are the limitations?
The study focused on novice users, so findings may differ for experienced AR users. The specific AR applications and hardware used may also influence results.