Short answer

Designers should proactively consider and measure both objective performance metrics and subjective user perceptions when developing augmented reality experiences to ensure a high-quality user experience.

Field
User-Centred Design
Source
IEEE Access (2022)
Method
Systematic Literature Review
Sample
101 documents
Evidence
Strong effect

A comprehensive framework categorizing 94 quality attributes (40 objective, 54 subjective) can guide the design and evaluation of augmented reality user experiences. This user-centred design research insight is drawn from a 2022 study published in IEEE Access. Using Systematic literature review with 101 documents, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should proactively consider and measure both objective performance metrics and subjective user perceptions when developing augmented reality experiences to ensure a high-quality user experience.

Study
User-Centred DesignHigh ImpactStrong effect

Augmented Reality User Experience: A Framework for Objective and Subjective Quality Attributes

A comprehensive framework categorizing 94 quality attributes (40 objective, 54 subjective) can guide the design and evaluation of augmented reality user experiences.

IEEE Access · 2022

01

Key Findings

  • 01Identified 40 objective quality attributes related to AR user experience.
  • 02Identified 54 subjective quality attributes related to AR user experience.
  • 03Proposed a two-category framework (objective and subjective) for characterizing AR quality attributes.
02

Application

Design takeaway

Designers should proactively consider and measure both objective performance metrics and subjective user perceptions when developing augmented reality experiences to ensure a high-quality user experience.

How to apply

Use the identified objective and subjective attributes as a checklist during the design and testing phases of an AR project to ensure all critical aspects of user experience are considered.

Project actions

  • 01When defining your project scope, consider which objective and subjective AR UX attributes are most relevant to your design goals.
  • 02Use the identified attributes to inform your user testing protocols and data collection methods.
03

Method & Evidence

AimTo identify and categorize quality attributes that characterize the user experience in augmented reality applications.
MethodSystematic Literature Review
ProcedureResearchers conducted a systematic review of primary studies from IEEE Xplore, Scopus, and ACM repositories, selecting 101 documents from an initial pool of 1165. These documents were analyzed to identify and categorize quality attributes related to user experience in AR, dividing them into objective and subjective categories.
Sample101 documents
ContextAugmented Reality (AR) application design and evaluation

Variables

IVDesign features of an AR application
DVUser experience quality attributes (objective and subjective)
CVAR hardware, user demographics, task complexity
04

Strengths & Limitations

Strengths

  • +Comprehensive literature review provides a broad overview of AR UX attributes.
  • +Categorization into objective and subjective attributes offers a structured approach to evaluation.

Limitations

It can be challenging to objectively measure all subjective attributes, and user responses may be influenced by individual differences or the specific AR hardware used.

Reliability & validity

The reliability of the attribute identification depends on the rigor of the systematic review process. Validity is supported by the breadth of sources reviewed and the consensus-building nature of identifying common attributes.

Think critically

How might the relative importance of objective versus subjective quality attributes shift depending on the specific application domain of augmented reality (e.g., gaming vs. industrial training)?

05

Design Principles

"Holistic UX evaluation in AR requires addressing both quantifiable performance and qualitative user perception."

Understanding and systematically evaluating both measurable performance aspects and user perceptions is crucial for creating effective and engaging augmented reality applications. This structured approach allows designers to identify critical areas for improvement and ensure a positive user journey.

06

What This Means for Your Design

When making AR apps, think about things you can measure (like how fast it works) and things users feel (like if it's fun or easy to use). This study lists lots of these things to help you design better.

How to use in your project

  • 1.Reference this study when justifying the selection of user experience metrics for your design project, particularly when evaluating AR prototypes.
07

Add to My Project

08

Quick Cite

Paragraph starter

This design project acknowledges the importance of a comprehensive approach to user experience in augmented reality, drawing upon established frameworks. As identified by Gutiérrez et al. (2022), AR user experience is characterized by a range of objective and subjective quality attributes. Therefore, this project will evaluate its design against key metrics within these categories, such as [mention specific objective attribute] and [mention specific subjective attribute], to ensure a robust and user-centered outcome.

09

Source

IEEE Access

Characterization of Quality Attributes to Evaluate the User Experience in Augmented Reality

journal · 2022

View source

Questions About This Research

What does the research say about augmented reality user experience: a framework for objective and subjective quality attributes?
Designers should proactively consider and measure both objective performance metrics and subjective user perceptions when developing augmented reality experiences to ensure a high-quality user experience. Evidence: IEEE Access (2022).
Why does "Augmented Reality User Experience: A Framework for Objective and Subjective Quality Attributes" matter for design?
Understanding and systematically evaluating both measurable performance aspects and user perceptions is crucial for creating effective and engaging augmented reality applications. This structured approach allows designers to identify critical areas for improvement and ensure a positive user journey.
How can designers apply this research?
Designers should proactively consider and measure both objective performance metrics and subjective user perceptions when developing augmented reality experiences to ensure a high-quality user experience.
What were the main findings?
Identified 40 objective quality attributes related to AR user experience.. Identified 54 subjective quality attributes related to AR user experience.. Proposed a two-category framework (objective and subjective) for characterizing AR quality attributes.
What research method was used?
Systematic Literature Review with 101 documents.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2022 journal from IEEE Access.
What should I do differently in my next project?
Use the identified objective and subjective attributes as a checklist during the design and testing phases of an AR project to ensure all critical aspects of user experience are considered.
What are the limitations?
The identified attributes are based on existing literature and may not encompass all emerging aspects of AR user experience. The subjective nature of some attributes can lead to variability in interpretation.