Study
ModellingHigh ImpactMixed findings

Graph-based visualization enhances scenario authoring efficiency in AR

Utilizing a graph-based visualization for scenario authoring in Augmented Reality (AR) can improve the understanding of learning artifacts and their relationships, potentially leading to more efficient design processes.

Academic Publication · 2019

01

Key Findings

  • 01No significant difference was found in the time taken to complete authoring tasks between desktop and AR systems.
  • 02No significant difference was found in the perceived usability of the desktop and AR systems.
  • 03Desktop systems were perceived as more efficient for authoring.
  • 04Participants made significantly more mistakes when authoring in the AR environment compared to the desktop environment.
02

Application

Design takeaway

When designing AR authoring tools for complex simulations, prioritize features that enhance perceived efficiency and minimize user error, potentially by refining the interface and interaction paradigms.

How to apply

When developing AR-based tools for creating complex models or simulations, conduct thorough user testing to identify and mitigate potential sources of inefficiency and error, perhaps by incorporating familiar desktop paradigms or optimizing AR-specific interactions.

Project actions

  • 01When comparing AR to traditional interfaces, clearly define what 'efficiency' means in your context.
  • 02Consider how to measure and improve the accuracy of user input in AR environments.
03

Method & Evidence

AimTo compare the effectiveness of desktop-based versus Augmented Reality (AR) based tools for authoring Scenario-Based Training (SBT) simulations, focusing on usability and efficiency.
MethodIterative design and comparative evaluation (qualitative and quantitative).
ProcedureTwo interface conditions for authoring SBT simulations were developed: one desktop-based and one AR-based. Both interfaces incorporated a graph-based visualization to represent scenario learning artifacts and their relationships. Participants completed authoring tasks using both systems, and their performance (time, mistakes) and perceptions (usability, efficiency) were recorded.
ContextDevelopment of training simulations, specifically Scenario-Based Training (SBT).

Variables

IVInterface condition (Desktop vs. Augmented Reality).
DVTime taken to complete tasks, perceived usability, perceived efficiency, number of mistakes made.
CVGraph-based authoring visualization, specific authoring tasks, learning artifacts and relationships.
04

Strengths & Limitations

Strengths

  • +Employs both qualitative and quantitative evaluation methods.
  • +Utilizes an iterative design process to refine interfaces.

Limitations

The study's findings on efficiency and errors might be specific to the particular graph visualization and authoring tasks used, and may not generalize to all AR authoring scenarios.

Reliability & validity

The study's validity is supported by the use of both objective measures (time, errors) and subjective measures (perceived usability, efficiency). Reliability could be enhanced by increasing the sample size and standardizing participant experience with AR.

Think critically

Given that no significant difference was found in task completion time or perceived usability, to what extent do the observed differences in perceived efficiency and error rates reflect fundamental limitations of AR for authoring versus specific design choices in the tested interface?

05

Design Principles

"For complex digital modelling and authoring tasks, consider the cognitive load and potential for error when transitioning to immersive environments; leverage clear visualizations to aid understanding."

As AR technology becomes more integrated into design workflows, understanding how to optimize the authoring process is crucial. Effective visualizations can reduce cognitive load and errors, making complex simulation creation more accessible and efficient for designers and researchers.

06

What This Means for Your Design

Creating training scenarios in AR was as easy to use as on a computer, but people felt the computer was faster and made fewer mistakes in AR.

How to use in your project

  • 1.Reference this study when discussing the usability and efficiency of AR interfaces for design or modelling tasks, particularly when comparing them to desktop alternatives.
07

Add to My Project

08

Quick Cite

(2019). A Comparison of Desktop and Augmented Reality Scenario Based Training Authoring Tools. Academic Publication. https://doi.org/10.1109/vr.2019.8797973 Retrieved from https://designdex.org/study/925b3509-0190-4452-8066-c528482377d9/graph-based-visualization-enhances-scenario-authoring-efficiency-in-ar

Paragraph starter

Research comparing desktop and Augmented Reality (AR) tools for authoring training simulations indicates that while perceived usability and task completion times may be comparable, desktop interfaces can be perceived as more efficient and lead to fewer user errors, suggesting a need for careful design of AR authoring environments to optimize performance and reduce mistakes.

09

Source

Academic Publication

A Comparison of Desktop and Augmented Reality Scenario Based Training Authoring Tools

journal · 2019

View source

Questions about this research

What does the research say about graph-based visualization enhances scenario authoring efficiency in ar?
When designing AR authoring tools for complex simulations, prioritize features that enhance perceived efficiency and minimize user error, potentially by refining the interface and interaction paradigms. Evidence: Academic Publication (2019).
Why does "Graph-based visualization enhances scenario authoring efficiency in AR" matter for design?
As AR technology becomes more integrated into design workflows, understanding how to optimize the authoring process is crucial. Effective visualizations can reduce cognitive load and errors, making complex simulation creation more accessible and efficient for designers and researchers.
How can designers apply this research?
When designing AR authoring tools for complex simulations, prioritize features that enhance perceived efficiency and minimize user error, potentially by refining the interface and interaction paradigms.
What were the main findings?
No significant difference was found in the time taken to complete authoring tasks between desktop and AR systems.. No significant difference was found in the perceived usability of the desktop and AR systems.. Desktop systems were perceived as more efficient for authoring.. Participants made significantly more mistakes when authoring in the AR environment compared to the desktop environment.
What research method was used?
Iterative design and comparative evaluation (qualitative and quantitative)..
How strong is the evidence?
Evidence strength is rated Mixed findings, based on a 2019 journal from Academic Publication.
What should I do differently in my next project?
When developing AR-based tools for creating complex models or simulations, conduct thorough user testing to identify and mitigate potential sources of inefficiency and error, perhaps by incorporating familiar desktop paradigms or optimizing AR-specific interactions.
What are the limitations?
The study did not find significant differences in task completion time or perceived usability, suggesting that the specific implementations or tasks may not have fully leveraged the potential benefits of AR or highlighted its drawbacks.
Is there evidence that authoring affects design outcomes?
While AR and desktop tools showed similar usability and task completion times for scenario authoring, desktop tools were perceived as more efficient, and AR authoring resulted in more mistakes. As AR technology becomes more integrated into design workflows, understanding how to optimize the authoring process is crucial Source: Academic Publication (2019).
Where does this scenario authoring research apply?
Development of training simulations, specifically Scenario-Based Training (SBT). It sits within modelling research on designdex.org.

Related research topics

authoring design research · evidence on authoring · does authoring improve design outcomes · scenario authoring studies for designers · authoring and scenario authoring findings · modelling research evidence