Short answer

When designing educational tools, consider how augmented reality can provide unique visual and contextual information to enhance student understanding and engagement, aiming for a moderate performance uplift.

Field
User-Centred Design
Source
IEEE Transactions on Learning Technologies (2014)
Method
Meta-analysis and qualitative analysis of research literature.
Sample
43 user studies were analyzed for qualitative aspects, and 7 studies allowed for effect size computation.
Evidence
Moderate effect

Augmented reality learning experiences can lead to moderate improvements in student performance, with an average effect size of 0.56. This user-centred design research insight is drawn from a 2014 study published in IEEE Transactions on Learning Technologies. Using Meta-analysis and qualitative analysis of research literature. with 43 user studies were analyzed for qualitative aspects, and 7 studies allowed for effect size computation., researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing educational tools, consider how augmented reality can provide unique visual and contextual information to enhance student understanding and engagement, aiming for a moderate performance uplift.

Study
User-Centred DesignHigh ImpactModerate effect

Augmented Reality Learning Experiences Yield Moderate Performance Gains

Augmented reality learning experiences can lead to moderate improvements in student performance, with an average effect size of 0.56.

IEEE Transactions on Learning Technologies · 2014

01

Key Findings

  • 01ARLEs achieved a mean effect size of 0.56 on student performance, indicating a moderate positive impact.
  • 02AR offers inherent advantages such as real-world annotation, contextual visualization, and vision-haptic visualization.
02

Application

Design takeaway

When designing educational tools, consider how augmented reality can provide unique visual and contextual information to enhance student understanding and engagement, aiming for a moderate performance uplift.

How to apply

When developing educational AR applications, prioritize features that directly utilize AR's ability to overlay information onto the physical environment and provide interactive visualizations.

Project actions

  • 01When designing an AR learning tool, think about how it can show information directly on real objects or in the context where students are learning.
  • 02Consider how theories like multimedia learning can guide your design choices for AR content.
03

Method & Evidence

AimWhat is the impact of augmented reality learning experiences on student performance and what are the key design considerations for their development?
MethodMeta-analysis and qualitative analysis of research literature.
ProcedureResearchers reviewed 87 articles on augmented reality learning experiences (ARLEs) in K-12 settings. They conducted a meta-analysis on studies with user data to determine the effect size on student performance and performed a qualitative analysis of design aspects, including hardware, software, content authoring, and evaluation techniques.
Sample43 user studies were analyzed for qualitative aspects, and 7 studies allowed for effect size computation.
ContextK-12 educational settings, focusing on augmented reality learning experiences.

Variables

IVUse of Augmented Reality Learning Experiences (ARLEs) vs. traditional learning methods.
DVStudent performance on tests or learning tasks.
CVAge/grade level of students, subject matter, specific AR hardware and software used, duration of the learning experience.
04

Strengths & Limitations

Strengths

  • +Comprehensive literature review covering a significant number of relevant studies.
  • +Combines quantitative meta-analysis with qualitative design analysis for a holistic view.

Limitations

The effectiveness of AR can vary greatly depending on the specific design and implementation, so results may not be universally applicable.

Reliability & validity

The meta-analysis provides a measure of reliability for the average effect size across multiple studies. Validity is supported by the qualitative analysis of design aspects and theoretical grounding.

Think critically

Given the wide variability in effect sizes, what factors might contribute to AR learning experiences being less effective or even detrimental to student performance?

05

Design Principles

"Leverage augmented reality's capacity for real-world annotation and contextual visualization to create immersive and effective learning experiences."

This finding suggests that AR has the potential to be a valuable tool in educational settings. Designers should consider how to leverage AR's unique capabilities to create engaging and effective learning materials that go beyond traditional methods.

06

What This Means for Your Design

Using augmented reality in school can help students learn better, with a noticeable, though not always huge, improvement in their test scores.

How to use in your project

  • 1.Reference this study when discussing the potential benefits of AR for learning and how it can impact user performance.
  • 2.Use the findings on effect size to justify the potential impact of your own AR design.
07

Add to My Project

08

Quick Cite

Paragraph starter

The research by Santos et al. (2014) indicates that augmented reality learning experiences (ARLEs) can yield a moderate positive effect on student performance, with a reported mean effect size of 0.56. This suggests that AR has the potential to enhance educational outcomes by leveraging its unique capabilities for real-world annotation and contextual visualization, aligning with principles of multimedia and experiential learning.

09

Source

IEEE Transactions on Learning Technologies

Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation

journal · 2014

View source

Questions About This Research

What does the research say about augmented reality learning experiences yield moderate performance gains?
When designing educational tools, consider how augmented reality can provide unique visual and contextual information to enhance student understanding and engagement, aiming for a moderate performance uplift. Evidence: IEEE Transactions on Learning Technologies (2014).
Why does "Augmented Reality Learning Experiences Yield Moderate Performance Gains" matter for design?
This finding suggests that AR has the potential to be a valuable tool in educational settings. Designers should consider how to leverage AR's unique capabilities to create engaging and effective learning materials that go beyond traditional methods.
How can designers apply this research?
When designing educational tools, consider how augmented reality can provide unique visual and contextual information to enhance student understanding and engagement, aiming for a moderate performance uplift.
What were the main findings?
ARLEs achieved a mean effect size of 0.56 on student performance, indicating a moderate positive impact.. AR offers inherent advantages such as real-world annotation, contextual visualization, and vision-haptic visualization.
What research method was used?
Meta-analysis and qualitative analysis of research literature. with 43 user studies were analyzed for qualitative aspects, and 7 studies allowed for effect size computation..
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2014 journal from IEEE Transactions on Learning Technologies.
What should I do differently in my next project?
When developing educational AR applications, prioritize features that directly utilize AR's ability to overlay information onto the physical environment and provide interactive visualizations.
What are the limitations?
The effect size of ARLEs on student performance is highly variable, ranging from negative to large positive effects.