Short answer
When designing educational technology, especially immersive ones like VR, prioritize robust evaluation methods and consider the long-term impact on user learning and retention.
- Field
- User-Centred Design
- Source
- Journal of Computers in Education (2020)
- Method
- Systematic Literature Review
- Sample
- 29 publications
- Evidence
- Moderate effect
Immersive virtual reality (I-VR) demonstrably improves quantitative learning outcomes in educational settings compared to traditional methods, provided the experimental design and assessment measures are robust. This user-centred design research insight is drawn from a 2020 study published in Journal of Computers in Education. Using Systematic literature review with 29 publications, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing educational technology, especially immersive ones like VR, prioritize robust evaluation methods and consider the long-term impact on user learning and retention.
Immersive VR enhances learning outcomes, but methodological rigor is key
Immersive virtual reality (I-VR) demonstrably improves quantitative learning outcomes in educational settings compared to traditional methods, provided the experimental design and assessment measures are robust.
Journal of Computers in Education · 2020
Key Findings
- 01Most studies found a significant advantage of using I-VR in education.
- 02A smaller number of studies found no significant differences in attainment level between I-VR and non-immersive methods.
- 03Only two studies found clear detrimental effects of using I-VR.
- 04Most studies used short interventions and did not examine information retention.
- 05Evaluation methods for learning outcomes were often inadequate, potentially affecting the interpretation of I-VR's utility.
Application
Design takeaway
When designing educational technology, especially immersive ones like VR, prioritize robust evaluation methods and consider the long-term impact on user learning and retention.
How to apply
When developing or evaluating educational VR applications, ensure the design includes opportunities for sustained engagement and that learning is measured through a variety of methods, including those that assess retention over time.
Project actions
- 01If you're using VR for a project, think about how you'll measure learning beyond just a quick quiz.
- 02Consider the psychological impact of immersion – does it help or hinder focus?
- 03Ensure your VR experience is accessible and comfortable for all potential users.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Systematic approach to literature review.
- +Inclusion of quality assessment of studies.
Limitations
The findings may be limited by the quality of the original studies reviewed, the specific VR technologies used, and the narrow focus on scientific subjects. Generalizability to other subjects or age groups might be limited.
Reliability & validity
The reliability of the review's findings depends on the quality and consistency of the original studies. Validity is challenged by the variability in assessment methods and the potential for publication bias towards positive results. The review itself aims to increase validity by systematically assessing study quality.
Think critically
To what extent does the 'immersion' factor in VR truly enhance learning, or could it be a distraction if not carefully managed within the design?
Design Principles
"The effectiveness of an educational technology is contingent upon both the design of the learning experience and the rigor of its assessment."
This insight is crucial for understanding how technology can be effectively integrated into learning environments. It highlights the importance of user experience (UX) in educational technology, emphasizing that the design of the VR intervention and how learning is measured directly impacts its perceived effectiveness.
What This Means for Your Design
VR can be a great way to learn, but only if it's designed well and tested properly to make sure people actually remember what they learned.
How to use in your project
- 1.Use this insight to justify the choice of VR as a learning tool in your project, but also to highlight the importance of your own rigorous testing and evaluation methods.
- 2.Discuss how your design addresses the limitations found in the review, such as short intervention times or inadequate assessment.
Add to My Project
Quick Cite
Paragraph starter
This systematic literature review highlights that while immersive virtual reality (I-VR) shows promise as a pedagogical tool, its effectiveness is significantly influenced by the quality of the experimental design and assessment measures. The review found that most studies indicate a positive impact of I-VR on learning outcomes, but limitations such as short intervention durations and inadequate evaluation of information retention were common. Therefore, when designing and evaluating educational technologies, it is imperative to adopt a rigorous methodological approach that includes appropriate assessment measures and considers long-term learning outcomes, aligning with user-centred design principles.
Source
Journal of Computers in Education
Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design
journal · 2020
View sourceQuestions About This Research
- What does the research say about immersive vr enhances learning outcomes, but methodological rigor is key?
- When designing educational technology, especially immersive ones like VR, prioritize robust evaluation methods and consider the long-term impact on user learning and retention. Evidence: Journal of Computers in Education (2020).
- Why does "Immersive VR enhances learning outcomes, but methodological rigor is key" matter for design?
- This insight is crucial for understanding how technology can be effectively integrated into learning environments. It highlights the importance of user experience (UX) in educational technology, emphasizing that the design of the VR intervention and how learning is measured directly impacts its perceived effectiveness.
- How can designers apply this research?
- When designing educational technology, especially immersive ones like VR, prioritize robust evaluation methods and consider the long-term impact on user learning and retention.
- What were the main findings?
- Most studies found a significant advantage of using I-VR in education.. A smaller number of studies found no significant differences in attainment level between I-VR and non-immersive methods.. Only two studies found clear detrimental effects of using I-VR.. Most studies used short interventions and did not examine information retention.
- What research method was used?
- Systematic Literature Review with 29 publications.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2020 journal from Journal of Computers in Education.
- What should I do differently in my next project?
- When developing or evaluating educational VR applications, ensure the design includes opportunities for sustained engagement and that learning is measured through a variety of methods, including those that assess retention over time.
- What are the limitations?
- Most studies focused on short interventions and scientific topics, and the quality of assessment methods varied significantly.