Short answer
Designers should consider how to integrate AI tools like ChatGPT into learning platforms and curricula, providing clear guidance and scaffolding to maximize their benefits for performance, perception, and critical thinking.
- Field
- User-Centred Design
- Source
- Humanities and Social Sciences Communications (2025)
- Method
- Meta-analysis
- Sample
- 51 research studies
- Evidence
- Strong effect
Leveraging AI tools like ChatGPT can significantly boost student learning outcomes and their perception of learning, particularly when integrated thoughtfully into educational frameworks. This user-centred design research insight is drawn from a 2025 study published in Humanities and Social Sciences Communications. Using Meta-analysis with 51 research studies, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should consider how to integrate AI tools like ChatGPT into learning platforms and curricula, providing clear guidance and scaffolding to maximize their benefits for performance, perception, and critical thinking.
ChatGPT integration enhances learning performance and perception by up to 86.7%
Leveraging AI tools like ChatGPT can significantly boost student learning outcomes and their perception of learning, particularly when integrated thoughtfully into educational frameworks.
Humanities and Social Sciences Communications · 2025
Key Findings
- 01ChatGPT has a large positive impact on improving learning performance (g = 0.867).
- 02ChatGPT has a moderately positive impact on enhancing learning perception (g = 0.456).
- 03ChatGPT has a moderately positive impact on fostering higher-order thinking (g = 0.457).
- 04The impact is moderated by course type, learning model, and duration.
Application
Design takeaway
Designers should consider how to integrate AI tools like ChatGPT into learning platforms and curricula, providing clear guidance and scaffolding to maximize their benefits for performance, perception, and critical thinking.
How to apply
When designing educational software or curricula, incorporate features that leverage AI for personalized feedback, content generation, and interactive learning experiences, ensuring these are supported by pedagogical best practices.
Project actions
- 01When exploring AI tools for your design project, consider how they can be integrated to support specific learning objectives.
- 02Think about the user experience of interacting with AI – how can it be made intuitive and effective for learning?
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Meta-analysis provides a robust synthesis of multiple studies.
- +Covers a range of learning outcomes (performance, perception, thinking skills).
Limitations
The findings are based on a meta-analysis of recent studies, so the long-term effects or impacts in very different educational contexts might not be fully captured.
Reliability & validity
The reliability and validity of the findings are strengthened by the meta-analytic approach, which aggregates data from multiple studies. However, the validity can be influenced by the quality and heterogeneity of the included studies.
Think critically
How might the 'moderating factors' (course type, learning model, duration, role of ChatGPT) influence the design of AI-powered learning tools for different subjects or user groups?
Design Principles
"AI tools should be designed and implemented with clear pedagogical goals and supportive structures to enhance user learning and cognitive development."
This research highlights the substantial positive impact of AI on learning, offering designers and educators data-driven insights into how these tools can be effectively implemented. Understanding these effects is crucial for developing educational technologies and pedagogical approaches that maximize student engagement and achievement.
What This Means for Your Design
Using AI tools like ChatGPT can really help students learn better and feel better about their learning, especially when teachers guide how it's used.
How to use in your project
- 1.Reference this study when discussing the potential benefits of AI tools in your design project's background research or when justifying the use of AI in your proposed solution.
Add to My Project
Quick Cite
Paragraph starter
The integration of AI tools, such as ChatGPT, has demonstrated significant potential in educational settings. A meta-analysis of recent studies indicates a large positive impact on learning performance (g = 0.867) and moderate positive effects on learning perception (g = 0.456) and higher-order thinking (g = 0.457). These findings suggest that AI can be a powerful component in educational design, provided it is implemented with appropriate scaffolding and pedagogical frameworks to maximize its benefits.
Source
Humanities and Social Sciences Communications
The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis
journal · 2025
View sourceQuestions About This Research
- What does the research say about chatgpt integration enhances learning performance and perception by up to 86.7%?
- Designers should consider how to integrate AI tools like ChatGPT into learning platforms and curricula, providing clear guidance and scaffolding to maximize their benefits for performance, perception, and critical thinking. Evidence: Humanities and Social Sciences Communications (2025).
- Why does "ChatGPT integration enhances learning performance and perception by up to 86.7%" matter for design?
- This research highlights the substantial positive impact of AI on learning, offering designers and educators data-driven insights into how these tools can be effectively implemented. Understanding these effects is crucial for developing educational technologies and pedagogical approaches that maximize student engagement and achievement.
- How can designers apply this research?
- Designers should consider how to integrate AI tools like ChatGPT into learning platforms and curricula, providing clear guidance and scaffolding to maximize their benefits for performance, perception, and critical thinking.
- What were the main findings?
- ChatGPT has a large positive impact on improving learning performance (g = 0.867).. ChatGPT has a moderately positive impact on enhancing learning perception (g = 0.456).. ChatGPT has a moderately positive impact on fostering higher-order thinking (g = 0.457).. The impact is moderated by course type, learning model, and duration.
- What research method was used?
- Meta-analysis with 51 research studies.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2025 journal from Humanities and Social Sciences Communications.
- What should I do differently in my next project?
- When designing educational software or curricula, incorporate features that leverage AI for personalized feedback, content generation, and interactive learning experiences, ensuring these are supported by pedagogical best practices.
- What are the limitations?
- Limited sample size for learning perception and higher-order thinking in some analyses; the meta-analysis is based on studies from a specific, relatively short timeframe (Nov 2022 - Feb 2025).