Short answer

When designing educational tools, focus on creating interactive experiences that prompt critical thinking and reflection, rather than simply delivering information.

Field: User-Centred Design
Source: JITeCS (Journal of Information Technology and Computer Science) (2026)
Method: Mixed-methods approach combining qualitative UI/UX design process with quantitative usability and engagement assessments.
Sample: 136 participants for usability testing, 312 Grade XI students for engagement testing.
Evidence: Strong effect

Designing a chatbot interface that facilitates Socratic dialogue, rather than providing direct answers, can significantly increase student engagement and critical thinking skills in online learning environments. This user-centred design research insight is drawn from a 2026 study published in JITeCS (Journal of Information Technology and Computer Science). Using Mixed-methods approach combining qualitative ui/ux design process with quantitative usability and engagement assessments. with 136 participants for usability testing, 312 Grade XI students for engagement testing., researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing educational tools, focus on creating interactive experiences that prompt critical thinking and reflection, rather than simply delivering information.

Study

User-Centred DesignNew This WeekStrong effect

Socratic Chatbot UI Boosts Critical Thinking by 35 Points

JITeCS (Journal of Information Technology and Computer Science) · 2026

Key Findings

01The UI successfully translated four narrative learning stages into an interactive interface.
02The chatbot interface achieved an excellent SUS score of 86.09.
03Students engaged in reflective thinking, avoiding direct answers.
04Critical thinking scores increased by 35.03 points (p = 0.005).

Application

Design takeaway

When designing educational tools, focus on creating interactive experiences that prompt critical thinking and reflection, rather than simply delivering information.

How to apply

When developing educational software or chatbots, integrate Socratic questioning principles into the conversational flow and design the interface to support this interactive learning style.

Project actions

01When designing an interactive system, consider how the interface can guide the user's cognitive process.
02Use user feedback to iteratively refine the design, focusing on how it impacts engagement and learning.

Method & Evidence

AimTo design and evaluate a Socratic dialogue chatbot interface for an LMS that enhances student engagement and critical thinking in history education.

MethodMixed-methods approach combining qualitative UI/UX design process with quantitative usability and engagement assessments.

ProcedureThe UI/UX design followed the Successive Approximation Model (SAM) integrated with Design Thinking (empathize, define, ideate, prototype, test). Usability was assessed using the System Usability Scale (SUS), and engagement/critical thinking impact was measured through observations, conversation logs, and pre/post-test critical thinking scores.

Sample136 participants for usability testing, 312 Grade XI students for engagement testing.

ContextOnline learning platforms, specifically history education within a Learning Management System (LMS).

Variables

IV["Chatbot interface design (Socratic vs. direct answer)","Integration of SAM and Design Thinking"]

DV["Student engagement","Critical thinking scores","Usability (SUS score)"]

CV["Grade level (Grade XI)","Subject (History)","Online learning platform (LMS)"]

Strengths & Limitations

Strengths

+Robust mixed-methods approach.
+Large sample size for engagement testing.
+Clear application of design methodologies (SAM, Design Thinking).

Limitations

The specific historical context might influence the results; the effectiveness in other subjects would need further investigation.

Reliability & validity

The use of established metrics like SUS and statistical analysis of critical thinking scores contributes to the study's reliability and validity. The qualitative process description adds depth to the findings.

Think critically

How might the 'Socratic' nature of the chatbot be implemented in an interface that doesn't rely on text-based dialogue, such as a visual programming environment?

Design Principles

"Design interfaces that facilitate inquiry-based learning and encourage user reflection."

This research highlights the power of interface design in shaping user interaction and learning outcomes. By moving beyond simple information delivery, designers can create tools that actively promote deeper cognitive processes, addressing common issues of student disengagement and passive learning.

What This Means for Your Design

Making a learning chatbot ask questions and guide students to think for themselves, instead of just giving them answers, makes them more engaged and better at critical thinking.

How to use in your project

1.Reference this study when discussing the impact of UI/UX design on user engagement and cognitive development in your design project.

Add to My Project

Quick Cite

Paragraph starter

The integration of Socratic dialogue principles within a user-centered interface design, as demonstrated by Widjanarko et al. (2026), significantly enhances critical thinking skills by promoting reflective engagement over passive information acquisition. This approach is crucial for developing educational technologies that foster deeper learning.

Source

JITeCS (Journal of Information Technology and Computer Science)

Designing and Evaluating the User Interface of a Socratic Dialogue Chatbot to Enhance Student Engagement in Online Learning Platforms

journal · 2026

View source

Questions About This Research

What does the research say about socratic chatbot ui boosts critical thinking by 35 points?: When designing educational tools, focus on creating interactive experiences that prompt critical thinking and reflection, rather than simply delivering information. Evidence: JITeCS (Journal of Information Technology and Computer Science) (2026).
Why does "Socratic Chatbot UI Boosts Critical Thinking by 35 Points" matter for design?: This research highlights the power of interface design in shaping user interaction and learning outcomes. By moving beyond simple information delivery, designers can create tools that actively promote deeper cognitive processes, addressing common issues of student disengagement and passive learning.
How can designers apply this research?: When designing educational tools, focus on creating interactive experiences that prompt critical thinking and reflection, rather than simply delivering information.
What were the main findings?: The UI successfully translated four narrative learning stages into an interactive interface.. The chatbot interface achieved an excellent SUS score of 86.09.. Students engaged in reflective thinking, avoiding direct answers.. Critical thinking scores increased by 35.03 points (p = 0.005).
What research method was used?: Mixed-methods approach combining qualitative UI/UX design process with quantitative usability and engagement assessments. with 136 participants for usability testing, 312 Grade XI students for engagement testing..
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2026 journal from JITeCS (Journal of Information Technology and Computer Science).
What should I do differently in my next project?: When developing educational software or chatbots, integrate Socratic questioning principles into the conversational flow and design the interface to support this interactive learning style.
What are the limitations?: The study focused on history education; generalizability to other subjects may vary. Long-term engagement effects were not assessed.