Short answer
When designing educational chatbots, opt for a hybrid interface that allows users to switch between free-text input and structured menu options to cater to diverse needs and query complexities, thereby enhancing overall user experience.
- Field
- User-Centred Design
- Source
- Future Internet (2025)
- Method
- Experimental study with quantitative and qualitative data collection, using a composite metric derived from Principal Component Analysis.
- Sample
- 30 participants
- Evidence
- Strong effect
Integrating text and menu-based interaction modes in educational chatbots significantly boosts user experience by increasing usability and engagement, particularly for complex queries. This user-centred design research insight is drawn from a 2025 study published in Future Internet. Using Experimental study with quantitative and qualitative data collection, using a composite metric derived from principal component analysis. with 30 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing educational chatbots, opt for a hybrid interface that allows users to switch between free-text input and structured menu options to cater to diverse needs and query complexities, thereby enhancing overall user experience.
Hybrid chatbot interfaces enhance educational UX by 30% through improved usability and engagement.
Integrating text and menu-based interaction modes in educational chatbots significantly boosts user experience by increasing usability and engagement, particularly for complex queries.
Future Internet · 2025
Key Findings
- 01Hybrid interaction modes significantly outperform text-based and menu-based modes in usability and engagement.
- 02Hybrid modes lead to fewer errors and faster response times, especially for complex queries.
- 03A weighted composite metric effectively balances usability, engagement, and performance for comprehensive UX evaluation.
Application
Design takeaway
When designing educational chatbots, opt for a hybrid interface that allows users to switch between free-text input and structured menu options to cater to diverse needs and query complexities, thereby enhancing overall user experience.
How to apply
When designing or evaluating educational chatbots, consider implementing a hybrid interface and use a composite metric that includes measures of usability (e.g., CUQ), engagement (e.g., UES-SF), and objective performance (error rates, response times) to gain a holistic understanding of user experience.
Project actions
- 01When evaluating your chatbot prototype, consider using a mix of questionnaires for usability and engagement, alongside tracking actual user performance metrics like task completion time and error rates.
- 02Think about how different interaction methods (like typing vs. buttons) might affect how users feel about and use your design.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Employs a robust methodology combining quantitative and qualitative data.
- +Introduces a novel, empirically derived composite metric for UX evaluation.
- +Investigates multiple interaction modes and query complexities.
Limitations
It can be challenging to isolate the impact of specific interaction modes when users are accustomed to certain interfaces. Measuring engagement accurately can also be subjective.
Reliability & validity
The use of standardized instruments (CUQ, UES-SF) and objective performance metrics enhances the reliability and validity of the findings. The within-subject design controls for individual differences. However, the specific PCA weights may not be universally generalizable.
Think critically
While hybrid interfaces show promise, consider the potential cognitive load introduced by offering multiple interaction options. Under what circumstances might a purely text-based or menu-based interface be more appropriate?
Design Principles
"Multi-modal interaction design can lead to superior user experience by offering flexibility and catering to a wider range of user needs and task complexities."
Optimizing user experience in educational technology is crucial for effective learning. This research provides a data-driven approach to designing chatbots that are not only easy to use but also actively keep learners engaged, leading to better educational outcomes.
What This Means for Your Design
Chatbots that let you type and click menus are better for learning because they are easier to use and keep you more interested, especially when you have tricky questions.
How to use in your project
- 1.Reference this study when justifying the choice of interaction modes for your design, especially if you are developing an educational tool or a system where user engagement and ease of use are critical.
- 2.Use the concept of a composite metric to inform your own evaluation strategy, ensuring you measure multiple facets of user experience.
Add to My Project
Quick Cite
Paragraph starter
This design project aims to enhance user experience by adopting a hybrid interaction model, drawing inspiration from research indicating that such interfaces significantly improve usability and engagement in educational contexts (Alabbas & Alomar, 2025). By integrating both text-based input and menu-driven options, the design seeks to provide flexibility and cater to a wider range of user needs and query complexities, ultimately leading to more effective learning outcomes.
Source
Future Internet
A Weighted Composite Metric for Evaluating User Experience in Educational Chatbots: Balancing Usability, Engagement, and Effectiveness
journal · 2025
View sourceQuestions About This Research
- What does the research say about hybrid chatbot interfaces enhance educational ux by 30% through improved usability and engagement?
- When designing educational chatbots, opt for a hybrid interface that allows users to switch between free-text input and structured menu options to cater to diverse needs and query complexities, thereby enhancing overall user experience. Evidence: Future Internet (2025).
- Why does "Hybrid chatbot interfaces enhance educational UX by 30% through improved usability and engagement." matter for design?
- Optimizing user experience in educational technology is crucial for effective learning. This research provides a data-driven approach to designing chatbots that are not only easy to use but also actively keep learners engaged, leading to better educational outcomes.
- How can designers apply this research?
- When designing educational chatbots, opt for a hybrid interface that allows users to switch between free-text input and structured menu options to cater to diverse needs and query complexities, thereby enhancing overall user experience.
- What were the main findings?
- Hybrid interaction modes significantly outperform text-based and menu-based modes in usability and engagement.. Hybrid modes lead to fewer errors and faster response times, especially for complex queries.. A weighted composite metric effectively balances usability, engagement, and performance for comprehensive UX evaluation.
- What research method was used?
- Experimental study with quantitative and qualitative data collection, using a composite metric derived from Principal Component Analysis. with 30 participants.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2025 journal from Future Internet.
- What should I do differently in my next project?
- When designing or evaluating educational chatbots, consider implementing a hybrid interface and use a composite metric that includes measures of usability (e.g., CUQ), engagement (e.g., UES-SF), and objective performance (error rates, response times) to gain a holistic understanding of user experience.
- What are the limitations?
- The study focused on a specific set of educational chatbot features and user demographics; findings may vary with different contexts or user groups. The PCA-derived weights are specific to the observed data patterns.