Algorithmic Thinking Assessment Tool Achieves Usability and Accessibility Through Participatory Design
A digital tool for assessing algorithmic thinking in compulsory education was successfully developed and refined through iterative design cycles involving end-user feedback and expert evaluation.
International Journal of Child-Computer Interaction · 2025
Key Findings
- 01The virtual CAT tool demonstrated usability and accessibility for a diverse age range of students.
- 02The participatory design approach effectively shaped the platform to be relevant and practical for classroom settings.
- 03Preliminary results suggest the tool is suitable for assessing algorithmic thinking skills across different developmental stages.
Application
Design takeaway
Integrate end-users (students and teachers) and subject matter experts throughout the design and development process of educational tools to ensure they are usable, accessible, and effectively meet learning objectives.
How to apply
When designing any educational software or digital learning tool, conduct user testing with the target age group and educators at multiple stages of development. Incorporate feedback to refine interfaces, content, and functionality.
Project actions
- 01Clearly define your target user group and their needs early in the project.
- 02Plan for multiple rounds of testing and feedback incorporation.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Inclusion of a wide age range in the pilot study.
- +Use of participatory design principles to gather end-user insights.
Limitations
It's hard to get feedback from a very large and diverse group of users. Also, initial tests might not show if the tool works perfectly for everyone in the long run.
Reliability & validity
The study's reliability could be enhanced by further validation of the assessment's psychometric properties. Validity is supported by the participatory design process ensuring relevance to user needs and classroom contexts.
Think critically
To what extent can a single digital tool effectively assess a complex skill like algorithmic thinking across a wide age range (4-12 years), and what are the potential trade-offs in depth versus breadth of assessment?
Design Principles
"Involve diverse user groups in iterative design and testing to create effective and accessible educational technologies."
This research highlights the critical role of user-centred design principles in creating effective educational technology. By involving students and teachers throughout the development process, the tool ensures relevance, practicality, and engagement, leading to more accurate and meaningful assessments.
What This Means for Your Design
To make a new learning tool for kids, designers talked to kids and teachers a lot. This helped them make the tool easy to use and good for learning, even for different ages and languages.
How to use in your project
- 1.Reference this study when discussing the importance of user testing and iterative design in your own design project, particularly if it involves educational technology or tools for specific age groups.
Add to My Project
Quick Cite
(2025). Designing the virtual CAT: A digital tool for algorithmic thinking assessment in compulsory education. International Journal of Child-Computer Interaction. https://doi.org/10.1016/j.ijcci.2025.100760 Retrieved from https://designdex.org/study/bd1195e3-a49e-4225-b09a-7a1f1fe96ce6/algorithmic-thinking-assessment-tool-achieves-usability-and-accessibility-through-participatory-design
Paragraph starter
The development of the virtual Cross Array Task (CAT) exemplifies a robust user-centred design approach, integrating participatory methods and iterative refinement to ensure the tool's usability and accessibility for students in compulsory education. This process, involving direct input from students and teachers, was crucial in shaping the platform to be practical and effective for assessing algorithmic thinking skills across diverse age groups and educational contexts.
Source
International Journal of Child-Computer Interaction
Designing the virtual CAT: A digital tool for algorithmic thinking assessment in compulsory education
journal · 2025
View sourceQuestions about this research
- What does the research say about algorithmic thinking assessment tool achieves usability and accessibility through participatory design?
- Integrate end-users (students and teachers) and subject matter experts throughout the design and development process of educational tools to ensure they are usable, accessible, and effectively meet learning objectives. Evidence: International Journal of Child-Computer Interaction (2025).
- Why does "Algorithmic Thinking Assessment Tool Achieves Usability and Accessibility Through Participatory Design" matter for design?
- This research highlights the critical role of user-centred design principles in creating effective educational technology. By involving students and teachers throughout the development process, the tool ensures relevance, practicality, and engagement, leading to more accurate and meaningful assessments.
- How can designers apply this research?
- Integrate end-users (students and teachers) and subject matter experts throughout the design and development process of educational tools to ensure they are usable, accessible, and effectively meet learning objectives.
- What were the main findings?
- The virtual CAT tool demonstrated usability and accessibility for a diverse age range of students.. The participatory design approach effectively shaped the platform to be relevant and practical for classroom settings.. Preliminary results suggest the tool is suitable for assessing algorithmic thinking skills across different developmental stages.
- What research method was used?
- Participatory Design and Iterative Design Cycles with Students aged 4-12 (specific number not stated).
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2025 journal from International Journal of Child-Computer Interaction.
- What should I do differently in my next project?
- When designing any educational software or digital learning tool, conduct user testing with the target age group and educators at multiple stages of development. Incorporate feedback to refine interfaces, content, and functionality.
- What are the limitations?
- The study focused on a specific algorithmic thinking assessment (CAT) and its application in Swiss compulsory education; generalizability to other assessment types or educational systems may vary. Preliminary analysis of assessment capabilities requires further validation.
- Is there evidence that algorithmic thinking affects design outcomes?
- The digital assessment tool was found to be easy to use and accessible for children across a wide age range, and the design process involving users ensured it was practical for schools. Initial data indicates it can effectively measure algorithmic thinking skills. This research highlights the critical role of user-cent Source: International Journal of Child-Computer Interaction (2025).
- Where does this thinking assessment research apply?
- Compulsory education, digital literacy, algorithmic thinking assessment It sits within user-centred design research on designdex.org.
Related research topics
algorithmic thinking design research · evidence on algorithmic thinking · does algorithmic thinking improve design outcomes · thinking assessment studies for designers · algorithmic thinking and thinking assessment findings · user-centred design research evidence