Short answer

Integrate educators as active co-designers throughout the entire development process of educational AI tools, utilizing tailored prototyping methods to ensure relevance and usability.

Field: Innovation & Design
Source: Journal of Learning Analytics (2019)
Method: Iterative Co-design and Classroom Evaluation
Evidence: Strong effect

Involving educators directly in the design process of AI-powered educational tools leads to more effective and usable systems that better support teacher-AI collaboration. This innovation & design research insight is drawn from a 2019 study published in Journal of Learning Analytics. Using Iterative co-design and classroom evaluation, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Integrate educators as active co-designers throughout the entire development process of educational AI tools, utilizing tailored prototyping methods to ensure relevance and usability.

Study

Innovation & DesignHigh ImpactStrong effect

Co-designing AI Tools for Education Enhances Teacher-AI Complementarity

Involving educators directly in the design process of AI-powered educational tools leads to more effective and usable systems that better support teacher-AI collaboration.

Journal of Learning Analytics · 2019

Key Findings

01Co-design is essential for creating usable and useful AI-driven educational tools.
02New prototyping methods are required for co-designing complex learning analytics systems.
03Educators can effectively participate in the entire design process of AI systems, from conception to evaluation.

Application

Design takeaway

Integrate educators as active co-designers throughout the entire development process of educational AI tools, utilizing tailored prototyping methods to ensure relevance and usability.

How to apply

When designing any AI-powered tool for a specific professional domain, establish a co-design framework that includes educators or domain experts from the initial concept stage through to final testing and refinement.

Project actions

01Involve potential users of your design project early and often.
02Consider how you can prototype your ideas in a way that non-experts can easily understand and interact with.

Method & Evidence

AimHow can co-design methodologies be adapted to effectively involve non-technical stakeholders in the development of complex AI-driven learning analytics systems?

MethodIterative Co-design and Classroom Evaluation

ProcedureThe researchers engaged in an iterative co-design process with educators to develop Konscia, a wearable real-time awareness tool for AI-enhanced classrooms. They introduced a novel prototyping method called REs to facilitate this co-design, moving from generative phases through analytics selection and tuning, to real-world classroom evaluation.

ContextK-12 Educational Technology

Variables

IV["Involvement of non-technical stakeholders in the design process","Type of prototyping method used"]

DV["Usability of the AI tool","Usefulness of the AI tool","Teacher-AI complementarity"]

CV["Classroom environment","Specific AI functionalities","Teacher experience level"]

Strengths & Limitations

Strengths

+Demonstrates a complete end-to-end co-design process for a complex AI system.
+Introduces a novel prototyping method (REs) tailored for learning analytics co-design.

Limitations

The specific co-design methods and prototyping tools used might not be universally applicable to all design projects.

Reliability & validity

The study's validity is strengthened by its real-world classroom evaluation. Reliability could be enhanced by replicating the co-design process with different groups of educators.

Think critically

To what extent can the co-design methods used for this educational AI tool be generalized to other complex technological domains, such as healthcare or industrial automation?

Design Principles

"User involvement in the design of complex AI systems should be iterative, comprehensive, and supported by appropriate prototyping tools."

This research highlights the critical need for user involvement in the development of complex technological systems, particularly in specialized fields like education. By integrating non-technical stakeholders, designers can ensure that AI tools are not only functional but also practically applicable and beneficial in real-world educational settings, fostering a more synergistic relationship between human educators and AI.

What This Means for Your Design

When you make a new tech tool for teachers, it's best to have teachers help you design it from start to finish. This makes the tool much more likely to be useful and easy to use in a real classroom.

How to use in your project

1.Reference this study when discussing the importance of user research and iterative design in your design project, particularly when developing technology for specific user groups.

Add to My Project

Quick Cite

Paragraph starter

The iterative co-design process, as demonstrated by Holstein et al. (2019) in the development of an AI orchestration tool, highlights the critical need for direct stakeholder involvement to ensure the utility and usability of complex technological systems. By actively engaging non-technical users throughout the design lifecycle, including the development of specialized prototyping methods, designers can create solutions that are effectively integrated into real-world contexts.

Source

Journal of Learning Analytics

Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher–AI Complementarity

journal · 2019

View source

Questions About This Research

What does the research say about co-designing ai tools for education enhances teacher-ai complementarity?: Integrate educators as active co-designers throughout the entire development process of educational AI tools, utilizing tailored prototyping methods to ensure relevance and usability. Evidence: Journal of Learning Analytics (2019).
Why does "Co-designing AI Tools for Education Enhances Teacher-AI Complementarity" matter for design?: This research highlights the critical need for user involvement in the development of complex technological systems, particularly in specialized fields like education. By integrating non-technical stakeholders, designers can ensure that AI tools are not only functional but also practically applicable and beneficial in real-world educational settings, fostering a more synergistic relationship between human educators and AI.
How can designers apply this research?: Integrate educators as active co-designers throughout the entire development process of educational AI tools, utilizing tailored prototyping methods to ensure relevance and usability.
What were the main findings?: Co-design is essential for creating usable and useful AI-driven educational tools.. New prototyping methods are required for co-designing complex learning analytics systems.. Educators can effectively participate in the entire design process of AI systems, from conception to evaluation.
What research method was used?: Iterative Co-design and Classroom Evaluation.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2019 journal from Journal of Learning Analytics.
What should I do differently in my next project?: When designing any AI-powered tool for a specific professional domain, establish a co-design framework that includes educators or domain experts from the initial concept stage through to final testing and refinement.
What are the limitations?: The effectiveness of the REs prototyping method may vary depending on the specific AI system and the participants' technical backgrounds.