Short answer

Move beyond initial user feedback to proactively plan for market integration, ethical safeguards, and the long-term adoption challenges of AI-driven educational technologies.

Field: User-Centred Design
Source: Postdigital Science and Education (2023)
Method: Ethnographic fieldwork and a relational materialist approach.
Evidence: Moderate effect

Co-designing AI and learning analytics integrated systems in education is a complex, iterative process that extends beyond initial idea generation to market integration and ethical considerations. This user-centred design research insight is drawn from a 2023 study published in Postdigital Science and Education. Using Ethnographic fieldwork and a relational materialist approach., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Move beyond initial user feedback to proactively plan for market integration, ethical safeguards, and the long-term adoption challenges of AI-driven educational technologies.

Study

User-Centred DesignRecentModerate effect

Co-designing AI-LMS in K-12: Navigating Complexities Beyond Idea Generation

Co-designing AI and learning analytics integrated systems in education is a complex, iterative process that extends beyond initial idea generation to market integration and ethical considerations.

Postdigital Science and Education · 2023

Key Findings

01The co-design process for AI and LA-integrated LMS is complex and emerges as a series of events, not a linear progression.
02AI and LA act as 'negotiating ideas' and 'boundary objects' that facilitate connection between diverse stakeholders.
03Despite teacher and student involvement, co-design did not guarantee extensive adoption or fully address ethical concerns regarding student data.
04The marketization of K-12 education and the prevalence of existing EdTech influence the co-design and adoption of new systems.

Application

Design takeaway

Move beyond initial user feedback to proactively plan for market integration, ethical safeguards, and the long-term adoption challenges of AI-driven educational technologies.

How to apply

When designing AI-powered educational tools, map out all stakeholders, anticipate market pressures, and build robust ethical frameworks for data handling into the core design, not as an afterthought.

Project actions

01Consider the entire journey of your design, from initial concept to potential market adoption.
02Identify and address potential ethical issues early in your design process.

Method & Evidence

AimTo explore the challenges and dynamics of co-designing an AI and learning analytics integrated learning management system (LMS) in K-12 education.

MethodEthnographic fieldwork and a relational materialist approach.

ProcedureResearchers conducted ethnographic fieldwork in primary and secondary schools to observe and analyze the co-design process of an AI and LA-integrated LMS, focusing on the relationships between various actors and the system's integration into the existing educational technology market.

ContextK-12 education, educational technology (EdTech), learning management systems (LMS), artificial intelligence (AI), learning analytics (LA).

Variables

IVCo-design process, involvement of actors (teachers, students, developers).

DVAdoption of LMS, addressing of ethical issues, integration into school market.

CVK-12 education setting, AI/LA integration, existing EdTech prevalence.

Strengths & Limitations

Strengths

+Utilizes ethnographic fieldwork for in-depth understanding of real-life processes.
+Applies a relational materialist approach to analyze complex actor networks.

Limitations

The specific AI/LA system studied might have unique implementation challenges not representative of all educational technologies. The 'marketization' aspect is specific to current trends in EdTech.

Reliability & validity

Reliability could be enhanced through triangulation of data sources and methods. Validity is strengthened by the in-depth ethnographic approach capturing nuanced social and material interactions.

Think critically

To what extent can 'co-design' truly be effective when commercial interests and market pressures are significant factors in the adoption of educational technology?

Design Principles

"User-centered design for complex systems requires continuous engagement with ethical considerations and market realities throughout the entire development and deployment lifecycle."

This research highlights that successful user-centered design for educational technology, particularly AI-driven systems, requires a deep understanding of the entire ecosystem, including market forces and ethical implications, not just user input during early stages. Designers must anticipate the challenges of scaling and commercialization.

What This Means for Your Design

When you try to design something new with AI for schools, it's not just about getting ideas from teachers and students. You also have to think about how it will be sold, if schools will actually use it, and how to keep student data safe.

How to use in your project

1.Reference this study when discussing the limitations of user testing or the importance of considering market factors in your design process.

Add to My Project

Quick Cite

Paragraph starter

The co-design of AI and learning analytics integrated systems in K-12 education presents significant challenges beyond initial idea generation, as highlighted by research indicating that marketization and ethical considerations play a crucial role in adoption and success. Designers must therefore adopt a holistic approach, anticipating the full lifecycle of their product and proactively addressing potential barriers to implementation and user trust.

Source

Postdigital Science and Education

Behind the Scenes of Co-designing AI and LA in K-12 Education

journal · 2023

View source

Questions About This Research

What does the research say about co-designing ai-lms in k-12: navigating complexities beyond idea generation?: Move beyond initial user feedback to proactively plan for market integration, ethical safeguards, and the long-term adoption challenges of AI-driven educational technologies. Evidence: Postdigital Science and Education (2023).
Why does "Co-designing AI-LMS in K-12: Navigating Complexities Beyond Idea Generation" matter for design?: This research highlights that successful user-centered design for educational technology, particularly AI-driven systems, requires a deep understanding of the entire ecosystem, including market forces and ethical implications, not just user input during early stages. Designers must anticipate the challenges of scaling and commercialization.
How can designers apply this research?: Move beyond initial user feedback to proactively plan for market integration, ethical safeguards, and the long-term adoption challenges of AI-driven educational technologies.
What were the main findings?: The co-design process for AI and LA-integrated LMS is complex and emerges as a series of events, not a linear progression.. AI and LA act as 'negotiating ideas' and 'boundary objects' that facilitate connection between diverse stakeholders.. Despite teacher and student involvement, co-design did not guarantee extensive adoption or fully address ethical concerns regarding student data.. The marketization of K-12 education and the prevalence of existing EdTech influence the co-design and adoption of new systems.
What research method was used?: Ethnographic fieldwork and a relational materialist approach..
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2023 journal from Postdigital Science and Education.
What should I do differently in my next project?: When designing AI-powered educational tools, map out all stakeholders, anticipate market pressures, and build robust ethical frameworks for data handling into the core design, not as an afterthought.
What are the limitations?: The study focused on a specific context of AI/LA integration in K-12, and findings may not generalize to all educational settings or technology types. The 'stand-alone app' development might represent a specific outcome not reflective of all potential LMS integrations.