Co-designing Learning Analytics Requires Navigating Ethical and Practical Challenges
Implementing human-centred design in learning analytics necessitates addressing challenges related to representative participation, integrating diverse expertise, balancing stakeholder input with innovation, and managing power dynamics.
Academic Publication · 2023
Key Findings
- 01Ensuring representative participation in co-design processes for LA is difficult.
- 02Integrating the expertise and lived experiences of educators and students into LA design is crucial but complex.
- 03Balancing stakeholder input with the drive for technological innovation presents a significant challenge.
- 04Navigating power dynamics and decision-making processes among diverse stakeholders is essential for equitable LA development.
Application
Design takeaway
To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle.
How to apply
When designing any system that relies on user data and interaction, especially in educational settings, dedicate significant effort to inclusive co-design, anticipating and planning for potential conflicts and representation issues.
Project actions
- 01When involving users in your design process, think about how you'll reach a wide range of people, not just the easiest ones to find.
- 02Consider how you can respectfully incorporate the unique knowledge and experiences of your users, even if they differ from your own technical expertise.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Highlights critical, often overlooked, challenges in implementing HCD in a specific, data-rich field.
- +Provides a framework for understanding potential pitfalls in participatory design.
Limitations
It can be difficult to recruit a truly representative sample of users, and balancing the needs of different user groups can lead to compromises that don't fully satisfy anyone.
Reliability & validity
The findings are based on expert contention and conceptual analysis of challenges, rather than empirical testing of solutions. Reliability would depend on the consistency of these challenges across different LA projects.
Think critically
How can designers proactively mitigate power imbalances in co-design sessions to ensure that the voices of less dominant stakeholders are genuinely influential?
Design Principles
"Human-centred design in data-intensive systems requires a deliberate and nuanced approach to stakeholder engagement that accounts for representation, expertise, and power dynamics."
Effective design of learning analytics (LA) systems hinges on genuinely involving end-users, such as educators and students, in the design process. Failing to address the complexities of co-design can lead to LA tools that are not only ineffective but also ethically problematic, undermining trust and adoption.
What This Means for Your Design
When you try to design something with input from many different people, like students and teachers for a new learning app, it's hard to make sure everyone's voice is heard equally and that their ideas are actually used, especially when technology is changing fast.
How to use in your project
- 1.Reference this research when discussing the methodology of your user research or co-design process, particularly if you encounter difficulties in participant recruitment or integrating feedback.
Add to My Project
Quick Cite
(2023). Human-centred learning analytics: Four challenges in realising the potential. Academic Publication. https://doi.org/10.59453/fizj7007 Retrieved from https://designdex.org/study/c2b5d5fc-8b67-430d-8533-8a6216589668/co-designing-learning-analytics-requires-navigating-ethical-and-practical-challenges
Paragraph starter
In developing this design, a human-centred approach was considered, acknowledging the challenges identified by Martínez‐Maldonado (2023) regarding representative participation, integrating diverse expertise, balancing stakeholder input with innovation, and navigating power dynamics. These factors were taken into account during user research and design iterations to ensure a more inclusive and effective outcome.
Source
Academic Publication
Human-centred learning analytics: Four challenges in realising the potential
journal · 2023
View sourceQuestions about this research
- What does the research say about co-designing learning analytics requires navigating ethical and practical challenges?
- To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle. Evidence: Academic Publication (2023).
- Why does "Co-designing Learning Analytics Requires Navigating Ethical and Practical Challenges" matter for design?
- Effective design of learning analytics (LA) systems hinges on genuinely involving end-users, such as educators and students, in the design process. Failing to address the complexities of co-design can lead to LA tools that are not only ineffective but also ethically problematic, undermining trust and adoption.
- How can designers apply this research?
- To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle.
- What were the main findings?
- Ensuring representative participation in co-design processes for LA is difficult.. Integrating the expertise and lived experiences of educators and students into LA design is crucial but complex.. Balancing stakeholder input with the drive for technological innovation presents a significant challenge.. Navigating power dynamics and decision-making processes among diverse stakeholders is essential for equitable LA development.
- What research method was used?
- Qualitative analysis of challenges in human-centred learning analytics design..
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2023 journal from Academic Publication.
- What should I do differently in my next project?
- When designing any system that relies on user data and interaction, especially in educational settings, dedicate significant effort to inclusive co-design, anticipating and planning for potential conflicts and representation issues.
- What are the limitations?
- The paper focuses on challenges within educational contexts and may not fully generalize to other data-intensive domains. The specific methods for overcoming these challenges are not detailed.
- Is there evidence that learning analytics affects design outcomes?
- Developing learning analytics tools with user input is complicated by the need for diverse representation, integrating varied knowledge, managing conflicting priorities between users and developers, and addressing inherent power imbalances. Effective design of learning analytics (LA) systems hinges on genuinely involvi Source: Academic Publication (2023).
- Where does this challenges research apply?
- Educational technology, learning analytics systems development. It sits within user-centred design research on designdex.org.
Related research topics
learning analytics design research · evidence on learning analytics · does learning analytics improve design outcomes · challenges studies for designers · learning analytics and challenges findings · user-centred design research evidence