Short answer
To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle.
- Field
- User-Centred Design
- Source
- Academic Publication (2023)
- Method
- Qualitative analysis of challenges in human-centred learning analytics design.
- Evidence
- Moderate effect
Implementing human-centred design in learning analytics necessitates addressing challenges related to representative participation, integrating diverse expertise, balancing stakeholder input with innovation, and managing power dynamics. This user-centred design research insight is drawn from a 2023 study published in Academic Publication. Using Qualitative analysis of challenges in human-centred learning analytics design., researchers explored how this design variable affects real-world outcomes. The key design takeaway: To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle.
Co-designing Learning Analytics Requires Navigating Ethical and Practical Challenges
Implementing human-centred design in learning analytics necessitates addressing challenges related to representative participation, integrating diverse expertise, balancing stakeholder input with innovation, and managing power dynamics.
Academic Publication · 2023
Key Findings
- 01Ensuring representative participation in co-design processes for LA is difficult.
- 02Integrating the expertise and lived experiences of educators and students into LA design is crucial but complex.
- 03Balancing stakeholder input with the drive for technological innovation presents a significant challenge.
- 04Navigating power dynamics and decision-making processes among diverse stakeholders is essential for equitable LA development.
Application
Design takeaway
To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle.
How to apply
When designing any system that relies on user data and interaction, especially in educational settings, dedicate significant effort to inclusive co-design, anticipating and planning for potential conflicts and representation issues.
Project actions
- 01When involving users in your design process, think about how you'll reach a wide range of people, not just the easiest ones to find.
- 02Consider how you can respectfully incorporate the unique knowledge and experiences of your users, even if they differ from your own technical expertise.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Highlights critical, often overlooked, challenges in implementing HCD in a specific, data-rich field.
- +Provides a framework for understanding potential pitfalls in participatory design.
Limitations
It can be difficult to recruit a truly representative sample of users, and balancing the needs of different user groups can lead to compromises that don't fully satisfy anyone.
Reliability & validity
The findings are based on expert contention and conceptual analysis of challenges, rather than empirical testing of solutions. Reliability would depend on the consistency of these challenges across different LA projects.
Think critically
How can designers proactively mitigate power imbalances in co-design sessions to ensure that the voices of less dominant stakeholders are genuinely influential?
Design Principles
"Human-centred design in data-intensive systems requires a deliberate and nuanced approach to stakeholder engagement that accounts for representation, expertise, and power dynamics."
Effective design of learning analytics (LA) systems hinges on genuinely involving end-users, such as educators and students, in the design process. Failing to address the complexities of co-design can lead to LA tools that are not only ineffective but also ethically problematic, undermining trust and adoption.
What This Means for Your Design
When you try to design something with input from many different people, like students and teachers for a new learning app, it's hard to make sure everyone's voice is heard equally and that their ideas are actually used, especially when technology is changing fast.
How to use in your project
- 1.Reference this research when discussing the methodology of your user research or co-design process, particularly if you encounter difficulties in participant recruitment or integrating feedback.
Add to My Project
Quick Cite
Paragraph starter
In developing this design, a human-centred approach was considered, acknowledging the challenges identified by Martínez‐Maldonado (2023) regarding representative participation, integrating diverse expertise, balancing stakeholder input with innovation, and navigating power dynamics. These factors were taken into account during user research and design iterations to ensure a more inclusive and effective outcome.
Source
Academic Publication
Human-centred learning analytics: Four challenges in realising the potential
journal · 2023
View sourceQuestions About This Research
- What does the research say about co-designing learning analytics requires navigating ethical and practical challenges?
- To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle. Evidence: Academic Publication (2023).
- Why does "Co-designing Learning Analytics Requires Navigating Ethical and Practical Challenges" matter for design?
- Effective design of learning analytics (LA) systems hinges on genuinely involving end-users, such as educators and students, in the design process. Failing to address the complexities of co-design can lead to LA tools that are not only ineffective but also ethically problematic, undermining trust and adoption.
- How can designers apply this research?
- To create effective and trustworthy learning analytics, designers must proactively plan for and address the inherent challenges of co-design, ensuring all voices are heard and valued throughout the development lifecycle.
- What were the main findings?
- Ensuring representative participation in co-design processes for LA is difficult.. Integrating the expertise and lived experiences of educators and students into LA design is crucial but complex.. Balancing stakeholder input with the drive for technological innovation presents a significant challenge.. Navigating power dynamics and decision-making processes among diverse stakeholders is essential for equitable LA development.
- What research method was used?
- Qualitative analysis of challenges in human-centred learning analytics design..
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2023 journal from Academic Publication.
- What should I do differently in my next project?
- When designing any system that relies on user data and interaction, especially in educational settings, dedicate significant effort to inclusive co-design, anticipating and planning for potential conflicts and representation issues.
- What are the limitations?
- The paper focuses on challenges within educational contexts and may not fully generalize to other data-intensive domains. The specific methods for overcoming these challenges are not detailed.