Short answer

When designing learning analytics, prioritize features that directly address learners' self-identified challenges in time management and motivation, and involve them throughout the design process.

Field
User-Centred Design
Source
Information and Learning Sciences (2023)
Method
Triangulated qualitative research
Sample
27 lifelong learners, 5 teachers, 4 experts
Evidence
Moderate effect

Designing learning analytics tools requires a deep understanding of lifelong learners' challenges and needs to effectively support their self-regulated learning processes. This user-centred design research insight is drawn from a 2023 study published in Information and Learning Sciences. Using Triangulated qualitative research with 27 lifelong learners, 5 teachers, 4 experts, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing learning analytics, prioritize features that directly address learners' self-identified challenges in time management and motivation, and involve them throughout the design process.

Study
User-Centred DesignRecentModerate effect

Integrate Learner Needs for Effective Self-Regulated Learning Analytics

Designing learning analytics tools requires a deep understanding of lifelong learners' challenges and needs to effectively support their self-regulated learning processes.

Information and Learning Sciences · 2023

01

Key Findings

  • 01Lifelong learners, particularly in professional development, struggle with time management and maintaining motivation.
  • 02Support for time management and motivation is crucial for improving self-regulated learning.
  • 03A set of design principles for self-regulated learning analytics (SRLA) was proposed and evaluated.
02

Application

Design takeaway

When designing learning analytics, prioritize features that directly address learners' self-identified challenges in time management and motivation, and involve them throughout the design process.

How to apply

Before developing or iterating on a learning analytics tool, conduct user research with the target audience to understand their specific SRL challenges and desired support mechanisms.

Project actions

  • 01When researching user needs for a design project, consider different stakeholder groups (users, educators, experts).
  • 02Use qualitative methods like focus groups and interviews to gather rich, in-depth insights into user experiences and challenges.
03

Method & Evidence

AimWhat are the challenges faced by lifelong learners in self-regulated learning, and what are their needs and desired features for learning analytics tools designed to support SRL?
MethodTriangulated qualitative research
ProcedureData was collected through focus group discussions with lifelong learners, interviews with teachers, and expert evaluations of learning analytics systems.
Sample27 lifelong learners, 5 teachers, 4 experts
ContextEducational technology, lifelong learning, self-regulated learning analytics

Variables

IVLearner challenges and needs in SRL
DVDesired features for SRLA, effectiveness of SRLA
CVLearner demographic (lifelong learners in professional development), context of learning
04

Strengths & Limitations

Strengths

  • +Utilizes a multi-stakeholder approach (learners, teachers, experts) for a comprehensive perspective.
  • +Employs qualitative methods to capture rich, nuanced user insights.

Limitations

Qualitative data can be subjective, and the sample size, while adequate for depth, may limit the generalizability of findings to broader populations.

Reliability & validity

The triangulation of data from multiple sources (learners, teachers, experts) enhances the validity of the findings. Reliability would depend on the consistency of responses within each group and the clear articulation of the research protocol.

Think critically

How might the design principles for SRLA differ for younger learners or those in different educational settings compared to lifelong learners in professional development?

05

Design Principles

"User-centric design for learning analytics must address practical learner challenges like time management and motivation."

In today's dynamic world, lifelong learning is essential. Tools that support self-regulated learning (SRL) can be powerful, but their design must actively incorporate the perspectives of the users—the learners themselves. Failing to do so risks creating analytics that are ineffective or even counterproductive.

06

What This Means for Your Design

To make learning tools that help people learn by themselves better, we need to ask them what's hard about learning and what they wish the tools could do to help.

How to use in your project

  • 1.Reference this study when justifying the need for user research to understand challenges in self-regulated learning for your design project.
  • 2.Use the findings on time management and motivation as a basis for identifying potential features or areas of focus for your design.
07

Add to My Project

08

Quick Cite

Paragraph starter

This research highlights the critical need to integrate lifelong learner perspectives into the design of self-regulated learning analytics. Findings indicate that learners in professional development face significant challenges with time management and motivation, underscoring the importance of SRLA features that directly address these issues. Therefore, user-centered design methodologies, incorporating direct feedback from learners, are essential for developing effective learning analytics tools that genuinely support self-regulated learning.

09

Source

Information and Learning Sciences

Lifelong learner needs for human-centered self-regulated learning analytics

journal · 2023

View source

Questions About This Research

What does the research say about integrate learner needs for effective self-regulated learning analytics?
When designing learning analytics, prioritize features that directly address learners' self-identified challenges in time management and motivation, and involve them throughout the design process. Evidence: Information and Learning Sciences (2023).
Why does "Integrate Learner Needs for Effective Self-Regulated Learning Analytics" matter for design?
In today's dynamic world, lifelong learning is essential. Tools that support self-regulated learning (SRL) can be powerful, but their design must actively incorporate the perspectives of the users—the learners themselves. Failing to do so risks creating analytics that are ineffective or even counterproductive.
How can designers apply this research?
When designing learning analytics, prioritize features that directly address learners' self-identified challenges in time management and motivation, and involve them throughout the design process.
What were the main findings?
Lifelong learners, particularly in professional development, struggle with time management and maintaining motivation.. Support for time management and motivation is crucial for improving self-regulated learning.. A set of design principles for self-regulated learning analytics (SRLA) was proposed and evaluated.
What research method was used?
Triangulated qualitative research with 27 lifelong learners, 5 teachers, 4 experts.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2023 journal from Information and Learning Sciences.
What should I do differently in my next project?
Before developing or iterating on a learning analytics tool, conduct user research with the target audience to understand their specific SRL challenges and desired support mechanisms.
What are the limitations?
The study focused on lifelong learners in professional development programs, so findings may not generalize to all learner populations or educational contexts.