Short answer

Empower users with control over how they view and interact with their learning data, and provide clear, understandable feedback, to build and maintain trust.

Field
User-Centred Design
Source
University of Birmingham Institutional Research Archive (University of Birmingham) (2014)
Method
User study
Evidence
Moderate effect

Learners are more likely to trust and engage with open learner models when they have control over the model's presentation and can view peer data. This user-centred design research insight is drawn from a 2014 study published in University of Birmingham Institutional Research Archive (University of Birmingham). Using User study, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Empower users with control over how they view and interact with their learning data, and provide clear, understandable feedback, to build and maintain trust.

Study
User-Centred DesignHigh ImpactModerate effect

Learner Trust in Open Models Increases with Perceived Control and Transparency

Learners are more likely to trust and engage with open learner models when they have control over the model's presentation and can view peer data.

University of Birmingham Institutional Research Archive (University of Birmingham) · 2014

01

Key Findings

  • 01Learners generally trust the OLM system more in the short term than in the long term.
  • 02Learners' trust is influenced by the complexity of model presentation and the level of control they have over the model.
  • 03Named peer models are trusted more than anonymous peer models.
02

Application

Design takeaway

Empower users with control over how they view and interact with their learning data, and provide clear, understandable feedback, to build and maintain trust.

How to apply

When designing any system that provides users with insights into their performance or data, offer options for customization and clear explanations of how the data is generated and used.

Project actions

  • 01Consider how your design will make users feel safe and in control.
  • 02Think about how you will explain complex information to users clearly.
03

Method & Evidence

AimTo investigate learner trust in open learner models from the perspectives of the system as a whole and specific model features.
MethodUser study
ProcedureInvestigated learner trust in an open learner model (OLM) system by examining initial use, continued optional use, and long-term use. Additionally, explored trust based on model presentation complexity, learner control, and the ability to view and share peer models.
ContextEducational technology, adaptive learning systems

Variables

IV["Complexity of model presentation","Level of learner control","Anonymity of peer models"]
DV["Learner trust in the system","Learner trust in OLM features"]
CV["Initial system use","Optional continued use","Long-term use"]
04

Strengths & Limitations

Strengths

  • +Investigated trust from multiple perspectives (system-wide and feature-specific).
  • +Considered both short-term and long-term user engagement.

Limitations

The study focused on a specific type of system (open learner models), so findings might not directly apply to all interactive systems.

Reliability & validity

Reliability could be improved by using standardized trust questionnaires. Validity is supported by examining trust from multiple angles (initial, long-term, feature-specific).

Think critically

How might the long-term decrease in trust be mitigated through design interventions?

05

Design Principles

"User trust in intelligent systems is cultivated through transparency, perceived control, and clear communication of system functionality and data."

Understanding user trust is critical for the adoption and effectiveness of adaptive learning systems. Designing interfaces that offer transparency and user agency can significantly improve user engagement and satisfaction.

06

What This Means for Your Design

People trust computer systems that show them how they work and let them change things more than systems that are secret or don't let them make choices.

How to use in your project

  • 1.Use this research to justify design decisions related to user control and transparency in your design project.
07

Add to My Project

08

Quick Cite

Paragraph starter

Research indicates that user trust in systems, particularly those providing feedback or insights, is significantly influenced by perceived control and transparency. Findings from studies on open learner models suggest that providing users with options to customize the presentation of information and offering clear explanations of system logic can foster greater trust and engagement. Furthermore, the way comparative data, such as peer performance, is presented can impact user perception, with named comparisons often eliciting higher trust than anonymous ones. These insights are crucial for designing user interfaces that promote confidence and long-term adoption.

09

Source

University of Birmingham Institutional Research Archive (University of Birmingham)

Users’ trust in open learner models

journal · 2014

View source

Questions About This Research

What does the research say about learner trust in open models increases with perceived control and transparency?
Empower users with control over how they view and interact with their learning data, and provide clear, understandable feedback, to build and maintain trust. Evidence: University of Birmingham Institutional Research Archive (University of Birmingham) (2014).
Why does "Learner Trust in Open Models Increases with Perceived Control and Transparency" matter for design?
Understanding user trust is critical for the adoption and effectiveness of adaptive learning systems. Designing interfaces that offer transparency and user agency can significantly improve user engagement and satisfaction.
How can designers apply this research?
Empower users with control over how they view and interact with their learning data, and provide clear, understandable feedback, to build and maintain trust.
What were the main findings?
Learners generally trust the OLM system more in the short term than in the long term.. Learners' trust is influenced by the complexity of model presentation and the level of control they have over the model.. Named peer models are trusted more than anonymous peer models.
What research method was used?
User study.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2014 journal from University of Birmingham Institutional Research Archive (University of Birmingham).
What should I do differently in my next project?
When designing any system that provides users with insights into their performance or data, offer options for customization and clear explanations of how the data is generated and used.
What are the limitations?
Long-term trust may decrease over time, suggesting a need for ongoing engagement strategies. The impact of anonymity on peer model trust requires further investigation.