Short answer

Designers should prioritize transparency, explainability, and clear communication of AI capabilities and limitations to foster user trust, especially in high-stakes domains like healthcare.

Field
User-Centred Design
Source
Bioengineering (2025)
Method
Narrative Review
Evidence
Strong effect

Understanding the evolution of human trust in automated systems to AI in healthcare is crucial for designing effective and user-accepted AI technologies. This user-centred design research insight is drawn from a 2025 study published in Bioengineering. Using Narrative review, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should prioritize transparency, explainability, and clear communication of AI capabilities and limitations to foster user trust, especially in high-stakes domains like healthcare.

Study
User-Centred DesignNew This WeekStrong effect

Trust in AI: Evolving from Automation to Healthcare Applications

Understanding the evolution of human trust in automated systems to AI in healthcare is crucial for designing effective and user-accepted AI technologies.

Bioengineering · 2025

01

Key Findings

  • 01Human trust has shifted from automation to AI, with expanded research paradigms and disciplines.
  • 02Key determinants of human-AI trust in healthcare include user characteristics, AI system attributes, and contextual factors.
  • 03Measurement of trust has evolved from self-report to dynamic, multimodal, and psychophysiological approaches.
  • 04Bridging actual trustworthiness and perceived trust is essential for human-centered AI.
02

Application

Design takeaway

Designers should prioritize transparency, explainability, and clear communication of AI capabilities and limitations to foster user trust, especially in high-stakes domains like healthcare.

How to apply

When designing AI-powered healthcare tools, explicitly map out how user characteristics, AI attributes (e.g., explainability features), and contextual factors (e.g., clinical workflow integration) will influence user trust, and plan for dynamic trust evaluation.

Project actions

  • 01When researching user trust in your design project, consider how the user's background and the environment affect their trust.
  • 02Think about how you can make your AI system's decisions understandable to the user.
03

Method & Evidence

AimHow has the concept of human trust in automated systems evolved into trust in AI, particularly within healthcare, and what framework can guide the design of trustworthy human-AI systems?
MethodNarrative Review
ProcedureThe researchers conducted a longitudinal review of literature spanning 30 years to trace the evolution of human-machine trust, focusing on AI in healthcare. They developed an interdisciplinary framework (I-HATR) and identified key determinants of trust, measurement approaches, and practical challenges.
ContextHealthcare AI

Variables

IVEvolution of AI technology, types of AI applications (automation vs. AI), research paradigms.
DVHuman trust in automated systems/AI, perceived trustworthiness, user acceptance.
CVHealthcare context, specific AI system features, user demographics, task complexity.
04

Strengths & Limitations

Strengths

  • +Provides a comprehensive 30-year longitudinal perspective.
  • +Offers an interdisciplinary framework (I-HATR) for research and design.

Limitations

It can be challenging to accurately measure subjective trust, and external factors not accounted for might influence user perception.

Reliability & validity

The review's reliability depends on the thoroughness of the literature search and synthesis. Validity is supported by the identification of consistent themes and the development of a structured framework. The evolution of measurement methods suggests increasing efforts towards more objective and dynamic validity.

Think critically

How might the 'black box' nature of some advanced AI algorithms inherently conflict with the need for explainability to build user trust, and what design strategies can mitigate this conflict?

05

Design Principles

"Design for trust by aligning AI's actual capabilities with user perceptions through transparent design and effective communication."

As AI becomes more integrated into critical fields like healthcare, designers must consider the nuanced factors that build and maintain user trust. This requires a shift from simply ensuring functional automation to fostering confidence in intelligent, adaptive systems.

06

What This Means for Your Design

This study shows how people's trust in technology has changed from simple machines to smart AI, especially in hospitals. It gives designers ideas on how to make AI that people will trust and use safely.

How to use in your project

  • 1.Use the identified determinants of trust (user, AI, context) to structure your user research and analysis.
  • 2.Refer to the evolution of trust measurement to justify your chosen methods for evaluating user trust in your design.
07

Add to My Project

08

Quick Cite

Paragraph starter

This research highlights the critical shift in user trust from basic automation to sophisticated AI, particularly within healthcare. The study identifies user characteristics, AI system attributes, and contextual factors as key determinants of trust. Understanding this evolution and these determinants is essential for designing AI systems that users will not only accept but also rely on effectively and safely, by ensuring perceived trustworthiness aligns with actual system capabilities.

09

Source

Bioengineering

From Trust in Automation to Trust in AI in Healthcare: A 30-Year Longitudinal Review and an Interdisciplinary Framework

journal · 2025

View source

Questions About This Research

What does the research say about trust in ai: evolving from automation to healthcare applications?
Designers should prioritize transparency, explainability, and clear communication of AI capabilities and limitations to foster user trust, especially in high-stakes domains like healthcare. Evidence: Bioengineering (2025).
Why does "Trust in AI: Evolving from Automation to Healthcare Applications" matter for design?
As AI becomes more integrated into critical fields like healthcare, designers must consider the nuanced factors that build and maintain user trust. This requires a shift from simply ensuring functional automation to fostering confidence in intelligent, adaptive systems.
How can designers apply this research?
Designers should prioritize transparency, explainability, and clear communication of AI capabilities and limitations to foster user trust, especially in high-stakes domains like healthcare.
What were the main findings?
Human trust has shifted from automation to AI, with expanded research paradigms and disciplines.. Key determinants of human-AI trust in healthcare include user characteristics, AI system attributes, and contextual factors.. Measurement of trust has evolved from self-report to dynamic, multimodal, and psychophysiological approaches.. Bridging actual trustworthiness and perceived trust is essential for human-centered AI.
What research method was used?
Narrative Review.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2025 journal from Bioengineering.
What should I do differently in my next project?
When designing AI-powered healthcare tools, explicitly map out how user characteristics, AI attributes (e.g., explainability features), and contextual factors (e.g., clinical workflow integration) will influence user trust, and plan for dynamic trust evaluation.
What are the limitations?
The review is based on existing literature and may not capture all emerging trends or niche applications. The focus on healthcare might limit direct applicability to other domains without adaptation.