Study
User-Centred DesignHigh ImpactModerate effect

AI in Healthcare: Public Preference for Human Oversight and Clear Communication

Despite general positivity towards Artificial Intelligence (AI) in healthcare, patients and the public express significant reservations, prioritizing human supervision and clear understanding of AI's role.

The Lancet Digital Health · 2021

01

Key Findings

  • 01Patients and the general public generally hold positive attitudes towards AI in healthcare.
  • 02Significant reservations exist regarding AI, with a strong preference for human supervision.
  • 03Concerns revolve around AI's conceptual understanding, acceptability, relationship with humans, development, implementation, strengths, benefits, weaknesses, and risks.
02

Application

Design takeaway

Design AI healthcare solutions that clearly delineate the AI's role as a supportive tool, ensuring human oversight and providing accessible explanations of its functionality and limitations to build trust and acceptance.

How to apply

When designing any AI-powered medical device or software, conduct user research specifically focused on understanding patient and clinician perceptions of AI's role, potential risks, and desired levels of human involvement.

Project actions

  • 01When designing a product that uses AI, think about how you will explain its function to the user.
  • 02Consider how your design will allow for human oversight or intervention.
03

Method & Evidence

AimWhat are the attitudes of patients and the general public towards clinical Artificial Intelligence, and what are their key concerns and preferences regarding its development and implementation?
MethodMixed Methods Systematic Review
ProcedureA systematic review of biomedical and computational databases was conducted to identify original research articles (quantitative, qualitative, and mixed methods) published between January 1, 2000, and September 28, 2020, focusing on patient and general public attitudes towards clinical AI. 2590 articles were screened, and 23 met the inclusion criteria.
ContextHealthcare, Clinical Artificial Intelligence

Variables

IV["Type of AI (hypothetical vs. realized)","AI application area"]
DV["Patient/public attitudes towards AI","Preferences for human supervision","Concerns and reservations"]
CV["Study design","Methodology of included studies"]
04

Strengths & Limitations

Strengths

  • +Comprehensive systematic review covering a decade of research.
  • +Mixed-methods approach captures diverse user perspectives.

Limitations

The studies reviewed often focused on hypothetical AI, so real-world user reactions might differ. The quality of the original studies varied.

Reliability & validity

The reliability of the review is enhanced by its systematic methodology and broad search strategy. Validity is supported by the inclusion of mixed methods, but is somewhat limited by the heterogeneity of the included studies and potential biases.

Think critically

How might the findings change if the AI was directly interacting with patients rather than solely assisting clinicians?

05

Design Principles

"Human-AI collaboration should be designed with transparency, explainability, and user control as core tenets."

For designers and engineers developing AI-driven healthcare solutions, understanding these user sentiments is crucial for successful adoption. Ignoring these concerns can lead to resistance, distrust, and ultimately, the failure of potentially beneficial technologies.

06

What This Means for Your Design

People generally like the idea of AI helping doctors, but they want to make sure a human doctor is still in charge and that they understand how the AI is helping.

How to use in your project

  • 1.Use this research to justify the importance of user research and user-centred design principles in your design project, particularly when dealing with complex or sensitive technologies like AI.
07

Add to My Project

08

Quick Cite

(2021). Patient and general public attitudes towards clinical artificial intelligence: a mixed methods systematic review. The Lancet Digital Health. https://doi.org/10.1016/s2589-7500(21)00132-1 Retrieved from https://designdex.org/study/59176c05-c61c-43d7-b92d-09f886f2784b/ai-in-healthcare-public-preference-for-human-oversight-and-clear-communication

Paragraph starter

This systematic review indicates that while there is a general acceptance of AI in healthcare, user-centred design must prioritize human oversight and transparent communication. Findings suggest that designs should clearly articulate the AI's supportive role and provide accessible explanations to address user reservations, ensuring a collaborative and trustworthy human-AI interaction.

09

Source

The Lancet Digital Health

Patient and general public attitudes towards clinical artificial intelligence: a mixed methods systematic review

journal · 2021

View source

Questions about this research

What does the research say about ai in healthcare: public preference for human oversight and clear communication?
Design AI healthcare solutions that clearly delineate the AI's role as a supportive tool, ensuring human oversight and providing accessible explanations of its functionality and limitations to build trust and acceptance. Evidence: The Lancet Digital Health (2021).
Why does "AI in Healthcare: Public Preference for Human Oversight and Clear Communication" matter for design?
For designers and engineers developing AI-driven healthcare solutions, understanding these user sentiments is crucial for successful adoption. Ignoring these concerns can lead to resistance, distrust, and ultimately, the failure of potentially beneficial technologies.
How can designers apply this research?
Design AI healthcare solutions that clearly delineate the AI's role as a supportive tool, ensuring human oversight and providing accessible explanations of its functionality and limitations to build trust and acceptance.
What were the main findings?
Patients and the general public generally hold positive attitudes towards AI in healthcare.. Significant reservations exist regarding AI, with a strong preference for human supervision.. Concerns revolve around AI's conceptual understanding, acceptability, relationship with humans, development, implementation, strengths, benefits, weaknesses, and risks.
What research method was used?
Mixed Methods Systematic Review.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2021 journal from The Lancet Digital Health.
What should I do differently in my next project?
When designing any AI-powered medical device or software, conduct user research specifically focused on understanding patient and clinician perceptions of AI's role, potential risks, and desired levels of human involvement.
What are the limitations?
Heterogeneity in study populations, AI types, and study designs; potential selection bias in included studies; a majority of studies assessed hypothetical AI rather than realized tools.
Is there evidence that human oversight affects design outcomes?
The public is open to AI in healthcare but wants doctors to remain in charge and wants to understand how AI works and what its limitations are. For designers and engineers developing AI-driven healthcare solutions, understanding these user sentiments is crucial for successful adoption. Ignoring these concerns can lead Source: The Lancet Digital Health (2021).
Where does this healthcare solutions research apply?
Healthcare, Clinical Artificial Intelligence It sits within user-centred design research on designdex.org.

Related research topics

human oversight design research · evidence on human oversight · does human oversight improve design outcomes · healthcare solutions studies for designers · human oversight and healthcare solutions findings · user-centred design research evidence