Short answer

When developing clinical decision support tools, focus not only on the system's ability to improve objective outcomes but also on fostering user trust and clearly communicating its practical benefits to the end-user.

Field
Innovation & Design
Source
Frontiers in Medicine (2023)
Method
Retrospective comparative study
Sample
363 participants (278 at T1, 85 at T2)
Evidence
Strong effect

Implementing clinical decision support systems (CDSS) like the ESR iGuide can significantly increase the appropriateness of diagnostic imaging referrals, yet their widespread adoption is hindered by physician skepticism regarding trust and perceived clinical value. This innovation & design research insight is drawn from a 2023 study published in Frontiers in Medicine. Using Retrospective comparative study with 363 participants (278 at T1, 85 at T2), researchers explored how this design variable affects real-world outcomes. The key design takeaway: When developing clinical decision support tools, focus not only on the system's ability to improve objective outcomes but also on fostering user trust and clearly communicating its practical benefits to the end-user.

Study
Innovation & DesignRecentStrong effect

Clinical Decision Support Systems Improve Imaging Appropriateness but Face Physician Trust Barriers

Implementing clinical decision support systems (CDSS) like the ESR iGuide can significantly increase the appropriateness of diagnostic imaging referrals, yet their widespread adoption is hindered by physician skepticism regarding trust and perceived clinical value.

Frontiers in Medicine · 2023

01

Key Findings

  • 01Appropriateness of CT exam referrals increased significantly from 70.14% at T1 to 96.47% at T2.
  • 02Physicians reported low system trust and minimal perceived clinical value.
  • 03100% of physicians indicated they would not recommend the system for collegial use.
02

Application

Design takeaway

When developing clinical decision support tools, focus not only on the system's ability to improve objective outcomes but also on fostering user trust and clearly communicating its practical benefits to the end-user.

How to apply

When designing any system intended to influence professional decision-making, conduct thorough user research to understand and address potential barriers related to trust, perceived value, and workflow integration.

Project actions

  • 01When evaluating a design, consider both its functional performance and how users feel about using it.
  • 02Think about how to build trust in a new design, not just how it works.
03

Method & Evidence

AimTo evaluate the impact of the ESR iGuide clinical decision support system on the appropriateness of computed tomography (CT) exam justifications and to assess physician acceptance and usability of the system.
MethodRetrospective comparative study
ProcedureData on 278 CT tests were collected before (T1) and after (T2; n=85) physicians used the ESR iGuide system. Two experts assessed the appropriateness of imaging referrals in both phases. Physicians completed a usability questionnaire (System Usability Scale).
Sample363 participants (278 at T1, 85 at T2)
ContextHealthcare, Medical Imaging

Variables

IVUse of ESR iGuide system (Yes/No)
DVAppropriateness of CT exam referrals, Physician acceptance/trust/usability
CVPhysician specialty, Time of data collection (pre/post intervention)
04

Strengths & Limitations

Strengths

  • +Quantified improvement in objective outcome (appropriateness).
  • +Included a measure of user perception (usability/trust).

Limitations

The study was at one hospital, and not many doctors used the system. We don't know exactly why they didn't trust it.

Reliability & validity

The use of expert review for appropriateness and a standardized usability scale (SUS) lends reliability. Validity is supported by the significant statistical changes observed. However, the single-center nature and potential for Hawthorne effect in T2 could impact generalizability and validity.

Think critically

How can designers proactively build trust into systems that are intended to guide expert decision-making, rather than relying solely on demonstrated efficacy?

05

Design Principles

"Efficacy must be coupled with perceived value and trust to achieve successful user adoption in complex decision-support systems."

For designers of healthcare technology, this highlights a critical tension between functional efficacy and user adoption. While a system can demonstrably improve outcomes, its success hinges on addressing the human element of trust and perceived utility, which are often overlooked in purely technical development.

06

What This Means for Your Design

A computer system helped doctors choose better CT scans, but the doctors didn't like or trust the system itself.

How to use in your project

  • 1.Reference this study when discussing the importance of user acceptance and trust in the evaluation of a new design, especially in professional or clinical settings.
07

Add to My Project

08

Quick Cite

Paragraph starter

The study by Singer et al. (2023) highlights that while clinical decision support systems can demonstrably improve the appropriateness of medical procedures, user acceptance is a significant challenge. Despite the system's effectiveness in guiding CT exam justification, physicians reported low trust and minimal perceived clinical value, indicating that the design must not only be functional but also address user confidence and perceived utility to ensure successful implementation and adoption.

09

Source

Frontiers in Medicine

Advancing acceptance: assessing acceptance of the ESR iGuide clinical decision support system for improved computed tomography test justification

journal · 2023

View source

Questions About This Research

What does the research say about clinical decision support systems improve imaging appropriateness but face physician trust barriers?
When developing clinical decision support tools, focus not only on the system's ability to improve objective outcomes but also on fostering user trust and clearly communicating its practical benefits to the end-user. Evidence: Frontiers in Medicine (2023).
Why does "Clinical Decision Support Systems Improve Imaging Appropriateness but Face Physician Trust Barriers" matter for design?
For designers of healthcare technology, this highlights a critical tension between functional efficacy and user adoption. While a system can demonstrably improve outcomes, its success hinges on addressing the human element of trust and perceived utility, which are often overlooked in purely technical development.
How can designers apply this research?
When developing clinical decision support tools, focus not only on the system's ability to improve objective outcomes but also on fostering user trust and clearly communicating its practical benefits to the end-user.
What were the main findings?
Appropriateness of CT exam referrals increased significantly from 70.14% at T1 to 96.47% at T2.. Physicians reported low system trust and minimal perceived clinical value.. 100% of physicians indicated they would not recommend the system for collegial use.
What research method was used?
Retrospective comparative study with 363 participants (278 at T1, 85 at T2).
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2023 journal from Frontiers in Medicine.
What should I do differently in my next project?
When designing any system intended to influence professional decision-making, conduct thorough user research to understand and address potential barriers related to trust, perceived value, and workflow integration.
What are the limitations?
The study was conducted at a single center, and the physician sample size in the intervention phase was relatively small. The long-term impact and reasons for low trust were not deeply explored.