Short answer

Develop an adaptive HMI that dynamically adjusts the level of detail and focus of system explanations based on the user's familiarity and stated priorities.

Field: User-Centred Design
Source: Sustainability (2023)
Method: Experimental study
Evidence: Strong effect

Providing context-aware, scenario-based explanations for automated vehicle behavior significantly improves user trust, understanding, and objective performance, with preferences varying between new and experienced users. This user-centred design research insight is drawn from a 2023 study published in Sustainability. Using Experimental study, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Develop an adaptive HMI that dynamically adjusts the level of detail and focus of system explanations based on the user's familiarity and stated priorities.

Study

User-Centred DesignRecentStrong effect

Scenario-Based Explanations Enhance Automated Vehicle Trust and Performance

Sustainability · 2023

Key Findings

01Scenario-based explanations significantly improved drivers' situational trust and user experience.
02Explanations enhanced the perception and understanding of the system's intelligence capabilities.
03Mental workload was reduced, and objective user performance was elevated by the explanations.
04New users preferred guided explanations for increased trust and transparency.
05Frequent users prioritized efficiency and driving safety in their explanation preferences.

Application

Design takeaway

Develop an adaptive HMI that dynamically adjusts the level of detail and focus of system explanations based on the user's familiarity and stated priorities.

How to apply

When designing HMIs for automated systems, consider creating different 'modes' or 'profiles' for explanations that users can select or that the system can infer based on usage patterns.

Project actions

01When testing user interfaces for complex systems, consider how you can explain the system's actions to the user.
02Think about how different types of users might need different kinds of information to feel comfortable and confident.

Method & Evidence

AimTo investigate the impact of scenario-based explanations on user trust, situational awareness, mental workload, and objective performance in an Automated Valet Parking (AVP) system, and to explore how these preferences differ between new and frequent users.

MethodExperimental study

ProcedureTwo experiments were conducted. Experiment 1 evaluated the effects of a proposed scenario-based explanation framework on drivers' situational trust, user experience, perception of system intelligence, mental workload, and objective performance. Experiment 2 explored explainability preferences between new and frequent users of the AVP system.

ContextAutomated Valet Parking (AVP) systems in automated vehicles.

Variables

IV["Type of explanation (scenario-based vs. generic, or presence/absence of explanations)","User experience level (new vs. frequent user)"]

DV["Situational trust","User experience (UX)","Perception of system intelligence","Mental workload","Objective user performance"]

CV["Automated Valet Parking (AVP) system interface","Driving scenarios","Objective performance metrics"]

Strengths & Limitations

Strengths

+Investigated both objective and subjective user perspectives.
+Differentiated user needs based on experience levels.
+Proposed a practical framework for scenario-based explanations.

Limitations

The complexity of creating truly 'scenario-based' explanations can be challenging. Ensuring that the explanations are accurate and don't oversimplify or mislead the user is also a critical consideration.

Reliability & validity

The study's validity is strengthened by using both objective performance metrics and subjective user ratings. Reliability could be enhanced by increasing the sample size and conducting more trials to ensure consistent results across participants.

Think critically

How might the 'black box' nature of some AI algorithms make it inherently difficult to provide truly accurate and meaningful scenario-based explanations, and what are the ethical implications of providing simplified or potentially misleading explanations?

Design Principles

"Provide transparent, context-aware explanations for automated system behavior, customizing the delivery to user experience levels to foster trust and optimize interaction."

As automated vehicle technology advances, user acceptance is a critical bottleneck. This research highlights that transparent, scenario-specific explanations are not just a feature but a necessity for building user confidence and facilitating market adoption. Designers must consider how to communicate system intent effectively to foster trust and ensure safe, intuitive interactions.

What This Means for Your Design

If you're designing a system that drives itself, explaining what it's doing in simple, real-life examples makes people trust it more and use it better. But, people who use it a lot want different explanations than people using it for the first time.

How to use in your project

1.Reference this study when discussing the importance of user trust and transparency in your design for automated systems.
2.Use the findings to justify the inclusion of specific explanation features in your user interface design.

Add to My Project

Quick Cite

Paragraph starter

The research by Ma and Feng (2023) demonstrates that scenario-based explanations significantly enhance user trust and performance in automated vehicle systems. Their findings indicate that tailoring explanations to user experience levels—providing more guidance for new users and efficiency-focused information for frequent users—is crucial for effective adoption and user satisfaction.

Source

Sustainability

Analysing the Effects of Scenario-Based Explanations on Automated Vehicle HMIs from Objective and Subjective Perspectives

journal · 2023

View source

Questions About This Research

What does the research say about scenario-based explanations enhance automated vehicle trust and performance?: Develop an adaptive HMI that dynamically adjusts the level of detail and focus of system explanations based on the user's familiarity and stated priorities. Evidence: Sustainability (2023).
Why does "Scenario-Based Explanations Enhance Automated Vehicle Trust and Performance" matter for design?: As automated vehicle technology advances, user acceptance is a critical bottleneck. This research highlights that transparent, scenario-specific explanations are not just a feature but a necessity for building user confidence and facilitating market adoption. Designers must consider how to communicate system intent effectively to foster trust and ensure safe, intuitive interactions.
How can designers apply this research?: Develop an adaptive HMI that dynamically adjusts the level of detail and focus of system explanations based on the user's familiarity and stated priorities.
What were the main findings?: Scenario-based explanations significantly improved drivers' situational trust and user experience.. Explanations enhanced the perception and understanding of the system's intelligence capabilities.. Mental workload was reduced, and objective user performance was elevated by the explanations.. New users preferred guided explanations for increased trust and transparency.
What research method was used?: Experimental study.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2023 journal from Sustainability.
What should I do differently in my next project?: When designing HMIs for automated systems, consider creating different 'modes' or 'profiles' for explanations that users can select or that the system can infer based on usage patterns.
What are the limitations?: The study focused on a specific L4 AVP system; findings may not generalize to all levels of automation or different vehicle functions. User segmentation was binary (new vs. frequent), and a more granular approach might reveal further nuances.