Short answer

When designing and evaluating voice assistants, go beyond basic usability and consider the emotional and relational aspects of the interaction, such as how anthropomorphic the assistant is and its perceived personality.

Field
User-Centred Design
Source
IEEE Access (2024)
Method
Systematic Literature Review (SLR)
Evidence
Moderate effect

Existing user experience scales for voice assistants are evolving beyond traditional usability and desirability to incorporate novel dimensions like anthropomorphism and machine personality. This user-centred design research insight is drawn from a 2024 study published in IEEE Access. Using Systematic literature review (slr), researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing and evaluating voice assistants, go beyond basic usability and consider the emotional and relational aspects of the interaction, such as how anthropomorphic the assistant is and its perceived personality.

Study
User-Centred DesignRecentModerate effect

Voice Assistant UX Scales Extend Beyond Traditional Metrics

Existing user experience scales for voice assistants are evolving beyond traditional usability and desirability to incorporate novel dimensions like anthropomorphism and machine personality.

IEEE Access · 2024

01

Key Findings

  • 0121 individual scales were identified for measuring voice assistant UX.
  • 02Scales for voice assistants incorporate dimensions beyond traditional VUDA (value, usability, desirability, adoptability), including anthropomorphism and machine personality.
  • 03There is variation in the rigor of operationalization during the development of these scales.
02

Application

Design takeaway

When designing and evaluating voice assistants, go beyond basic usability and consider the emotional and relational aspects of the interaction, such as how anthropomorphic the assistant is and its perceived personality.

How to apply

When designing a voice assistant, use a combination of established usability heuristics and qualitative methods to explore user perceptions of the assistant's personality and human-likeness. Consider developing or adapting scales that specifically measure these emergent UX dimensions.

Project actions

  • 01When designing a voice assistant prototype, think about its 'personality' and how it communicates.
  • 02When creating user surveys for voice assistants, include questions about anthropomorphism and perceived personality traits.
03

Method & Evidence

AimTo systematically review and analyze existing subjective scales used for measuring the user experience of voice assistants, identifying the dimensions of UX being assessed and evaluating the rigor of scale development.
MethodSystematic Literature Review (SLR)
ProcedureThe researchers conducted a comprehensive search of academic literature to identify scales used for measuring the user experience of voice assistants. They then analyzed these scales based on defined evaluation criteria, focusing on the dimensions of UX captured and the methodology employed in their development.
ContextVoice Assistant User Experience Research

Variables

IVType of UX scale used (traditional vs. extended dimensions), specific voice assistant features.
DVUser satisfaction, perceived usability, anthropomorphism ratings, machine personality ratings.
CVUser demographics, prior experience with voice assistants, task complexity.
04

Strengths & Limitations

Strengths

  • +Comprehensive systematic literature review methodology.
  • +Identification and analysis of a significant number of UX scales.

Limitations

The identified scales might not be universally applicable to all types of voice assistants or user contexts. The subjective nature of user experience means findings can be influenced by individual user differences.

Reliability & validity

The reliability of the findings depends on the quality and consistency of the reviewed literature. Validity is supported by the systematic approach to scale identification and analysis. However, the subjective nature of UX measures introduces inherent variability.

Think critically

To what extent can anthropomorphism and machine personality be intentionally designed into voice assistants, and what are the ethical implications of creating overly 'human-like' AI interactions?

05

Design Principles

"User experience evaluation for conversational interfaces should encompass both functional and relational dimensions."

As voice assistants become more integrated into daily life, understanding their user experience is critical for their adoption and long-term success. Designers and researchers need to employ evaluation methods that capture the unique nuances of human-AI interaction, moving beyond established frameworks for graphical interfaces.

06

What This Means for Your Design

When you test how people feel about voice assistants, you need to ask questions that go beyond just 'is it easy to use?' You also need to ask if it feels like a person and what kind of personality it has.

How to use in your project

  • 1.Use this research to justify the inclusion of specific user experience metrics beyond basic usability in your design project's evaluation phase.
  • 2.Cite this paper when discussing the unique aspects of user experience for voice-based interfaces in your design project documentation.
07

Add to My Project

08

Quick Cite

Paragraph starter

The user experience of voice assistants extends beyond traditional usability metrics, incorporating novel dimensions such as anthropomorphism and machine personality. Research indicates that existing scales are evolving to capture these aspects, suggesting that design projects evaluating voice interfaces should consider these factors to provide a comprehensive assessment of user perception and interaction quality.

09

Source

IEEE Access

A Review of Subjective Scales Measuring the User Experience of Voice Assistants

journal · 2024

View source

Questions About This Research

What does the research say about voice assistant ux scales extend beyond traditional metrics?
When designing and evaluating voice assistants, go beyond basic usability and consider the emotional and relational aspects of the interaction, such as how anthropomorphic the assistant is and its perceived personality. Evidence: IEEE Access (2024).
Why does "Voice Assistant UX Scales Extend Beyond Traditional Metrics" matter for design?
As voice assistants become more integrated into daily life, understanding their user experience is critical for their adoption and long-term success. Designers and researchers need to employ evaluation methods that capture the unique nuances of human-AI interaction, moving beyond established frameworks for graphical interfaces.
How can designers apply this research?
When designing and evaluating voice assistants, go beyond basic usability and consider the emotional and relational aspects of the interaction, such as how anthropomorphic the assistant is and its perceived personality.
What were the main findings?
21 individual scales were identified for measuring voice assistant UX.. Scales for voice assistants incorporate dimensions beyond traditional VUDA (value, usability, desirability, adoptability), including anthropomorphism and machine personality.. There is variation in the rigor of operationalization during the development of these scales.
What research method was used?
Systematic Literature Review (SLR).
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2024 journal from IEEE Access.
What should I do differently in my next project?
When designing a voice assistant, use a combination of established usability heuristics and qualitative methods to explore user perceptions of the assistant's personality and human-likeness. Consider developing or adapting scales that specifically measure these emergent UX dimensions.
What are the limitations?
The review focused on subjective scales, and the applicability of findings might vary depending on the specific voice assistant and its intended use case. The rigor of scale development was evaluated based on reported criteria, which may not capture all nuances of the process.