Short answer

In designing communication aids for individuals with hearing impairments, prioritize dynamic, spatially-aware visualizations like AR speech bubbles over static text captions, especially in multi-speaker scenarios.

Field: User-Centred Design
Source: Academic Publication (2018)
Method: User-centred design with co-design and user studies.
Sample: 20 participants (8 in co-design, 12 in user study)
Evidence: Strong effect

Visualizing spoken dialogue as augmented reality speech bubbles significantly improves comprehension and user preference for deaf and hard-of-hearing individuals in group conversations compared to traditional captions. This user-centred design research insight is drawn from a 2018 study published in Academic Publication. Using User-centred design with co-design and user studies. with 20 participants (8 in co-design, 12 in user study), researchers explored how this design variable affects real-world outcomes. The key design takeaway: In designing communication aids for individuals with hearing impairments, prioritize dynamic, spatially-aware visualizations like AR speech bubbles over static text captions, especially in multi-speaker scenarios.

Study

User-Centred DesignHigh ImpactStrong effect

Augmented Reality Speech Bubbles Enhance Group Conversation Comprehension for the Deaf and Hard-of-Hearing

Academic Publication · 2018

Key Findings

01Participants significantly preferred speech bubble visualizations over traditional captions.
02The SpeechBubbles prototype, utilizing AR speech bubbles, was preferred over traditional captions for group conversations by DHH participants.

Application

Design takeaway

How to apply

When designing interfaces for group communication, especially for users with hearing impairments, explore AR solutions that visually represent who is speaking and what they are saying in real-time.

Project actions

01Focus on identifying specific communication barriers for your target user group.
02Consider how visual elements can be used to convey information that is typically auditory.

Method & Evidence

AimHow can augmented reality speech bubble visualizations improve the comprehension and user experience of deaf and hard-of-hearing individuals in group conversations?

MethodUser-centred design with co-design and user studies.

ProcedureThe research involved interviewing and co-designing with eight deaf and hard-of-hearing (DHH) participants to identify key communication challenges. Multiple design concepts for speech bubble visualizations were then evaluated through a user study with twelve DHH participants. A prototype interface, SpeechBubbles, was developed based on these findings and further evaluated.

Sample20 participants (8 in co-design, 12 in user study)

ContextAugmented reality interfaces for communication accessibility.

Variables

IVType of visual display (AR speech bubbles vs. traditional captions).

DVUser comprehension of conversation, user preference.

CVGroup conversation scenario, participants' hearing status, AR head-mounted display.

Strengths & Limitations

Strengths

+Direct co-design with the target user group.
+Evaluation of multiple design concepts before prototype development.

Limitations

The prototype may not fully replicate the nuances of real-world conversations, and the sample size is relatively small. The effectiveness might vary depending on the user's familiarity with AR technology.

Reliability & validity

The study's validity is supported by direct user feedback and preference measures. Reliability could be enhanced by replicating the study with a larger and more diverse sample.

Think critically

To what extent can AR speech bubbles fully compensate for hearing loss in complex social interactions, and what are the potential cognitive loads associated with processing this visual information?

Design Principles

"For enhanced auditory accessibility in group settings, visualize spoken information in a spatially-aware and dynamic manner that directly links content to its source."

This research highlights the potential of AR interfaces to bridge communication gaps for individuals with hearing impairments. By directly addressing the challenges of identifying speakers, ordering utterances, and managing content length, AR speech bubbles offer a more intuitive and effective communication aid.

What This Means for Your Design

Using speech bubbles in augmented reality glasses helps deaf people understand group chats better than regular captions because they can see who is talking and what they are saying more clearly.

How to use in your project

1.Reference this study when exploring the use of AR for accessibility or when evaluating different methods of presenting spoken information visually.

Add to My Project

Quick Cite

Paragraph starter

The SpeechBubbles project demonstrates the significant advantages of using augmented reality speech bubbles for deaf and hard-of-hearing individuals in group conversations, showing a strong preference over traditional captions due to improved speaker attribution and utterance ordering.

Source

Academic Publication

SpeechBubbles

journal · 2018

View source

Questions About This Research

What does the research say about augmented reality speech bubbles enhance group conversation comprehension for the deaf and hard-of-hearing?: In designing communication aids for individuals with hearing impairments, prioritize dynamic, spatially-aware visualizations like AR speech bubbles over static text captions, especially in multi-speaker scenarios. Evidence: Academic Publication (2018).
Why does "Augmented Reality Speech Bubbles Enhance Group Conversation Comprehension for the Deaf and Hard-of-Hearing" matter for design?: This research highlights the potential of AR interfaces to bridge communication gaps for individuals with hearing impairments. By directly addressing the challenges of identifying speakers, ordering utterances, and managing content length, AR speech bubbles offer a more intuitive and effective communication aid.
How can designers apply this research?: In designing communication aids for individuals with hearing impairments, prioritize dynamic, spatially-aware visualizations like AR speech bubbles over static text captions, especially in multi-speaker scenarios.
What were the main findings?: Participants significantly preferred speech bubble visualizations over traditional captions.. The SpeechBubbles prototype, utilizing AR speech bubbles, was preferred over traditional captions for group conversations by DHH participants.
What research method was used?: User-centred design with co-design and user studies. with 20 participants (8 in co-design, 12 in user study).
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2018 journal from Academic Publication.
What should I do differently in my next project?: When designing interfaces for group communication, especially for users with hearing impairments, explore AR solutions that visually represent who is speaking and what they are saying in real-time.
What are the limitations?: The study was conducted with a specific prototype and may not generalize to all AR platforms or all types of hearing impairments. The complexity of real-world group conversations (e.g., background noise, multiple simultaneous speakers) might present further challenges.