Short answer

When designing captioning technologies for informal group settings, prioritize features that address social and environmental factors alongside technical accuracy, and explore ways to convey non-speech communication elements.

Field
User-Centred Design
Source
Proceedings of the ACM on Human-Computer Interaction (2021)
Method
Qualitative research
Sample
15 participants
Evidence
Moderate effect

Designing effective captioning systems for small-group conversations requires a holistic approach that considers not only technical performance but also the social dynamics and environmental context of the interaction. This user-centred design research insight is drawn from a 2021 study published in Proceedings of the ACM on Human-Computer Interaction. Using Qualitative research with 15 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing captioning technologies for informal group settings, prioritize features that address social and environmental factors alongside technical accuracy, and explore ways to convey non-speech communication elements.

Study
User-Centred DesignHigh ImpactModerate effect

Captioning for Small Groups: Integrating Social, Environmental, and Technical Factors for Enhanced Accessibility

Designing effective captioning systems for small-group conversations requires a holistic approach that considers not only technical performance but also the social dynamics and environmental context of the interaction.

Proceedings of the ACM on Human-Computer Interaction · 2021

01

Key Findings

  • 01Participants' experiences with captioned small-group conversations are influenced by social factors (e.g., interlocutor relationships), environmental factors (e.g., display types), and technical factors (e.g., caption lag).
  • 02Future captioning tools are desired to provide feedback on non-speech elements like speaker identity and speech rate, and to assist hearing interlocutors in communicating more accessibly.
02

Application

Design takeaway

When designing captioning technologies for informal group settings, prioritize features that address social and environmental factors alongside technical accuracy, and explore ways to convey non-speech communication elements.

How to apply

When designing communication tools, conduct user research that explores not just functional requirements but also the social and environmental conditions under which the tool will be used.

Project actions

  • 01When researching accessibility features, think about the whole situation, not just the technology.
  • 02Interview users about their experiences in different settings to uncover hidden needs.
03

Method & Evidence

AimWhat are the social, environmental, and technical factors influencing the use of real-time captioning in small-group conversations, and what are the design preferences for future captioning tools to better support d/Deaf and hard of hearing (DHH) individuals?
MethodQualitative research
ProcedureSemi-structured interviews and design probe activities were conducted with d/Deaf and hard of hearing participants to explore their experiences with existing captioning services and gather input on future design preferences for small-group communication.
Sample15 participants
ContextInformal, interactive small-group conversations (in-person and remote)

Variables

IV["Social factors (e.g., interlocutor relationships)","Environmental factors (e.g., type of captioning displays)","Technical factors (e.g., caption lag)"]
DV["User experience with existing captioning services","Preferences for future captioning tools"]
CV["Type of conversation (small-group)","Participant group (d/Deaf and hard of hearing)"]
04

Strengths & Limitations

Strengths

  • +Focuses on an under-researched area (small-group informal captioning).
  • +Employs user-centered methods (interviews, probes) to gather rich qualitative data.

Limitations

The study involved a small group of participants, so the findings might not apply to everyone. The research focused on specific types of conversations, so other informal settings might have different needs.

Reliability & validity

The qualitative nature of the study provides rich insights but may have limited generalizability. The use of semi-structured interviews and design probes allows for in-depth exploration of user experiences, enhancing the validity of the findings within the studied context.

Think critically

How can designers proactively anticipate and design for the complex interplay of social, environmental, and technical factors in diverse informal communication settings, beyond just direct user feedback?

05

Design Principles

"Accessibility solutions must be context-aware, considering the multifaceted nature of user interaction."

This research highlights that user experience with captioning is deeply intertwined with social relationships, physical surroundings, and the technical limitations of the system. Designers must move beyond purely technical metrics to create solutions that genuinely support diverse user needs in real-world, informal settings.

06

What This Means for Your Design

For captioning to work well in casual chats, it needs to be good technically, but also consider who is talking to whom and where they are. People want captions to show who's speaking and how loud they are, not just the words.

How to use in your project

  • 1.Use this study to justify the need for user research that explores social and environmental factors in your design project.
  • 2.Reference the findings to support your design decisions regarding contextual information in your interface.
07

Add to My Project

08

Quick Cite

Paragraph starter

This research highlights the critical need to integrate social, environmental, and technical considerations into the design of communication technologies. By understanding how factors like interlocutor relationships, display environments, and caption lag affect user experience, designers can create more effective and inclusive solutions. The study's emphasis on user preferences for non-speech elements, such as speaker identification and prosody, further underscores the importance of a holistic, user-centered approach to accessibility design.

09

Source

Proceedings of the ACM on Human-Computer Interaction

Social, Environmental, and Technical: Factors at Play in the Current Use and Future Design of Small-Group Captioning

journal · 2021

View source

Questions About This Research

What does the research say about captioning for small groups: integrating social, environmental, and technical factors for enhanced accessibility?
When designing captioning technologies for informal group settings, prioritize features that address social and environmental factors alongside technical accuracy, and explore ways to convey non-speech communication elements. Evidence: Proceedings of the ACM on Human-Computer Interaction (2021).
Why does "Captioning for Small Groups: Integrating Social, Environmental, and Technical Factors for Enhanced Accessibility" matter for design?
This research highlights that user experience with captioning is deeply intertwined with social relationships, physical surroundings, and the technical limitations of the system. Designers must move beyond purely technical metrics to create solutions that genuinely support diverse user needs in real-world, informal settings.
How can designers apply this research?
When designing captioning technologies for informal group settings, prioritize features that address social and environmental factors alongside technical accuracy, and explore ways to convey non-speech communication elements.
What were the main findings?
Participants' experiences with captioned small-group conversations are influenced by social factors (e.g., interlocutor relationships), environmental factors (e.g., display types), and technical factors (e.g., caption lag).. Future captioning tools are desired to provide feedback on non-speech elements like speaker identity and speech rate, and to assist hearing interlocutors in communicating more accessibly.
What research method was used?
Qualitative research with 15 participants.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2021 journal from Proceedings of the ACM on Human-Computer Interaction.
What should I do differently in my next project?
When designing communication tools, conduct user research that explores not just functional requirements but also the social and environmental conditions under which the tool will be used.
What are the limitations?
Findings are specific to the experiences of the interviewed DHH participants and may not generalize to all users or all types of informal conversations.