Short answer

Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design.

Field: User-Centred Design
Source: D-Scholarship@Pitt (University of Pittsburgh) (2013)
Method: Conceptual Framework Development and Pedagogical Proposal
Evidence: Moderate effect

By integrating sensory, material, and contextual elements beyond just audible sound, designers can foster a deeper understanding of sonic experiences, leading to more effective and nuanced audio design. This user-centred design research insight is drawn from a 2013 study published in D-Scholarship@Pitt (University of Pittsburgh). Using Conceptual framework development and pedagogical proposal, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design.

Study

User-Centred DesignHigh ImpactModerate effect

Multimodal Listening Enhances Sonic Compositional Skills

D-Scholarship@Pitt (University of Pittsburgh) · 2013

Key Findings

01Traditional listening practices are often limited to the audible, neglecting broader sonic influences.
02Multimodal listening, which considers the ecological relationship between sound, bodies, and environments, offers a more comprehensive understanding of sonic events.
03Embodied and context-aware listening practices can enhance users' compositional abilities and critical engagement with sound.

Application

Design takeaway

Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design.

How to apply

When developing audio interfaces or soundscapes, consider how the user's physical posture, movement, and surrounding environment might influence their perception and interaction with the sound.

Project actions

01Consider how different sounds might affect a user's physical comfort or emotional state.
02Explore how the environment where a sound is experienced can change its meaning or impact.

Method & Evidence

AimHow can a multimodal listening pedagogy, incorporating embodied and contextual awareness, improve users' ability to compose and critically engage with sonic experiences?

MethodConceptual Framework Development and Pedagogical Proposal

ProcedureThe research proposes a new listening pedagogy by drawing inspiration from diverse practices (deaf musicians, acoustic designers, automotive engineers) and conceptualizing 'multimodal listening' as an integration of sensory, material, and contextual aspects of sound, moving beyond an ear-centric approach.

ContextRhetoric and Composition Studies, Sound Design Education

Variables

IVPedagogical approach to listening (e.g., traditional vs. multimodal)

DVUser's ability to compose and critically engage with sonic experiences

CVAuditory content being analyzed or composed

Strengths & Limitations

Strengths

+Offers a novel and comprehensive framework for understanding sound.
+Connects theoretical concepts to practical design and educational applications.

Limitations

It can be challenging to objectively measure or quantify the 'embodied' or 'contextual' aspects of sound perception.

Reliability & validity

The validity of the multimodal listening concept relies on its ability to explain and predict user responses to sound. Reliability would be assessed by consistent application and interpretation of the framework across different users and contexts.

Think critically

To what extent can 'multimodal listening' be objectively measured and applied across diverse design fields, and what are the potential biases in interpreting embodied and contextual responses?

Design Principles

"Design auditory experiences by considering the interplay of sound, user embodiment, and environmental context."

In an increasingly sound-saturated world, understanding how users perceive and interact with sound is crucial for creating compelling and effective designs. This approach moves beyond purely auditory feedback to consider the holistic experience of sound, impacting everything from product interaction to environmental acoustics.

What This Means for Your Design

Think about how sound makes you feel and how it connects to your body and surroundings, not just what you hear.

How to use in your project

1.Use the concept of multimodal listening to justify your design choices related to sound, explaining how you considered factors beyond just the audible.
2.In your user research, ask questions that probe users' embodied and contextual responses to sound.

Add to My Project

Quick Cite

Paragraph starter

This design project adopts a multimodal listening approach, recognizing that sound perception is not solely auditory but is deeply intertwined with the user's physical embodiment and environmental context. By considering these factors, the design aims to create a more resonant and effective sonic experience.

Source

D-Scholarship@Pitt (University of Pittsburgh)

Sounding Composition, Composing Sound: Multimodal Listening, Bodily Pedagogies, and Everyday Experience

journal · 2013

View source

Questions About This Research

What does the research say about multimodal listening enhances sonic compositional skills?: Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design. Evidence: D-Scholarship@Pitt (University of Pittsburgh) (2013).
Why does "Multimodal Listening Enhances Sonic Compositional Skills" matter for design?: In an increasingly sound-saturated world, understanding how users perceive and interact with sound is crucial for creating compelling and effective designs. This approach moves beyond purely auditory feedback to consider the holistic experience of sound, impacting everything from product interaction to environmental acoustics.
How can designers apply this research?: Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design.
What were the main findings?: Traditional listening practices are often limited to the audible, neglecting broader sonic influences.. Multimodal listening, which considers the ecological relationship between sound, bodies, and environments, offers a more comprehensive understanding of sonic events.. Embodied and context-aware listening practices can enhance users' compositional abilities and critical engagement with sound.
What research method was used?: Conceptual Framework Development and Pedagogical Proposal.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2013 journal from D-Scholarship@Pitt (University of Pittsburgh).
What should I do differently in my next project?: When developing audio interfaces or soundscapes, consider how the user's physical posture, movement, and surrounding environment might influence their perception and interaction with the sound.
What are the limitations?: The research is primarily theoretical and pedagogical, with limited empirical testing of the proposed listening practices in diverse design contexts.