Multimodal Listening Enhances Sonic Compositional Skills
By integrating sensory, material, and contextual elements beyond just audible sound, designers can foster a deeper understanding of sonic experiences, leading to more effective and nuanced audio design.
D-Scholarship@Pitt (University of Pittsburgh) · 2013
Key Findings
- 01Traditional listening practices are often limited to the audible, neglecting broader sonic influences.
- 02Multimodal listening, which considers the ecological relationship between sound, bodies, and environments, offers a more comprehensive understanding of sonic events.
- 03Embodied and context-aware listening practices can enhance users' compositional abilities and critical engagement with sound.
Application
Design takeaway
Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design.
How to apply
When developing audio interfaces or soundscapes, consider how the user's physical posture, movement, and surrounding environment might influence their perception and interaction with the sound.
Project actions
- 01Consider how different sounds might affect a user's physical comfort or emotional state.
- 02Explore how the environment where a sound is experienced can change its meaning or impact.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Offers a novel and comprehensive framework for understanding sound.
- +Connects theoretical concepts to practical design and educational applications.
Limitations
It can be challenging to objectively measure or quantify the 'embodied' or 'contextual' aspects of sound perception.
Reliability & validity
The validity of the multimodal listening concept relies on its ability to explain and predict user responses to sound. Reliability would be assessed by consistent application and interpretation of the framework across different users and contexts.
Think critically
To what extent can 'multimodal listening' be objectively measured and applied across diverse design fields, and what are the potential biases in interpreting embodied and contextual responses?
Design Principles
"Design auditory experiences by considering the interplay of sound, user embodiment, and environmental context."
In an increasingly sound-saturated world, understanding how users perceive and interact with sound is crucial for creating compelling and effective designs. This approach moves beyond purely auditory feedback to consider the holistic experience of sound, impacting everything from product interaction to environmental acoustics.
What This Means for Your Design
Think about how sound makes you feel and how it connects to your body and surroundings, not just what you hear.
How to use in your project
- 1.Use the concept of multimodal listening to justify your design choices related to sound, explaining how you considered factors beyond just the audible.
- 2.In your user research, ask questions that probe users' embodied and contextual responses to sound.
Add to My Project
Quick Cite
(2013). Sounding Composition, Composing Sound: Multimodal Listening, Bodily Pedagogies, and Everyday Experience. D-Scholarship@Pitt (University of Pittsburgh). Retrieved from https://designdex.org/study/9411146b-29c0-4a4f-8d60-e9fa9e32bb38/multimodal-listening-enhances-sonic-compositional-skills
Paragraph starter
This design project adopts a multimodal listening approach, recognizing that sound perception is not solely auditory but is deeply intertwined with the user's physical embodiment and environmental context. By considering these factors, the design aims to create a more resonant and effective sonic experience.
Source
D-Scholarship@Pitt (University of Pittsburgh)
Sounding Composition, Composing Sound: Multimodal Listening, Bodily Pedagogies, and Everyday Experience
journal · 2013
View sourceQuestions about this research
- What does the research say about multimodal listening enhances sonic compositional skills?
- Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design. Evidence: D-Scholarship@Pitt (University of Pittsburgh) (2013).
- Why does "Multimodal Listening Enhances Sonic Compositional Skills" matter for design?
- In an increasingly sound-saturated world, understanding how users perceive and interact with sound is crucial for creating compelling and effective designs. This approach moves beyond purely auditory feedback to consider the holistic experience of sound, impacting everything from product interaction to environmental acoustics.
- How can designers apply this research?
- Designers should move beyond designing for 'hearing' to designing for 'experiencing' sound, integrating physical and environmental factors into auditory design.
- What were the main findings?
- Traditional listening practices are often limited to the audible, neglecting broader sonic influences.. Multimodal listening, which considers the ecological relationship between sound, bodies, and environments, offers a more comprehensive understanding of sonic events.. Embodied and context-aware listening practices can enhance users' compositional abilities and critical engagement with sound.
- What research method was used?
- Conceptual Framework Development and Pedagogical Proposal.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2013 journal from D-Scholarship@Pitt (University of Pittsburgh).
- What should I do differently in my next project?
- When developing audio interfaces or soundscapes, consider how the user's physical posture, movement, and surrounding environment might influence their perception and interaction with the sound.
- What are the limitations?
- The research is primarily theoretical and pedagogical, with limited empirical testing of the proposed listening practices in diverse design contexts.
- Is there evidence that sound affects design outcomes?
- A more holistic approach to listening, considering how sound interacts with our bodies and environments, can significantly improve our ability to create and understand sound. In an increasingly sound-saturated world, understanding how users perceive and interact with sound is crucial for creating compelling and effecti Source: D-Scholarship@Pitt (University of Pittsburgh) (2013).
- Where does this multimodal listening research apply?
- Rhetoric and Composition Studies, Sound Design Education It sits within user-centred design research on designdex.org.
Related research topics
sound design research · evidence on sound · does sound improve design outcomes · multimodal listening studies for designers · sound and multimodal listening findings · user-centred design research evidence