Sound as a Tangible Medium: Visualizing Auditory Experiences
Translating auditory experiences into visual art forms can create new modes of expression and performance.
Academic Publication · 2012
Key Findings
- 01The act of drawing graphic scores in real-time led to the development of 'sound drawing'.
- 02Closer examination of visual imagery, drawing materials, physical gestures, and sound production matured the sound drawing process.
- 03Integrating video and real-time audio and visual projection within a performance context created a comprehensive audiovisual experience.
Application
Design takeaway
Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects.
How to apply
Experiment with creating visual interfaces that directly influence sound generation or manipulation, or design physical objects whose form is derived from specific sound characteristics.
Project actions
- 01Think about how different senses can work together in your design.
- 02Consider how a user's actions can directly influence both visual and auditory feedback.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Novelty of the 'sound drawing' concept.
- +Integration of multiple creative and technical domains.
Limitations
The subjective nature of art and sound interpretation can make objective measurement challenging.
Reliability & validity
Reliability would be assessed by the consistency of the translation process, while validity would depend on whether the resulting sound and visuals effectively convey the intended auditory experience.
Think critically
To what extent can the principles of 'sound drawing' be applied to functional design, rather than purely artistic expression?
Design Principles
"Sensory translation: Design can leverage the interplay between different sensory modalities to create richer and more integrated experiences."
This research explores the innovative concept of 'sound drawing,' where sound is not just heard but visually represented and interacted with. This challenges traditional disciplinary boundaries, offering designers new perspectives on how sensory inputs can inform and shape tangible outputs.
What This Means for Your Design
This research shows how artists can draw pictures that make sounds, and how these drawings can be part of a live performance where sound and visuals are created at the same time.
How to use in your project
- 1.Use this as an example of interdisciplinary design practice and the development of novel creative processes.
Add to My Project
Quick Cite
(2012). Looking at sound / listening to image. Academic Publication. Retrieved from https://designdex.org/study/3c71c285-8c65-4701-a4ba-b2c4cfbdd795/sound-as-a-tangible-medium-visualizing-auditory-experiences
Paragraph starter
This research exemplifies a practice-based approach to design innovation, where the development of a novel concept ('sound drawing') involved a deep exploration of interdisciplinary connections between visual art, sound design, and performance technology. The findings highlight the potential for cross-modal sensory translation in creating engaging and dynamic user experiences.
Source
Questions about this research
- What does the research say about sound as a tangible medium: visualizing auditory experiences?
- Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects. Evidence: Academic Publication (2012).
- Why does "Sound as a Tangible Medium: Visualizing Auditory Experiences" matter for design?
- This research explores the innovative concept of 'sound drawing,' where sound is not just heard but visually represented and interacted with. This challenges traditional disciplinary boundaries, offering designers new perspectives on how sensory inputs can inform and shape tangible outputs.
- How can designers apply this research?
- Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects.
- What were the main findings?
- The act of drawing graphic scores in real-time led to the development of 'sound drawing'.. Closer examination of visual imagery, drawing materials, physical gestures, and sound production matured the sound drawing process.. Integrating video and real-time audio and visual projection within a performance context created a comprehensive audiovisual experience.
- What research method was used?
- Practice-based research.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2012 journal from Academic Publication.
- What should I do differently in my next project?
- Experiment with creating visual interfaces that directly influence sound generation or manipulation, or design physical objects whose form is derived from specific sound characteristics.
- What are the limitations?
- The practice-specific nature of the research may limit direct applicability to broader design fields without adaptation.
- Is there evidence that sound affects design outcomes?
- The research successfully developed a 'sound drawing' practice where visual art, sound, and performance are intricately linked, culminating in real-time audiovisual creations. This research explores the innovative concept of 'sound drawing,' where sound is not just heard but visually represented and interacted with. Th Source: Academic Publication (2012).
- Where does this sound drawing research apply?
- Art and Design Practice It sits within classic design research on designdex.org.
Related research topics
sound design research · evidence on sound · does sound improve design outcomes · sound drawing studies for designers · sound and sound drawing findings · classic design research evidence