Short answer
Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects.
- Field
- Classic Design
- Source
- Academic Publication (2012)
- Method
- Practice-based research
- Evidence
- Moderate effect
Translating auditory experiences into visual art forms can create new modes of expression and performance. This classic design research insight is drawn from a 2012 study published in Academic Publication. Using Practice-based research, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects.
Sound as a Tangible Medium: Visualizing Auditory Experiences
Translating auditory experiences into visual art forms can create new modes of expression and performance.
Academic Publication · 2012
Key Findings
- 01The act of drawing graphic scores in real-time led to the development of 'sound drawing'.
- 02Closer examination of visual imagery, drawing materials, physical gestures, and sound production matured the sound drawing process.
- 03Integrating video and real-time audio and visual projection within a performance context created a comprehensive audiovisual experience.
Application
Design takeaway
Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects.
How to apply
Experiment with creating visual interfaces that directly influence sound generation or manipulation, or design physical objects whose form is derived from specific sound characteristics.
Project actions
- 01Think about how different senses can work together in your design.
- 02Consider how a user's actions can directly influence both visual and auditory feedback.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Novelty of the 'sound drawing' concept.
- +Integration of multiple creative and technical domains.
Limitations
The subjective nature of art and sound interpretation can make objective measurement challenging.
Reliability & validity
Reliability would be assessed by the consistency of the translation process, while validity would depend on whether the resulting sound and visuals effectively convey the intended auditory experience.
Think critically
To what extent can the principles of 'sound drawing' be applied to functional design, rather than purely artistic expression?
Design Principles
"Sensory translation: Design can leverage the interplay between different sensory modalities to create richer and more integrated experiences."
This research explores the innovative concept of 'sound drawing,' where sound is not just heard but visually represented and interacted with. This challenges traditional disciplinary boundaries, offering designers new perspectives on how sensory inputs can inform and shape tangible outputs.
What This Means for Your Design
This research shows how artists can draw pictures that make sounds, and how these drawings can be part of a live performance where sound and visuals are created at the same time.
How to use in your project
- 1.Use this as an example of interdisciplinary design practice and the development of novel creative processes.
Add to My Project
Quick Cite
Paragraph starter
This research exemplifies a practice-based approach to design innovation, where the development of a novel concept ('sound drawing') involved a deep exploration of interdisciplinary connections between visual art, sound design, and performance technology. The findings highlight the potential for cross-modal sensory translation in creating engaging and dynamic user experiences.
Source
Questions About This Research
- What does the research say about sound as a tangible medium: visualizing auditory experiences?
- Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects. Evidence: Academic Publication (2012).
- Why does "Sound as a Tangible Medium: Visualizing Auditory Experiences" matter for design?
- This research explores the innovative concept of 'sound drawing,' where sound is not just heard but visually represented and interacted with. This challenges traditional disciplinary boundaries, offering designers new perspectives on how sensory inputs can inform and shape tangible outputs.
- How can designers apply this research?
- Consider how visual representations can be used to inform, generate, or interact with auditory outputs, and vice versa, especially in interactive or performance-based design projects.
- What were the main findings?
- The act of drawing graphic scores in real-time led to the development of 'sound drawing'.. Closer examination of visual imagery, drawing materials, physical gestures, and sound production matured the sound drawing process.. Integrating video and real-time audio and visual projection within a performance context created a comprehensive audiovisual experience.
- What research method was used?
- Practice-based research.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2012 journal from Academic Publication.
- What should I do differently in my next project?
- Experiment with creating visual interfaces that directly influence sound generation or manipulation, or design physical objects whose form is derived from specific sound characteristics.
- What are the limitations?
- The practice-specific nature of the research may limit direct applicability to broader design fields without adaptation.