Short answer

When designing audio-visual experiences, consider analyzing and visualizing individual audio components rather than just the final mixed output to reveal deeper musical relationships and enhance user engagement.

Field: User-Centred Design
Source: Queen Mary Research Online (Queen Mary University of London) (2016)
Method: Iterative design study with prototype development and user feedback.
Evidence: Moderate effect

Leveraging independent multitracks and audio feature extraction in music visualization can create a richer and more engaging experience for users, particularly with non-tonal electronic music. This user-centred design research insight is drawn from a 2016 study published in Queen Mary Research Online (Queen Mary University of London). Using Iterative design study with prototype development and user feedback., researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing audio-visual experiences, consider analyzing and visualizing individual audio components rather than just the final mixed output to reveal deeper musical relationships and enhance user engagement.

Study

User-Centred DesignHigh ImpactModerate effect

Multitrack Audio Visualization Enhances User Engagement with Electronic Music

Leveraging independent multitracks and audio feature extraction in music visualization can create a richer and more engaging experience for users, particularly with non-tonal electronic music.

Queen Mary Research Online (Queen Mary University of London) · 2016

Key Findings

01Visualizing multitrack audio circumvents source separation issues inherent in mixed audio.
02Audio feature extraction, typically used for music information retrieval, can be adapted for generating live visualizations.
03This approach offers an opportunity to explore interdependent relationships within and between separate musical streams.
04The method is particularly suited for non-tonal, non-notated forms of electronic music.

Application

Design takeaway

How to apply

Develop interactive installations or digital applications that allow users to explore the individual layers of a musical piece through synchronized visual representations.

Project actions

01When visualizing sound, think about what makes each sound unique (e.g., pitch, volume, rhythm) and how you can represent those differences visually.
02Consider using different visual elements for different instruments or audio tracks to help users distinguish them.

Method & Evidence

AimHow can multitrack audio and audio feature extraction be utilized to create a more engaging and informative visualization of electronic music for users?

MethodIterative design study with prototype development and user feedback.

ProcedureThe research involved developing a prototype visualization tool (FEATUR.UX) that processes pre-mixed, independent multitracks. Audio feature extraction techniques were employed to analyze these tracks, and the findings were used to inform the visual output. Preliminary quantitative user survey data and insights from prior research on live performance informed the development process.

ContextElectronic music visualization, human-computer interaction, digital art.

Variables

IVUse of multitrack audio vs. mixed audio; use of audio feature extraction.

DVUser engagement, perceived complexity, aesthetic appreciation, understanding of musical structure.

CVType of music (electronic, non-tonal), visualization interface, user demographics.

Strengths & Limitations

Strengths

+Novel approach to audio visualization by utilizing multitracks.
+Addresses a gap in current visualization practices for electronic music.

Limitations

The complexity of implementing multitrack analysis and visualization can be a significant technical challenge for a design project.

Reliability & validity

The iterative design process and user feedback contribute to the validity of the findings. Reliability would depend on the consistency of the visualization algorithm and user responses across multiple trials.

Think critically

To what extent can the principles of multitrack audio visualization be applied to genres of music that are not primarily electronic or non-tonal?

Design Principles

"Deconstruct and visualize the constituent elements of audio to reveal complex relationships and enhance user perception."

Traditional audio visualization often relies on a single mixed track, limiting the depth of visual representation. By analyzing and visualizing individual audio streams, designers can unlock new possibilities for conveying the complexity and interplay within music, leading to more immersive user experiences.

What This Means for Your Design

Imagine seeing each instrument in a song as a different color or shape that moves and changes based on how it sounds. This makes listening to electronic music more interesting and easier to understand.

How to use in your project

1.Use this research to justify exploring multitrack audio visualization in your design project, explaining how it can lead to a more engaging user experience.

Add to My Project

Quick Cite

Paragraph starter

The FEATUR.UX research by Olowe et al. (2016) suggests that visualizing multitrack audio, by analyzing individual sound components and their features, can significantly enhance user engagement, particularly for electronic music. This approach moves beyond traditional single-track visualizations to reveal the intricate relationships within a composition, offering a richer perceptual experience.

Source

Queen Mary Research Online (Queen Mary University of London)

FEATUR.UX: An approach to leveraging multitrack information for artistic music visualization

journal · 2016

View source

Questions About This Research

What does the research say about multitrack audio visualization enhances user engagement with electronic music?: When designing audio-visual experiences, consider analyzing and visualizing individual audio components rather than just the final mixed output to reveal deeper musical relationships and enhance user engagement. Evidence: Queen Mary Research Online (Queen Mary University of London) (2016).
Why does "Multitrack Audio Visualization Enhances User Engagement with Electronic Music" matter for design?: Traditional audio visualization often relies on a single mixed track, limiting the depth of visual representation. By analyzing and visualizing individual audio streams, designers can unlock new possibilities for conveying the complexity and interplay within music, leading to more immersive user experiences.
How can designers apply this research?: When designing audio-visual experiences, consider analyzing and visualizing individual audio components rather than just the final mixed output to reveal deeper musical relationships and enhance user engagement.
What were the main findings?: Visualizing multitrack audio circumvents source separation issues inherent in mixed audio.. Audio feature extraction, typically used for music information retrieval, can be adapted for generating live visualizations.. This approach offers an opportunity to explore interdependent relationships within and between separate musical streams.. The method is particularly suited for non-tonal, non-notated forms of electronic music.
What research method was used?: Iterative design study with prototype development and user feedback..
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2016 journal from Queen Mary Research Online (Queen Mary University of London).
What should I do differently in my next project?: Develop interactive installations or digital applications that allow users to explore the individual layers of a musical piece through synchronized visual representations.
What are the limitations?: The study focuses on electronic music and may not be directly applicable to other genres without adaptation. The prototype is still under development.