Short answer

When designing audiovisual data representations, consider established cross-sensory correspondences to ensure intuitive interpretation and avoid ambiguity.

Field: User-Centred Design
Source: Proceedings of DRS (2022)
Method: Phenomenological analysis of existing audiovisual sonifications.
Sample: 80 audiovisual sonifications
Evidence: Moderate effect

A structured map of sensory correspondences can guide designers in creating more intuitive and effective audiovisual data sonifications. This user-centred design research insight is drawn from a 2022 study published in Proceedings of DRS. Using Phenomenological analysis of existing audiovisual sonifications. with 80 audiovisual sonifications, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing audiovisual data representations, consider established cross-sensory correspondences to ensure intuitive interpretation and avoid ambiguity.

Study

User-Centred DesignHigh ImpactModerate effect

Cross-Sensory Design Map Standardizes Audiovisual Data Representation

A structured map of sensory correspondences can guide designers in creating more intuitive and effective audiovisual data sonifications.

Proceedings of DRS · 2022

Key Findings

01Lack of shared perceptual codes hinders meaning construction in data sonification.
02A cross-sensory design map can propose testable hypotheses for systematic data sonification.
03The map can offer a basis for standardizing design choices in audiovisual data representation.

Application

Design takeaway

When designing audiovisual data representations, consider established cross-sensory correspondences to ensure intuitive interpretation and avoid ambiguity.

How to apply

Use the principles of the cross-sensory design map to inform the selection of visual and auditory elements when designing dashboards, infographics, or interactive data visualizations.

Project actions

01When designing a data visualization, think about how sound can complement the visual elements to convey information more effectively.
02Consider using established cross-modal correspondences (e.g., high pitch for high values) to guide your design choices.

Method & Evidence

AimTo develop a systematic approach to data sonification by identifying and mapping correspondences between visual and auditory sensory modalities.

MethodPhenomenological analysis of existing audiovisual sonifications.

Procedure80 audiovisual sonifications were collected and analyzed to identify patterns and correspondences between sensory inputs and perceived meanings.

Sample80 audiovisual sonifications

ContextData representation and human-computer interaction.

Variables

IVType of audiovisual sonification (implicitly, the mapping of data to sensory modalities).

DVPerceived meaning and effectiveness of data representation.

CVThe 80 collected audiovisual sonifications themselves serve as the basis for analysis.

Strengths & Limitations

Strengths

+Systematic analysis of a significant number of existing sonifications.
+Development of a practical 'design map' with potential for standardization.

Limitations

The subjective nature of interpreting sensory experiences can make it challenging to create universally applicable mappings. The specific context of the data can also influence how well certain mappings work.

Reliability & validity

Reliability could be enhanced by having multiple analysts perform the phenomenological analysis. Validity is supported by the aim to create testable hypotheses for future systematic research.

Think critically

To what extent can a universal 'design map' account for cultural differences in sensory perception and data interpretation?

Design Principles

"Leverage established cross-sensory mappings to enhance the intuitiveness and effectiveness of multisensory data representations."

Effective data representation relies on users' ability to quickly and accurately interpret information. By understanding how visual and auditory perceptions align, designers can create more impactful and less ambiguous data experiences, enhancing user comprehension and engagement.

What This Means for Your Design

This study shows that by looking at how we naturally connect what we see with what we hear, designers can create better ways to show data using both sound and visuals, making it easier for people to understand.

How to use in your project

1.Reference this study when justifying your design choices for integrating audiovisual elements in your data representation project, explaining how you considered cross-modal correspondences.

Add to My Project

Quick Cite

Paragraph starter

This research highlights the importance of leveraging cross-sensory correspondences in audiovisual data representation. By analyzing existing sonifications, a design map was developed to guide designers in creating more intuitive and effective multisensory experiences, suggesting that adherence to established perceptual links can enhance user comprehension and reduce ambiguity in data interpretation.

Source

Proceedings of DRS

Audiovisual sonifications: A design map for multisensory integration in data representation

journal · 2022

View source

Questions About This Research

What does the research say about cross-sensory design map standardizes audiovisual data representation?: When designing audiovisual data representations, consider established cross-sensory correspondences to ensure intuitive interpretation and avoid ambiguity. Evidence: Proceedings of DRS (2022).
Why does "Cross-Sensory Design Map Standardizes Audiovisual Data Representation" matter for design?: Effective data representation relies on users' ability to quickly and accurately interpret information. By understanding how visual and auditory perceptions align, designers can create more impactful and less ambiguous data experiences, enhancing user comprehension and engagement.
How can designers apply this research?: When designing audiovisual data representations, consider established cross-sensory correspondences to ensure intuitive interpretation and avoid ambiguity.
What were the main findings?: Lack of shared perceptual codes hinders meaning construction in data sonification.. A cross-sensory design map can propose testable hypotheses for systematic data sonification.. The map can offer a basis for standardizing design choices in audiovisual data representation.
What research method was used?: Phenomenological analysis of existing audiovisual sonifications. with 80 audiovisual sonifications.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2022 journal from Proceedings of DRS.
What should I do differently in my next project?: Use the principles of the cross-sensory design map to inform the selection of visual and auditory elements when designing dashboards, infographics, or interactive data visualizations.
What are the limitations?: The analysis is based on existing sonifications, which may have inherent biases. The subjective nature of phenomenological analysis can introduce variability.