Short answer

Design systems that integrate and present multi-sensory data to facilitate richer skill transfer and experience sharing.

Field: User-Centred Design
Source: DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) (2017)
Method: Workshop and seminar format with interdisciplinary researchers.
Evidence: Moderate effect

New technologies for capturing multi-sensory experiences can enable richer skill transfer and experience sharing, moving beyond traditional visual and auditory methods. This user-centred design research insight is drawn from a 2017 study published in DROPS (Schloss Dagstuhl – Leibniz Center for Informatics). Using Workshop and seminar format with interdisciplinary researchers., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Design systems that integrate and present multi-sensory data to facilitate richer skill transfer and experience sharing.

Study

User-Centred DesignHigh ImpactModerate effect

Beyond VR/AR: Towards an Internet of Abilities for Skill Transfer

New technologies for capturing multi-sensory experiences can enable richer skill transfer and experience sharing, moving beyond traditional visual and auditory methods.

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · 2017

Key Findings

01Advancements in capture technology (e.g., 360° video, tactile, odor recorders) enable richer and more comprehensive experience preservation.
02New methods are required for selecting, displaying, and sharing the massive amounts of data generated by these advanced recording technologies.
03The concept of an 'Internet of Abilities' offers a framework for reimagining how skills and experiences are shared and transferred.

Application

Design takeaway

Design systems that integrate and present multi-sensory data to facilitate richer skill transfer and experience sharing.

How to apply

Develop prototypes that capture and replay tactile or olfactory information alongside audio-visual content for training purposes.

Project actions

01Consider how you can capture more than just visual and auditory information in your design project.
02Think about how users would interact with and understand multi-sensory data.
03Explore existing technologies that offer haptic or olfactory feedback.

Method & Evidence

AimHow can multi-sensory capture technologies and data processing be leveraged to create an 'Internet of Abilities' for enhanced experience sharing and skill transfer?

MethodWorkshop and seminar format with interdisciplinary researchers.

ProcedureResearchers from various computing disciplines convened to discuss and explore future interaction paradigms beyond VR and AR, focusing on experience sharing and skill transfer through novel recording technologies and data handling.

ContextHuman-computer interaction, experience sharing, skill transfer, emerging technologies.

Variables

IVType of sensory data captured and shared (e.g., audio-visual only vs. multi-sensory).

DVEffectiveness of skill transfer or richness of experience sharing.

CVComplexity of the skill being taught, user's prior experience, interface design.

Strengths & Limitations

Strengths

+Interdisciplinary approach fosters broad thinking.
+Focuses on future-oriented interaction paradigms.

Limitations

The cost and complexity of multi-sensory capture and playback technology can be a significant barrier.

Reliability & validity

The findings are based on expert discussion and conceptual exploration rather than empirical testing, thus reliability and validity in a traditional sense are not directly applicable. The strength lies in identifying future research directions.

Think critically

What are the ethical implications of capturing and sharing highly personal sensory experiences?

Design Principles

"Design for multi-sensory data capture and playback to enhance learning and experience sharing."

This research points to a future where design can facilitate more immersive and comprehensive knowledge and skill transfer. By considering a wider range of sensory inputs and outputs, designers can create more effective training tools and collaborative platforms.

What This Means for Your Design

Imagine being able to 'record' not just what something looks and sounds like, but also how it feels or smells, and then share that complete experience with someone else to teach them a skill.

How to use in your project

1.This research can inform the development of novel user interfaces for skill transfer or experience sharing in your design project.
2.Use the concept of an 'Internet of Abilities' to justify the exploration of advanced input/output methods.

Add to My Project

Quick Cite

Paragraph starter

This research highlights the potential of an 'Internet of Abilities,' where advanced capture technologies beyond audio-visual can enable richer skill transfer and experience sharing. By considering multi-sensory inputs and outputs, designers can create more effective training tools and collaborative platforms, moving beyond the limitations of current VR and AR.

Source

DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)

Beyond VR and AR: Reimagining Experience Sharing and Skill Transfer Towards an Internet of Abilities (Dagstuhl Seminar 17062)

journal · 2017

View source

Questions About This Research

What does the research say about beyond vr/ar: towards an internet of abilities for skill transfer?: Design systems that integrate and present multi-sensory data to facilitate richer skill transfer and experience sharing. Evidence: DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) (2017).
Why does "Beyond VR/AR: Towards an Internet of Abilities for Skill Transfer" matter for design?: This research points to a future where design can facilitate more immersive and comprehensive knowledge and skill transfer. By considering a wider range of sensory inputs and outputs, designers can create more effective training tools and collaborative platforms.
How can designers apply this research?: Design systems that integrate and present multi-sensory data to facilitate richer skill transfer and experience sharing.
What were the main findings?: Advancements in capture technology (e.g., 360° video, tactile, odor recorders) enable richer and more comprehensive experience preservation.. New methods are required for selecting, displaying, and sharing the massive amounts of data generated by these advanced recording technologies.. The concept of an 'Internet of Abilities' offers a framework for reimagining how skills and experiences are shared and transferred.
What research method was used?: Workshop and seminar format with interdisciplinary researchers..
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2017 journal from DROPS (Schloss Dagstuhl – Leibniz Center for Informatics).
What should I do differently in my next project?: Develop prototypes that capture and replay tactile or olfactory information alongside audio-visual content for training purposes.
What are the limitations?: The research is conceptual and forward-looking, with many technological and practical challenges yet to be addressed.