Short answer

Incorporate interactive machine teaching principles into your prototyping workflow to quickly develop and test tangible AR interactions using readily available objects.

Field
Modelling
Source
Academic Publication (2023)
Method
User study and expert interviews
Evidence
Strong effect

Leveraging interactive machine teaching with everyday objects significantly lowers the barrier to creating functional, tangible augmented reality prototypes without requiring traditional programming. This modelling research insight is drawn from a 2023 study published in Academic Publication. Using User study and expert interviews, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Incorporate interactive machine teaching principles into your prototyping workflow to quickly develop and test tangible AR interactions using readily available objects.

Study
ModellingRecentStrong effect

Interactive Machine Teaching Enables Rapid Prototyping of Tangible Augmented Reality Experiences

Leveraging interactive machine teaching with everyday objects significantly lowers the barrier to creating functional, tangible augmented reality prototypes without requiring traditional programming.

Academic Publication · 2023

01

Key Findings

  • 01Teachable Reality allows users to create functional AR prototypes using everyday objects without programming.
  • 02The approach offers flexibility and generalizability for tangible AR applications.
  • 03User studies and expert interviews confirmed a lowered barrier to AR prototyping and a flexible, general-purpose prototyping experience.
02

Application

Design takeaway

Incorporate interactive machine teaching principles into your prototyping workflow to quickly develop and test tangible AR interactions using readily available objects.

How to apply

Use readily available objects (e.g., cups, books, hands) and a tool like Teachable Machine to train a system to recognize specific gestures or object states, then link these to AR outputs or behaviors for rapid prototyping.

Project actions

  • 01Consider using everyday objects as input for your AR prototypes.
  • 02Explore tools that allow for 'machine teaching' to recognize user interactions.
  • 03Focus on creating tangible interactions that feel natural and intuitive.
03

Method & Evidence

AimCan interactive machine teaching be effectively used to prototype tangible augmented reality applications with everyday objects, bypassing the need for traditional programming?
MethodUser study and expert interviews
ProcedureThe researchers developed a tool called 'Teachable Reality' that uses vision-based interactive machine teaching to capture real-world interactions with everyday objects. Users could then define tangible and gestural interactions via a trigger-action interface to create functional AR prototypes. The effectiveness and usability of this tool were evaluated through user studies and expert interviews.
ContextAugmented Reality (AR) prototyping, Human-Computer Interaction (HCI)

Variables

IVUse of interactive machine teaching for AR prototyping.
DVEase of prototyping, flexibility of application, functionality of AR prototypes.
CVType of everyday objects used, complexity of interactions programmed, AR display technology.
04

Strengths & Limitations

Strengths

  • +Novel approach to AR prototyping.
  • +Addresses the need for accessible AR development tools.
  • +Demonstrates practical application with diverse examples.

Limitations

The accuracy of object recognition can be a challenge, and complex or subtle interactions might be difficult to teach. The range of objects and interactions that can be reliably used may be limited.

Reliability & validity

The study's validity is supported by user studies and expert interviews. Reliability would depend on the consistency of the machine learning model's performance across different users and environmental conditions.

Think critically

How might the accuracy and robustness of the machine teaching model impact the user experience and reliability of the AR prototype?

05

Design Principles

"Democratize complex technology prototyping by abstracting technical barriers and leveraging familiar interaction paradigms."

This approach democratizes AR development by enabling designers and researchers to quickly iterate on tangible AR concepts using familiar objects. It allows for more intuitive and context-aware interactions, moving beyond screen-based interfaces to richer, object-driven experiences.

06

What This Means for Your Design

You can make augmented reality (AR) prototypes that use real-world objects by 'teaching' a computer program to recognize how you interact with them, without needing to code.

How to use in your project

  • 1.Reference this study when discussing the prototyping of interactive AR systems, especially when using non-traditional inputs or aiming for rapid iteration.
07

Add to My Project

08

Quick Cite

Paragraph starter

The research by Monteiro et al. (2023) on 'Teachable Reality' demonstrates a significant advancement in AR prototyping by utilizing interactive machine teaching. This approach allows for the creation of tangible AR applications using everyday objects without requiring programming expertise. By enabling designers to quickly train systems to recognize object-based interactions, it significantly lowers the barrier to entry for developing novel and intuitive AR experiences, offering a flexible and generalizable method for rapid prototyping.

09

Source

Academic Publication

Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine Teaching

journal · 2023

View source

Questions About This Research

What does the research say about interactive machine teaching enables rapid prototyping of tangible augmented reality experiences?
Incorporate interactive machine teaching principles into your prototyping workflow to quickly develop and test tangible AR interactions using readily available objects. Evidence: Academic Publication (2023).
Why does "Interactive Machine Teaching Enables Rapid Prototyping of Tangible Augmented Reality Experiences" matter for design?
This approach democratizes AR development by enabling designers and researchers to quickly iterate on tangible AR concepts using familiar objects. It allows for more intuitive and context-aware interactions, moving beyond screen-based interfaces to richer, object-driven experiences.
How can designers apply this research?
Incorporate interactive machine teaching principles into your prototyping workflow to quickly develop and test tangible AR interactions using readily available objects.
What were the main findings?
Teachable Reality allows users to create functional AR prototypes using everyday objects without programming.. The approach offers flexibility and generalizability for tangible AR applications.. User studies and expert interviews confirmed a lowered barrier to AR prototyping and a flexible, general-purpose prototyping experience.
What research method was used?
User study and expert interviews.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2023 journal from Academic Publication.
What should I do differently in my next project?
Use readily available objects (e.g., cups, books, hands) and a tool like Teachable Machine to train a system to recognize specific gestures or object states, then link these to AR outputs or behaviors for rapid prototyping.
What are the limitations?
The effectiveness may depend on the quality of the object recognition model and the complexity of the desired interactions. Generalizability to all object types and interaction complexities may vary.