Short answer

Integrate hands-free and eyes-free interaction modalities into messaging applications for wearable AR devices to enable communication during activities that typically preclude smartphone use.

Field: Innovation & Design
Source: Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (2023)
Method: Iterative development through formative study, followed by comparative evaluation.
Evidence: Strong effect

Augmented reality (AR) based messaging applications, when designed for hands- and eyes-busy scenarios, can significantly increase communication opportunities and efficiency during daily activities. This innovation & design research insight is drawn from a 2023 study published in Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies. Using Iterative development through formative study, followed by comparative evaluation., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Integrate hands-free and eyes-free interaction modalities into messaging applications for wearable AR devices to enable communication during activities that typically preclude smartphone use.

Study

Innovation & DesignRecentStrong effect

Augmented Reality Messaging Enhances Multitasking Communication Efficiency

Augmented reality (AR) based messaging applications, when designed for hands- and eyes-busy scenarios, can significantly increase communication opportunities and efficiency during daily activities.

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · 2023

Key Findings

01GlassMessaging increased messaging opportunities during multitasking due to its hands-free and wearable nature.
02Multimodal input capabilities in GlassMessaging reduced response time by 33.1% and increased texting speed by 40.3% compared to mobile phones.
03There was a slight decrease in texting accuracy (2.5%) with GlassMessaging, particularly as texting complexity increased.

Application

Design takeaway

Integrate hands-free and eyes-free interaction modalities into messaging applications for wearable AR devices to enable communication during activities that typically preclude smartphone use.

How to apply

When designing communication tools for mobile or field-based workers, consider AR interfaces that allow for voice input and display information without requiring users to look away from their primary task.

Project actions

01Consider how users interact with technology while performing other tasks.
02Explore multimodal input methods (voice, gesture) for your design.

Method & Evidence

AimTo investigate the effectiveness of an AR-based messaging application (GlassMessaging) compared to traditional mobile phone messaging for users engaged in hands- and eyes-busy activities.

MethodIterative development through formative study, followed by comparative evaluation.

ProcedureA formative study was conducted to understand current messaging behaviors and challenges during multitasking. Based on these findings, GlassMessaging was developed for Optical See-Through Head-Mounted Displays (OHMDs). The application was then evaluated against mobile phone messaging in eating and walking scenarios, assessing messaging opportunities, response time, texting speed, and accuracy across varying texting complexities.

ContextMobile and ubiquitous computing, human-computer interaction, augmented reality interfaces.

Variables

IV["Messaging platform (AR vs. Mobile Phone)","Texting complexity"]

DV["Messaging opportunities","Response time","Texting speed","Texting accuracy"]

CV["Activities performed (eating, walking)","User demographics (implied)"]

Strengths & Limitations

Strengths

+Addresses a real-world problem of device interaction during multitasking.
+Employs an iterative design process informed by user needs.
+Provides quantitative data comparing AR and mobile phone performance.

Limitations

The accuracy drop in AR messaging might be a concern for applications requiring high precision. The novelty of AR interfaces could also influence user performance.

Reliability & validity

The study's validity is supported by its comparative approach and quantitative metrics. Reliability could be enhanced by increasing the sample size and standardizing environmental conditions.

Think critically

How can the accuracy trade-off in AR messaging be mitigated without sacrificing the speed and convenience benefits?

Design Principles

"Design for seamless multimodal interaction in AR to support user engagement in concurrent tasks."

This research highlights the potential of AR to overcome the limitations of traditional mobile devices in multitasking contexts. By enabling hands-free and eyes-free interaction, AR messaging can unlock new use cases and improve user productivity in scenarios previously constrained by device interaction.

What This Means for Your Design

Using AR glasses to send messages is faster and lets you message more often when you're busy with your hands or eyes, like when eating or walking, compared to using a phone, though it might be a bit less accurate for long messages.

How to use in your project

1.Reference this study when discussing the limitations of current mobile devices for multitasking and how AR can offer a solution.
2.Use the findings on response time and texting speed to justify design choices for hands-free communication.

Add to My Project

Quick Cite

Paragraph starter

The development of AR-based messaging applications, such as GlassMessaging, demonstrates a significant advancement in enabling communication during hands- and eyes-busy multitasking scenarios. Research indicates that these systems can increase messaging opportunities and improve efficiency, with response times reduced by over 30% and texting speeds increased by over 40% compared to traditional mobile phones. While a slight decrease in accuracy was observed, particularly with increased complexity, the overall benefits for concurrent task engagement are substantial, offering a valuable direction for future human-computer interaction design.

Source

Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies

GlassMessaging

journal · 2023

View source

Questions About This Research

What does the research say about augmented reality messaging enhances multitasking communication efficiency?: Integrate hands-free and eyes-free interaction modalities into messaging applications for wearable AR devices to enable communication during activities that typically preclude smartphone use. Evidence: Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (2023).
Why does "Augmented Reality Messaging Enhances Multitasking Communication Efficiency" matter for design?: This research highlights the potential of AR to overcome the limitations of traditional mobile devices in multitasking contexts. By enabling hands-free and eyes-free interaction, AR messaging can unlock new use cases and improve user productivity in scenarios previously constrained by device interaction.
How can designers apply this research?: Integrate hands-free and eyes-free interaction modalities into messaging applications for wearable AR devices to enable communication during activities that typically preclude smartphone use.
What were the main findings?: GlassMessaging increased messaging opportunities during multitasking due to its hands-free and wearable nature.. Multimodal input capabilities in GlassMessaging reduced response time by 33.1% and increased texting speed by 40.3% compared to mobile phones.. There was a slight decrease in texting accuracy (2.5%) with GlassMessaging, particularly as texting complexity increased.
What research method was used?: Iterative development through formative study, followed by comparative evaluation..
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2023 journal from Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies.
What should I do differently in my next project?: When designing communication tools for mobile or field-based workers, consider AR interfaces that allow for voice input and display information without requiring users to look away from their primary task.
What are the limitations?: The study focused on specific multitasking scenarios (eating and walking) and may not generalize to all hands- and eyes-busy activities. The accuracy trade-off needs further investigation and mitigation strategies.