Short answer

When evaluating mobile applications, don't just measure if users can complete tasks and if they are happy; also measure how much mental effort it takes them.

Field
User-Centred Design
Source
Journal of Interaction Science (2013)
Method
Literature review and model development
Evidence
Moderate effect

Integrating cognitive load alongside effectiveness, efficiency, and satisfaction provides a more complete assessment of mobile application usability. This user-centred design research insight is drawn from a 2013 study published in Journal of Interaction Science. Using Literature review and model development, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When evaluating mobile applications, don't just measure if users can complete tasks and if they are happy; also measure how much mental effort it takes them.

Study
User-Centred DesignHigh ImpactModerate effect

Comprehensive Usability Models Enhance Mobile Application Success

Integrating cognitive load alongside effectiveness, efficiency, and satisfaction provides a more complete assessment of mobile application usability.

Journal of Interaction Science · 2013

01

Key Findings

  • 01Prominent mobile usability models typically focus on effectiveness, efficiency, and satisfaction.
  • 02Cognitive load is a significant factor in mobile application usability but is often overlooked in existing models.
  • 03The PACMAD model integrates key attributes from various usability models to provide a more comprehensive evaluation framework.
02

Application

Design takeaway

When evaluating mobile applications, don't just measure if users can complete tasks and if they are happy; also measure how much mental effort it takes them.

How to apply

When designing or evaluating a mobile app, use a checklist that includes questions about task success, user satisfaction, and perceived mental effort required to complete tasks.

Project actions

  • 01When defining your usability goals, go beyond just 'easy to use' and consider specific metrics for effectiveness, efficiency, satisfaction, and cognitive load.
  • 02When selecting methods for user research, ensure they can capture data on all these different aspects of usability.
03

Method & Evidence

AimTo develop and validate a more comprehensive usability model for mobile applications that addresses the limitations of existing frameworks.
MethodLiterature review and model development
ProcedureA literature search was conducted to identify existing mobile usability models. These models were then analyzed to identify common attributes and gaps. A new model, PACMAD, was proposed, incorporating attributes such as cognitive load, which were found to be frequently overlooked. The new model was then used to evaluate existing studies on mobile application usability.
ContextMobile application design and evaluation

Variables

IVUsability model attributes (e.g., inclusion of cognitive load)
DVUsability evaluation outcomes (effectiveness, efficiency, satisfaction, cognitive load)
CVType of mobile application, user demographics, task complexity
04

Strengths & Limitations

Strengths

  • +Identifies a gap in existing usability models for mobile applications.
  • +Proposes a new, more comprehensive model (PACMAD).

Limitations

Measuring cognitive load directly can be challenging and may require specialized techniques or subjective self-reporting, which can be prone to bias.

Reliability & validity

The reliability and validity of the PACMAD model would need to be established through empirical testing across various mobile applications and user groups.

Think critically

How might the importance of cognitive load vary across different types of mobile applications (e.g., a game versus a banking app)?

05

Design Principles

"Holistic usability assessment requires considering user effort (cognitive load) in addition to task completion and user satisfaction."

Existing usability models often overlook critical factors like cognitive load, which can significantly impact user experience and task completion in mobile environments. A more holistic approach ensures that designs are not only functional but also intuitive and less mentally taxing for users.

06

What This Means for Your Design

When making apps for phones, it's not enough to check if people can use them and if they like them. You also need to check if the app makes their brain work too hard.

How to use in your project

  • 1.Reference this research when justifying the selection of usability metrics for your design project, particularly if you choose to include measures of cognitive load.
  • 2.Use the PACMAD model as a framework for structuring your usability testing and analysis.
07

Add to My Project

08

Quick Cite

Paragraph starter

This research highlights the importance of a comprehensive approach to usability, suggesting that traditional metrics of effectiveness, efficiency, and satisfaction are insufficient for mobile applications. By incorporating factors like cognitive load, as proposed by the PACMAD model, designers can achieve a more thorough understanding of user experience and develop more successful products.

09

Source

Journal of Interaction Science

Usability of mobile applications: literature review and rationale for a new usability model

journal · 2013

View source

Questions About This Research

What does the research say about comprehensive usability models enhance mobile application success?
When evaluating mobile applications, don't just measure if users can complete tasks and if they are happy; also measure how much mental effort it takes them. Evidence: Journal of Interaction Science (2013).
Why does "Comprehensive Usability Models Enhance Mobile Application Success" matter for design?
Existing usability models often overlook critical factors like cognitive load, which can significantly impact user experience and task completion in mobile environments. A more holistic approach ensures that designs are not only functional but also intuitive and less mentally taxing for users.
How can designers apply this research?
When evaluating mobile applications, don't just measure if users can complete tasks and if they are happy; also measure how much mental effort it takes them.
What were the main findings?
Prominent mobile usability models typically focus on effectiveness, efficiency, and satisfaction.. Cognitive load is a significant factor in mobile application usability but is often overlooked in existing models.. The PACMAD model integrates key attributes from various usability models to provide a more comprehensive evaluation framework.
What research method was used?
Literature review and model development.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2013 journal from Journal of Interaction Science.
What should I do differently in my next project?
When designing or evaluating a mobile app, use a checklist that includes questions about task success, user satisfaction, and perceived mental effort required to complete tasks.
What are the limitations?
The study's review of existing models was described as 'small,' and the application of the new model was based on evaluating existing studies rather than direct user testing of new designs.