Short answer

Prioritize data security and evidence-based design principles alongside user experience to create more trustworthy and effective digital health products.

Field
User-Centred Design
Source
JMIR mhealth and uhealth (2018)
Method
Review and Content Analysis
Sample
65 apps
Evidence
Strong effect

Despite high user ratings and usability, many popular physical activity apps exhibit significant deficiencies in data privacy and lack robust evidence of their development and effectiveness. This user-centred design research insight is drawn from a 2018 study published in JMIR mhealth and uhealth. Using Review and content analysis with 65 apps, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Prioritize data security and evidence-based design principles alongside user experience to create more trustworthy and effective digital health products.

Study
User-Centred DesignHigh ImpactStrong effect

Digital Health Tools Often Neglect User Privacy and Evidence-Based Design

Despite high user ratings and usability, many popular physical activity apps exhibit significant deficiencies in data privacy and lack robust evidence of their development and effectiveness.

JMIR mhealth and uhealth · 2018

01

Key Findings

  • 01Nearly 30% of apps lacked a privacy policy.
  • 02All apps incorporated at least one behavior change technique, averaging 7 per app.
  • 03Only one app did not have a commercial affiliation.
  • 04Few apps (12/65) had expert consultation or user involvement in development.
  • 05Only 12 apps had associated peer-reviewed studies.
02

Application

Design takeaway

Prioritize data security and evidence-based design principles alongside user experience to create more trustworthy and effective digital health products.

How to apply

When designing or selecting digital health tools, rigorously evaluate their privacy policies, look for evidence of expert consultation or user involvement in development, and seek out apps with a documented research basis.

Project actions

  • 01When designing a digital product, consider how you will protect user data and be transparent about it.
  • 02Think about how you can incorporate evidence-based techniques into your design.
  • 03Plan for user testing that goes beyond just usability to include feedback on trust and perceived safety.
03

Method & Evidence

AimTo evaluate the quality of popular physical activity applications based on healthcare quality indicators, focusing on data privacy, behavior change techniques, and user feedback.
MethodReview and Content Analysis
ProcedureThe study screened 400 top-ranked physical activity apps from app stores, included those targeting adults with physical activity as the primary goal, and assessed 65 randomly selected apps against criteria for data privacy, presence and quality of behavior change techniques, and user ratings/usability.
Sample65 apps
ContextDigital Health / Mobile Applications

Variables

IV["App type (Physical Activity)","App cost (free/paid)","App store (iTunes/Google Play)"]
DV["Presence and quality of privacy policy","Number and type of behavior change techniques (BCTs)","Evidence of expert consultation or user involvement","Existence of peer-reviewed studies","User ratings","Usability score"]
CV["Target audience (adults)","Primary behavior target (physical activity)","Stand-alone functionality"]
04

Strengths & Limitations

Strengths

  • +Systematic review process.
  • +Use of established quality indicators.
  • +Analysis of a substantial number of apps.

Limitations

The study only looked at apps available on major app stores and did not assess the actual impact of the apps on users' physical activity levels.

Reliability & validity

The study employed two reviewers to assess the apps, which enhances reliability. The use of specific quality indicators provides a framework for validity. However, the subjective nature of user ratings and the potential for reviewer bias are limitations.

Think critically

Given that users often rate apps highly despite privacy concerns, what psychological factors might be at play, and how can designers ethically navigate this tension?

05

Design Principles

"User trust in digital health tools is built on a foundation of both excellent usability and demonstrable commitment to data privacy and evidence-based design."

This highlights a critical gap between user perception and actual product quality in the rapidly growing digital health market. Designers and developers must prioritize not only user experience but also the ethical considerations of data handling and the scientific validation of their interventions to ensure truly beneficial and trustworthy products.

06

What This Means for Your Design

Many fitness apps are easy to use and people like them, but they might not protect your personal information well and there's not much proof they actually work.

How to use in your project

  • 1.Use this study to justify the importance of privacy policies and evidence-based design in your own design project.
  • 2.Reference the findings when discussing the limitations of user ratings alone as a measure of quality.
07

Add to My Project

08

Quick Cite

Paragraph starter

The quality of publicly available digital health tools, such as physical activity applications, can be inconsistent. While many apps achieve high user ratings and excellent usability, a significant portion may exhibit shortcomings in critical areas like data privacy and lack a robust evidence base for their design and effectiveness. This suggests that designers must move beyond user satisfaction metrics to ensure ethical data handling and scientifically validated features are integral to product development.

09

Source

JMIR mhealth and uhealth

Quality of Publicly Available Physical Activity Apps: Review and Content Analysis

journal · 2018

View source

Questions About This Research

What does the research say about digital health tools often neglect user privacy and evidence-based design?
Prioritize data security and evidence-based design principles alongside user experience to create more trustworthy and effective digital health products. Evidence: JMIR mhealth and uhealth (2018).
Why does "Digital Health Tools Often Neglect User Privacy and Evidence-Based Design" matter for design?
This highlights a critical gap between user perception and actual product quality in the rapidly growing digital health market. Designers and developers must prioritize not only user experience but also the ethical considerations of data handling and the scientific validation of their interventions to ensure truly beneficial and trustworthy products.
How can designers apply this research?
Prioritize data security and evidence-based design principles alongside user experience to create more trustworthy and effective digital health products.
What were the main findings?
Nearly 30% of apps lacked a privacy policy.. All apps incorporated at least one behavior change technique, averaging 7 per app.. Only one app did not have a commercial affiliation.. Few apps (12/65) had expert consultation or user involvement in development.
What research method was used?
Review and Content Analysis with 65 apps.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2018 journal from JMIR mhealth and uhealth.
What should I do differently in my next project?
When designing or selecting digital health tools, rigorously evaluate their privacy policies, look for evidence of expert consultation or user involvement in development, and seek out apps with a documented research basis.
What are the limitations?
The study focused on publicly available apps and did not assess actual effectiveness in promoting physical activity.