Equity Gaps in Health Tech Usability Testing Identified
Current usability evaluation methods for health technologies often fail to adequately consider or include marginalized user groups, leading to potential safety and effectiveness risks.
Human Factors in Healthcare · 2026
Key Findings
- 01Failure modes in heuristic evaluation were related to evaluator expertise and a lack of heuristics addressing marginalized groups' needs.
- 02Failure modes in usability testing were predominantly related to challenges in recruiting users from marginalized groups.
- 03Current methods may not uncover usability problems affecting marginalized groups.
Application
Design takeaway
Proactively integrate equity considerations into the design of usability evaluation methods, focusing on diverse participant recruitment and tailored evaluation criteria.
How to apply
When planning usability evaluations for health technologies, explicitly map out potential equity risks and develop mitigation strategies for participant recruitment and evaluation criteria.
Project actions
- 01Consider the diversity of your target user group from the outset of your design project.
- 02When planning user testing, think about how you will recruit participants who represent different backgrounds and needs.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Utilizes a recognized risk analysis technique (FMEA) for a novel application in usability.
- +Involves experienced practitioners in the field.
Limitations
Recruiting a truly representative sample for user testing can be challenging due to time, budget, and access constraints.
Reliability & validity
The reliability of the FMEA process depends on the consensus among the expert participants. Validity is supported by the use of a structured risk analysis technique applied to a relevant domain.
Think critically
How might the findings of this study apply to the usability of non-health-related technologies, and what specific adaptations would be necessary?
Design Principles
"Usability evaluations must be designed with equity at their core to ensure the safety and effectiveness of technologies for all users."
This research highlights a critical blind spot in the design and development of health technologies. By not proactively addressing the needs and participation of diverse user populations, designers risk creating products that are not only less effective but potentially unsafe for significant segments of the population.
What This Means for Your Design
When testing health technology, we need to make sure we are testing with and for everyone, not just the most common users, otherwise, the technology might not work well or could even be dangerous for some people.
How to use in your project
- 1.Reference this study when discussing the importance of inclusive user research and the potential pitfalls of standard usability testing methods in your design project.
Add to My Project
Quick Cite
(2026). Equity risks in usability evaluations of health technologies: A failure modes and effects analysis. Human Factors in Healthcare. https://doi.org/10.1016/j.hfh.2026.100124 Retrieved from https://designdex.org/study/82f76615-10eb-40b3-af54-476eb497efd1/equity-gaps-in-health-tech-usability-testing-identified
Paragraph starter
This research highlights critical equity risks within health technology usability evaluations, indicating that standard methods may inadvertently exclude or fail to identify issues for marginalized user groups. Incorporating a proactive approach to equity in user recruitment and evaluation criteria is essential for ensuring the safety and effectiveness of designed solutions for all.
Source
Human Factors in Healthcare
Equity risks in usability evaluations of health technologies: A failure modes and effects analysis
journal · 2026
View sourceQuestions about this research
- What does the research say about equity gaps in health tech usability testing identified?
- Proactively integrate equity considerations into the design of usability evaluation methods, focusing on diverse participant recruitment and tailored evaluation criteria. Evidence: Human Factors in Healthcare (2026).
- Why does "Equity Gaps in Health Tech Usability Testing Identified" matter for design?
- This research highlights a critical blind spot in the design and development of health technologies. By not proactively addressing the needs and participation of diverse user populations, designers risk creating products that are not only less effective but potentially unsafe for significant segments of the population.
- How can designers apply this research?
- Proactively integrate equity considerations into the design of usability evaluation methods, focusing on diverse participant recruitment and tailored evaluation criteria.
- What were the main findings?
- Failure modes in heuristic evaluation were related to evaluator expertise and a lack of heuristics addressing marginalized groups' needs.. Failure modes in usability testing were predominantly related to challenges in recruiting users from marginalized groups.. Current methods may not uncover usability problems affecting marginalized groups.
- What research method was used?
- Failure Modes and Effects Analysis (FMEA) through expert workshops. with 10 participants.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2026 journal from Human Factors in Healthcare.
- What should I do differently in my next project?
- When planning usability evaluations for health technologies, explicitly map out potential equity risks and develop mitigation strategies for participant recruitment and evaluation criteria.
- What are the limitations?
- The study focused on practitioners from a single consulting firm, potentially limiting the generalizability of findings across all usability evaluation contexts.
- Is there evidence that health technologies affects design outcomes?
- The study found that both heuristic evaluations and usability testing for health technologies have significant potential failure points related to equity, particularly concerning the inclusion and consideration of marginalized user groups. This research highlights a critical blind spot in the design and development of Source: Human Factors in Healthcare (2026).
- Where does this usability testing research apply?
- Health technology usability evaluations, specifically for regulated medical devices. It sits within user-centred design research on designdex.org.
Related research topics
health technologies design research · evidence on health technologies · does health technologies improve design outcomes · usability testing studies for designers · health technologies and usability testing findings · user-centred design research evidence