Short answer

Prioritize the use or development of standardized metrics for user feedback to enable consistent evaluation and comparison of design effectiveness.

Field
User-Centred Design
Source
BMJ (2002)
Method
Bibliographic study and systematic review of electronic databases.
Sample
3921 reports met inclusion criteria.
Evidence
Strong effect

A significant increase in patient-assessed health outcome measures across various medical specialties highlights a need for standardization to ensure consistent and reliable data for design and development. This user-centred design research insight is drawn from a 2002 study published in BMJ. Using Bibliographic study and systematic review of electronic databases. with 3921 reports met inclusion criteria., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Prioritize the use or development of standardized metrics for user feedback to enable consistent evaluation and comparison of design effectiveness.

Study
User-Centred DesignHigh ImpactStrong effect

Standardizing Patient-Reported Health Outcomes is Crucial for Design Consistency

A significant increase in patient-assessed health outcome measures across various medical specialties highlights a need for standardization to ensure consistent and reliable data for design and development.

BMJ · 2002

01

Key Findings

  • 01A substantial increase in the development and evaluation of patient-assessed health outcome measures occurred between 1990 and 1999.
  • 02Disease-specific measures saw exponential growth, with a large proportion of evaluations concentrated in cancer, rheumatology, musculoskeletal disorders, and older people's health.
  • 03Despite the volume of measures, there is a lack of standardization in many specialties, necessitating concurrent evaluation and structured reviews.
02

Application

Design takeaway

Prioritize the use or development of standardized metrics for user feedback to enable consistent evaluation and comparison of design effectiveness.

How to apply

When designing a new product, research existing standardized user experience questionnaires or outcome measures relevant to your product's domain. If none exist, consider developing a set of core questions that can be consistently applied across user testing phases.

Project actions

  • 01When gathering user feedback for your design project, consider using established questionnaires or scales if they fit your needs.
  • 02If you create your own feedback questions, ensure they are clear, unambiguous, and consistently applied to all participants.
03

Method & Evidence

AimTo assess the growth and availability of patient-assessed health outcome measures across medical specialties and identify needs for standardization.
MethodBibliographic study and systematic review of electronic databases.
ProcedureSystematic searches were conducted to identify developmental and evaluative work on patient-assessed health outcome measures. Reports were classified by measure type (disease-specific, generic, dimension-specific, utility, individualised) and the medical specialties in which they were developed and evaluated.
Sample3921 reports met inclusion criteria.
ContextHealthcare quality of life measurement.

Variables

IVType of health outcome measure (disease-specific, generic, etc.), Medical specialty.
DVNumber of reports of development and evaluation, Trends in reporting over time.
04

Strengths & Limitations

Strengths

  • +Comprehensive systematic review of a large volume of literature.
  • +Identifies clear trends in the development of outcome measures.

Limitations

The availability of standardized measures might be limited in niche design fields. Developing new standardized measures can be time-consuming and resource-intensive.

Reliability & validity

The study's reliability is supported by its systematic methodology. Validity is enhanced by the broad scope of the search and classification of measures.

Think critically

How might the lack of standardization in user feedback metrics impact the scalability and long-term success of a product or service?

05

Design Principles

"Standardization of user feedback metrics enhances data reliability and comparability."

In user-centered design, understanding the user's experience and well-being is paramount. The proliferation of diverse measurement tools, as seen in healthcare, can lead to fragmented data and make it difficult to compare user feedback across different contexts or products. Establishing standardized metrics allows for more robust analysis and informed design decisions.

06

What This Means for Your Design

Lots of ways to ask people about their health exist, but they aren't all the same. It's better if we can use similar ways to ask so we can compare answers fairly.

How to use in your project

  • 1.Reference this study when discussing the importance of reliable and valid data collection methods for user research in your design project.
07

Add to My Project

08

Quick Cite

Paragraph starter

The proliferation of measurement tools in fields like healthcare, as documented by Garratt et al. (2002), underscores the critical need for standardization in user research. Inconsistent or varied methods of gathering user feedback can lead to unreliable data and hinder effective design iteration. Therefore, adopting or developing standardized metrics for user assessment is essential for ensuring data comparability and informing robust design decisions.

09

Source

BMJ

Quality of life measurement: bibliographic study of patient assessed health outcome measures

journal · 2002

View source

Questions About This Research

What does the research say about standardizing patient-reported health outcomes is crucial for design consistency?
Prioritize the use or development of standardized metrics for user feedback to enable consistent evaluation and comparison of design effectiveness. Evidence: BMJ (2002).
Why does "Standardizing Patient-Reported Health Outcomes is Crucial for Design Consistency" matter for design?
In user-centered design, understanding the user's experience and well-being is paramount. The proliferation of diverse measurement tools, as seen in healthcare, can lead to fragmented data and make it difficult to compare user feedback across different contexts or products. Establishing standardized metrics allows for more robust analysis and informed design decisions.
How can designers apply this research?
Prioritize the use or development of standardized metrics for user feedback to enable consistent evaluation and comparison of design effectiveness.
What were the main findings?
A substantial increase in the development and evaluation of patient-assessed health outcome measures occurred between 1990 and 1999.. Disease-specific measures saw exponential growth, with a large proportion of evaluations concentrated in cancer, rheumatology, musculoskeletal disorders, and older people's health.. Despite the volume of measures, there is a lack of standardization in many specialties, necessitating concurrent evaluation and structured reviews.
What research method was used?
Bibliographic study and systematic review of electronic databases. with 3921 reports met inclusion criteria..
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2002 journal from BMJ.
What should I do differently in my next project?
When designing a new product, research existing standardized user experience questionnaires or outcome measures relevant to your product's domain. If none exist, consider developing a set of core questions that can be consistently applied across user testing phases.
What are the limitations?
The study focused on healthcare; findings may not directly translate to all design domains. The review was based on published reports, potentially missing unpublished work.