Short answer

Develop and apply metrics that quantify the integration of user needs and principles throughout the design process, even in its early stages, to ensure a more robustly human-centred outcome.

Field
User-Centred Design
Source
Applied Sciences (2023)
Method
Metric development and application
Sample
16 concepts
Evidence
Mixed findings

A novel metric can provide an early, quantitative assessment of how effectively human-centred design principles have been integrated into product concepts. This user-centred design research insight is drawn from a 2023 study published in Applied Sciences. Using Metric development and application with 16 concepts, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Develop and apply metrics that quantify the integration of user needs and principles throughout the design process, even in its early stages, to ensure a more robustly human-centred outcome.

Study
User-Centred DesignRecentMixed findings

Quantifiable Human-Centredness: A Metric for Evaluating Design Process Quality

A novel metric can provide an early, quantitative assessment of how effectively human-centred design principles have been integrated into product concepts.

Applied Sciences · 2023

01

Key Findings

  • 01Trends suggest that the application of specific human-centred design methods can positively influence the human-centredness score of product concepts.
  • 02Statistical significance was not achieved, likely due to limitations in concept complexity, sample size, and the developmental stage of the concepts.
02

Application

Design takeaway

Develop and apply metrics that quantify the integration of user needs and principles throughout the design process, even in its early stages, to ensure a more robustly human-centred outcome.

How to apply

Create a checklist or scoring system based on core human-centred design principles (e.g., user research integration, empathy, usability considerations) and apply it to your design concepts at various milestones.

Project actions

  • 01When evaluating your design process, consider creating your own metric to score how well you've incorporated user needs.
  • 02Be aware that small sample sizes and early-stage concepts can make it hard to find clear results.
03

Method & Evidence

AimHow can the quality of human-centred design activities be assessed early in the design process by evaluating the resulting product concepts?
MethodMetric development and application
ProcedureA Human-Centredness Metric (HCM) was developed based on the four goals of human-centred design. This metric was then applied to evaluate 16 product concepts generated by students using different human-centred design methods, with scores recorded on a 4-point Likert scale.
Sample16 concepts
ContextProduct design education and practice

Variables

IVUse of specific human-centred design methods
DVHuman-Centredness Metric (HCM) score
CVConcept complexity, developmental stage of concepts, number of students involved
04

Strengths & Limitations

Strengths

  • +Introduces a novel metric for early assessment of human-centred design quality.
  • +Provides a framework for quantitative evaluation of design processes.

Limitations

The number of design concepts evaluated was small, and the concepts were in their early stages, which might have affected the clarity of the results.

Reliability & validity

The study's validity is potentially limited by the small sample size and the early stage of the concepts, which may not fully represent the impact of design methods. Reliability could be improved with clearer definitions of metric components and standardized application procedures.

Think critically

Given the limitations, how could the Human-Centredness Metric be refined to be more sensitive to the nuances of different design methods and product types?

05

Design Principles

"Quantify user-centricity throughout the design lifecycle to ensure consistent and effective integration of user needs."

This metric offers a way to benchmark and improve the application of human-centred design methodologies during the early stages of a design project. By providing a quantifiable score, design teams can identify areas where user considerations might be lacking and make targeted improvements before significant resources are committed.

06

What This Means for Your Design

This research created a way to score how 'human-centred' a design idea is, even early on. It found that using specific design methods might help, but more research is needed to be sure.

How to use in your project

  • 1.Reference this study when discussing the importance of evaluating the effectiveness of your chosen design methodologies.
  • 2.Use the concept of a 'human-centredness metric' as inspiration for developing your own evaluation criteria for your design process.
07

Add to My Project

08

Quick Cite

Paragraph starter

The study by Sankowski and Krause (2023) highlights the challenge of quantifying the effectiveness of human-centred design activities. Their development of a 'Human-Centredness Metric' (HCM) suggests that even early in a design project, it is possible to assess the degree to which user-centric principles have been integrated into product concepts. While their initial application showed promising trends, they noted limitations such as small sample sizes and concept complexity, underscoring the need for robust evaluation frameworks in design practice.

09

Source

Applied Sciences

The Human-Centredness Metric: Early Assessment of the Quality of Human-Centred Design Activities

journal · 2023

View source

Questions About This Research

What does the research say about quantifiable human-centredness: a metric for evaluating design process quality?
Develop and apply metrics that quantify the integration of user needs and principles throughout the design process, even in its early stages, to ensure a more robustly human-centred outcome. Evidence: Applied Sciences (2023).
Why does "Quantifiable Human-Centredness: A Metric for Evaluating Design Process Quality" matter for design?
This metric offers a way to benchmark and improve the application of human-centred design methodologies during the early stages of a design project. By providing a quantifiable score, design teams can identify areas where user considerations might be lacking and make targeted improvements before significant resources are committed.
How can designers apply this research?
Develop and apply metrics that quantify the integration of user needs and principles throughout the design process, even in its early stages, to ensure a more robustly human-centred outcome.
What were the main findings?
Trends suggest that the application of specific human-centred design methods can positively influence the human-centredness score of product concepts.. Statistical significance was not achieved, likely due to limitations in concept complexity, sample size, and the developmental stage of the concepts.
What research method was used?
Metric development and application with 16 concepts.
How strong is the evidence?
Evidence strength is rated Mixed findings, based on a 2023 journal from Applied Sciences.
What should I do differently in my next project?
Create a checklist or scoring system based on core human-centred design principles (e.g., user research integration, empathy, usability considerations) and apply it to your design concepts at various milestones.
What are the limitations?
The study's findings were limited by the small number of concepts evaluated, the complexity of the concepts themselves, and the early stage of their development, which may have obscured statistically significant results.