Short answer

Implement a unified metric system to track and communicate product quality throughout the design and development process, enabling faster and more informed decision-making.

Field
Innovation & Design
Source
Academic Publication (2021)
Method
Quantitative research and method development
Evidence
Moderate effect

A single, aggregated metric for product quality across software iterations can significantly aid decision-making regarding acceptance or rejection. This innovation & design research insight is drawn from a 2021 study published in Academic Publication. Using Quantitative research and method development, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Implement a unified metric system to track and communicate product quality throughout the design and development process, enabling faster and more informed decision-making.

Study
Innovation & DesignHigh ImpactModerate effect

Aggregated Quality Metric Streamlines Software Iteration Decisions

A single, aggregated metric for product quality across software iterations can significantly aid decision-making regarding acceptance or rejection.

Academic Publication · 2021

01

Key Findings

  • 01PQEM provides a synthetic and intuitive way to visualize and understand product quality.
  • 02An aggregated quality value per iteration facilitates decision-making for accepting or rejecting development stages.
  • 03The method integrates established quality standards and testing coverage for a comprehensive evaluation.
02

Application

Design takeaway

Implement a unified metric system to track and communicate product quality throughout the design and development process, enabling faster and more informed decision-making.

How to apply

Define key quality characteristics relevant to your project, establish metrics for each, and aggregate them into a single score for each development milestone.

Project actions

  • 01Clearly define the quality characteristics you will measure.
  • 02Ensure your chosen metrics are quantifiable and directly related to the quality characteristics.
03

Method & Evidence

AimHow can an aggregated quality metric be developed and applied to effectively evaluate software product quality across development iterations?
MethodQuantitative research and method development
ProcedureDeveloped the Product Quality Evaluation Method (PQEM) by integrating the Goal-Question-Metric (GQM) approach, ISO/IEC 25010 standard, and testing coverage extensions. Applied PQEM to a web and mobile healthcare application to generate an aggregated quality value per iteration.
ContextSoftware development lifecycle, particularly for web and mobile applications in the healthcare sector.

Variables

IVQuality characteristics and testing coverage metrics.
DVAggregated product quality score per iteration.
CVSpecific software product, development environment, chosen quality standards.
04

Strengths & Limitations

Strengths

  • +Provides a unified and intuitive view of product quality.
  • +Integrates established quality frameworks and testing data.

Limitations

It can be challenging to assign appropriate weights to different quality characteristics when aggregating them into a single score.

Reliability & validity

Reliability could be improved by standardizing the scoring process for each quality characteristic. Validity is supported by the use of established quality standards like ISO/IEC 25010, but the aggregation method's validity depends on how well the single score reflects overall user satisfaction and product success.

Think critically

To what extent does a single aggregated metric truly represent the multifaceted nature of product quality, and what are the risks of oversimplification?

05

Design Principles

"Synthesize complex data into actionable insights for efficient decision-making."

In fast-paced development environments, project managers and stakeholders require clear, synthesized information to make timely decisions. This approach provides an intuitive way to assess product quality at each stage, optimizing resource allocation and ensuring feasible quality levels for deliverables.

06

What This Means for Your Design

Imagine you're building something in stages. This method helps you get one simple score for how good each stage is, so you can quickly decide if it's ready to move on.

How to use in your project

  • 1.Use the PQEM framework to justify design decisions based on iterative quality assessments in your design project.
07

Add to My Project

08

Quick Cite

Paragraph starter

The Product Quality Evaluation Method (PQEM) offers a structured approach to assessing product quality iteratively. By integrating metrics from established standards and testing coverage, it generates an aggregated quality score per development stage, thereby streamlining decision-making for project progression and resource allocation.

09

Source

Academic Publication

Product Quality Evaluation Method (PQEM): A Comprehensive Approach for the Software Product Life Cycle

journal · 2021

View source

Questions About This Research

What does the research say about aggregated quality metric streamlines software iteration decisions?
Implement a unified metric system to track and communicate product quality throughout the design and development process, enabling faster and more informed decision-making. Evidence: Academic Publication (2021).
Why does "Aggregated Quality Metric Streamlines Software Iteration Decisions" matter for design?
In fast-paced development environments, project managers and stakeholders require clear, synthesized information to make timely decisions. This approach provides an intuitive way to assess product quality at each stage, optimizing resource allocation and ensuring feasible quality levels for deliverables.
How can designers apply this research?
Implement a unified metric system to track and communicate product quality throughout the design and development process, enabling faster and more informed decision-making.
What were the main findings?
PQEM provides a synthetic and intuitive way to visualize and understand product quality.. An aggregated quality value per iteration facilitates decision-making for accepting or rejecting development stages.. The method integrates established quality standards and testing coverage for a comprehensive evaluation.
What research method was used?
Quantitative research and method development.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2021 journal from Academic Publication.
What should I do differently in my next project?
Define key quality characteristics relevant to your project, establish metrics for each, and aggregate them into a single score for each development milestone.
What are the limitations?
The reliance on a single aggregated value might oversimplify nuanced quality aspects; the method's effectiveness may vary across different software types and industries.