Short answer
Designers should advocate for and contribute to the development of standardized metrics that can objectively demonstrate the positive impact of their work.
- Field
- Innovation & Design
- Source
- BMC Health Services Research (2012)
- Method
- Qualitative analysis of pilot indicators and expert opinion
- Evidence
- Moderate effect
The effectiveness of research initiatives can be significantly improved by developing and implementing standardized, reliable methods for measuring their impact. This innovation & design research insight is drawn from a 2012 study published in BMC Health Services Research. Using Qualitative analysis of pilot indicators and expert opinion, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should advocate for and contribute to the development of standardized metrics that can objectively demonstrate the positive impact of their work.
Standardized impact metrics are crucial for evaluating research effectiveness.
The effectiveness of research initiatives can be significantly improved by developing and implementing standardized, reliable methods for measuring their impact.
BMC Health Services Research · 2012
Key Findings
- 01Existing pilot indicators for research impact have some validity.
- 02Significant challenges exist in reliably operationalizing and measuring these indicators.
- 03Standardized comparison of research impact across different cases is difficult.
Application
Design takeaway
Designers should advocate for and contribute to the development of standardized metrics that can objectively demonstrate the positive impact of their work.
How to apply
When initiating a design project, establish specific, quantifiable objectives related to user outcomes, market penetration, or efficiency gains, and plan for how these will be measured and reported.
Project actions
- 01Clearly define what 'impact' means for your design project before you start.
- 02Consider how you will collect data to prove your project's impact.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Identifies a significant gap in research evaluation.
- +Proposes a collaborative approach to solution development.
Limitations
Measuring the 'impact' of a design can be complex and influenced by many external factors.
Reliability & validity
The study points to challenges in the reliability and validity of current impact indicators, suggesting that further work is needed to ensure these measures are consistent and accurately reflect true impact.
Think critically
If standardized metrics are difficult to implement, what alternative methods can be used to credibly assess the impact of design projects?
Design Principles
"Define and measure impact with standardized, reliable indicators."
In design practice, understanding the tangible outcomes and influence of design projects is vital for demonstrating value and securing future investment. Establishing clear metrics allows for objective assessment of design's contribution to user well-being, market success, or societal advancement.
What This Means for Your Design
It's hard to know if research or design projects are truly successful because we don't have good, consistent ways to measure their results. We need to agree on common methods to track impact.
How to use in your project
- 1.Use this research to justify the importance of defining and measuring the impact of your design solutions.
Add to My Project
Quick Cite
Paragraph starter
This research highlights the critical need for standardized methodologies in assessing impact. For my design project, this means that simply creating a functional prototype is insufficient; I must also define and measure its tangible effects on users or the intended context to demonstrate its true value and success.
Source
BMC Health Services Research
Assessing research impact in academic clinical medicine: a study using Research Excellence Framework pilot impact indicators
journal · 2012
View sourceQuestions About This Research
- What does the research say about standardized impact metrics are crucial for evaluating research effectiveness?
- Designers should advocate for and contribute to the development of standardized metrics that can objectively demonstrate the positive impact of their work. Evidence: BMC Health Services Research (2012).
- Why does "Standardized impact metrics are crucial for evaluating research effectiveness." matter for design?
- In design practice, understanding the tangible outcomes and influence of design projects is vital for demonstrating value and securing future investment. Establishing clear metrics allows for objective assessment of design's contribution to user well-being, market success, or societal advancement.
- How can designers apply this research?
- Designers should advocate for and contribute to the development of standardized metrics that can objectively demonstrate the positive impact of their work.
- What were the main findings?
- Existing pilot indicators for research impact have some validity.. Significant challenges exist in reliably operationalizing and measuring these indicators.. Standardized comparison of research impact across different cases is difficult.
- What research method was used?
- Qualitative analysis of pilot indicators and expert opinion.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2012 journal from BMC Health Services Research.
- What should I do differently in my next project?
- When initiating a design project, establish specific, quantifiable objectives related to user outcomes, market penetration, or efficiency gains, and plan for how these will be measured and reported.
- What are the limitations?
- The study focused on academic clinical medicine, and findings may not directly translate to all design fields.