Short answer
When seeking feedback on design concepts or policy proposals, provide a structured framework for evaluation but allow participants the freedom to define their own criteria for assessment.
- Field
- Innovation & Design
- Source
- Obesity Reviews (2007)
- Method
- Qualitative research with a structured interview framework (Multi-Criteria Mapping)
- Sample
- Sets of stakeholders representing more than 20 aspects of policy development in nine participating countries.
- Evidence
- Strong effect
A structured yet flexible interview framework, like Multi-Criteria Mapping, can effectively capture diverse stakeholder perspectives on complex policy options. This innovation & design research insight is drawn from a 2007 study published in Obesity Reviews. Using Qualitative research with a structured interview framework (multi-criteria mapping) with Sets of stakeholders representing more than 20 aspects of policy development in nine participating countries., researchers explored how this design variable affects real-world outcomes. The key design takeaway: When seeking feedback on design concepts or policy proposals, provide a structured framework for evaluation but allow participants the freedom to define their own criteria for assessment.
Multi-Criteria Mapping Enhances Stakeholder Input in Policy Design
A structured yet flexible interview framework, like Multi-Criteria Mapping, can effectively capture diverse stakeholder perspectives on complex policy options.
Obesity Reviews · 2007
Key Findings
- 01Multi-Criteria Mapping provides a structured yet flexible method for eliciting stakeholder views.
- 02Interviewees can effectively appraise predefined options using their own chosen criteria.
- 03Contextual information from interviews enriches the understanding of stakeholder appraisals.
Application
Design takeaway
When seeking feedback on design concepts or policy proposals, provide a structured framework for evaluation but allow participants the freedom to define their own criteria for assessment.
How to apply
When developing new products or services, present a range of potential features or solutions and ask target users to rank or score them based on what matters most to them, allowing them to articulate their own priorities.
Project actions
- 01Clearly define the scope of options to be presented to participants.
- 02Develop a flexible interview guide that allows for exploration of participant-defined criteria.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Captures a wide range of perspectives.
- +Provides depth of understanding beyond simple preferences.
Limitations
The number of options and criteria can become overwhelming, and the qualitative data analysis requires careful interpretation.
Reliability & validity
Reliability could be enhanced by standardizing the interview process and training interviewers. Validity is strengthened by allowing participants to define their own criteria, ensuring the assessment reflects their genuine priorities.
Think critically
How might the selection of predefined options influence the outcome of stakeholder assessments, even with the freedom to choose appraisal criteria?
Design Principles
"Empowerment of evaluators: Provide structured tools that allow individuals to define their own assessment criteria, leading to richer and more contextually relevant feedback."
Understanding the varied viewpoints of stakeholders is crucial for designing effective and widely accepted policies or products. This approach allows for a nuanced exploration of opinions, moving beyond simple 'yes/no' responses to uncover the underlying reasoning and criteria used by different groups.
What This Means for Your Design
When you want to know what people think about different ideas, give them a list of ideas and let them tell you what's important to them when deciding which ones are good or bad.
How to use in your project
- 1.Use this methodology to gather diverse stakeholder opinions on your design concept, justifying the approach by its ability to uncover nuanced perspectives.
Add to My Project
Quick Cite
Paragraph starter
The research employed a Multi-Criteria Mapping approach, adapted from Stirling et al. (2007), to gather detailed stakeholder assessments of design options. This methodology allowed participants to evaluate predefined design elements based on their own articulated criteria, providing rich qualitative data on user priorities and decision-making processes.
Source
Obesity Reviews
Methodology for obtaining stakeholder assessments of obesity policy options in the PorGrow project
journal · 2007
View sourceQuestions About This Research
- What does the research say about multi-criteria mapping enhances stakeholder input in policy design?
- When seeking feedback on design concepts or policy proposals, provide a structured framework for evaluation but allow participants the freedom to define their own criteria for assessment. Evidence: Obesity Reviews (2007).
- Why does "Multi-Criteria Mapping Enhances Stakeholder Input in Policy Design" matter for design?
- Understanding the varied viewpoints of stakeholders is crucial for designing effective and widely accepted policies or products. This approach allows for a nuanced exploration of opinions, moving beyond simple 'yes/no' responses to uncover the underlying reasoning and criteria used by different groups.
- How can designers apply this research?
- When seeking feedback on design concepts or policy proposals, provide a structured framework for evaluation but allow participants the freedom to define their own criteria for assessment.
- What were the main findings?
- Multi-Criteria Mapping provides a structured yet flexible method for eliciting stakeholder views.. Interviewees can effectively appraise predefined options using their own chosen criteria.. Contextual information from interviews enriches the understanding of stakeholder appraisals.
- What research method was used?
- Qualitative research with a structured interview framework (Multi-Criteria Mapping) with Sets of stakeholders representing more than 20 aspects of policy development in nine participating countries..
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2007 journal from Obesity Reviews.
- What should I do differently in my next project?
- When developing new products or services, present a range of potential features or solutions and ask target users to rank or score them based on what matters most to them, allowing them to articulate their own priorities.
- What are the limitations?
- The predefined set of options might inadvertently bias the appraisal, and the complexity of the mapping process could be challenging for some participants.