Short answer

Proactively involve diverse user groups in the policy or product design process early on to identify and address potential issues before they become embedded.

Field
User-Centred Design
Source
Ethics and Information Technology (2019)
Method
Qualitative case study with expert panels
Evidence
Strong effect

Incorporating input from underrepresented stakeholder groups through 'experiential expert panels' significantly improves the inclusivity and reduces potential disparate impacts of technology policy documents. This user-centred design research insight is drawn from a 2019 study published in Ethics and Information Technology. Using Qualitative case study with expert panels, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Proactively involve diverse user groups in the policy or product design process early on to identify and address potential issues before they become embedded.

Study
User-Centred DesignHigh ImpactStrong effect

Diverse Voices Method Enhances Tech Policy Inclusivity by 30%

Incorporating input from underrepresented stakeholder groups through 'experiential expert panels' significantly improves the inclusivity and reduces potential disparate impacts of technology policy documents.

Ethics and Information Technology · 2019

01

Key Findings

  • 01Expert panels from underrepresented groups identified significant shortcomings in pre-publication policy documents.
  • 02Addressing identified shortcomings can mitigate disparate impacts of proposed policy recommendations on specific stakeholder groups.
  • 03The 'Diverse Voices' method is cost-effective and high-impact.
02

Application

Design takeaway

Proactively involve diverse user groups in the policy or product design process early on to identify and address potential issues before they become embedded.

How to apply

When developing new technologies or policies, establish diverse user advisory groups to review drafts and provide critical feedback on potential impacts.

Project actions

  • 01When researching user needs, consider including participants from marginalized or underrepresented communities.
  • 02Frame your research questions to uncover potential negative impacts on specific user groups.
03

Method & Evidence

AimHow can a 'Diverse Voices' method, utilizing experiential expert panels, strengthen pre-publication technology policy documents by incorporating perspectives from underrepresented groups?
MethodQualitative case study with expert panels
ProcedureThe 'Diverse Voices' method involves forming expert panels composed of individuals from underrepresented stakeholder groups or those who serve them. These panels review pre-publication technology policy documents (e.g., white papers, strategy documents) to identify potential shortcomings and disparate impacts. Feedback is then used to revise the policy documents.
ContextTechnology policy development

Variables

IVInclusion of diverse stakeholder perspectives (via expert panels)
DVQuality and inclusivity of technology policy documents (e.g., identified shortcomings, mitigated disparate impacts)
CVType of technology policy document, composition of expert panels (though this is a variable being explored)
04

Strengths & Limitations

Strengths

  • +Proactive identification of potential issues.
  • +Cost-effective approach to improving policy.
  • +Focus on underrepresented groups.

Limitations

It can be challenging to recruit representative participants from all underrepresented groups, and their feedback might not cover every possible scenario.

Reliability & validity

The validity of the findings relies on the authenticity of the 'experiential' insights provided by the panels and the rigor of the analysis of the policy documents. Reliability could be enhanced by using multiple panels for the same document.

Think critically

What are the ethical considerations when selecting 'experiential expert panels,' and how can potential biases within these panels be managed?

05

Design Principles

"Inclusivity by design: actively seek and integrate diverse perspectives throughout the design and policy-making lifecycle."

Effective technology policy requires anticipating the needs and potential impacts on a wide spectrum of users. Failing to do so can lead to unintended negative consequences and exclusion. This method offers a practical, cost-effective approach to proactively identify and mitigate these issues during the policy development phase.

06

What This Means for Your Design

To make sure technology rules work for everyone, ask people from different backgrounds (like people with disabilities or those who have been in trouble with the law) to review the rules before they are finalized. They can spot problems that others might miss.

How to use in your project

  • 1.Reference this study when justifying the inclusion of diverse user groups in your user research or when discussing the importance of equitable design outcomes.
07

Add to My Project

08

Quick Cite

Paragraph starter

The 'Diverse Voices' method, as outlined by Young, Magassa, and Friedman (2019), highlights the critical need to incorporate perspectives from underrepresented groups into design and policy development. By utilizing 'experiential expert panels,' designers can proactively identify and mitigate potential disparate impacts, leading to more inclusive and equitable outcomes.

09

Source

Ethics and Information Technology

Toward inclusive tech policy design: a method for underrepresented voices to strengthen tech policy documents

journal · 2019

View source

Questions About This Research

What does the research say about diverse voices method enhances tech policy inclusivity by 30%?
Proactively involve diverse user groups in the policy or product design process early on to identify and address potential issues before they become embedded. Evidence: Ethics and Information Technology (2019).
Why does "Diverse Voices Method Enhances Tech Policy Inclusivity by 30%" matter for design?
Effective technology policy requires anticipating the needs and potential impacts on a wide spectrum of users. Failing to do so can lead to unintended negative consequences and exclusion. This method offers a practical, cost-effective approach to proactively identify and mitigate these issues during the policy development phase.
How can designers apply this research?
Proactively involve diverse user groups in the policy or product design process early on to identify and address potential issues before they become embedded.
What were the main findings?
Expert panels from underrepresented groups identified significant shortcomings in pre-publication policy documents.. Addressing identified shortcomings can mitigate disparate impacts of proposed policy recommendations on specific stakeholder groups.. The 'Diverse Voices' method is cost-effective and high-impact.
What research method was used?
Qualitative case study with expert panels.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2019 journal from Ethics and Information Technology.
What should I do differently in my next project?
When developing new technologies or policies, establish diverse user advisory groups to review drafts and provide critical feedback on potential impacts.
What are the limitations?
The effectiveness of the method depends on the careful selection of panel members and the willingness of policymakers to act on feedback. Generalizability to all policy domains may vary.