Short answer
When designing algorithms that impact multiple groups, actively involve those groups in the design process using a structured framework to ensure fairness, efficiency, and legitimacy.
- Field
- User-Centred Design
- Source
- Proceedings of the ACM on Human-Computer Interaction (2019)
- Method
- Case Study with Participatory Design Framework
- Evidence
- Strong effect
A collective participatory framework can empower diverse stakeholders to collaboratively design algorithmic policies, leading to more equitable and efficient outcomes. This user-centred design research insight is drawn from a 2019 study published in Proceedings of the ACM on Human-Computer Interaction. Using Case study with participatory design framework, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing algorithms that impact multiple groups, actively involve those groups in the design process using a structured framework to ensure fairness, efficiency, and legitimacy.
Participatory Frameworks Enhance Algorithmic Policy Design by Balancing Stakeholder Interests
A collective participatory framework can empower diverse stakeholders to collaboratively design algorithmic policies, leading to more equitable and efficient outcomes.
Proceedings of the ACM on Human-Computer Interaction · 2019
Key Findings
- 01The framework successfully enabled participants to build models that accurately represented their beliefs.
- 02Participatory algorithm design improved both procedural fairness and distributive outcomes.
- 03The process raised participants' algorithmic awareness.
- 04It helped identify inconsistencies in human decision-making within the governing organization.
Application
Design takeaway
When designing algorithms that impact multiple groups, actively involve those groups in the design process using a structured framework to ensure fairness, efficiency, and legitimacy.
How to apply
When developing algorithms for services with multiple user groups or societal impact, create a structured process for these groups to contribute their perspectives and preferences to the algorithm's design and policy decisions.
Project actions
- 01Consider how to represent different user groups' needs in your design.
- 02Think about how to get feedback from a diverse range of potential users early in the design process.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Directly addresses the challenge of designing fair algorithms.
- +Provides a practical framework (WeBuildAI) and demonstrates its application.
- +Includes research into participant experiences.
Limitations
It can be challenging to get all relevant stakeholders to participate, and their individual preferences might still conflict.
Reliability & validity
The study's validity is supported by the case study approach and research into participant experiences. Reliability would depend on the replicability of the framework and the consistency of outcomes across different contexts.
Think critically
To what extent can this participatory framework be generalized to algorithms with much higher stakes, such as those used in criminal justice or healthcare?
Design Principles
"Empower diverse stakeholders through participatory design frameworks to co-create algorithms that reflect collective values and needs."
In an era where algorithms increasingly influence critical societal functions, understanding how to design them in a morally and legitimately balanced way is paramount. This research demonstrates that involving end-users and affected parties directly in the design process can lead to algorithms that better reflect diverse needs and values.
What This Means for Your Design
When you make an algorithm (like one for matching people or resources), it's better to let the people who will be affected by it help design it. This makes the algorithm fairer and work better for everyone.
How to use in your project
- 1.Reference this study when discussing the importance of user involvement in the design of systems that involve decision-making or resource allocation.
Add to My Project
Quick Cite
Paragraph starter
The research by Lee et al. (2019) highlights the efficacy of participatory frameworks in designing algorithms that balance competing stakeholder interests. Their study on an on-demand food donation service demonstrated that empowering users to build computational models representing their views led to improved fairness and efficiency, increased algorithmic awareness, and identified inconsistencies in organizational decision-making, suggesting that collaborative design is crucial for legitimate and effective algorithmic policy.
Source
Questions About This Research
- What does the research say about participatory frameworks enhance algorithmic policy design by balancing stakeholder interests?
- When designing algorithms that impact multiple groups, actively involve those groups in the design process using a structured framework to ensure fairness, efficiency, and legitimacy. Evidence: Proceedings of the ACM on Human-Computer Interaction (2019).
- Why does "Participatory Frameworks Enhance Algorithmic Policy Design by Balancing Stakeholder Interests" matter for design?
- In an era where algorithms increasingly influence critical societal functions, understanding how to design them in a morally and legitimately balanced way is paramount. This research demonstrates that involving end-users and affected parties directly in the design process can lead to algorithms that better reflect diverse needs and values.
- How can designers apply this research?
- When designing algorithms that impact multiple groups, actively involve those groups in the design process using a structured framework to ensure fairness, efficiency, and legitimacy.
- What were the main findings?
- The framework successfully enabled participants to build models that accurately represented their beliefs.. Participatory algorithm design improved both procedural fairness and distributive outcomes.. The process raised participants' algorithmic awareness.. It helped identify inconsistencies in human decision-making within the governing organization.
- What research method was used?
- Case Study with Participatory Design Framework.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2019 journal from Proceedings of the ACM on Human-Computer Interaction.
- What should I do differently in my next project?
- When developing algorithms for services with multiple user groups or societal impact, create a structured process for these groups to contribute their perspectives and preferences to the algorithm's design and policy decisions.
- What are the limitations?
- The feasibility and scalability of this framework for very large or complex systems may require further investigation. The specific context of food donation logistics might not directly translate to all algorithmic design scenarios.