Short answer

Design systems that actively encourage and support informed, deliberative contributions from the public, rather than passively collecting comments.

Field: User-Centred Design
Source: Michigan Journal of Environmental & Administrative Law (2012)
Method: Conceptual framework development and case study analysis.
Evidence: Moderate effect

Simply providing more technological avenues for public input in policy-making does not guarantee meaningful or valuable participation; the design of the participation system itself is critical. This user-centred design research insight is drawn from a 2012 study published in Michigan Journal of Environmental & Administrative Law. Using Conceptual framework development and case study analysis., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Design systems that actively encourage and support informed, deliberative contributions from the public, rather than passively collecting comments.

Study

User-Centred DesignHigh ImpactModerate effect

Technology-enabled public participation in rulemaking requires nuanced design, not just increased access.

Simply providing more technological avenues for public input in policy-making does not guarantee meaningful or valuable participation; the design of the participation system itself is critical.

Michigan Journal of Environmental & Administrative Law · 2012

Key Findings

01Increased technological access to rulemaking does not automatically result in higher quality public participation.
02Much of the current technology-enabled participation is driven by orchestrated mass comment campaigns, which may not reflect genuine, deliberated public preferences.
03A framework is needed to differentiate between types of public preferences based on information quality and deliberativeness to assess their value in rulemaking.

Application

Design takeaway

Design systems that actively encourage and support informed, deliberative contributions from the public, rather than passively collecting comments.

How to apply

When designing platforms for public consultation or feedback, incorporate features that encourage users to provide reasoning, evidence, or engage in structured debate, rather than just submitting simple opinions.

Project actions

01Consider how your design encourages users to think critically about their input.
02Think about how to differentiate between casual opinions and well-reasoned arguments in user feedback.

Method & Evidence

AimHow can the design of technology-enabled public participation systems in rulemaking be improved to foster more valuable and deliberative input, rather than just increasing the volume of comments?

MethodConceptual framework development and case study analysis.

ProcedureThe researchers analyzed existing approaches to technology-enabled public participation in rulemaking, identified shortcomings in the assumption that increased access equates to increased value, and proposed a framework for assessing participation quality based on information and deliberation.

ContextGovernmental rulemaking processes and public administration.

Variables

IVDesign of participation system (e.g., access level, prompt structure).

DVQuality of public participation (e.g., information richness, deliberativeness of comments).

CVType of policy issue, technological platform used, user demographics.

Strengths & Limitations

Strengths

+Addresses a critical gap in understanding the effectiveness of technology in public participation.
+Provides a conceptual framework for evaluating participation quality.

Limitations

It can be difficult to objectively measure 'deliberativeness' or 'information quality' in user feedback.

Reliability & validity

Reliability would depend on consistent application of the framework for assessing comment quality. Validity would be challenged by the subjective nature of 'information quality' and 'deliberativeness'.

Think critically

If mass comment campaigns are a common form of participation, how can designers create systems that encourage individual, deliberated input without alienating large advocacy groups?

Design Principles

"Design for deliberative quality, not just participation volume."

Designers and researchers involved in public-facing digital platforms or policy-making tools must move beyond a 'more is better' approach. Understanding the quality and deliberativeness of user input is essential for creating systems that genuinely enhance democratic processes and lead to better policy outcomes.

What This Means for Your Design

Just because you build a bigger door for people to give feedback doesn't mean the feedback will be good. You need to design the room and the process to help people give *useful* feedback.

How to use in your project

1.Use this research to justify designing for specific types of user interaction that promote deeper engagement, rather than just broad participation.

Add to My Project

Quick Cite

Paragraph starter

The research by Farina, Newhart, and Heidt (2012) suggests that technology-enabled public participation in design processes should prioritize the quality of user input over sheer volume. Their work indicates that simply increasing access does not guarantee valuable contributions, as users may engage through superficial means like mass comment campaigns. Therefore, design interventions should focus on fostering reasoned deliberation and informed preference formation to ensure that user feedback genuinely enhances decision-making.

Source

Michigan Journal of Environmental & Administrative Law

Rulemaking vs. Democracy: Judging and Nudging Public Participation That Counts

journal · 2012

View source

Questions About This Research

What does the research say about technology-enabled public participation in rulemaking requires nuanced design, not just increased access?: Design systems that actively encourage and support informed, deliberative contributions from the public, rather than passively collecting comments. Evidence: Michigan Journal of Environmental & Administrative Law (2012).
Why does "Technology-enabled public participation in rulemaking requires nuanced design, not just increased access." matter for design?: Designers and researchers involved in public-facing digital platforms or policy-making tools must move beyond a 'more is better' approach. Understanding the quality and deliberativeness of user input is essential for creating systems that genuinely enhance democratic processes and lead to better policy outcomes.
How can designers apply this research?: Design systems that actively encourage and support informed, deliberative contributions from the public, rather than passively collecting comments.
What were the main findings?: Increased technological access to rulemaking does not automatically result in higher quality public participation.. Much of the current technology-enabled participation is driven by orchestrated mass comment campaigns, which may not reflect genuine, deliberated public preferences.. A framework is needed to differentiate between types of public preferences based on information quality and deliberativeness to assess their value in rulemaking.
What research method was used?: Conceptual framework development and case study analysis..
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2012 journal from Michigan Journal of Environmental & Administrative Law.
What should I do differently in my next project?: When designing platforms for public consultation or feedback, incorporate features that encourage users to provide reasoning, evidence, or engage in structured debate, rather than just submitting simple opinions.
What are the limitations?: The framework's practical application and measurement of 'information quality' and 'deliberativeness' may require further empirical validation.