Short answer

When designing online communities or discussion features, acknowledge that a one-size-fits-all approach is unlikely to be effective; tailor the design to the specific user group and desired level of discourse.

Field
Innovation & Markets
Source
Scholarworks (University of Massachusetts Amherst) (2021)
Method
A priori content analysis
Evidence
Moderate effect

Online discussion forums associated with news sites exhibit significant differences in their deliberative quality, suggesting that different platforms cater to distinct user typologies. This innovation & markets research insight is drawn from a 2021 study published in Scholarworks (University of Massachusetts Amherst). Using A priori content analysis, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing online communities or discussion features, acknowledge that a one-size-fits-all approach is unlikely to be effective; tailor the design to the specific user group and desired level of discourse.

Study
Innovation & MarketsHigh ImpactModerate effect

Online Discussion Platforms Foster Diverse Publics with Varying Deliberative Qualities

Online discussion forums associated with news sites exhibit significant differences in their deliberative quality, suggesting that different platforms cater to distinct user typologies.

Scholarworks (University of Massachusetts Amherst) · 2021

01

Key Findings

  • 01Statistically significant differences were found in the overall deliberative quality of comments across the four platforms.
  • 02There were wide variations within each of the component measures (civility, politeness, justification, complexity) across the platforms.
02

Application

Design takeaway

When designing online communities or discussion features, acknowledge that a one-size-fits-all approach is unlikely to be effective; tailor the design to the specific user group and desired level of discourse.

How to apply

When developing a new online forum or evaluating an existing one, analyze the types of discussions that occur and consider how the platform's design might be influencing them. Experiment with different moderation strategies or content prompts to see how they affect user engagement and the quality of discourse.

Project actions

  • 01When researching user behavior on online platforms, consider the specific context of each platform and its typical users.
  • 02When designing an online community, think about how different features might encourage or discourage certain types of interactions.
03

Method & Evidence

AimTo assess the deliberative quality of online postings across different news websites and to understand how news content influences these discussions.
MethodA priori content analysis
ProcedureThe researcher analyzed online comments from four popular news sites over two months, measuring civility, politeness, justification, and complexity. Data was also coded based on the precipitating news content.
ContextOnline news discussion forums

Variables

IV["News website platform","Type of news content"]
DV["Deliberative quality of comments (civility, politeness, justification, complexity)"]
04

Strengths & Limitations

Strengths

  • +Employs a structured content analysis scheme for objective measurement.
  • +Compares multiple platforms, offering a comparative perspective.

Limitations

The study's findings are specific to the chosen platforms and time period. Generalizing to all online discussions might be an oversimplification.

Reliability & validity

The use of an a priori content analysis scheme with defined measures (civility, politeness, justification, complexity) enhances reliability. Validity is supported by the comparison across multiple platforms and the exploration of relationships with news content.

Think critically

To what extent can platform design truly shape user behavior in online discussions, or are user predispositions the primary drivers of discourse quality?

05

Design Principles

"Design for diverse publics: Recognize that different online spaces attract and foster different types of user interaction and deliberative quality."

Understanding the varied nature of online public spaces is crucial for designing effective communication strategies and platforms. Recognizing these differences allows for more targeted approaches to fostering productive dialogue and managing user engagement.

06

What This Means for Your Design

Online comment sections on news websites can be very different from each other. Some are polite and thoughtful, while others are rude and chaotic. This means designers need to think about who will use a platform and what kind of conversations they want to happen.

How to use in your project

  • 1.Reference this study when discussing the importance of user research and understanding target audiences for digital products.
  • 2.Use the findings to justify design choices aimed at fostering specific types of online interactions.
07

Add to My Project

08

Quick Cite

Paragraph starter

Research indicates that online discussion platforms exhibit significant variations in deliberative quality, with different platforms attracting distinct user typologies and fostering unique interaction styles. This suggests that a nuanced approach to platform design and community management is essential, recognizing that a 'one-size-fits-all' solution is unlikely to be effective in cultivating productive online discourse.

09

Source

Scholarworks (University of Massachusetts Amherst)

The Shifting Structure of Chicago's Organized Crime Network and the Women It Left Behind

journal · 2021

View source

Questions About This Research

What does the research say about online discussion platforms foster diverse publics with varying deliberative qualities?
When designing online communities or discussion features, acknowledge that a one-size-fits-all approach is unlikely to be effective; tailor the design to the specific user group and desired level of discourse. Evidence: Scholarworks (University of Massachusetts Amherst) (2021).
Why does "Online Discussion Platforms Foster Diverse Publics with Varying Deliberative Qualities" matter for design?
Understanding the varied nature of online public spaces is crucial for designing effective communication strategies and platforms. Recognizing these differences allows for more targeted approaches to fostering productive dialogue and managing user engagement.
How can designers apply this research?
When designing online communities or discussion features, acknowledge that a one-size-fits-all approach is unlikely to be effective; tailor the design to the specific user group and desired level of discourse.
What were the main findings?
Statistically significant differences were found in the overall deliberative quality of comments across the four platforms.. There were wide variations within each of the component measures (civility, politeness, justification, complexity) across the platforms.
What research method was used?
A priori content analysis.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2021 journal from Scholarworks (University of Massachusetts Amherst).
What should I do differently in my next project?
When developing a new online forum or evaluating an existing one, analyze the types of discussions that occur and consider how the platform's design might be influencing them. Experiment with different moderation strategies or content prompts to see how they affect user engagement and the quality of discourse.
What are the limitations?
The study focused on a specific two-month period and four news sites, which may not be representative of all online discussion forums.