Short answer
When designing systems to combat misinformation, prioritize features that analyze communicative intent and the potential for content to mislead users, in addition to factual accuracy.
- Field
- Innovation & Design
- Source
- Journal of Documentation (2017)
- Method
- Philosophical analysis and argumentation
- Evidence
- Moderate effect
The core distinction between information, misinformation, and disinformation lies not solely in truthfulness, but critically in the communicator's intention and the misleading nature of the content. This innovation & design research insight is drawn from a 2017 study published in Journal of Documentation. Using Philosophical analysis and argumentation, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing systems to combat misinformation, prioritize features that analyze communicative intent and the potential for content to mislead users, in addition to factual accuracy.
Intent and Misleadingness, Not Just Truth, Define Misinformation in Design
The core distinction between information, misinformation, and disinformation lies not solely in truthfulness, but critically in the communicator's intention and the misleading nature of the content.
Journal of Documentation · 2017
Key Findings
- 01The primary differentiator between information, misinformation, and disinformation is the presence of intention and the degree of misleadingness, rather than just truth or falsity.
- 02The concepts of 'true disinformation' and 'true misinformation' challenge the binary of true vs. false information, suggesting a more nuanced understanding is required.
- 03Automatic detection systems often overlook the communicative intent and misleading potential, focusing too narrowly on factual accuracy.
Application
Design takeaway
When designing systems to combat misinformation, prioritize features that analyze communicative intent and the potential for content to mislead users, in addition to factual accuracy.
How to apply
When developing AI for content analysis, train models not only on factual correctness but also on linguistic cues indicative of deceptive intent or manipulative framing.
Project actions
- 01Consider the user's intent when designing interactive systems.
- 02Explore how to visually represent uncertainty or potential misleadingness in data visualizations.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Provides a philosophical foundation for understanding misinformation.
- +Challenges simplistic approaches to content detection.
Limitations
It can be challenging to definitively determine intent from content alone, and users may interpret intent differently.
Reliability & validity
The philosophical nature of the argument makes direct reliability and validity testing difficult. Validity would depend on the logical coherence of the arguments presented.
Think critically
If 'true misinformation' exists, how does this impact the ethical responsibilities of platforms and designers in curating information?
Design Principles
"Design for communicative intent and misleadingness in information systems."
Understanding the intent behind information and its potential to mislead is crucial for designing systems that can effectively identify and flag problematic content. This goes beyond simple fact-checking to consider the communicative context and user perception.
What This Means for Your Design
To spot fake news, it's not just about if it's wrong, but also about whether the person sharing it meant to trick you and if it's designed to make you believe something false.
How to use in your project
- 1.Use this research to justify the inclusion of user intent analysis in your design process for digital products.
- 2.Reference the findings when discussing the limitations of purely data-driven approaches to content evaluation.
Add to My Project
Quick Cite
Paragraph starter
This research emphasizes that the distinction between information and misinformation/disinformation hinges on the communicator's intention and the potential for misleadingness, rather than solely on factual accuracy. This perspective is critical for designing effective content moderation systems and user interfaces that provide nuanced information about content reliability.
Source
Journal of Documentation
Algorithmic detection of misinformation and disinformation: Gricean perspectives
journal · 2017
View sourceQuestions About This Research
- What does the research say about intent and misleadingness, not just truth, define misinformation in design?
- When designing systems to combat misinformation, prioritize features that analyze communicative intent and the potential for content to mislead users, in addition to factual accuracy. Evidence: Journal of Documentation (2017).
- Why does "Intent and Misleadingness, Not Just Truth, Define Misinformation in Design" matter for design?
- Understanding the intent behind information and its potential to mislead is crucial for designing systems that can effectively identify and flag problematic content. This goes beyond simple fact-checking to consider the communicative context and user perception.
- How can designers apply this research?
- When designing systems to combat misinformation, prioritize features that analyze communicative intent and the potential for content to mislead users, in addition to factual accuracy.
- What were the main findings?
- The primary differentiator between information, misinformation, and disinformation is the presence of intention and the degree of misleadingness, rather than just truth or falsity.. The concepts of 'true disinformation' and 'true misinformation' challenge the binary of true vs. false information, suggesting a more nuanced understanding is required.. Automatic detection systems often overlook the communicative intent and misleading potential, focusing too narrowly on factual accuracy.
- What research method was used?
- Philosophical analysis and argumentation.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2017 journal from Journal of Documentation.
- What should I do differently in my next project?
- When developing AI for content analysis, train models not only on factual correctness but also on linguistic cues indicative of deceptive intent or manipulative framing.
- What are the limitations?
- The paper's findings are theoretical and philosophical, requiring empirical validation for practical application in algorithmic design. The nuances of 'true misinformation' may be difficult to operationalize in automated systems.