Short answer
Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information.
- Field
- User-Centred Design
- Source
- eYLS (Yale Law School) (2020)
- Method
- Literature review and conceptual analysis
- Evidence
- Strong effect
Artificial intelligence can derive sensitive health information from seemingly unrelated digital behaviors, creating 'emergent medical data' (EMD) without user awareness or consent. This user-centred design research insight is drawn from a 2020 study published in eYLS (Yale Law School). Using Literature review and conceptual analysis, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information.
AI-inferred health data from digital traces poses significant ethical and privacy risks.
Artificial intelligence can derive sensitive health information from seemingly unrelated digital behaviors, creating 'emergent medical data' (EMD) without user awareness or consent.
eYLS (Yale Law School) · 2020
Key Findings
- 01AI can infer health information (EMD) from mundane digital traces like location data, purchase history, and social media activity.
- 02EMD profiling is proposed as a solution for public health crises but lacks strong evidence of efficacy.
- 03EMD mining and profiling can cause significant harm and are often conducted without user knowledge or consent due to legal loopholes.
- 04Potential regulatory options include restricting data collection, regulating AI algorithms, and limiting EMD usage.
Application
Design takeaway
Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information.
How to apply
When designing systems that collect user data, particularly for AI analysis, conduct a thorough ethical review to identify potential privacy risks and ensure robust consent mechanisms are in place.
Project actions
- 01Consider the ethical implications of any data you collect and how it might be interpreted by AI.
- 02Explore user consent models that are clear and comprehensive.
- 03Research existing privacy regulations relevant to your design project.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Identifies a novel and concerning application of AI.
- +Provides a comprehensive overview of ethical and legal challenges.
- +Proposes concrete regulatory solutions.
Limitations
The article is a legal and ethical analysis, not a technical one, so it doesn't detail the specific AI methods used for inference.
Reliability & validity
The article's validity relies on the logical coherence of its arguments and its synthesis of existing literature. Reliability is based on the consistent application of legal and ethical principles to the described phenomena.
Think critically
To what extent should designers be responsible for anticipating and mitigating the potential for AI to infer unintended sensitive information from user data?
Design Principles
"Inferred data carries ethical weight; design for transparency and user control over sensitive information."
This capability raises profound ethical questions about privacy, consent, and potential misuse of personal data. Designers must consider the ethical implications of data collection and AI analysis, especially when sensitive information can be inferred.
What This Means for Your Design
Computers can figure out private health stuff about you from your online activity, even if you didn't tell them directly, and this can be risky.
How to use in your project
- 1.Reference this research when discussing the ethical considerations of data collection and AI in your design project.
- 2.Use it to justify your design choices related to privacy and user consent.
Add to My Project
Quick Cite
Paragraph starter
The research by Marks (2020) highlights significant ethical concerns surrounding the inference of sensitive health data (emergent medical data or EMD) from user digital traces by artificial intelligence. This underscores the critical need for designers to implement transparent data collection practices and robust consent mechanisms, ensuring users are fully aware of how their data might be analyzed and what sensitive information could be inferred, thereby mitigating potential privacy harms and building user trust.
Source
eYLS (Yale Law School)
Emergent Medical Data: Health Information Inferred by Artificial Intelligence
journal · 2020
View sourceQuestions About This Research
- What does the research say about ai-inferred health data from digital traces poses significant ethical and privacy risks?
- Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information. Evidence: eYLS (Yale Law School) (2020).
- Why does "AI-inferred health data from digital traces poses significant ethical and privacy risks." matter for design?
- This capability raises profound ethical questions about privacy, consent, and potential misuse of personal data. Designers must consider the ethical implications of data collection and AI analysis, especially when sensitive information can be inferred.
- How can designers apply this research?
- Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information.
- What were the main findings?
- AI can infer health information (EMD) from mundane digital traces like location data, purchase history, and social media activity.. EMD profiling is proposed as a solution for public health crises but lacks strong evidence of efficacy.. EMD mining and profiling can cause significant harm and are often conducted without user knowledge or consent due to legal loopholes.. Potential regulatory options include restricting data collection, regulating AI algorithms, and limiting EMD usage.
- What research method was used?
- Literature review and conceptual analysis.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2020 journal from eYLS (Yale Law School).
- What should I do differently in my next project?
- When designing systems that collect user data, particularly for AI analysis, conduct a thorough ethical review to identify potential privacy risks and ensure robust consent mechanisms are in place.
- What are the limitations?
- The article focuses on conceptual risks and regulatory proposals rather than empirical studies of EMD effectiveness.