AI-inferred health data from digital traces poses significant ethical and privacy risks.
Artificial intelligence can derive sensitive health information from seemingly unrelated digital behaviors, creating 'emergent medical data' (EMD) without user awareness or consent.
eYLS (Yale Law School) · 2020
Key Findings
- 01AI can infer health information (EMD) from mundane digital traces like location data, purchase history, and social media activity.
- 02EMD profiling is proposed as a solution for public health crises but lacks strong evidence of efficacy.
- 03EMD mining and profiling can cause significant harm and are often conducted without user knowledge or consent due to legal loopholes.
- 04Potential regulatory options include restricting data collection, regulating AI algorithms, and limiting EMD usage.
Application
Design takeaway
Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information.
How to apply
When designing systems that collect user data, particularly for AI analysis, conduct a thorough ethical review to identify potential privacy risks and ensure robust consent mechanisms are in place.
Project actions
- 01Consider the ethical implications of any data you collect and how it might be interpreted by AI.
- 02Explore user consent models that are clear and comprehensive.
- 03Research existing privacy regulations relevant to your design project.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Identifies a novel and concerning application of AI.
- +Provides a comprehensive overview of ethical and legal challenges.
- +Proposes concrete regulatory solutions.
Limitations
The article is a legal and ethical analysis, not a technical one, so it doesn't detail the specific AI methods used for inference.
Reliability & validity
The article's validity relies on the logical coherence of its arguments and its synthesis of existing literature. Reliability is based on the consistent application of legal and ethical principles to the described phenomena.
Think critically
To what extent should designers be responsible for anticipating and mitigating the potential for AI to infer unintended sensitive information from user data?
Design Principles
"Inferred data carries ethical weight; design for transparency and user control over sensitive information."
This capability raises profound ethical questions about privacy, consent, and potential misuse of personal data. Designers must consider the ethical implications of data collection and AI analysis, especially when sensitive information can be inferred.
What This Means for Your Design
Computers can figure out private health stuff about you from your online activity, even if you didn't tell them directly, and this can be risky.
How to use in your project
- 1.Reference this research when discussing the ethical considerations of data collection and AI in your design project.
- 2.Use it to justify your design choices related to privacy and user consent.
Add to My Project
Quick Cite
(2020). Emergent Medical Data: Health Information Inferred by Artificial Intelligence. eYLS (Yale Law School). Retrieved from https://designdex.org/study/9e44e1e1-2ceb-4913-ab22-c8bfd8c4b3e3/ai-inferred-health-data-from-digital-traces-poses-significant-ethical-and-privacy-risks
Paragraph starter
The research by Marks (2020) highlights significant ethical concerns surrounding the inference of sensitive health data (emergent medical data or EMD) from user digital traces by artificial intelligence. This underscores the critical need for designers to implement transparent data collection practices and robust consent mechanisms, ensuring users are fully aware of how their data might be analyzed and what sensitive information could be inferred, thereby mitigating potential privacy harms and building user trust.
Source
eYLS (Yale Law School)
Emergent Medical Data: Health Information Inferred by Artificial Intelligence
journal · 2020
View sourceQuestions about this research
- What does the research say about ai-inferred health data from digital traces poses significant ethical and privacy risks?
- Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information. Evidence: eYLS (Yale Law School) (2020).
- Why does "AI-inferred health data from digital traces poses significant ethical and privacy risks." matter for design?
- This capability raises profound ethical questions about privacy, consent, and potential misuse of personal data. Designers must consider the ethical implications of data collection and AI analysis, especially when sensitive information can be inferred.
- How can designers apply this research?
- Always consider the potential for data to be used in ways users did not anticipate, especially when dealing with AI-driven inference of sensitive information.
- What were the main findings?
- AI can infer health information (EMD) from mundane digital traces like location data, purchase history, and social media activity.. EMD profiling is proposed as a solution for public health crises but lacks strong evidence of efficacy.. EMD mining and profiling can cause significant harm and are often conducted without user knowledge or consent due to legal loopholes.. Potential regulatory options include restricting data collection, regulating AI algorithms, and limiting EMD usage.
- What research method was used?
- Literature review and conceptual analysis.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2020 journal from eYLS (Yale Law School).
- What should I do differently in my next project?
- When designing systems that collect user data, particularly for AI analysis, conduct a thorough ethical review to identify potential privacy risks and ensure robust consent mechanisms are in place.
- What are the limitations?
- The article focuses on conceptual risks and regulatory proposals rather than empirical studies of EMD effectiveness.
- Is there evidence that data affects design outcomes?
- AI can uncover private health details from everyday online activities, but this practice is unproven, potentially harmful, and lacks adequate legal oversight. This capability raises profound ethical questions about privacy, consent, and potential misuse of personal data. Designers must consider the ethical implications Source: eYLS (Yale Law School) (2020).
- Where does this information inferred research apply?
- Digital health, public health, data privacy, AI ethics It sits within user-centred design research on designdex.org.
Related research topics
data design research · evidence on data · does data improve design outcomes · information inferred studies for designers · data and information inferred findings · user-centred design research evidence