Short answer

Design data science tools and workflows with an awareness that data are not neutral facts but are imbued with context, interpretation, and values, requiring collaborative sense-making and continuous communication.

Field: Innovation & Design
Source: Big Data (2017)
Method: Qualitative research, including ethnographic studies.
Evidence: Moderate effect

By actively incorporating critiques from fields like critical data studies into the daily practices of data science, organizations can foster more ethical and effective data-driven decision-making. This innovation & design research insight is drawn from a 2017 study published in Big Data. Using Qualitative research, including ethnographic studies., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Design data science tools and workflows with an awareness that data are not neutral facts but are imbued with context, interpretation, and values, requiring collaborative sense-making and continuous communication.

Study

Innovation & DesignHigh ImpactModerate effect

Integrating Critical Perspectives Enhances Data Science Practice and Ethical Outcomes

By actively incorporating critiques from fields like critical data studies into the daily practices of data science, organizations can foster more ethical and effective data-driven decision-making.

Big Data · 2017

Key Findings

01Data are inherently interpretive and inseparable from their context.
02Data are produced and mediated through sociomaterial arrangements.
03Data serve as a medium for negotiating and communicating values.
04Communication is central to the data science endeavor.
05Making sense of data is a collective process.

Application

Design takeaway

How to apply

When designing data analysis platforms or AI systems, consider features that facilitate annotation of data context, collaborative interpretation, and transparent communication of data provenance and potential biases.

Project actions

01When researching a design problem involving data, consider the potential biases and contexts of the data you are using or proposing to use.
02Think about how your design will facilitate communication and collaboration among users who interpret data differently.

Method & Evidence

AimHow can critical perspectives from fields like critical data studies be integrated into the day-to-day practices of data science to improve its ethical and practical outcomes?

MethodQualitative research, including ethnographic studies.

ProcedureResearchers conducted qualitative studies with academic data scientists, 'data for good' projects, and specialized cross-disciplinary engineering teams to observe and understand their daily practices and how they grapple with the complexities of data. This involved ethnographic observation and interviews.

ContextData science practice, critical data studies, ethical data science.

Variables

IV["Integration of critical data studies perspectives into data science practice."]

DV["Ethical outcomes of data science.","Effectiveness of data science practice."]

CV["Specific data science tasks.","Organizational structures.","Types of data used."]

Strengths & Limitations

Strengths

+Provides a practical framework for bridging theoretical critique and applied data science.
+Uses rich qualitative data from real-world settings to support its claims.

Limitations

It can be challenging to quantitatively measure the 'ethical outcome' of data science practices. The qualitative nature of the research means findings are context-specific.

Reliability & validity

Reliability could be improved through triangulation of data sources and methods. Validity is strengthened by the in-depth ethnographic approach capturing nuanced practices.

Think critically

How might the 'data are sets of stories' finding influence the design of data visualization tools?

Design Principles

"Embrace the socio-technical nature of data science by integrating critical humanistic and social scientific insights into design and practice."

This approach moves beyond theoretical critique to practical application, suggesting that understanding the interpretive, contextual, and value-laden nature of data is crucial for designing robust and responsible data science systems. It encourages a more holistic view of data science as a socio-technical endeavor.

What This Means for Your Design

To make data science better and more ethical, we need to listen to the people who point out its problems and use their ideas to change how data scientists actually work every day.

How to use in your project

1.Reference this study when discussing the importance of considering data context, interpretation, and ethical implications in your design process, particularly when your project involves data analysis or AI.

Add to My Project

Quick Cite

Paragraph starter

This research highlights that data science is not a purely objective process but is deeply intertwined with human interpretation, context, and values. By integrating critical perspectives into the daily practices of data science, as demonstrated by Neff et al. (2017), designers can foster more ethical and effective data-driven outcomes. This involves acknowledging that data are interpretive, contextual, and mediated through sociomaterial arrangements, and that sense-making is a collective and communicative process.

Source

Big Data

Critique and Contribute: A Practice-Based Framework for Improving Critical Data Studies and Data Science

journal · 2017

View source

Questions About This Research

What does the research say about integrating critical perspectives enhances data science practice and ethical outcomes?: Design data science tools and workflows with an awareness that data are not neutral facts but are imbued with context, interpretation, and values, requiring collaborative sense-making and continuous communication. Evidence: Big Data (2017).
Why does "Integrating Critical Perspectives Enhances Data Science Practice and Ethical Outcomes" matter for design?: This approach moves beyond theoretical critique to practical application, suggesting that understanding the interpretive, contextual, and value-laden nature of data is crucial for designing robust and responsible data science systems. It encourages a more holistic view of data science as a socio-technical endeavor.
How can designers apply this research?: Design data science tools and workflows with an awareness that data are not neutral facts but are imbued with context, interpretation, and values, requiring collaborative sense-making and continuous communication.
What were the main findings?: Data are inherently interpretive and inseparable from their context.. Data are produced and mediated through sociomaterial arrangements.. Data serve as a medium for negotiating and communicating values.. Communication is central to the data science endeavor.
What research method was used?: Qualitative research, including ethnographic studies..
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2017 journal from Big Data.
What should I do differently in my next project?: When designing data analysis platforms or AI systems, consider features that facilitate annotation of data context, collaborative interpretation, and transparent communication of data provenance and potential biases.
What are the limitations?: The findings are based on qualitative observations and may not be generalizable to all data science contexts. The specific critiques and proposed solutions are rooted in the studied environments.