Short answer
Always assume open urban data requires validation and cleaning; build processes to handle potential errors and consider mechanisms for ongoing data quality improvement.
- Field
- Modelling
- Source
- Maynooth University ePrints and eTheses Archive (Maynooth University) (2015)
- Method
- Qualitative analysis of practical experience and proposed crowdsourcing mechanism.
- Evidence
- Strong effect
The authenticity, precision, and fidelity of open urban data are often unverified, necessitating robust assessment and cleaning processes by data scientists and developers to ensure reliable smart city applications and evidence-based decision-making. This modelling research insight is drawn from a 2015 study published in Maynooth University ePrints and eTheses Archive (Maynooth University). Using Qualitative analysis of practical experience and proposed crowdsourcing mechanism., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Always assume open urban data requires validation and cleaning; build processes to handle potential errors and consider mechanisms for ongoing data quality improvement.
Open Urban Data Veracity: A Critical Assessment Framework
The authenticity, precision, and fidelity of open urban data are often unverified, necessitating robust assessment and cleaning processes by data scientists and developers to ensure reliable smart city applications and evidence-based decision-making.
Maynooth University ePrints and eTheses Archive (Maynooth University) · 2015
Key Findings
- 01Open urban data is often provided 'as-is' with no guarantees of veracity, continuity, or lineage.
- 02Data quality issues can propagate through systems, leading to poor applications and unreliable decisions.
- 03A 'janitorial' role of data cleaning, parsing, validation, and transformation is crucial but often hidden.
- 04Crowdsourcing offers a potential mechanism to generate and record user observations and fixes for data improvement.
Application
Design takeaway
Always assume open urban data requires validation and cleaning; build processes to handle potential errors and consider mechanisms for ongoing data quality improvement.
How to apply
When using open urban datasets for modelling or system design, implement automated checks for common data errors (e.g., missing values, outliers, inconsistent formats) and document any data transformations performed.
Project actions
- 01Clearly document all data cleaning and validation steps taken in your design project.
- 02Consider the potential impact of data inaccuracies on your design's functionality and user experience.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Highlights a critical, often overlooked, aspect of data-driven design.
- +Provides practical insights based on real-world experience.
Limitations
The availability of time and computational resources to thoroughly clean and validate large datasets can be a significant constraint for student design projects.
Reliability & validity
The reliability of the findings is based on the authors' practical experience. Validity is supported by the logical argument presented regarding the consequences of poor data quality. However, empirical validation of the proposed crowdsourcing solution is not provided.
Think critically
To what extent is it feasible for individual designers or small teams to perform the 'janitorial' work required to ensure data veracity, and what are the implications if this work is not adequately done?
Design Principles
"Data integrity is paramount for the successful implementation and trustworthiness of data-driven design solutions."
Designers and engineers developing smart city solutions rely heavily on urban data. Without a clear understanding of data veracity, the models and systems built upon this data can be fundamentally flawed, leading to inaccurate predictions, inefficient resource allocation, and a loss of public trust in smart city initiatives.
What This Means for Your Design
When you get data for your design project, especially free data from the internet, you can't always trust it to be perfect. It might have mistakes or be incomplete. You need to check it carefully and fix it before you use it to build your design, otherwise your design might not work properly.
How to use in your project
- 1.Reference this paper when discussing the importance of data quality and validation in your design project's methodology section.
- 2.Use the findings to justify the time and effort spent on data pre-processing and cleaning.
Add to My Project
Quick Cite
Paragraph starter
The veracity of open urban data, as highlighted by McArdle and Kitchin (2015), presents a significant challenge for design projects. Their work emphasizes that data often lacks explicit quality reports, necessitating a critical approach to assessment and cleaning. This research underscores the importance of incorporating robust data validation and transformation processes into the design workflow to ensure the reliability of resulting models and applications, thereby mitigating the risk of flawed decision-making and ensuring the integrity of the final design.
Source
Maynooth University ePrints and eTheses Archive (Maynooth University)
Improving the Veracity of Open and Real-Time Urban Data. The Programmable City Working Paper 13
journal · 2015
View sourceQuestions About This Research
- What does the research say about open urban data veracity: a critical assessment framework?
- Always assume open urban data requires validation and cleaning; build processes to handle potential errors and consider mechanisms for ongoing data quality improvement. Evidence: Maynooth University ePrints and eTheses Archive (Maynooth University) (2015).
- Why does "Open Urban Data Veracity: A Critical Assessment Framework" matter for design?
- Designers and engineers developing smart city solutions rely heavily on urban data. Without a clear understanding of data veracity, the models and systems built upon this data can be fundamentally flawed, leading to inaccurate predictions, inefficient resource allocation, and a loss of public trust in smart city initiatives.
- How can designers apply this research?
- Always assume open urban data requires validation and cleaning; build processes to handle potential errors and consider mechanisms for ongoing data quality improvement.
- What were the main findings?
- Open urban data is often provided 'as-is' with no guarantees of veracity, continuity, or lineage.. Data quality issues can propagate through systems, leading to poor applications and unreliable decisions.. A 'janitorial' role of data cleaning, parsing, validation, and transformation is crucial but often hidden.. Crowdsourcing offers a potential mechanism to generate and record user observations and fixes for data improvement.
- What research method was used?
- Qualitative analysis of practical experience and proposed crowdsourcing mechanism..
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2015 journal from Maynooth University ePrints and eTheses Archive (Maynooth University).
- What should I do differently in my next project?
- When using open urban datasets for modelling or system design, implement automated checks for common data errors (e.g., missing values, outliers, inconsistent formats) and document any data transformations performed.
- What are the limitations?
- The paper focuses on the challenges and proposes a solution without detailing the implementation or empirical testing of the crowdsourcing mechanism. The 'janitorial' work is resource-intensive and may not always be feasible.