Short answer
Integrate features into digital research tools that automatically log user interactions, providing transparent metrics of research engagement and decision-making.
- Field
- User-Centred Design
- Source
- CHI Conference on Human Factors in Computing Systems (2022)
- Method
- Qualitative case study with observational and interview components.
- Evidence
- Moderate effect
Utilizing digital interaction logs (paradata) in qualitative co-research projects can provide tangible evidence of research processes, thereby increasing transparency and accountability for stakeholders. This user-centred design research insight is drawn from a 2022 study published in CHI Conference on Human Factors in Computing Systems. Using Qualitative case study with observational and interview components., researchers explored how this design variable affects real-world outcomes. The key design takeaway: Integrate features into digital research tools that automatically log user interactions, providing transparent metrics of research engagement and decision-making.
Digital Paradata Enhances Transparency and Rigour in Qualitative Co-Research
Utilizing digital interaction logs (paradata) in qualitative co-research projects can provide tangible evidence of research processes, thereby increasing transparency and accountability for stakeholders.
CHI Conference on Human Factors in Computing Systems · 2022
Key Findings
- 01Digital platforms generate valuable paradata, including metrics like listening coverage, engagement rates, thematic map usage, and data discard instances.
- 02Paradata can be conceptualized to enhance process transparency, facilitate data sharing, and establish feedback loops with research participants.
- 03The use of paradata can address stakeholder needs for evidence of rigour and accountability in qualitative research.
Application
Design takeaway
Integrate features into digital research tools that automatically log user interactions, providing transparent metrics of research engagement and decision-making.
How to apply
When developing or evaluating digital platforms for collaborative research, ensure they capture interaction logs that can serve as evidence of the research process.
Project actions
- 01Consider how your design process can be documented using digital tools.
- 02Think about what kind of interaction data would best demonstrate the rigour of your design decisions.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Provides a novel approach to demonstrating rigour in qualitative research.
- +Addresses a practical need for accountability in collaborative projects.
Limitations
Collecting and interpreting paradata can be complex, and it might not capture all nuances of human decision-making.
Reliability & validity
Reliability could be enhanced by using standardized logging mechanisms across different platforms. Validity might be challenged if paradata is interpreted without qualitative context, as it may not fully represent the intent behind user actions.
Think critically
To what extent can paradata fully capture the complexities of human decision-making in a co-design process, and what are the potential ethical considerations of relying heavily on such data?
Design Principles
"Transparency through digital trace data enhances the perceived validity and trustworthiness of collaborative research processes."
In collaborative design and research settings, demonstrating the integrity of the research process is crucial for gaining trust and securing support. Paradata offers a method to objectively track and present the effort and decisions made during qualitative data collection and analysis, moving beyond subjective accounts.
What This Means for Your Design
When people work together on research using computers, the computer can keep track of what everyone does, like how long they spend on tasks. This information, called 'paradata', can prove that the research was done properly and honestly.
How to use in your project
- 1.Use examples of digital interaction data (e.g., time spent on user testing, frequency of prototype iterations) to support claims about your design process.
- 2.Discuss how features in your design could capture paradata to enhance transparency.
Add to My Project
Quick Cite
Paragraph starter
The integration of digital platforms in collaborative design projects offers opportunities to capture 'paradata,' which are interaction logs detailing user engagement and decision-making processes. This data can serve as objective evidence of the rigour and transparency of the design research, addressing potential concerns from stakeholders regarding accountability. By thoughtfully designing digital tools to record relevant interactions, designers can enhance the credibility of their work and foster greater trust among collaborators and evaluators.
Source
CHI Conference on Human Factors in Computing Systems
Exploring the Role of Paradata in Digitally Supported Qualitative Co-Research
journal · 2022
View sourceQuestions About This Research
- What does the research say about digital paradata enhances transparency and rigour in qualitative co-research?
- Integrate features into digital research tools that automatically log user interactions, providing transparent metrics of research engagement and decision-making. Evidence: CHI Conference on Human Factors in Computing Systems (2022).
- Why does "Digital Paradata Enhances Transparency and Rigour in Qualitative Co-Research" matter for design?
- In collaborative design and research settings, demonstrating the integrity of the research process is crucial for gaining trust and securing support. Paradata offers a method to objectively track and present the effort and decisions made during qualitative data collection and analysis, moving beyond subjective accounts.
- How can designers apply this research?
- Integrate features into digital research tools that automatically log user interactions, providing transparent metrics of research engagement and decision-making.
- What were the main findings?
- Digital platforms generate valuable paradata, including metrics like listening coverage, engagement rates, thematic map usage, and data discard instances.. Paradata can be conceptualized to enhance process transparency, facilitate data sharing, and establish feedback loops with research participants.. The use of paradata can address stakeholder needs for evidence of rigour and accountability in qualitative research.
- What research method was used?
- Qualitative case study with observational and interview components..
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2022 journal from CHI Conference on Human Factors in Computing Systems.
- What should I do differently in my next project?
- When developing or evaluating digital platforms for collaborative research, ensure they capture interaction logs that can serve as evidence of the research process.
- What are the limitations?
- The effectiveness and interpretation of paradata can be context-dependent and may require careful design of the data collection and presentation methods.