Short answer
When designing user studies involving security or privacy risks, explicitly document and justify the chosen method for communicating those risks to participants.
- Field
- User-Centred Design
- Source
- ACM Transactions on Computer-Human Interaction (2021)
- Method
- Systematic Literature Review
- Sample
- 284 papers
- Evidence
- Moderate effect
Diverse methods exist for representing security and privacy risks to participants in user studies, each with distinct advantages and disadvantages. This user-centred design research insight is drawn from a 2021 study published in ACM Transactions on Computer-Human Interaction. Using Systematic literature review with 284 papers, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing user studies involving security or privacy risks, explicitly document and justify the chosen method for communicating those risks to participants.
Risk Communication in Usable Security Studies: A Systematic Review of Methods
Diverse methods exist for representing security and privacy risks to participants in user studies, each with distinct advantages and disadvantages.
ACM Transactions on Computer-Human Interaction · 2021
Key Findings
- 01A variety of approaches are employed to represent risk to research participants.
- 02Key methodological, ethical, and research challenges exist in representing and assessing security and privacy risk.
- 03Guidelines for reporting user studies in security and privacy are needed.
Application
Design takeaway
When designing user studies involving security or privacy risks, explicitly document and justify the chosen method for communicating those risks to participants.
How to apply
When planning a user study that involves potential security or privacy risks, consider the trade-offs between different methods of risk communication (e.g., scenarios, prototypes, direct explanation) and their potential impact on participant behavior and understanding.
Project actions
- 01When designing your own user study, think carefully about how you will explain any potential risks to your participants.
- 02Consider whether your explanation is clear, accurate, and doesn't unduly influence their behavior.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Comprehensive systematic review covering a significant period.
- +Focus on empirical methods provides practical insights.
Limitations
The review's findings are based on published literature, which may not always reflect the full spectrum of methods used or the nuances of their application in practice.
Reliability & validity
The systematic review methodology enhances reliability by using a structured approach to paper selection and analysis. Validity is supported by the focus on empirical methods and the identification of challenges, though the subjective nature of risk perception can introduce variability.
Think critically
Given the variety of risk representation methods, how can designers ensure that participants truly understand the risks involved without being overly alarmed or desensitized?
Design Principles
"Transparent and ethical communication of risks is paramount in user research."
Understanding these methods is crucial for researchers designing studies that accurately assess user perceptions and behaviors related to security and privacy. Choosing the appropriate risk representation can significantly impact the validity and ethical considerations of the research findings.
What This Means for Your Design
When you ask people to test a design that might have security or privacy risks, there are many ways to tell them about those risks. This study looked at how researchers do it and found that some ways are better than others, and it's important to be ethical.
How to use in your project
- 1.Reference this review when discussing the methodology for user studies involving risk assessment or when justifying your choice of risk communication methods.
Add to My Project
Quick Cite
Paragraph starter
This research highlights the critical need for careful consideration of risk representation methods in user studies. As demonstrated by Distler et al. (2021), the choice of how to communicate potential security and privacy risks to participants can significantly influence study outcomes and ethical considerations. Therefore, when designing user studies, it is imperative to select and justify methods that are both clear and ethically sound.
Source
ACM Transactions on Computer-Human Interaction
A Systematic Literature Review of Empirical Methods and Risk Representation in Usable Privacy and Security Research
journal · 2021
View sourceQuestions About This Research
- What does the research say about risk communication in usable security studies: a systematic review of methods?
- When designing user studies involving security or privacy risks, explicitly document and justify the chosen method for communicating those risks to participants. Evidence: ACM Transactions on Computer-Human Interaction (2021).
- Why does "Risk Communication in Usable Security Studies: A Systematic Review of Methods" matter for design?
- Understanding these methods is crucial for researchers designing studies that accurately assess user perceptions and behaviors related to security and privacy. Choosing the appropriate risk representation can significantly impact the validity and ethical considerations of the research findings.
- How can designers apply this research?
- When designing user studies involving security or privacy risks, explicitly document and justify the chosen method for communicating those risks to participants.
- What were the main findings?
- A variety of approaches are employed to represent risk to research participants.. Key methodological, ethical, and research challenges exist in representing and assessing security and privacy risk.. Guidelines for reporting user studies in security and privacy are needed.
- What research method was used?
- Systematic Literature Review with 284 papers.
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2021 journal from ACM Transactions on Computer-Human Interaction.
- What should I do differently in my next project?
- When planning a user study that involves potential security or privacy risks, consider the trade-offs between different methods of risk communication (e.g., scenarios, prototypes, direct explanation) and their potential impact on participant behavior and understanding.
- What are the limitations?
- The review focused on papers published between 2014-2018 and may not capture the latest methodological advancements. The selection criteria might have excluded relevant studies.