Short answer
Before and during technology trials, especially with vulnerable users, actively manage expectations by communicating potential limitations and technical uncertainties, and be prepared to address disappointment constructively.
- Field
- Human Factors
- Source
- Interacting with Computers (2016)
- Method
- Reflective case study and qualitative analysis
- Evidence
- Strong effect
Overly positive participant expectations, fueled by external publicity, can lead to significant disappointment and negative psychological impacts when technology trials encounter technical issues. This human factors research insight is drawn from a 2016 study published in Interacting with Computers. Using Reflective case study and qualitative analysis, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Before and during technology trials, especially with vulnerable users, actively manage expectations by communicating potential limitations and technical uncertainties, and be prepared to address disappointment constructively.
Managing Participant Expectations in Technology Trials with Vulnerable Populations
Overly positive participant expectations, fueled by external publicity, can lead to significant disappointment and negative psychological impacts when technology trials encounter technical issues.
Interacting with Computers · 2016
Key Findings
- 01External publicity can create unrealistic positive expectations among participants.
- 02Technical issues beyond researcher control can lead to participant frustration and a diminished sense of self-worth.
- 03The co-design process can be hampered by unmet expectations.
- 04Ethical considerations are paramount when conducting 'in the wild' technology studies with vulnerable groups.
Application
Design takeaway
Before and during technology trials, especially with vulnerable users, actively manage expectations by communicating potential limitations and technical uncertainties, and be prepared to address disappointment constructively.
How to apply
When planning user studies, create a communication plan that explicitly addresses the experimental nature of the technology and potential challenges, rather than focusing solely on its benefits.
Project actions
- 01Be honest about the limitations of prototypes or early-stage technologies.
- 02Consider how media coverage or project promotion might influence user perceptions.
- 03Plan for how to handle negative user feedback or disappointment.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Provides an honest account of ethical challenges in real-world research.
- +Offers practical guidance for future 'in the wild' studies.
Limitations
The specific technology (Google Glass) and user group (Parkinson's patients) may limit direct transferability to other contexts.
Reliability & validity
The study's validity is strengthened by its reflective nature and detailed account of ethical dilemmas. Reliability might be limited due to the specific context and subjective interpretation of experiences.
Think critically
To what extent is it the researcher's responsibility to control external publicity versus managing its impact on participant expectations?
Design Principles
"Realistic expectation management is crucial for ethical and effective user research."
Designers and researchers must proactively manage participant expectations, especially when working with vulnerable groups. Unrealistic preconceptions can undermine the research process and negatively affect participants' well-being and self-perception.
What This Means for Your Design
If you tell people a new gadget is amazing before they try it, and then it doesn't work perfectly, they'll be really disappointed and might feel bad about themselves.
How to use in your project
- 1.Use this research to justify your approach to user recruitment and expectation management in your design project.
- 2.Discuss the ethical considerations of managing participant expectations in your project's methodology section.
Add to My Project
Quick Cite
Paragraph starter
This research highlights the critical need to manage participant expectations, particularly when working with vulnerable populations. As demonstrated by Vines et al. (2016), external publicity can create heightened preconceptions that, when unmet due to technical issues, can lead to negative psychological outcomes such as frustration and reduced self-worth. Therefore, in this design project, a conscious effort was made to communicate the experimental nature of the prototype and potential limitations to participants, ensuring a more realistic and ethical user experience.
Source
Interacting with Computers
Our Year With the Glass: Expectations, Letdowns and Ethical Dilemmas of Technology Trials With Vulnerable People
journal · 2016
View sourceQuestions About This Research
- What does the research say about managing participant expectations in technology trials with vulnerable populations?
- Before and during technology trials, especially with vulnerable users, actively manage expectations by communicating potential limitations and technical uncertainties, and be prepared to address disappointment constructively. Evidence: Interacting with Computers (2016).
- Why does "Managing Participant Expectations in Technology Trials with Vulnerable Populations" matter for design?
- Designers and researchers must proactively manage participant expectations, especially when working with vulnerable groups. Unrealistic preconceptions can undermine the research process and negatively affect participants' well-being and self-perception.
- How can designers apply this research?
- Before and during technology trials, especially with vulnerable users, actively manage expectations by communicating potential limitations and technical uncertainties, and be prepared to address disappointment constructively.
- What were the main findings?
- External publicity can create unrealistic positive expectations among participants.. Technical issues beyond researcher control can lead to participant frustration and a diminished sense of self-worth.. The co-design process can be hampered by unmet expectations.. Ethical considerations are paramount when conducting 'in the wild' technology studies with vulnerable groups.
- What research method was used?
- Reflective case study and qualitative analysis.
- How strong is the evidence?
- Evidence strength is rated Strong effect, based on a 2016 journal from Interacting with Computers.
- What should I do differently in my next project?
- When planning user studies, create a communication plan that explicitly addresses the experimental nature of the technology and potential challenges, rather than focusing solely on its benefits.
- What are the limitations?
- The study's findings are based on a specific case and may not be universally generalizable. The researchers' own reflections introduce a subjective element.