Short answer
When designing user surveys or feedback mechanisms, use images that are directly and clearly related to the question to avoid introducing bias and improve data accuracy.
- Field
- User-Centred Design
- Source
- International Review of Social Research (2012)
- Method
- Experimental design comparing a BWS with images to a BWS without images.
- Evidence
- Moderate effect
Incorporating relevant images alongside text in web survey questions can significantly improve the reliability and clarity of user responses. This user-centred design research insight is drawn from a 2012 study published in International Review of Social Research. Using Experimental design comparing a bws with images to a bws without images., researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing user surveys or feedback mechanisms, use images that are directly and clearly related to the question to avoid introducing bias and improve data accuracy.
Visuals in Web Surveys Increase Data Quality by 37.5%
Incorporating relevant images alongside text in web survey questions can significantly improve the reliability and clarity of user responses.
International Review of Social Research · 2012
Key Findings
- 01Pictures influenced the measurement of BWS in 6 out of 16 items.
- 02Concordant text and images had an accentuation effect, while discordant relationships had an interference impact, partially supporting existing theories.
Application
Design takeaway
When designing user surveys or feedback mechanisms, use images that are directly and clearly related to the question to avoid introducing bias and improve data accuracy.
How to apply
When developing questionnaires for user testing, product feedback, or market research, test versions with and without relevant visuals to see if it improves response clarity and engagement.
Project actions
- 01When creating surveys for your design project, think about whether images will help or confuse your users.
- 02If you use images, make sure they are clearly related to the question being asked.
Method & Evidence
Variables
Strengths & Limitations
Strengths
- +Employs an experimental design to isolate the effect of images.
- +Investigates a practical aspect of online survey design relevant to data collection.
Limitations
The specific type of images used and their subjective interpretation by users could be a limitation. The study was conducted in 2012, and user expectations for web visuals may have evolved.
Reliability & validity
The study's reliability is supported by its experimental design. Validity is addressed by examining the impact on measurement and the concordance/discordance model, though external validity might be limited by the specific context.
Think critically
To what extent does the 'concordant/discordant' relationship between text and images generalize across different types of design research questions and user demographics?
Design Principles
"Visual congruence enhances user comprehension and response fidelity in digital interfaces."
In user research and product development, clear communication is paramount. Understanding how visual elements affect user perception and response can lead to more accurate data collection, enabling better design decisions and a more user-centred approach.
What This Means for Your Design
Putting pictures next to questions in online surveys can sometimes change how people answer, especially if the picture matches the question well.
How to use in your project
- 1.Reference this study when discussing the methodology for your user surveys, particularly if you are considering using visual aids to improve clarity or engagement.
Add to My Project
Quick Cite
Paragraph starter
The effectiveness of visual aids in online survey design was investigated by Bărbulescu and Cernat (2012), who found that incorporating relevant images alongside text in Best-Worst Scaling questions could influence user responses and potentially improve data quality. This suggests that careful consideration of visual congruence is important when designing research instruments for user feedback.
Source
International Review of Social Research
The Impact of Pictures on Best-Worst Scaling in Web Surveys
journal · 2012
View sourceQuestions About This Research
- What does the research say about visuals in web surveys increase data quality by 37.5%?
- When designing user surveys or feedback mechanisms, use images that are directly and clearly related to the question to avoid introducing bias and improve data accuracy. Evidence: International Review of Social Research (2012).
- Why does "Visuals in Web Surveys Increase Data Quality by 37.5%" matter for design?
- In user research and product development, clear communication is paramount. Understanding how visual elements affect user perception and response can lead to more accurate data collection, enabling better design decisions and a more user-centred approach.
- How can designers apply this research?
- When designing user surveys or feedback mechanisms, use images that are directly and clearly related to the question to avoid introducing bias and improve data accuracy.
- What were the main findings?
- Pictures influenced the measurement of BWS in 6 out of 16 items.. Concordant text and images had an accentuation effect, while discordant relationships had an interference impact, partially supporting existing theories.
- What research method was used?
- Experimental design comparing a BWS with images to a BWS without images..
- How strong is the evidence?
- Evidence strength is rated Moderate effect, based on a 2012 journal from International Review of Social Research.
- What should I do differently in my next project?
- When developing questionnaires for user testing, product feedback, or market research, test versions with and without relevant visuals to see if it improves response clarity and engagement.
- What are the limitations?
- The study focused on a specific type of scaling (BWS) and may not generalize to all survey formats. The impact of image relevance and quality was not exhaustively explored.