Short answer

Designers should move away from a one-size-fits-all approach to rapid first impression testing and instead tailor the exposure time based on the cognitive capabilities of their target users and the visual complexity of the design being evaluated.

Field: User-Centred Design
Source: Behaviour and Information Technology (2023)
Method: Experimental study
Evidence: Moderate effect

First impressions gathered from rapid user testing are significantly influenced by individual cognitive abilities and the visual complexity of the design, necessitating a more nuanced approach than a fixed five-second exposure. This user-centred design research insight is drawn from a 2023 study published in Behaviour and Information Technology. Using Experimental study, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should move away from a one-size-fits-all approach to rapid first impression testing and instead tailor the exposure time based on the cognitive capabilities of their target users and the visual complexity of the design being evaluated.

Study

User-Centred DesignRecentModerate effect

Five-second testing is unreliable; adapt stimulus exposure time to user cognition and complexity.

Behaviour and Information Technology · 2023

Key Findings

01First impression feedback is inconsistent due to variations in cognitive ability and stimulus visual complexity.
02Visually complex stimuli presented for short durations (e.g., 2 seconds) can hinder users' ability to identify the purpose of a webpage.
03While perceptual speed may yield comparable results at 5 seconds, lower working memory capacity leads to less verbose answers and reduced information recall.

Application

Design takeaway

How to apply

When conducting rapid first impression tests, consider piloting different exposure times for designs with high visual complexity or for user groups known to have diverse cognitive profiles. Observe if users struggle to identify the core purpose of the design within the standard timeframe.

Project actions

01When planning your user testing, think about how long you'll show participants your design.
02Consider if your design is very detailed or simple, and if your target users might have different thinking speeds.
03Don't just stick to a standard time; be prepared to adjust it if your initial tests suggest it's needed.

Method & Evidence

AimTo investigate how variations in cognitive abilities (working memory, perceptual speed) and visual complexity of stimuli impact the consistency and relevance of first impression feedback obtained through rapid exposure testing.

MethodExperimental study

ProcedureParticipants first completed assessments of their cognitive abilities. They were then shown website stimuli of varying visual complexity for different durations (2, 5, and 10 seconds) and asked to answer questions typical for evaluating first impressions. Data on their responses and recall were collected and analyzed.

ContextUser interface and product design evaluation

Variables

IV["Exposure time (e.g., 2, 5, 10 seconds)","Visual complexity of stimuli","Participant's cognitive abilities (working memory, perceptual speed)"]

DV["Quality of first impression feedback","Ability to identify webpage purpose","Information recall"]

CV["Type of stimuli (e.g., website designs)","Specific questions asked during evaluation"]

Strengths & Limitations

Strengths

+Investigates a critical aspect of user testing methodology.
+Highlights the interaction between user characteristics and design factors.

Limitations

It's difficult to accurately measure individual cognitive abilities in a typical design project setting. The complexity of a design can also be subjective.

Reliability & validity

The study's validity is enhanced by controlling stimulus type and questions, but reliability might be affected by the inherent variability in human cognition and the subjective nature of 'visual complexity'.

Think critically

If a fixed five-second test is unreliable, what alternative methods or modifications to rapid testing could provide more robust first impression data?

Design Principles

"User testing duration should be dynamically adjusted based on user cognitive load and stimulus complexity to ensure valid and reliable feedback."

This research challenges the common practice of a uniform five-second exposure in first impression testing. Understanding how cognitive differences and visual complexity affect user perception allows designers to refine their testing methodologies, leading to more accurate and actionable insights into user experience.

What This Means for Your Design

When you ask people for their first impression of a design very quickly (like in 5 seconds), it's hard to get good answers because everyone thinks and sees things differently. Some people are faster thinkers, and some designs are more complicated to look at. So, you might need to give people more or less time depending on the person and the design.

How to use in your project

1.Reference this study when justifying the duration chosen for your first impression testing or heuristic evaluation, especially if you deviate from a standard time.

Add to My Project

Quick Cite

Paragraph starter

The effectiveness of rapid first impression testing, such as the common five-second exposure method, is challenged by individual cognitive variations and stimulus complexity. Research indicates that factors like working memory and perceptual speed, alongside the visual intricacy of a design, significantly influence the consistency and relevance of user feedback. Therefore, a flexible approach to testing duration, tailored to both the user and the design, is recommended for more accurate insights.

Source

Behaviour and Information Technology

Cognitive abilities and visual complexity impact first impressions in five-second testing

journal · 2023

View source

Questions About This Research

What does the research say about five-second testing is unreliable; adapt stimulus exposure time to user cognition and complexity?: Designers should move away from a one-size-fits-all approach to rapid first impression testing and instead tailor the exposure time based on the cognitive capabilities of their target users and the visual complexity of the design being evaluated. Evidence: Behaviour and Information Technology (2023).
Why does "Five-second testing is unreliable; adapt stimulus exposure time to user cognition and complexity." matter for design?: This research challenges the common practice of a uniform five-second exposure in first impression testing. Understanding how cognitive differences and visual complexity affect user perception allows designers to refine their testing methodologies, leading to more accurate and actionable insights into user experience.
How can designers apply this research?: Designers should move away from a one-size-fits-all approach to rapid first impression testing and instead tailor the exposure time based on the cognitive capabilities of their target users and the visual complexity of the design being evaluated.
What were the main findings?: First impression feedback is inconsistent due to variations in cognitive ability and stimulus visual complexity.. Visually complex stimuli presented for short durations (e.g., 2 seconds) can hinder users' ability to identify the purpose of a webpage.. While perceptual speed may yield comparable results at 5 seconds, lower working memory capacity leads to less verbose answers and reduced information recall.
What research method was used?: Experimental study.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2023 journal from Behaviour and Information Technology.
What should I do differently in my next project?: When conducting rapid first impression tests, consider piloting different exposure times for designs with high visual complexity or for user groups known to have diverse cognitive profiles. Observe if users struggle to identify the core purpose of the design within the standard timeframe.
What are the limitations?: The study may not account for all possible cognitive abilities or all types of visual complexity. The specific website stimuli used might not generalize to all design contexts.