Short answer

When using eye-tracking, employ advanced metrics and control for confounding variables to accurately understand user cognitive states, rather than relying on basic fixations alone.

Field: User-Centred Design
Source: Journal of Eye Movement Research (2026)
Method: Systematic Literature Review with Quality Appraisal
Sample: 23 empirical studies
Evidence: Moderate effect

Relying solely on simple eye-tracking metrics like fixations can lead to inaccurate interpretations of user interest and cognitive states, as these metrics do not inherently differentiate between various underlying psychological processes. This user-centred design research insight is drawn from a 2026 study published in Journal of Eye Movement Research. Using Systematic literature review with quality appraisal with 23 empirical studies, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When using eye-tracking, employ advanced metrics and control for confounding variables to accurately understand user cognitive states, rather than relying on basic fixations alone.

Study

User-Centred DesignNew This WeekModerate effect

Basic Fixation Metrics Misinterpret Complex User Cognition

Journal of Eye Movement Research · 2026

Key Findings

01Majority of studies exhibited a 'tool-first' exploratory approach, using basic fixation metrics to infer complex psychological states.
02Many studies failed to control for stimulus-level confounds (e.g., luminance, AOI size).
03Inappropriate data-handling procedures were common, including lack of data cleaning and treating count/binary data as continuous.
04Deficits in transparency undermined the validity of conclusions.

Application

Design takeaway

When using eye-tracking, employ advanced metrics and control for confounding variables to accurately understand user cognitive states, rather than relying on basic fixations alone.

How to apply

When designing user studies involving eye-tracking, implement data cleaning protocols, control for visual stimulus properties, and consider a wider range of eye-tracking metrics beyond simple fixations.

Project actions

01When planning an eye-tracking study, define your research questions clearly before selecting metrics.
02Ensure your experimental setup controls for environmental factors that could influence eye movements.
03Document your data cleaning and analysis procedures meticulously.

Method & Evidence

AimHow can eye-tracking methodology be improved to ensure more accurate and valid interpretations of user cognitive states in design research?

MethodSystematic Literature Review with Quality Appraisal

ProcedureA systematic review of 23 empirical eye-tracking studies in destination marketing and branding was conducted using the SALSA framework and PRISMA 2020 guidelines. Studies were appraised using an eight-dimensional quality rubric, focusing on theoretical grounding, experimental design, and statistical rigour.

Sample23 empirical studies

ContextUser behaviour research, specifically in the domain of destination marketing and branding, applicable to user interface and experience design.

Variables

IVType of eye-tracking metric used (basic vs. advanced), control for stimulus confounds (present vs. absent).

DVAccuracy of inferred user cognitive states (e.g., interest, attention), validity of conclusions.

CVStimulus characteristics (e.g., luminance, size, content), participant demographics, experimental environment.

Strengths & Limitations

Strengths

+Systematic and transparent review process.
+Development of practical tools (Checklist for Eye-Tracking Rigour) for researchers.

Limitations

The complexity of advanced eye-tracking analysis can be a barrier. Ensuring participant comfort and minimizing motion artifacts are practical challenges.

Reliability & validity

Reliability can be improved by standardizing participant instructions and environmental conditions. Validity is enhanced by using multiple metrics and controlling for confounds, ensuring the data accurately reflects cognitive processes.

Think critically

What are the ethical implications of inferring complex psychological states from neurophysiological data, and how can researchers ensure responsible interpretation?

Design Principles

"User cognitive states should be inferred using robust, validated eye-tracking metrics and controlled experimental conditions, ensuring transparency in the research process."

In user-centred design, understanding user cognition is paramount for creating effective and engaging products. Over-reliance on superficial data can lead to flawed design decisions, resulting in products that fail to meet user needs or expectations. Rigorous methodology ensures that insights derived from user research are valid and actionable.

What This Means for Your Design

Just looking at where people look isn't enough to know what they're thinking. You need to use better tools and be careful about how you collect and share your data to get real answers.

How to use in your project

1.Reference this study when discussing the limitations of basic eye-tracking metrics or justifying the need for rigorous methodology in your user research section.

Add to My Project

Quick Cite

Paragraph starter

The rigorous application of eye-tracking methodology is crucial for accurate user insight. As demonstrated by research in related fields, a 'tool-first' approach relying on basic metrics like fixation counts can lead to misinterpretations of complex cognitive states. To ensure validity, design projects should prioritize controlling for stimulus confounds, implementing robust data cleaning, and employing a comprehensive suite of eye-tracking metrics, thereby enhancing the reliability and actionability of user research findings.

Source

Journal of Eye Movement Research

Towards Rigorous Eye-Tracking Methodology in Interdisciplinary Fields: Insights from and Recommendations for Tourism Research

journal · 2026

View source

Questions About This Research

What does the research say about basic fixation metrics misinterpret complex user cognition?: When using eye-tracking, employ advanced metrics and control for confounding variables to accurately understand user cognitive states, rather than relying on basic fixations alone. Evidence: Journal of Eye Movement Research (2026).
Why does "Basic Fixation Metrics Misinterpret Complex User Cognition" matter for design?: In user-centred design, understanding user cognition is paramount for creating effective and engaging products. Over-reliance on superficial data can lead to flawed design decisions, resulting in products that fail to meet user needs or expectations. Rigorous methodology ensures that insights derived from user research are valid and actionable.
How can designers apply this research?: When using eye-tracking, employ advanced metrics and control for confounding variables to accurately understand user cognitive states, rather than relying on basic fixations alone.
What were the main findings?: Majority of studies exhibited a 'tool-first' exploratory approach, using basic fixation metrics to infer complex psychological states.. Many studies failed to control for stimulus-level confounds (e.g., luminance, AOI size).. Inappropriate data-handling procedures were common, including lack of data cleaning and treating count/binary data as continuous.. Deficits in transparency undermined the validity of conclusions.
What research method was used?: Systematic Literature Review with Quality Appraisal with 23 empirical studies.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2026 journal from Journal of Eye Movement Research.
What should I do differently in my next project?: When designing user studies involving eye-tracking, implement data cleaning protocols, control for visual stimulus properties, and consider a wider range of eye-tracking metrics beyond simple fixations.
What are the limitations?: The review focused on a specific domain (tourism marketing); findings may not directly translate to all design contexts. The quality rubric's subjective elements could introduce bias.