Short answer

When designing systems that use eye-tracking, especially in dynamic or complex tasks, prioritize hardware known for better performance in such conditions and be mindful of factors like head movement and user cognitive load that can degrade data quality.

Field: Human Factors
Source: Behavior Research Methods (2023)
Method: Experimental evaluation
Sample: 36 participants
Evidence: Moderate effect

The accuracy of head-mounted eye-tracking systems is significantly impacted by the degree of head movement and the user's cognitive load. This human factors research insight is drawn from a 2023 study published in Behavior Research Methods. Using Experimental evaluation with 36 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing systems that use eye-tracking, especially in dynamic or complex tasks, prioritize hardware known for better performance in such conditions and be mindful of factors like head movement and user cognitive load that can degrade data quality.

Study

Human FactorsRecentModerate effect

Head-mounted eye-tracker accuracy degrades with increased head movement and perceived workload

The accuracy of head-mounted eye-tracking systems is significantly impacted by the degree of head movement and the user's cognitive load.

Behavior Research Methods · 2023

Key Findings

01Tobii Pro Glasses 3 demonstrated higher accuracy than Tobii Pro Glasses 2 during walking trials.
02Using a chinrest reduced eye-tracker accuracy by requiring larger eye eccentricities for fixation.
03Higher reported workload correlated with poorer eye-tracking accuracy.

Application

Design takeaway

How to apply

When designing user studies involving eye-tracking, select equipment appropriate for the expected level of head movement. If using head-mounted trackers, consider protocols that allow for natural head movement rather than restrictive setups like chinrests, and be aware that high task difficulty might necessitate more robust data processing or validation.

Project actions

01If your design project involves observing user attention with eye-tracking, think about how much the user will be moving their head.
02Consider if the task you're designing will be mentally demanding for the user, as this could affect eye-tracking data.

Method & Evidence

AimTo evaluate the accuracy of two head-mounted eye-tracking devices (Tobii Pro Glasses 2 and 3) under varying conditions of head movement and user workload.

MethodExperimental evaluation

ProcedureParticipants performed eye-tracking tasks under three conditions: seated with a chinrest, seated without a chinrest, and walking. Gaze accuracy was assessed by comparing the eye-tracker's reported gaze point with the actual target location, identified using computer vision on the scene camera feed. Perceived workload was also measured.

Sample36 participants

ContextHuman-computer interaction, user research, experimental design

Variables

IV["Dynamicity condition (seated with chinrest, seated without chinrest, walking)","Perceived workload"]

DV["Eye-tracker accuracy"]

CV["Eye-tracking device model (Tobii Pro Glasses 2 vs. 3)","Target presentation method (audio instructions, direct gaze)","Task environment (wall targets, bullseye target)"]

Strengths & Limitations

Strengths

+Inclusion of multiple dynamicity conditions, including a realistic walking scenario.
+Direct comparison of two contemporary eye-tracking devices.

Limitations

The specific eye-tracking devices tested might not represent all available technology. The tasks were controlled and might not fully replicate real-world complexity.

Reliability & validity

The study's validity is supported by the use of computer vision for objective accuracy assessment and the inclusion of multiple conditions. Reliability is addressed by testing multiple participants and devices.

Think critically

How might the design of the eye-tracking hardware itself (e.g., field of view, sensor placement) contribute to the observed differences in accuracy between static and dynamic conditions?

Design Principles

"Dynamic task complexity and user cognitive load are critical variables affecting the reliability of head-mounted eye-tracking data."

Understanding the limitations of eye-tracking technology in dynamic environments is crucial for designers developing user interfaces, training simulations, or research tools that rely on gaze data. This insight helps in setting realistic expectations for data quality and in designing experimental protocols that mitigate potential inaccuracies.

What This Means for Your Design

Eye-tracking glasses can be less accurate when you move your head a lot or when the task is really hard and makes you think hard.

How to use in your project

1.Reference this study when discussing the limitations of your chosen eye-tracking method, especially if your design involves dynamic user interaction or cognitive load.

Add to My Project

Quick Cite

Paragraph starter

The reliability of head-mounted eye-tracking systems, as demonstrated by Onkhar et al. (2023), is significantly influenced by user movement and cognitive load. Their findings indicate that increased head mobility and higher perceived workload can degrade gaze accuracy, suggesting that experimental designs should carefully consider these factors to ensure valid data collection.

Source

Behavior Research Methods

Evaluating the Tobii Pro Glasses 2 and 3 in static and dynamic conditions

journal · 2023

View source

Questions About This Research

What does the research say about head-mounted eye-tracker accuracy degrades with increased head movement and perceived workload?: When designing systems that use eye-tracking, especially in dynamic or complex tasks, prioritize hardware known for better performance in such conditions and be mindful of factors like head movement and user cognitive load that can degrade data quality. Evidence: Behavior Research Methods (2023).
Why does "Head-mounted eye-tracker accuracy degrades with increased head movement and perceived workload" matter for design?: Understanding the limitations of eye-tracking technology in dynamic environments is crucial for designers developing user interfaces, training simulations, or research tools that rely on gaze data. This insight helps in setting realistic expectations for data quality and in designing experimental protocols that mitigate potential inaccuracies.
How can designers apply this research?: When designing systems that use eye-tracking, especially in dynamic or complex tasks, prioritize hardware known for better performance in such conditions and be mindful of factors like head movement and user cognitive load that can degrade data quality.
What were the main findings?: Tobii Pro Glasses 3 demonstrated higher accuracy than Tobii Pro Glasses 2 during walking trials.. Using a chinrest reduced eye-tracker accuracy by requiring larger eye eccentricities for fixation.. Higher reported workload correlated with poorer eye-tracking accuracy.
What research method was used?: Experimental evaluation with 36 participants.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2023 journal from Behavior Research Methods.
What should I do differently in my next project?: When designing user studies involving eye-tracking, select equipment appropriate for the expected level of head movement. If using head-mounted trackers, consider protocols that allow for natural head movement rather than restrictive setups like chinrests, and be aware that high task difficulty might necessitate more robust data processing or validation.
What are the limitations?: The study focused on specific eye-tracking devices and tasks; results may vary with different hardware or more complex dynamic environments. The definition of 'accuracy' was based on computer vision identification of targets.