Short answer

When conducting user studies involving visual content, especially in virtual or augmented reality, be aware that the display hardware itself can bias results. Consider using a control group with standard displays or explicitly account for HMD-induced effects in your analysis.

Field
Human Factors
Source
Electronic Imaging (2021)
Method
Subjective experiment
Evidence
Strong effect

The use of head-mounted displays (HMDs) introduces visual artifacts and potential discomfort, leading to altered perceptions of image quality compared to standard viewing methods. This human factors research insight is drawn from a 2021 study published in Electronic Imaging. Using Subjective experiment, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When conducting user studies involving visual content, especially in virtual or augmented reality, be aware that the display hardware itself can bias results. Consider using a control group with standard displays or explicitly account for HMD-induced effects in your analysis.

Study
Human FactorsHigh ImpactStrong effect

Head-mounted displays significantly alter subjective image quality ratings

The use of head-mounted displays (HMDs) introduces visual artifacts and potential discomfort, leading to altered perceptions of image quality compared to standard viewing methods.

Electronic Imaging · 2021

01

Key Findings

  • 01Head-mounted displays introduce significant impairments like the screen door effect.
  • 02Extended HMD use can lead to cybersickness.
  • 03There are significant differences in quality ratings when using HMDs compared to other methods.
  • 04HMDs impact overall ratings and perceptions of individual distortions.
02

Application

Design takeaway

When conducting user studies involving visual content, especially in virtual or augmented reality, be aware that the display hardware itself can bias results. Consider using a control group with standard displays or explicitly account for HMD-induced effects in your analysis.

How to apply

If you are developing a virtual reality application or evaluating visual assets for VR, conduct user testing with the target HMDs and consider how the display's limitations might affect user feedback and perceived quality.

Project actions

  • 01When designing a user study, clearly define the display technology used and its potential impact on results.
  • 02Consider including a baseline test with a standard display to compare against HMD results.
03

Method & Evidence

AimTo investigate how the use of head-mounted displays influences the subjective quality ratings of omnidirectional images.
MethodSubjective experiment
ProcedureParticipants rated the quality of omnidirectional images using various head-mounted displays and content types. The collected data was statistically analyzed.
ContextImmersive media consumption and visual quality assessment

Variables

IVUse of Head-Mounted Display (HMD) vs. standard display
DVSubjective quality ratings of omnidirectional images
CVType of content, specific HMD model, participant demographics (potentially)
04

Strengths & Limitations

Strengths

  • +Directly addresses a practical issue in immersive media evaluation.
  • +Provides empirical data on the impact of HMDs on subjective quality.

Limitations

The specific HMD models and content used in the original study might not be representative of all possible scenarios. User susceptibility to cybersickness also varies.

Reliability & validity

Reliability could be assessed by repeating the ratings with the same participants after a time interval. Validity is supported by the statistical analysis showing significant differences, suggesting the HMD is indeed influencing the ratings.

Think critically

How might the findings of this study be applied to the design of user interfaces for virtual reality environments, beyond just image quality assessment?

05

Design Principles

"The user's perceptual experience is a product of both the content and the viewing medium; therefore, the medium's characteristics must be understood and controlled for accurate assessment."

When designing immersive experiences or evaluating visual content, it's crucial to acknowledge that the display technology itself can be a confounding factor. Designers must consider the inherent limitations of HMDs, such as the screen door effect, and their potential to induce cybersickness, which can negatively impact user experience and the validity of subjective feedback.

06

What This Means for Your Design

When people watch images on VR headsets, they rate the quality differently than if they watched on a normal screen because the headset itself can make the image look worse or make people feel sick.

How to use in your project

  • 1.Reference this study when discussing the methodology of your user testing, particularly if you are using VR/AR or if display technology could influence user perception of your design.
07

Add to My Project

08

Quick Cite

Paragraph starter

Research indicates that the display technology used for visual quality assessment can significantly influence user ratings. For instance, studies on head-mounted displays (HMDs) have shown that artifacts like the screen door effect and the potential for cybersickness can lead to altered perceptions of image quality, impacting both overall scores and the evaluation of specific distortions. Therefore, when designing user testing protocols, it is crucial to consider and potentially control for the characteristics of the display medium to ensure the validity of the collected data.

09

Source

Electronic Imaging

On the influence of head-mounted displays on quality rating of omnidirectional images

journal · 2021

View source

Questions About This Research

What does the research say about head-mounted displays significantly alter subjective image quality ratings?
When conducting user studies involving visual content, especially in virtual or augmented reality, be aware that the display hardware itself can bias results. Consider using a control group with standard displays or explicitly account for HMD-induced effects in your analysis. Evidence: Electronic Imaging (2021).
Why does "Head-mounted displays significantly alter subjective image quality ratings" matter for design?
When designing immersive experiences or evaluating visual content, it's crucial to acknowledge that the display technology itself can be a confounding factor. Designers must consider the inherent limitations of HMDs, such as the screen door effect, and their potential to induce cybersickness, which can negatively impact user experience and the validity of subjective feedback.
How can designers apply this research?
When conducting user studies involving visual content, especially in virtual or augmented reality, be aware that the display hardware itself can bias results. Consider using a control group with standard displays or explicitly account for HMD-induced effects in your analysis.
What were the main findings?
Head-mounted displays introduce significant impairments like the screen door effect.. Extended HMD use can lead to cybersickness.. There are significant differences in quality ratings when using HMDs compared to other methods.. HMDs impact overall ratings and perceptions of individual distortions.
What research method was used?
Subjective experiment.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2021 journal from Electronic Imaging.
What should I do differently in my next project?
If you are developing a virtual reality application or evaluating visual assets for VR, conduct user testing with the target HMDs and consider how the display's limitations might affect user feedback and perceived quality.
What are the limitations?
The study may not generalize to all types of HMDs, content, or user populations. The specific impairments and their severity can vary widely.