Short answer

When designing complex systems, explicitly map information needs to specific user goals and tasks to ensure adequate situation awareness support, and consider adaptive interfaces.

Field
Human Factors
Source
International Journal of Information Technology and Management (2016)
Method
Cognitive Task Analysis (CTA) extension
Evidence
Strong effect

A systematic analysis scheme can reveal critical gaps in how complex systems support user situation awareness by focusing on information needs tied to specific goals and tasks. This human factors research insight is drawn from a 2016 study published in International Journal of Information Technology and Management. Using Cognitive task analysis (cta) extension, researchers explored how this design variable affects real-world outcomes. The key design takeaway: When designing complex systems, explicitly map information needs to specific user goals and tasks to ensure adequate situation awareness support, and consider adaptive interfaces.

Study
Human FactorsHigh ImpactStrong effect

Situation Awareness Deficiencies Identified Through Goal-Task Dependent Analysis

A systematic analysis scheme can reveal critical gaps in how complex systems support user situation awareness by focusing on information needs tied to specific goals and tasks.

International Journal of Information Technology and Management · 2016

01

Key Findings

  • 01Existing methods for defining situation awareness do not adequately distinguish between general information needs and situation awareness requirements.
  • 02Required situation awareness is significantly dependent on the specific context and the operator's role.
  • 03The developed analysis scheme effectively defined RSA and identified deficiencies in current support.
02

Application

Design takeaway

When designing complex systems, explicitly map information needs to specific user goals and tasks to ensure adequate situation awareness support, and consider adaptive interfaces.

How to apply

Use a structured approach to map user goals and tasks to information requirements, then critically evaluate how well the current interface supports the user's awareness of the situation relevant to those goals and tasks.

Project actions

  • 01When defining user needs, clearly separate general information requirements from specific situation awareness needs.
  • 02Consider how the context of use and the user's role might change their information requirements.
03

Method & Evidence

AimHow can a systematic analysis scheme be developed and applied to identify deficiencies in situation awareness support within complex man-machine interactions?
MethodCognitive Task Analysis (CTA) extension
ProcedureDeveloped and applied an analysis scheme to define Required Situation Awareness (RSA) by integrating goal and task dependencies with system and individual factors. This scheme was trialled in a nautical traffic management context to identify specific RSA and current support deficiencies.
ContextNautical traffic management

Variables

IVAnalysis scheme application (presence/absence or specific implementation)
DVIdentification of situation awareness deficiencies, definition of Required Situation Awareness (RSA)
CVContext (nautical traffic management), specific tasks and goals
04

Strengths & Limitations

Strengths

  • +Provides a structured methodology for analyzing situation awareness.
  • +Highlights the critical link between goals, tasks, and information needs for situation awareness.

Limitations

The complexity of conducting a full cognitive task analysis and defining situation awareness can be challenging within the scope of a typical design project. Generalizing findings from one context to another requires careful consideration.

Reliability & validity

The reliability of the analysis scheme would depend on the consistency of its application by different researchers. Validity is supported by its successful application in identifying deficiencies in a real-world context, though further validation across diverse domains would strengthen it.

Think critically

To what extent can a generic analysis scheme be universally applied across vastly different complex man-machine interaction domains, or does each domain necessitate a bespoke approach to defining situation awareness?

05

Design Principles

"Situation awareness support in complex systems must be explicitly defined by user goals and tasks, and be context and operator-dependent."

Understanding and addressing situation awareness deficiencies is crucial for designing effective and safe human-machine interactions. This approach allows designers to move beyond generic usability to pinpoint specific information requirements that, if unmet, can lead to errors or reduced performance in complex operational environments.

06

What This Means for Your Design

This study shows that to make sure people understand what's going on in a complex system (like a ship's bridge), you need to figure out exactly what information they need for their specific job and goals, not just give them everything. Current methods aren't good enough at this, and what people need changes depending on the situation and who they are.

How to use in your project

  • 1.Use the concept of Required Situation Awareness (RSA) to justify specific information displays or user interface elements in your design project.
  • 2.Employ a cognitive task analysis approach to inform your user research and identify potential situation awareness gaps in existing products or your proposed solution.
07

Add to My Project

08

Quick Cite

Paragraph starter

This research highlights the importance of a systematic approach to understanding user situation awareness in complex man-machine interactions. By employing a scheme that links information needs to specific user goals and tasks, and acknowledging the context and operator dependency of Required Situation Awareness (RSA), designers can more effectively identify and address deficiencies in current systems. This methodology provides a robust framework for user research, ensuring that design solutions adequately support the user's cognitive state and operational effectiveness.

09

Source

International Journal of Information Technology and Management

A situation awareness analysis scheme to identify deficiencies of complex man-machine interactions

journal · 2016

View source

Questions About This Research

What does the research say about situation awareness deficiencies identified through goal-task dependent analysis?
When designing complex systems, explicitly map information needs to specific user goals and tasks to ensure adequate situation awareness support, and consider adaptive interfaces. Evidence: International Journal of Information Technology and Management (2016).
Why does "Situation Awareness Deficiencies Identified Through Goal-Task Dependent Analysis" matter for design?
Understanding and addressing situation awareness deficiencies is crucial for designing effective and safe human-machine interactions. This approach allows designers to move beyond generic usability to pinpoint specific information requirements that, if unmet, can lead to errors or reduced performance in complex operational environments.
How can designers apply this research?
When designing complex systems, explicitly map information needs to specific user goals and tasks to ensure adequate situation awareness support, and consider adaptive interfaces.
What were the main findings?
Existing methods for defining situation awareness do not adequately distinguish between general information needs and situation awareness requirements.. Required situation awareness is significantly dependent on the specific context and the operator's role.. The developed analysis scheme effectively defined RSA and identified deficiencies in current support.
What research method was used?
Cognitive Task Analysis (CTA) extension.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2016 journal from International Journal of Information Technology and Management.
What should I do differently in my next project?
Use a structured approach to map user goals and tasks to information requirements, then critically evaluate how well the current interface supports the user's awareness of the situation relevant to those goals and tasks.
What are the limitations?
The study was conducted in a specific domain (nautical traffic management), and the findings may require adaptation for other complex man-machine interaction contexts.