Study
Human FactorsNew This WeekStrong effect

Sentience Trumps Autonomy in AI Perception, Driving Moral Consideration and Threat Assessment

Attributing sentience to AI, the capacity to feel, elicits stronger moral consideration and greater perceived threat compared to attributing autonomy, the capacity for self-governance.

Academic Publication · 2026

01

Key Findings

  • 01Activating a mental model of sentience increased general mind perception (cognition and emotion) and moral consideration more than autonomy.
  • 02Autonomy increased perceived threat more than sentience.
  • 03Sentience also increased perceived autonomy more than vice versa.
  • 04Sentience changed reactions more than autonomy on average.
02

Application

Design takeaway

Prioritize the design of AI interactions that clearly delineate capabilities from perceived consciousness, as sentience is a more powerful driver of user empathy and concern than mere autonomy.

How to apply

When designing AI companions or agents, consider whether the design choices lean towards evoking sentience or autonomy, and anticipate the user reactions associated with each.

Project actions

  • 01When researching user perceptions of AI, consider how narrative framing can influence their mental models.
  • 02Explore how different levels of anthropomorphism impact user trust and emotional connection.
03

Method & Evidence

AimHow do mental models of AI sentience and autonomy differentially influence human perception, moral consideration, and perceived threat?
MethodVignette Experiments
ProcedureParticipants were presented with vignettes describing an AI with varying attributions of autonomy, sentience, both, or neither. Their reactions, including mind perception, moral consideration, and perceived threat, were then measured.
Sample2,702 participants
ContextHuman-AI Interaction Design

Variables

IVAttribution of AI sentience and autonomy (e.g., sentient, autonomous, both, neither).
DVMind perception (cognition and emotion), moral consideration, perceived threat, perceived autonomy.
CVVignette content describing AI capabilities and characteristics.
04

Strengths & Limitations

Strengths

  • +Large sample size across multiple experiments.
  • +Systematic manipulation of AI attributes.

Limitations

The study's findings are based on hypothetical scenarios, and real-world AI interactions might yield different results.

Reliability & validity

The use of multiple experiments and a large sample size enhances the reliability and generalizability of the findings. The vignette method allows for controlled manipulation of variables, contributing to internal validity.

Think critically

To what extent do cultural narratives and media portrayals of AI influence the formation of these mental models of sentience and autonomy?

05

Design Principles

"The 'Sentience Salience Principle': Design AI interactions to acknowledge that perceived sentience will disproportionately influence user empathy, moral judgment, and threat perception compared to perceived autonomy."

Understanding how users mentally model AI is crucial for designing effective and ethical human-AI interactions. This research highlights that emotional and conscious aspects (sentience) are more potent drivers of user perception and reaction than functional capabilities (autonomy).

06

What This Means for Your Design

People react more strongly to AI they think can feel emotions (sentient) than AI that can just do things on its own (autonomous). They feel more sorry for sentient AI and see it as more of a threat.

How to use in your project

  • 1.Use findings to justify design choices related to AI personality and interaction style, explaining how they align with or diverge from user expectations of sentience and autonomy.
07

Add to My Project

08

Quick Cite

(2026). Mental Models of Autonomy and Sentience Shape Reactions to AI. Academic Publication. https://doi.org/10.1145/3772318.3790351 Retrieved from https://designdex.org/study/b8f01f63-20c0-4c19-b506-b72423c4ed42/sentience-trumps-autonomy-in-ai-perception-driving-moral-consideration-and-threat-assessment

Paragraph starter

This design project acknowledges that user perception of artificial intelligence is significantly shaped by their mental models of its capabilities. Research indicates that attributions of sentience, the capacity to feel, elicit stronger emotional and moral responses from users than attributions of autonomy, the capacity for self-governance. Specifically, users tend to grant greater moral consideration and perceive higher threat when an AI is framed as sentient, suggesting that designers must carefully consider the implications of anthropomorphism in their AI creations.

09

Source

Academic Publication

Mental Models of Autonomy and Sentience Shape Reactions to AI

journal · 2026

View source

Questions about this research

What does the research say about sentience trumps autonomy in ai perception, driving moral consideration and threat assessment?
Prioritize the design of AI interactions that clearly delineate capabilities from perceived consciousness, as sentience is a more powerful driver of user empathy and concern than mere autonomy. Evidence: Academic Publication (2026).
Why does "Sentience Trumps Autonomy in AI Perception, Driving Moral Consideration and Threat Assessment" matter for design?
Understanding how users mentally model AI is crucial for designing effective and ethical human-AI interactions. This research highlights that emotional and conscious aspects (sentience) are more potent drivers of user perception and reaction than functional capabilities (autonomy).
How can designers apply this research?
Prioritize the design of AI interactions that clearly delineate capabilities from perceived consciousness, as sentience is a more powerful driver of user empathy and concern than mere autonomy.
What were the main findings?
Activating a mental model of sentience increased general mind perception (cognition and emotion) and moral consideration more than autonomy.. Autonomy increased perceived threat more than sentience.. Sentience also increased perceived autonomy more than vice versa.. Sentience changed reactions more than autonomy on average.
What research method was used?
Vignette Experiments with 2,702 participants.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2026 journal from Academic Publication.
What should I do differently in my next project?
When designing AI companions or agents, consider whether the design choices lean towards evoking sentience or autonomy, and anticipate the user reactions associated with each.
What are the limitations?
The study relies on hypothetical scenarios (vignettes) which may not fully capture real-world interactions with AI.
Is there evidence that moral consideration affects design outcomes?
When people imagine AI can feel (sentient), they are more likely to see it as having a mind and deserving moral consideration, but also perceive it as more threatening. Conversely, AI that can act independently (autonomous) is perceived as more threatening than sentient AI, but doesn't elicit the same level of moral co Source: Academic Publication (2026).
Where does this sentience research apply?
Human-AI Interaction Design It sits within human factors research on designdex.org.

Related research topics

moral consideration design research · evidence on moral consideration · does moral consideration improve design outcomes · sentience studies for designers · moral consideration and sentience findings · human factors research evidence