Ai Vs. Human: The Public's Perceptions Of The Design Abilities Of Artificial Intelligence

doi:10.1017/pds.2023.50

Study

User-Centred DesignRecentModerate effect

Public Perceives Human Designers Superior to AI for User-Centric Design Goals

The general public believes human designers are more capable than AI for achieving user-dependent design goals, indicating a current barrier to AI adoption in user-facing design roles.

Proceedings of the Design Society · 2023

01

Key Findings

01Participants generally perceived AI as performing worse than human designers on most design goals.
02This perception was particularly pronounced for design goals that are user-dependent.
03Higher self-reported design and AI/ML knowledge, along with older age, correlated with a greater likelihood of believing AI could outperform human designers.

02

Application

Design takeaway

When designing AI-powered design tools or products, prioritize demonstrating AI's ability to understand and cater to user needs, or clearly position AI as a supportive tool for human designers.

How to apply

When presenting AI-generated designs, highlight the specific user benefits and how the AI considered user feedback or data, rather than just the AI's technical prowess.

Project actions

01When evaluating AI design tools, consider how they address user-centric aspects.
02Investigate user perceptions of AI-generated outputs in your specific design project.

03

Method & Evidence

AimTo investigate public perception of AI's design capabilities compared to human designers, particularly concerning user-dependent design goals.

MethodOnline Survey

ProcedureAn online survey was administered to 205 participants to gauge their perceptions of AI versus human designer performance across 16 specific bicycle design goals. The survey also collected demographic data and self-reported knowledge levels in design and AI/ML.

Sample205 participants

ContextProduct Design, Human-Computer Interaction, Artificial Intelligence in Design

Variables

IV["Perceived designer (AI vs. Human)","Design goal type (user-dependent vs. other)","Participant's self-reported knowledge (design, AI/ML)","Participant's age"]

DV["Perceived performance of AI/Human designer on design goals"]

CV["Specific design goals evaluated (16 bicycle goals)","Survey platform (Amazon Mechanical Turk)"]

04

Strengths & Limitations

Strengths

+Addresses a timely and relevant topic in design practice.
+Collects quantitative data on public perception across multiple design goals.

Limitations

The study's findings are based on self-reported perceptions and may not reflect actual performance differences. The specific design goals chosen might influence the results.

Reliability & validity

Reliability could be assessed through test-retest of survey questions. Validity is supported by the direct measurement of perceptions related to design goals and AI capabilities.

Think critically

To what extent do these perceptions reflect actual limitations of current AI design capabilities versus ingrained human biases towards human creativity?

05

Design Principles

"User trust in AI design capabilities is contingent on perceived empathy and understanding of user-specific requirements."

Understanding public perception is critical for the successful integration of AI into design workflows. If users inherently distrust AI's ability to understand their needs, it can hinder the adoption of AI-generated designs and impact the acceptance of human-AI collaborative design processes.

06

What This Means for Your Design

People generally think humans are better designers than AI, especially for things that need to understand people's feelings or needs. But, if you know a lot about design or AI, or are older, you might think AI could be better.

How to use in your project

1.Reference this study when discussing user acceptance of AI in design or when justifying the need for human oversight in user-focused design tasks.

07

Add to My Project

08

Quick Cite

(2023). AI VS. HUMAN: THE PUBLIC'S PERCEPTIONS OF THE DESIGN ABILITIES OF ARTIFICIAL INTELLIGENCE. Proceedings of the Design Society. https://doi.org/10.1017/pds.2023.50 Retrieved from https://designdex.org/study/2c11a1ed-812e-41e0-87f4-508341b8b414/public-perceives-human-designers-superior-to-ai-for-user-centric-design-goals

Paragraph starter

Research indicates that the public generally perceives human designers as superior to AI, particularly for user-dependent design goals. This suggests that integrating AI into design processes requires careful consideration of user trust and acceptance, especially in applications demanding high levels of user empathy and understanding.

09

Source

Proceedings of the Design Society

AI VS. HUMAN: THE PUBLIC'S PERCEPTIONS OF THE DESIGN ABILITIES OF ARTIFICIAL INTELLIGENCE

journal · 2023

View source

Questions about this research

What does the research say about public perceives human designers superior to ai for user-centric design goals?: When designing AI-powered design tools or products, prioritize demonstrating AI's ability to understand and cater to user needs, or clearly position AI as a supportive tool for human designers. Evidence: Proceedings of the Design Society (2023).
Why does "Public Perceives Human Designers Superior to AI for User-Centric Design Goals" matter for design?: Understanding public perception is critical for the successful integration of AI into design workflows. If users inherently distrust AI's ability to understand their needs, it can hinder the adoption of AI-generated designs and impact the acceptance of human-AI collaborative design processes.
How can designers apply this research?: When designing AI-powered design tools or products, prioritize demonstrating AI's ability to understand and cater to user needs, or clearly position AI as a supportive tool for human designers.
What were the main findings?: Participants generally perceived AI as performing worse than human designers on most design goals.. This perception was particularly pronounced for design goals that are user-dependent.. Higher self-reported design and AI/ML knowledge, along with older age, correlated with a greater likelihood of believing AI could outperform human designers.
What research method was used?: Online Survey with 205 participants.
How strong is the evidence?: Evidence strength is rated Moderate effect, based on a 2023 journal from Proceedings of the Design Society.
What should I do differently in my next project?: When presenting AI-generated designs, highlight the specific user benefits and how the AI considered user feedback or data, rather than just the AI's technical prowess.
What are the limitations?: Perceptions may vary across different product types and cultural contexts. The study focused on bicycle design, which may not generalize to all design domains.
Is there evidence that design affects design outcomes?: Most people think AI isn't as good as humans at designing things, especially when it comes to understanding what users need. However, those with more design or AI knowledge, and older individuals, are more open to AI's potential. Understanding public perception is critical for the successful integration of AI into desi Source: Proceedings of the Design Society (2023).
Where does this human designers research apply?: Product Design, Human-Computer Interaction, Artificial Intelligence in Design It sits within user-centred design research on designdex.org.