Short answer

Designers should explore and advocate for AI tools that support a dynamic, iterative workflow, allowing for continuous refinement of both narrative and visual elements in their storyboarding process.

Field
User-Centred Design
Source
arXiv (Cornell University) (2024)
Method
Iterative development of an AI system (StoryDiffusion) followed by a user study.
Sample
12 participants
Evidence
Moderate effect

Integrating text-to-text and text-to-image generative AI models in a single pipeline can effectively support the entire UX storyboarding process, from concept ideation to illustration. This user-centred design research insight is drawn from a 2024 study published in arXiv (Cornell University). Using Iterative development of an ai system (storydiffusion) followed by a user study. with 12 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Designers should explore and advocate for AI tools that support a dynamic, iterative workflow, allowing for continuous refinement of both narrative and visual elements in their storyboarding process.

Study
User-Centred DesignRecentModerate effect

Generative AI enhances UX storyboarding by supporting iterative narrative and image co-creation.

Integrating text-to-text and text-to-image generative AI models in a single pipeline can effectively support the entire UX storyboarding process, from concept ideation to illustration.

arXiv (Cornell University) · 2024

01

Key Findings

  • 01Generative AI can support both concept ideation and illustration in UX storyboarding.
  • 02Designers employ both AI-directed and user-directed creative strategies.
  • 03The interchange between narrative iteration and image generation is critical for effective storyboarding.
  • 04Design tasks influence designers' strategies and preferences when using AI tools.
02

Application

Design takeaway

Designers should explore and advocate for AI tools that support a dynamic, iterative workflow, allowing for continuous refinement of both narrative and visual elements in their storyboarding process.

How to apply

When developing or selecting AI tools for design, prioritize those that allow for easy iteration between different stages of the design process and offer flexibility in user control.

Project actions

  • 01Consider how AI could assist in generating visual elements for your design project.
  • 02Think about how you can maintain creative control while leveraging AI for efficiency.
03

Method & Evidence

AimHow can generative AI systems be designed to effectively support the end-to-end UX storyboarding process, considering designers' individual workflows and creative strategies?
MethodIterative development of an AI system (StoryDiffusion) followed by a user study.
ProcedureThe StoryDiffusion system, integrating text-to-text and text-to-image models, was iteratively developed. A user study was conducted where 12 UX designers used the system for concept ideation and illustration tasks, with observations focusing on their creative strategies and preferences.
Sample12 participants
ContextUser Experience (UX) Design, Storyboarding, Generative AI

Variables

IV["Integration of text-to-text and text-to-image models in a single pipeline.","AI-directed vs. user-directed creative strategies."]
DV["Effectiveness of UX storyboarding (concept ideation and illustration).","Designer strategies and preferences."]
CV["Type of design tasks (concept ideation, illustration).","User study environment."]
04

Strengths & Limitations

Strengths

  • +Iterative development process ensures the tool is refined based on user needs.
  • +User study provides direct insights into designer interaction with AI.

Limitations

The AI tools used might have biases or limitations in their output, which could affect the final storyboard. The study participants were experienced UX designers, so results might differ with novices.

Reliability & validity

The study's validity is supported by direct observation of designers using the system for specific tasks. Reliability could be enhanced by increasing the sample size and conducting the study across different design contexts.

Think critically

To what extent does reliance on AI for storyboarding risk homogenizing design outcomes or stifling truly novel conceptualization?

05

Design Principles

"AI tools for creative design should enable a synergistic co-creation process, balancing automated generation with user control and iterative refinement."

This approach allows designers to fluidly move between refining narrative elements and generating visual representations, accelerating the creation of user experience storyboards. Understanding how designers interact with AI in this co-creative process is crucial for developing more intuitive and supportive design tools.

06

What This Means for Your Design

AI can help UX designers create storyboards faster by generating both the text descriptions and the images, but it works best when designers can easily go back and forth between writing and drawing, and when the AI helps them without taking over completely.

How to use in your project

  • 1.Reference this study when discussing the use of AI tools for ideation or visualization in your design project.
  • 2.Use the findings to justify the design of your own AI-assisted design features.
07

Add to My Project

08

Quick Cite

Paragraph starter

The integration of generative AI, as demonstrated by systems like StoryDiffusion, offers significant potential for enhancing UX storyboarding by supporting an iterative co-creation process between narrative development and visual generation. This approach allows designers to efficiently ideate and illustrate concepts, leveraging AI for both text and image synthesis while maintaining crucial user control over the creative direction.

09

Source

arXiv (Cornell University)

StoryDiffusion: How to Support UX Storyboarding With Generative-AI

journal · 2024

View source

Questions About This Research

What does the research say about generative ai enhances ux storyboarding by supporting iterative narrative and image co-creation?
Designers should explore and advocate for AI tools that support a dynamic, iterative workflow, allowing for continuous refinement of both narrative and visual elements in their storyboarding process. Evidence: arXiv (Cornell University) (2024).
Why does "Generative AI enhances UX storyboarding by supporting iterative narrative and image co-creation." matter for design?
This approach allows designers to fluidly move between refining narrative elements and generating visual representations, accelerating the creation of user experience storyboards. Understanding how designers interact with AI in this co-creative process is crucial for developing more intuitive and supportive design tools.
How can designers apply this research?
Designers should explore and advocate for AI tools that support a dynamic, iterative workflow, allowing for continuous refinement of both narrative and visual elements in their storyboarding process.
What were the main findings?
Generative AI can support both concept ideation and illustration in UX storyboarding.. Designers employ both AI-directed and user-directed creative strategies.. The interchange between narrative iteration and image generation is critical for effective storyboarding.. Design tasks influence designers' strategies and preferences when using AI tools.
What research method was used?
Iterative development of an AI system (StoryDiffusion) followed by a user study. with 12 participants.
How strong is the evidence?
Evidence strength is rated Moderate effect, based on a 2024 journal from arXiv (Cornell University).
What should I do differently in my next project?
When developing or selecting AI tools for design, prioritize those that allow for easy iteration between different stages of the design process and offer flexibility in user control.
What are the limitations?
The study focused on a specific AI system (StoryDiffusion) and a limited number of UX designers, potentially limiting the generalizability of findings to all AI tools or design contexts.