Short answer

Integrate AI-powered assistive technologies into product designs to support novice users and accelerate their learning curve, thereby enhancing overall user performance and satisfaction.

Field
Innovation & Design
Source
National Bureau of Economic Research (2023)
Method
Observational study using real-world data
Sample
5,179 customer support agents
Evidence
Strong effect

Introducing generative AI tools into customer support significantly enhances the productivity of less experienced workers, effectively bridging knowledge gaps and accelerating their skill development. This innovation & design research insight is drawn from a 2023 study published in National Bureau of Economic Research. Using Observational study using real-world data with 5,179 customer support agents, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Integrate AI-powered assistive technologies into product designs to support novice users and accelerate their learning curve, thereby enhancing overall user performance and satisfaction.

Study
Innovation & DesignRecentStrong effect

Generative AI boosts novice worker productivity by 14%

Introducing generative AI tools into customer support significantly enhances the productivity of less experienced workers, effectively bridging knowledge gaps and accelerating their skill development.

National Bureau of Economic Research · 2023

01

Key Findings

  • 01Average productivity (issues resolved per hour) increased by 14%.
  • 02The greatest productivity gains were observed in novice and low-skilled workers.
  • 03Experienced and highly skilled workers showed minimal productivity changes.
  • 04AI assistance improved customer sentiment.
  • 05Requests for managerial intervention decreased.
02

Application

Design takeaway

Integrate AI-powered assistive technologies into product designs to support novice users and accelerate their learning curve, thereby enhancing overall user performance and satisfaction.

How to apply

When designing products for a diverse user base, consider incorporating AI features that can provide contextual help, guidance, and knowledge transfer, particularly benefiting those with less experience.

Project actions

  • 01Consider how AI could assist a user in your project, especially if they are new to the task.
  • 02Explore how AI could help transfer tacit knowledge (knowledge that is hard to articulate) to a user.
  • 03Think about the ethical implications of AI assisting users.
03

Method & Evidence

AimTo investigate the impact of generative AI on the productivity and skill development of customer support agents.
MethodObservational study using real-world data
ProcedureThe study analyzed data from 5,179 customer support agents who were introduced to a generative AI conversational assistant. Productivity, customer sentiment, and managerial intervention requests were tracked before and after the AI's introduction.
Sample5,179 customer support agents
ContextCustomer support operations in a professional environment.

Variables

IVAccess to generative AI conversational assistant
DVProductivity (issues resolved per hour), customer sentiment, requests for managerial intervention, employee retention
CVWorker skill level (novice, low-skilled, experienced, highly skilled)
04

Strengths & Limitations

Strengths

  • +Large sample size provides robust statistical power.
  • +Real-world data collection offers ecological validity.
  • +Analysis of multiple outcome measures provides a comprehensive view of AI impact.

Limitations

The AI used was a specific conversational assistant; other AI types might have different effects. The study didn't explore the potential for AI to create over-reliance or deskilling in experienced workers.

Reliability & validity

The study's use of a large, real-world dataset enhances its reliability and external validity. However, the specific AI tool and context might limit generalizability to other AI applications or industries.

Think critically

What are the potential long-term consequences of AI significantly reducing the need for human expertise in certain roles?

05

Design Principles

"Assistive AI integration can bridge skill gaps and democratize expertise."

This research highlights how AI can democratize expertise, making complex tasks more accessible and reducing the learning curve for new employees. It suggests a paradigm shift in how training and skill development can be approached in professional settings.

06

What This Means for Your Design

Using AI tools at work can make less experienced people much better at their jobs, almost as good as the experts, by sharing knowledge easily.

How to use in your project

  • 1.In your project, you could justify the use of an AI-powered feature by referencing this study's findings on productivity gains for novice users.
  • 2.Use this to support claims about how your design will improve user efficiency or reduce the learning curve.
07

Add to My Project

08

Quick Cite

Paragraph starter

The integration of generative AI tools has demonstrated a significant positive impact on worker productivity, particularly for novice and low-skilled individuals, by facilitating knowledge dissemination and accelerating skill acquisition. This suggests that AI-powered assistive technologies can be a valuable design strategy for enhancing user performance and reducing the learning curve in complex tasks.

09

Source

National Bureau of Economic Research

Generative AI at Work

journal · 2023

View source

Questions About This Research

What does the research say about generative ai boosts novice worker productivity by 14%?
Integrate AI-powered assistive technologies into product designs to support novice users and accelerate their learning curve, thereby enhancing overall user performance and satisfaction. Evidence: National Bureau of Economic Research (2023).
Why does "Generative AI boosts novice worker productivity by 14%" matter for design?
This research highlights how AI can democratize expertise, making complex tasks more accessible and reducing the learning curve for new employees. It suggests a paradigm shift in how training and skill development can be approached in professional settings.
How can designers apply this research?
Integrate AI-powered assistive technologies into product designs to support novice users and accelerate their learning curve, thereby enhancing overall user performance and satisfaction.
What were the main findings?
Average productivity (issues resolved per hour) increased by 14%.. The greatest productivity gains were observed in novice and low-skilled workers.. Experienced and highly skilled workers showed minimal productivity changes.. AI assistance improved customer sentiment.
What research method was used?
Observational study using real-world data with 5,179 customer support agents.
How strong is the evidence?
Evidence strength is rated Strong effect, based on a 2023 journal from National Bureau of Economic Research.
What should I do differently in my next project?
When designing products for a diverse user base, consider incorporating AI features that can provide contextual help, guidance, and knowledge transfer, particularly benefiting those with less experience.
What are the limitations?
The study focused on a specific type of AI (conversational assistant) and a particular industry (customer support). The long-term effects and potential for AI to displace highly skilled workers were not fully explored.