Short answer

Prioritize the development and application of context-specific theoretical frameworks for AI trust, moving beyond purely exploratory research to inform more robust and reliable AI designs.

Field: User-Centred Design
Source: arXiv (Cornell University) (2023)
Method: Bibliometric and Qualitative Content Analysis
Sample: 1156 core articles
Evidence: Strong effect

Empirical research on trust in AI has predominantly relied on exploratory methods and has not sufficiently developed contextualized theoretical models, hindering a deep understanding of user reliance. This user-centred design research insight is drawn from a 2023 study published in arXiv (Cornell University). Using Bibliometric and qualitative content analysis with 1156 core articles, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Prioritize the development and application of context-specific theoretical frameworks for AI trust, moving beyond purely exploratory research to inform more robust and reliable AI designs.

Study

User-Centred DesignRecentStrong effect

AI Trust Research Lacks Contextual Models and Rigorous Methods

arXiv (Cornell University) · 2023

Key Findings

01A significant reliance on exploratory methodologies in AI trust research.
02A lack of contextualized theoretical models to explain trust in AI.
03Missing perspectives in global discussions on trust in AI.

Application

Design takeaway

Prioritize the development and application of context-specific theoretical frameworks for AI trust, moving beyond purely exploratory research to inform more robust and reliable AI designs.

How to apply

When designing AI systems, consider the specific context of use and the target user group to develop tailored trust-building strategies, rather than applying generic principles.

Project actions

01When researching user trust in your design project, think about the specific context and user group.
02Try to base your research on existing theories of trust, or develop a new one that fits your specific AI application.

Method & Evidence

AimWhat are the prevailing trends, overlooked issues, and future directions in empirical research on trust in Artificial Intelligence?

MethodBibliometric and Qualitative Content Analysis

ProcedureA comprehensive bibliometric analysis was conducted on over two decades of empirical research measuring trust in AI, followed by a qualitative content analysis of the core articles to identify trends, gaps, and future research needs.

Sample1156 core articles

ContextArtificial Intelligence (AI) systems, user interaction with technology

Variables

IV["Research methodology (e.g., exploratory vs. experimental)","Theoretical model (e.g., presence/absence, type of model)"]

DVLevel of user trust in AI

CV["AI application domain","User demographics","Specific AI features"]

Strengths & Limitations

Strengths

+Comprehensive bibliometric analysis covering a long period.
+Qualitative content analysis provides depth to the quantitative findings.

Limitations

The scope of the review might not capture all emerging research or niche applications of AI trust. The qualitative interpretation of findings can be subjective.

Reliability & validity

The reliability of the bibliometric analysis depends on the accuracy of the databases used. The validity of the qualitative findings relies on the systematic coding and interpretation by the researchers, which can be subject to bias.

Think critically

Given the identified lack of contextualized theoretical models, how can designers proactively develop and test their own context-specific trust frameworks for novel AI applications?

Design Principles

"Design for trust by grounding AI development in contextually relevant theoretical models and employing rigorous empirical validation."

For designers and engineers developing AI-powered products, understanding the nuances of user trust is paramount for successful adoption and safe interaction. A lack of robust, context-specific models means current design approaches may not adequately address the diverse factors influencing user confidence in AI systems.

What This Means for Your Design

Research on how much people trust AI has been going on for a long time, but it often uses simple methods and doesn't have clear theories for different situations, which makes it hard to know exactly how to build trustworthy AI.

How to use in your project

1.Use this research to justify the need for rigorous user testing and the development of context-specific design guidelines for AI trust in your design project.

Add to My Project

Quick Cite

Paragraph starter

This bibliometric review of AI trust research reveals a significant reliance on exploratory methodologies and a deficit in contextualized theoretical models. Consequently, designers must move beyond generic trust-building strategies and develop AI systems informed by context-specific theories and rigorous empirical validation to ensure user confidence and adoption.

Source

arXiv (Cornell University)

Twenty-Four Years of Empirical Research on Trust in AI: A Bibliometric Review of Trends, Overlooked Issues, and Future Directions

journal · 2023

View source

Questions About This Research

What does the research say about ai trust research lacks contextual models and rigorous methods?: Prioritize the development and application of context-specific theoretical frameworks for AI trust, moving beyond purely exploratory research to inform more robust and reliable AI designs. Evidence: arXiv (Cornell University) (2023).
Why does "AI Trust Research Lacks Contextual Models and Rigorous Methods" matter for design?: For designers and engineers developing AI-powered products, understanding the nuances of user trust is paramount for successful adoption and safe interaction. A lack of robust, context-specific models means current design approaches may not adequately address the diverse factors influencing user confidence in AI systems.
How can designers apply this research?: Prioritize the development and application of context-specific theoretical frameworks for AI trust, moving beyond purely exploratory research to inform more robust and reliable AI designs.
What were the main findings?: A significant reliance on exploratory methodologies in AI trust research.. A lack of contextualized theoretical models to explain trust in AI.. Missing perspectives in global discussions on trust in AI.
What research method was used?: Bibliometric and Qualitative Content Analysis with 1156 core articles.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2023 journal from arXiv (Cornell University).
What should I do differently in my next project?: When designing AI systems, consider the specific context of use and the target user group to develop tailored trust-building strategies, rather than applying generic principles.
What are the limitations?: The review is based on published research, potentially missing unpublished work or emerging trends not yet widely documented. The qualitative analysis is subject to the interpretations of the researchers.