Short answer

Prioritize clear and trustworthy presentation of search results, as users often rely on ranking as a proxy for quality and authority.

Field: User-Centred Design
Source: Journal of the American Society for Information Science and Technology (2001)
Method: Mixed-methods research combining verbal protocols, search logs, and post-search interviews.
Sample: 15 participants
Evidence: Strong effect

The position of a search result directly impacts how users evaluate its credibility and usefulness, even before they engage with the content. This user-centred design research insight is drawn from a 2001 study published in Journal of the American Society for Information Science and Technology. Using Mixed-methods research combining verbal protocols, search logs, and post-search interviews. with 15 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Prioritize clear and trustworthy presentation of search results, as users often rely on ranking as a proxy for quality and authority.

Study

User-Centred DesignHigh ImpactStrong effect

Web search result ranking significantly influences user perception of information quality and authority.

The position of a search result directly impacts how users evaluate its credibility and usefulness, even before they engage with the content.

Journal of the American Society for Information Science and Technology · 2001

Key Findings

01Users make two types of judgments: predictive (anticipating quality) and evaluative (assessing quality after initial review).
02Factors influencing these judgments include information object characteristics, source characteristics, user knowledge, situational context, and search result ranking.
03Search result ranking is a significant factor in perceived quality and authority.

Application

Design takeaway

Prioritize clear and trustworthy presentation of search results, as users often rely on ranking as a proxy for quality and authority.

How to apply

When designing interfaces that present lists of information (e.g., search results, product listings, news feeds), consider how the order and visual presentation can influence user perception of credibility.

Project actions

01Consider how the order of elements in your design might influence user judgment.
02Think about how to visually communicate the credibility of information sources within your design.

Method & Evidence

AimTo understand the factors influencing users' judgments of information quality and authority on the Web and the impact of these judgments on selection behaviors.

MethodMixed-methods research combining verbal protocols, search logs, and post-search interviews.

ProcedureFifteen scholars from various disciplines performed web searches while verbalizing their thought processes. Their search activities were logged, and they were interviewed afterward to gather insights into their judgments of information quality and authority.

Sample15 participants

ContextWeb information retrieval and user search behavior.

Variables

IVRanking of search results, characteristics of information objects, characteristics of sources, user knowledge, situational context.

DVUser judgment of information quality, user judgment of cognitive authority, selection behavior.

CVParticipant discipline (controlled for diversity), task type (web search).

Strengths & Limitations

Strengths

+Utilized a mixed-methods approach for rich data collection.
+Involved expert users from diverse disciplines.

Limitations

The study was conducted in 2001, and web search technologies and user behaviors have evolved significantly since then.

Reliability & validity

The use of multiple data sources (verbal protocols, logs, interviews) enhances the validity of the findings. Reliability would depend on the consistency of judgments across similar information types and user profiles.

Think critically

How might the evolution of search engine algorithms and the rise of social media 'fake news' challenge or reinforce the findings of this study regarding user judgment of information quality and authority?

Design Principles

"Information presented earlier in a user's interaction is perceived with higher authority and quality."

Understanding how users perceive information quality and authority is crucial for designing effective information retrieval systems and digital interfaces. Designers can leverage this knowledge to improve user trust and satisfaction by optimizing how information is presented and ranked.

What This Means for Your Design

How search results are ordered matters a lot! People tend to trust information that appears higher up on a search page more, even before they read it.

How to use in your project

1.This study can inform the justification for prioritizing certain information or design elements in your project based on user perception of authority and quality.

Add to My Project

Quick Cite

Paragraph starter

Research by Rieh (2001) highlights that the ranking of search results significantly influences users' judgments of information quality and authority. This suggests that the order in which information is presented in a design can act as a heuristic for credibility, impacting user trust and selection behavior. Therefore, design decisions regarding information hierarchy and presentation order should consider the psychological implications for user perception.

Source

Journal of the American Society for Information Science and Technology

Judgment of information quality and cognitive authority in the Web

journal · 2001

View source

Questions About This Research

What does the research say about web search result ranking significantly influences user perception of information quality and authority?: Prioritize clear and trustworthy presentation of search results, as users often rely on ranking as a proxy for quality and authority. Evidence: Journal of the American Society for Information Science and Technology (2001).
Why does "Web search result ranking significantly influences user perception of information quality and authority." matter for design?: Understanding how users perceive information quality and authority is crucial for designing effective information retrieval systems and digital interfaces. Designers can leverage this knowledge to improve user trust and satisfaction by optimizing how information is presented and ranked.
How can designers apply this research?: Prioritize clear and trustworthy presentation of search results, as users often rely on ranking as a proxy for quality and authority.
What were the main findings?: Users make two types of judgments: predictive (anticipating quality) and evaluative (assessing quality after initial review).. Factors influencing these judgments include information object characteristics, source characteristics, user knowledge, situational context, and search result ranking.. Search result ranking is a significant factor in perceived quality and authority.
What research method was used?: Mixed-methods research combining verbal protocols, search logs, and post-search interviews. with 15 participants.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2001 journal from Journal of the American Society for Information Science and Technology.
What should I do differently in my next project?: When designing interfaces that present lists of information (e.g., search results, product listings, news feeds), consider how the order and visual presentation can influence user perception of credibility.
What are the limitations?: The study focused on academic users, and their search behaviors and judgment criteria might differ from the general population. The Web environment in 2001 was also less sophisticated than today's.