Short answer

Prioritize clear, intuitive ranking and presentation of search results to positively influence user judgment of information quality and authority.

Field: User-Centred Design
Source: Journal of the American Society for Information Science and Technology (2002)
Method: Qualitative and Quantitative Analysis
Sample: 15 participants
Evidence: Strong effect

The position of a search result directly impacts how users judge its credibility and usefulness, often overriding deeper content evaluation. This user-centred design research insight is drawn from a 2002 study published in Journal of the American Society for Information Science and Technology. Using Qualitative and quantitative analysis with 15 participants, researchers explored how this design variable affects real-world outcomes. The key design takeaway: Prioritize clear, intuitive ranking and presentation of search results to positively influence user judgment of information quality and authority.

Study

User-Centred DesignHigh ImpactStrong effect

Web search result ranking significantly influences user perception of information quality and authority.

The position of a search result directly impacts how users judge its credibility and usefulness, often overriding deeper content evaluation.

Journal of the American Society for Information Science and Technology · 2002

Key Findings

01Users make two types of judgments: predictive (anticipating quality) and evaluative (assessing quality).
02Factors influencing these judgments include information object characteristics, source characteristics, user knowledge, situational context, and search result ranking.

Application

Design takeaway

Prioritize clear, intuitive ranking and presentation of search results to positively influence user judgment of information quality and authority.

How to apply

When designing search interfaces or presenting lists of information, carefully consider the visual hierarchy and ordering of items. Test different ranking strategies to see how they affect user perception and task completion.

Project actions

01When evaluating search results or lists, consider how the order might be influencing your own judgment.
02Think about how you can make the most important or relevant information stand out visually.

Method & Evidence

AimWhat factors influence users' judgments of information quality and authority when searching the web, and how do these judgments affect their selection behavior?

MethodQualitative and Quantitative Analysis

ProcedureResearchers observed participants' web searching behavior, collected verbal protocols during searches, analyzed search logs, and conducted post-search interviews with scholars from various disciplines.

Sample15 participants

ContextWeb information retrieval and user search behavior

Variables

IVPosition of search result, characteristics of information objects, characteristics of sources, user knowledge, situational context.

DVUser judgment of information quality and authority, user selection behavior.

CVParticipant's disciplinary background (though diverse, it's a characteristic of the sample).

Strengths & Limitations

Strengths

+Uses a mixed-methods approach combining observation, logs, and interviews for rich data.
+Involves expert users (scholars) to understand complex information-seeking behaviors.

Limitations

The specific search engines and web content used in the study are likely outdated, and user behavior may have changed with newer technologies.

Reliability & validity

The use of multiple data sources (verbal protocols, logs, interviews) enhances the validity of the findings. Reliability would depend on the consistency of user judgments across similar search tasks.

Think critically

To what extent has the evolution of search engine algorithms and user familiarity with online information changed the dynamics of information quality judgment since this study was conducted?

Design Principles

"The principle of perceived authority: Users often defer to information that appears authoritative or is presented in a way that suggests authority, such as high ranking in search results."

In digital design, understanding how users process information is crucial for creating effective interfaces. This insight highlights the power of presentation and ranking in shaping user trust and decision-making, which is vital for any platform that relies on users finding and acting upon information.

What This Means for Your Design

Where you put information in a list matters a lot to people – they often think the top results are the best, even without reading them closely.

How to use in your project

1.Reference this study when discussing how users interact with search functions or information displays in your design project.

Add to My Project

Quick Cite

Paragraph starter

Research indicates that the ranking of search results significantly influences users' judgments of information quality and authority. For instance, Rieh (2002) found that users often make predictive and evaluative judgments based on factors such as information object characteristics, source credibility, and crucially, the position of the result within the search output. This suggests that design choices related to information hierarchy and presentation order can directly impact user trust and their subsequent selection behaviors.

Source

Journal of the American Society for Information Science and Technology

Judgment of information quality and cognitive authority in the Web

journal · 2002

View source

Questions About This Research

What does the research say about web search result ranking significantly influences user perception of information quality and authority?: Prioritize clear, intuitive ranking and presentation of search results to positively influence user judgment of information quality and authority. Evidence: Journal of the American Society for Information Science and Technology (2002).
Why does "Web search result ranking significantly influences user perception of information quality and authority." matter for design?: In digital design, understanding how users process information is crucial for creating effective interfaces. This insight highlights the power of presentation and ranking in shaping user trust and decision-making, which is vital for any platform that relies on users finding and acting upon information.
How can designers apply this research?: Prioritize clear, intuitive ranking and presentation of search results to positively influence user judgment of information quality and authority.
What were the main findings?: Users make two types of judgments: predictive (anticipating quality) and evaluative (assessing quality).. Factors influencing these judgments include information object characteristics, source characteristics, user knowledge, situational context, and search result ranking.
What research method was used?: Qualitative and Quantitative Analysis with 15 participants.
How strong is the evidence?: Evidence strength is rated Strong effect, based on a 2002 journal from Journal of the American Society for Information Science and Technology.
What should I do differently in my next project?: When designing search interfaces or presenting lists of information, carefully consider the visual hierarchy and ordering of items. Test different ranking strategies to see how they affect user perception and task completion.
What are the limitations?: The study focused on academic users, and findings might differ for general internet users. The web environment has evolved significantly since 2002.