User‐defined relevance criteria in web searching
- 1 November 2006
- journal article
- research article
- Published by Emerald in Journal of Documentation
- Vol. 62 (6), 685-707
- https://doi.org/10.1108/00220410610714921
Abstract
Purpose: The purpose of this paper is to specify user‐defined relevance criteria by which people select hyperlinks and pages in web searching.Design/methodology/approach: A quantitative and qualitative analysis was undertaken of talking aloud data from nine web searches conducted about self‐generated topics.Findings: Altogether 18 different criteria for selecting hyperlinks and web pages were found. The selection is constituted, by two, intertwined processes: the relevance judgment of hyperlinks, and web pages by user‐defined criteria, and decision‐making concerning the acceptance or rejection of hyperlinks and web pages. The study focuses on the former process. Of the individual criteria, specificity, topicality, familiarity, and variety were used most frequently in relevance judgments. The study shows that despite the high number of individual criteria used in the judgments, a few criteria such as specificity and topicality tend to dominate. Searchers were less critical in the judgment of hyperlinks than deciding whether the activated web pages should be consulted in more detail.Research limitations/implications: The study is exploratory, drawing on a relatively low number of case searches.Originality/value: The paper gives a detailed picture of the criteria used in the relevance judgments of hyperlinks and web pages. The study also discusses the specific nature of criteria used in web searching, as compared to those used in traditional online searching environments.Keywords
This publication has 26 references indexed in Scilit:
- How users assess Web pages for information seekingJournal of the American Society for Information Science and Technology, 2004
- On the Web at home: Information seeking and Web searching in the home environmentJournal of the American Society for Information Science and Technology, 2004
- Exploring users' video relevance criteria—A pilot studyProceedings of the American Society for Information Science and Technology, 2004
- The concept of relevance in IRJournal of the American Society for Information Science and Technology, 2003
- User perspectives on relevance criteria: A comparison among relevant, partially relevant, and not‐relevant judgmentsJournal of the American Society for Information Science and Technology, 2002
- Judgment of information quality and cognitive authority in the WebJournal of the American Society for Information Science and Technology, 2001
- Relevance judging, evaluation, and decision making in virtual libraries: A descriptive studyJournal of the American Society for Information Science and Technology, 2001
- Changes in relevance criteria and problem stages in task performanceJournal of Documentation, 2000
- Children's relevance criteria and information seeking on electronic resourcesJournal of the American Society for Information Science, 1999
- The Nature of Relevance in Information Retrieval: An Empirical StudyThe Library Quarterly, 1993