Optimal Search Strategies for Detecting Clinically Sound Prognostic Studies in EMBASE: An Analytic Survey
Open Access
- 31 August 2005
- journal article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 12 (4), 481-485
- https://doi.org/10.1197/jamia.m1752
Abstract
Background: Clinical end users of EMBASE have a difficult time retrieving articles that are both scientifically sound and directly relevant to clinical practice. Search filters have been developed to assist end users in increasing the success of their searches. Many filters have been developed for the literature on therapy and reviews for use in MEDLINE, but little has been done for use in EMBASE with no filter development for studies of prognosis. The objective of this study was to determine how well various methodologic textwords, index terms, and their Boolean combinations retrieve methodologically sound literature on the prognosis of health disorders in EMBASE. Methods: An analytic survey was conducted, comparing hand searches of 55 journals with retrievals from EMBASE for 4,843 candidate search terms and 8,919 combinations. All articles were rated using purpose and quality indicators, and clinically relevant prognostic articles were categorized as “pass” or “fail” according to explicit criteria for scientific merit. Candidate search strategies were run in EMBASE, the retrievals being compared with the hand search data. The sensitivity, specificity, precision, and accuracy of the search strategies were calculated. Results: Of the 1,064 articles about prognosis, 148 (13.9%) met basic criteria for scientific merit. Combinations of search terms reached peak sensitivities of 98.7% with specificity at 50.6%. Compared with best single terms, best multiple terms increased sensitivity for sound studies by 12.2% (absolute increase), while decreasing specificity (absolute decrease 5.1%) when sensitivity was maximized. Combinations of search terms reached peak specificities of 93.4% with sensitivity at 50.7%. Compared with best single terms, best multiple terms increased specificity for sound studies by 7.1% (absolute increase), while decreasing sensitivity (absolute decrease 8.8%) when specificity was maximized. Conclusion: Empirically derived search strategies combining indexing terms and textwords can achieve high sensitivity or specificity for retrieving sound prognostic studies from EMBASE.Keywords
This publication has 23 references indexed in Scilit:
- Text Categorization Models for High-Quality Article Retrieval in Internal MedicineJournal of the American Medical Informatics Association, 2004
- Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical surveyBMJ, 2004
- Clinicians' assessments of the usefulness of online evidence to answer clinical questions.2004
- Do Clinicians Use Online Evidence to Support Patient Care? A Study of 55,000 CliniciansJournal of the American Medical Informatics Association, 2003
- Identifying Diagnostic Studies in MEDLINE: Reducing the Number Needed to ReadJournal of the American Medical Informatics Association, 2002
- Publications on diagnostic test evaluation in family medicine journals: an optimal search strategyJournal of Clinical Epidemiology, 2000
- A Two-Term MEDLINE Search Strategy for Identifying Randomized Trials in Obstetrics and GynecologyObstetrics & Gynecology, 1998
- How Easy are Randomized Controlled Trials in Epilepsy to Find on Medline? The Sensitivity and Precision of Two Medline SearchesEpilepsia, 1996
- Developing Optimal Search Strategies for Detecting Clinically Sound Studies in MEDLINEJournal of the American Medical Informatics Association, 1994
- An investigation of the adequacy of MEDLINE searches for randomized controlled trials (RCTs) of the effects of mental health carePsychological Medicine, 1994