Sensitivity and predictive value of 15 PubMed search strategies to answer clinical questions rated against full systematic reviews

Journal of Medical Internet Research

Volumn 14, Issue 3, 2012, Pages

  Agoritsas, Thomas ^a   Merglen, Arnaud ^a   Courvoisier, Delphine S ^a,b   Combescure, Christophe ^a   Garin, Nicolas ^a   Perrier, Arnaud ^a   Perneger, Thomas V ^a  

^a GENEVA UNIVERSITY HOSPITALS   (Switzerland)

^b HARVARD UNIVERSITY   (United States)

Author keywords

Clinical queries; Evidence based medicine; Information retrieval; Medical literature; Medline; Positive predictive value; Precision; PubMed; Recall; Search filters; Search strategy; Sensitivity

Indexed keywords

INFORMATION RETRIEVAL; MEDLINE; META ANALYSIS; REVIEW;

INFORMATION STORAGE AND RETRIEVAL; PUBMED;

EID: 84864217968     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.2021     Document Type: Conference Paper

References (46)

1. Straus SE, Richardson WS, Glasziou P, Haynes RB. Evidence-Based Medicine: How to Practice and Teach EBM. 3rd edition. Edinburgh: Elsevier/Churchill Livingstone; 2005.
2. González-González AI, Dawes M, Sánchez-Mateos J, Riesgo-Fuertes R, Escortell-Mayor E, Sanz-Cuesta T, et al. Information needs and information-seeking behavior of primary care physicians. Ann Fam Med 2007;5(4):345-352 [FREE Full text] [doi: 10.1370/afm.681] [Medline: 17664501] (Pubitemid 47294851)
3. Green ML, Ciampi MA, Ellis PJ. Residents' medical information needs in clinic: are they being met? Am J Med 2000 Aug 15;109(3):218-223. [Medline: 10974185]
4. Graber MA, Randles BD, Ely JW, Monnahan J. Answering clinical questions in the ED. Am J Emerg Med 2008 Feb;26(2):144-147. [doi: 10.1016/j.ajem.2007.03. 031] [Medline: 18272092] (Pubitemid 351215768)
5. Straus SE, McAlister FA. Evidence-based medicine: a commentary on common criticisms. CMAJ 2000 Oct 3;163(7):837-841. [Medline: 11033714]
6. Glasziou P, Burls A, Gilbert R. Evidence based medicine and the medical curriculum. BMJ 2008;337:a1253. [Medline: 18815165]
7. US National Library of Medicine, National Institutes of Health. PubMed URL: http://www.ncbi.nlm.nih.gov/sites/entrez?otool=ichbfmglib [accessed 2011-11-30] [WebCite Cache ID 63a0b5P6K]
8. Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med 2010 Sep;7(9):e1000326 [FREE Full text] [doi: 10.1371/journal.pmed.1000326] [Medline: 20877712]
9. Haynes RB. Of studies, syntheses, synopses, summaries, and systems: the "5S" evolution of information services for evidence-based healthcare decisions. Evid Based Med 2006 Dec;11(6):162-164. [doi: 10.1136/ebm.11.6.162-a] [Medline: 17213159] (Pubitemid 46001939)
10. UpToDate, Inc. 2011. Helping Clinicians Provide the Best Patient Care URL: http://www.uptodate.com/index [accessed 2011-11-30] [WebCite Cache ID 63a0n7Fqj]
11. Thiele RH, Poiro NC, Scalzo DC, Nemergut EC. Speed, accuracy, and confidence in Google, Ovid, PubMed, and UpToDate: results of a randomised trial. Postgrad Med J 2010 Aug;86(1018):459-465. [doi: 10.1136/pgmj.2010.098053] [Medline: 20709767]
12. Hoogendam A, Stalenhoef AF, Robbé PF, Overbeke AJ. Answers to questions posed during daily patient care are more likely to be answered by UpToDate than PubMed. J Med Internet Res 2008;10(4):e29 [FREE Full text] [doi: 10.2196/jmir.1012] [Medline: 18926978]
13. Banzi R, Cinquini M, Liberati A, Moschetti I, Pecoraro V, Tagliabue L, et al. Speed of updating online evidence based point of care summaries: prospective cohort analysis. BMJ 2011;343:d5856 [FREE Full text] [Medline: 21948588]
14. Haynes RB. ACP Journal Club: the best new evidence for patient care. ACP J Club 2008 May 20;148(3):2. [Medline: 18489065]
15. Patel MR, Schardt CM, Sanders LL, Keitz SA. Randomized trial for answers to clinical questions: evaluating a pre-appraised versus a MEDLINE search protocol. J Med Libr Assoc 2006 Oct;94(4):382-387. [Medline: 17082828]
16. Bonis PA, Pickens GT, Rind DM, Foster DA. Association of a clinical knowledge support system with improved patient safety, reduced complications and shorter length of stay among Medicare beneficiaries in acute care hospitals in the United States. Int J Med Inform 2008 Nov;77(11):745-753. [doi: 10.1016/j.ijmedinf.2008.04.002] [Medline: 18565788]
17. McKibbon KA, Fridsma DB. Effectiveness of clinician-selected electronic information resources for answering primary care physicians' information needs. J Am Med Inform Assoc 2006;13(6):653-659 [FREE Full text] [doi: 10.1197/jamia.M2087] [Medline: 16929042] (Pubitemid 44648760)
18. Schilling LM, Steiner JF, Lundahl K, Anderson RJ. Residents' patient-specific clinical questions: opportunities for evidence-based learning. Acad Med 2005 Jan;80(1):51-56. [Medline: 15618093] (Pubitemid 40075736)
19. Shariff SZ, Bejaimal SA, Sontrop JM, Iansavichus AV, Weir MA, Haynes RB, et al. Searching for medical information online: a survey of Canadian nephrologists. J Nephrol 2011;24(6):723-732. [doi: 10.5301/JN.2011.6373] [Medline: 21360475]
20. Herskovic JR, Tanaka LY, Hersh W, Bernstam EV. A day in the life of PubMed: analysis of a typical day's query log. J Am Med Inform Assoc 2007;14(2):212-220 [FREE Full text] [doi: 10.1197/jamia.M2191] [Medline: 17213501] (Pubitemid 46275489)
21. Hoogendam A, Stalenhoef AF, Robbé PF, Overbeke AJ. Analysis of queries sent to PubMed at the point of care: observation of search behaviour in a medical teaching hospital. BMC Med Inform Decis Mak 2008;8:42 [FREE Full text] [doi: 10.1186/1472-6947-8-42] [Medline: 18816391]
22. Webster AC, Cross NB, Mitchell R, Craig JC. How to get the most from the medical literature: searching the medical literature effectively. Nephrology (Carlton) 2010 Feb;15(1):12-19. [doi: 10.1111/j.1440-1797.2009.01263.x] [Medline: 20377765]
23. Doig GS, Simpson F. Efficient literature searching: a core skill for the practice of evidence-based medicine. Intensive Care Med 2003 Dec;29(12):2119-2127. [doi: 10.1007/s00134-003-1942-5] [Medline: 12955188] (Pubitemid 38030660)
24. Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med Inform Decis Mak 2007;7:16 [FREE Full text] [doi: 10.1186/1472-6947-7-16] [Medline: 17573961]
25. US National Library of Medicine, National Institutes of Health. PubMed Limits URL: http://www.ncbi.nlm.nih.gov/pubmed/ limits [accessed 2011-11-30] [WebCite Cache ID 63a11ZmDN]
26. US National Library of Medicine, National Institutes of Health. PubMed Clinical Queries URL: http://www.ncbi.nlm.nih.gov/pubmed/clinical [accessed 2011-11-30] [WebCite Cache ID 63a17P1uh]
27. Haynes RB, McKibbon KA, Wilczynski NL, Walter SD, Werre SR, Hedges Team. Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey. BMJ 2005 May 21;330(7501):1179. [doi: 10.1136/bmj.38446.498542.8F] [Medline: 15894554]
28. US National Library of Medicine, National Institutes of Health. 2011 Nov 8. Abridged Index Medicus (AIM or "Core Clinical") Journal Titles URL: http://www.nlm.nih.gov/bsd/aim.html [accessed 2011-11-30] [WebCite Cache ID 63a1LosQL]
29. Stark R, Helenius IM, Schimming LM, Takahara N, Kronish I, Korenstein D. Real-time EBM: from bed board to keyboard and back. J Gen Intern Med 2007 Dec;22(12):1656-1660. [doi: 10.1007/s11606-007-0387-x] [Medline: 17922170] (Pubitemid 350160338)
30. Gruppen LD, Rana GK, Arndt TS. A controlled comparison study of the efficacy of training medical students in evidence-based medicine literature searching skills. Acad Med 2005 Oct;80(10):940-944. [Medline: 16186614] (Pubitemid 41376927)
31. Hoogendam A, de Vries Robbé PF, Stalenhoef AF, Overbeke AJ. Evaluation of PubMed filters used for evidence-based searching: validation using relative recall. J Med Libr Assoc 2009 Jul;97(3):186-193. [doi: 10.3163/1536-5050.97.3.007] [Medline: 19626144]
32. Kastner M, Wilczynski NL, McKibbon AK, Garg AX, Haynes RB. Diagnostic test systematic reviews: bibliographic search filters ("Clinical Queries") for diagnostic accuracy studies perform well. J Clin Epidemiol 2009 Sep;62(9):974-981. [doi: 10.1016/j.jclinepi.2008.11.006] [Medline: 19230607]
33. Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, et al. An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Med Res Methodol 2006;6:33 [FREE Full text] [doi: 10.1186/1471-2288-6-33] [Medline: 16848895]
34. Delaney A, Bagshaw SM, Ferland A, Laupland K, Manns B, Doig C. The quality of reports of critical care meta-analyses in the Cochrane Database of Systematic Reviews: an independent appraisal. Crit Care Med 2007 Feb;35(2):589-594. [doi: 10.1097/01.CCM.0000253394.15628.FD] [Medline: 17205029] (Pubitemid 46148553)
35. Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M, et al. Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. JAMA 1998 Jul 15;280(3):278-280. [Medline: 9676681] (Pubitemid 28493907)
36. Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med 2007 Mar 27;4(3):e78 [FREE Full text] [doi: 10.1371/journal.pmed.0040078] [Medline: 17388659]
37. The Cochrane Collaboration. John Wiley & Sons, Inc. 2012. The Cochrane Library: Advanced Search URL: http://onlinelibrary.wiley.com/o/ cochrane/mainSearch?action=displayForm [accessed 2012-05-21] [WebCite Cache ID 67ppfvtsm]
38. Poole P, Black PN. Mucolytic agents for chronic bronchitis or chronic obstructive pulmonary disease. Cochrane Database Syst Rev 2010(2): CD001287. [doi: 10.1002/14651858.CD001287.pub3] [Medline: 20166060]
39. McKibbon KA, Wilczynski NL, Haynes RB, Hedges Team. Retrieving randomized controlled trials from medline: a comparison of 38 published search filters. Health Info Libr J 2009 Sep;26(3):187-202. [doi: 10.1111/j.1471-1842.2008.00827. x] [Medline: 19712211]
40. Higgins J, Green S.e. The Cochrane Collaboration. 2011 Mar. Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0, Section 6.4.2, Structure of a Search Strategy URL: http://www.cochrane-handbook.org/ [accessed 2012-05-16] [WebCite Cache ID 67i0XLLQh]
41. Lin J, Wilbur WJ. PubMed related articles: a probabilistic topic-based model for content similarity. BMC Bioinformatics 2007;8:423 [FREE Full text] [doi: 10.1186/1471-2105-8-423] [Medline: 17971238]
42. R Development Core Team. R Foundation for Statistical Computing. 2008. The R Project for Statistical Computing URL: http://www.r-project.org/ [accessed 2011-11-30] [WebCite Cache ID 63a1mUGlw]
43. Hersh WR, Crabtree MK, Hickam DH, Sacherek L, Friedman CP, Tidmarsh P, et al. Factors associated with success in searching MEDLINE and applying evidence to answer clinical questions. J Am Med Inform Assoc 2002;9(3):283-293 [FREE Full text] [Medline: 11971889] (Pubitemid 34975822)
44. Vakkari P, Huuskonen S. Search effort degrades search output but improves task outcome. J Am Soc Inf Sci Technol 2012;63(4):657-670. [doi: 10.1002/asi.21683]
45. Shariff SZ, Cuerden MS, Haynes RB, McKibbon KA, Wilczynski NL, Iansavichus AV, et al. Evaluating the impact of MEDLINE filters on evidence retrieval: study protocol. Implement Sci 2010;5:58 [FREE Full text] [doi: 10.1186/1748-5908-5-58] [Medline: 20646295]
46. Garg AX, Iansavichus AV, Wilczynski NL, Kastner M, Baier LA, Shariff SZ, et al. Filtering Medline for a clinical discipline: diagnostic test assessment framework. BMJ 2009;339:b3435 [FREE Full text] [Medline: 19767336]