Google Scholar as replacement for systematic literature searches: Good relative recall and precision are not enough

BMC Medical Research Methodology

Volumn 13, Issue 1, 2013, Pages

  Boeker, Martin ^a   Vach, Werner ^a   Motschall, Edith ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Google Scholar; Information storage and retrieval; Literature search; Medline; Methods; Systematic

Indexed keywords

ALGORITHM; ARTICLE; DATA MINING; DOCUMENTATION; HUMAN; INTERNET; LITERATURE; MEDLINE; METHODOLOGY; SEARCH ENGINE; STANDARD;

ABSTRACTING AND INDEXING AS TOPIC; ALGORITHMS; DATA MINING; HUMANS; INTERNET; MEDLINE; REVIEW LITERATURE AS TOPIC; SEARCH ENGINE;

EID: 84886217588     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-13-131     Document Type: Article

References (54)

1. Errors in search strategies were identified by type and frequency. Sampson M, McGowan J, J Clin Epidemiol 2006 59 1057.e1 1057.e9
2. Reproducibility of literature search reporting in medical education reviews. Maggio LAM, Tannery NH, Kanter SL, Acad Med Aug 2011 2011 86 1049 1054
3. Semantically equivalent PubMed and Ovid-MEDLINE queries: different retrieval results because of database subset inclusion. Boeker M, Vach W, Motschall E, J Clin Epidemiol 2012 65 915 916 10.1016/j.jclinepi.2012.01.015 22640569
4. Lost in PubMed. Factors influencing the success of medical information retrieval. Vanopstal K, Buysschaert J, Laureys G, Vander Stichele R, Expert Syst Appl 2013 40 4106 4114 10.1016/j.eswa.2013.01.036
5. BEME guide No. 3: systematic searching for evidence in medical education-part 2: constructing searches. Haig A, Dozier M, Med Teach 2003 25 463 10.1080/01421590310001608667 14522667 (Pubitemid 37265644)
6. Searching for studies. Lefebrve C, Manheimer E, Glanville J, Cochrane handbook for systematic reviews of interventions Version 5.1.0, Higgins JP, Green S, 2008 1 21 The Cochrane Collaboration 2011. http://www.cochrane- handbook.org
7. Medical literature searches: a comparison of PubMed and Google scholar. Nourbakhsh E, Nugent R, Wang H, Cevik C, Nugent K, Health Info Libr J 2012 29 214 222 10.1111/j.1471-1842.2012.00992.x 22925384
8. Medizinreport: studien im fokus. Medizinisch-wissenschaftliche recherche: Google scholar ist PubMed möglicherweise überlegen. Heinzl S, Dtsch Arztebl 2012 109-2467
9. Is the coverage of Google scholar enough to be used alone for systematic reviews. Gehanno J-F, Rollin L, Darmoni S, BMC Med Inform Decis Mak 2013 13 7 10.1186/1472-6947-13-7 23302542
10. Ovaska T, Fiander M, Weightman A, BMC medical informatics and decision making-user comments-is the coverage of Google scholar enough to be used alone for systematic reviews 2013 http://www.biomedcentral.com/1472-6947/13/7/comments
11. Giustini D, Is Google scholar enough for SR searching? No.-The search principle: views are my own 2013 http://blogs.ubc.ca/dean/2013/01/is-google- scholar-enough-for-sr-searching-no/
12. Giustini D, More on using Google scholar for the systematic review-the search principle: views are my own 2013 http://blogs.ubc.ca/dean/2013/01/more- on-using-google-scholar-for-the-systematic-review/
13. Google scholar is not enough to be used alone for systematic reviews. Giustini D, Boulos MNK, Online J Public Health Informatics 2013 5 214
14. "Brimful of STARLITE": toward standards for reporting literature searches: toward standards for reporting literature searches. Booth A, J Med Libr Assoc 2006 94 421 e205 17082834
15. An evidence-based practice guideline for the peer review of electronic search strategies. Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C, J Clin Epidemiol 2009 62 944 952 10.1016/j.jclinepi.2008.10.012 19230612
16. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JPA, Clarke M, Devereaux PJ, Kleijnen J, Moher D, PLoS Med 2009 6 1000100 10.1371/journal.pmed.1000100 19621070
17. A catalogue of reporting guidelines for health research. Simera I, Moher D, Hoey J, Schulz KF, Altman DG, Eur J Clin Invest 2010 40 35 53 10.1111/j.1365-2362.2009.02234.x 20055895
18. Cochrane Editorial Unit, Methodological expectations of Cochrane intervention reviews (MECIR) 2013 http://www.editorial-unit.cochrane.org/mecir
19. An alternative to the hand searching gold standard: validating methodological search filters using relative recall. Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, Klassen TP, Moher D, BMC Med Res Methodol 2006 6 33 10.1186/1471-2288-6-33 16848895 (Pubitemid 44321469)
20. Simple search techniques in PubMed are potentially suitable for evaluating the completeness of systematic reviews. Waffenschmidt S, Janzen T, Hausner E, Kaiser T, J Clin Epidemiol 2013 66 660 665 10.1016/j.jclinepi.2012. 11.011 23419611
21. Antidepressants versus placebo for depression in primary care. Arroll B, Elley CR, Fishman T, Goodyear-Smith FA, Kenealy T, Blashki G, Kerse N, MacGillivray S, Cochrane Database Syst Rev 2009 3
22. Artemisinin-based combination therapy for treating uncomplicated malaria. Sinclair D, Zani B, Donegan S, Olliaro P, Garner P, Cochrane Database Syst Rev 2009 3
23. Brief interventions for heavy alcohol users admitted to general hospital wards. McQueen J, Howe TE, Allan L, Mains D, Hardy V, Cochrane Database of Syst Rev 2011 8
24. Combined DTP-HBV-HIB vaccine versus separately administered DTP-HBV and HIB vaccines for primary prevention of diphtheria, tetanus, pertussis, hepatitis B and haemophilus influenzae B (HIB). Bar-On ES, Goldberg E, Hellmann S, Leibovici L, Cochrane Database of Syst Rev 2012 4
25. Erythropoietin or darbepoetin for patients with cancer-meta-analysis based on individual patient data. Bohlius J, Schmidlin K, Brillant C, Schwarzer G, Trelle S, Seidenfeld J, Zwahlen M, Clarke MJ, Weingart O, Kluge S, Piper M, Napoli M, Rades D, Steensma D, Djulbegovic B, Fey MF, Ray-Coquard I, Moebus V, Thomas G, Untch M, Schumacher M, Egger M, Engert A, Cochrane Database of Syst Rev 2009 3
26. Green tea (camellia sinensis) for the prevention of cancer. Boehm K, Borrelli F, Ernst E, Habacher G, Hung SK, Milazzo S, Horneber M, Cochrane Database of Syst Rev 2009 3
27. Incentive spirometry for prevention of postoperative pulmonary complications in upper abdominal surgery. Guimarães MM, El Dib RP, Smith AF, Matos D, Cochrane Database of Syst Rev 2009 3
28. Interventions to prevent occupational noise-induced hearing loss. Verbeek JH, Kateman E, Morata TC, Dreschler WA, Mischke C, Cochrane Database of Syst Rev 2012 10
29. Non-pharmacological interventions for assisting the induction of anaesthesia in children. Yip P, Middleton P, Cyna AM, Carlyle AV, Cochrane Database of Syst Rev 2009 3
30. Oral iron supplements for children in malaria-endemic areas. Okebe JU, Yahav D, Shbita R, Paul M, Cochrane Database of Syst Rev 2011 10
31. Pharmacotherapy for anxiety disorders in children and adolescents. Ipser JC, Stein DJ, Hawkridge S, Hoppe L, Cochrane Database of Syst Rev 2009 3
32. Single dose oral Flurbiprofen for acute postoperative pain in adults. Sultan A, McQuay HJ, Moore RA, Derry S, Cochrane Database of Syst Rev 2009 3
33. The effects of antimicrobial therapy on bacterial vaginosis in non-pregnant women. Oduyebo OO, Anorlu RI, Ogunsola FT, Cochrane Database of Syst Rev 2009 3
34. Therapeutic interventions for symptomatic treatment in Huntington's disease. Mestre T, Ferreira J, Coelho MM, Rosa M, Sampaio C, Cochrane Database of Syst Rev 2009 3
35. Google scholar search performance: comparative recall and precision. Walters WH, portal: Libr and the Acad 2008 9 5 24 10.1353/pla.0.0034
36. Accuracy and completeness of publication and citation records in the Web of science, PsycINFO, and Google scholar: a case study for the computation of h indices in psychology. García-Pérez MA, J Am Soc Inf Sci Technol 2010 61 2070 2085 10.1002/asi.21372
37. Comparison of PubMed, Scopus, Web of science, and Google scholar: strengths and weaknesses. Falagas ME, Pitsouni EI, Malietzis GA, Pappas G, FASEB J 2008 22 338 342 17884971 (Pubitemid 351225599)
38. Comparisons of citations in Web of science, Scopus, and Google scholar for articles published in general medical journals. Kulkarni AV, Aziz B, Shams I, Busse JW, JAMA 2009 302 1092 1096 10.1001/jama.2009.1307 19738094
39. An exploratory study of Google scholar. Mayr P, Walter A-K, Online Inf Rev 2007 31 814 830 10.1108/14684520710841784 (Pubitemid 350174495)
40. Google Inc, About Google scholar 2013 http://www.google.com/intl/en/ scholar/about.html
41. Selecting studies and collecting data. Higgins JP, Deeks JJ, Cochrane handbook for systematic reviews of interventions: John Wiley & Sons, Ltd, Higgins JP, Green S, 510 2011 1 21
42. As we may search-comparison of major features of the Web of science, Scopus, and Google scholar citation-based and citation-enhanced databases. Jasco P, Curr Sci 2005 89 1537 1547
43. The Cochrane Collaboration, The Cochrane Library. Independent high-quality evidence for health care decision making 2013 http://www. thecochranelibrary.com/view/0/index.html
44. Unpacking your literature search toolbox: on search styles and tactics. Booth A, Health Info Libr J 2008 25 313 317 10.1111/j.1471-1842.2008.00825.x 19076679
45. Developing search strategies for clinical practice guidelines in SUMSearch and Google scholar and assessing their retrieval performance. Haase A, Follmann M, Skipka G, Kirchner H, BMC Med Res Methodol 2007 7 28 10.1186/1471-2288-7-28 17603909 (Pubitemid 47096608)
46. Retrieving clinical evidence: a comparison of PubMed and Google scholar for quick clinical searches. Shariff SZ, Bejaimal SA, Sontrop JM, Iansavichus AV, Haynes RB, Weir MA, Garg AX, J Med Internet Res 2013 15 164 10.2196/jmir.2624 23948488
47. Reflections on medical literature searches: letters to the editor. Sharma P, Transfusion 2013 53 1858 1861 10.1111/trf.12247 23927639
48. Comparing test searches in PubMed and Google scholar. Shultz M, J Med Libr Assoc 2007 95 442 445 10.3163/1536-5050.95.4.442 17971893 (Pubitemid 350106793)
49. Systematic reviews need systematic searchers. McGowan J, Sampson M, J Med Libr Assoc 2005 93 74 80 15685278 (Pubitemid 41711169)
50. Comparison of PubMed and Google scholar literature searches. Anders ME, Evans DP, Respir care 2010 55 578 583 20420728
51. Precision of healthcare systematic review searches in a cross-sectional sample. Sampson M, Tetzlaff J, Urquhart C, Res Synthesis Methods 2011 2 119 125 10.1002/jrsm.42
52. How much searching is enough? Comprehensive versus optimal retrieval for technology assessments. Booth A, Int J Technol Assess Health Care 2010 26 431 435 10.1017/S0266462310000966 20923586
53. Semi-automated screening of biomedical citations for systematic reviews. Wallace BC, Trikalinos TA, Lau J, Brodley C, Schmid CH, BMC Bioinformatics 2010 11 1 11 10.1186/1471-2105-11-1 20043860
54. A look at Google scholar, PubMed, and scirus: comparisons and recommendations. Giustini D, Barsky E, J Can Health Libr Assoc 2005 26 85 89 10.5596/c05-030