The role of google scholar in evidence reviews and its applicability to grey literature searching

PLoS ONE

Volumn 10, Issue 9, 2015, Pages

  Haddaway, Neal Robert ^a   Collins, Alexandra Mary ^b,c   Coughlin, Deborah ^b,c   Kirk, Stuart ^c,d  

^a ROYAL SWEDISH ACADEMY OF SCIENCES   (Sweden)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

^c Food and Rural Affairs   (United Kingdom)

^d ENVIRONMENT AGENCY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ATTENTION; HUMAN; HUMAN EXPERIMENT; INFORMATION RETRIEVAL; ORGANIZATION; SYSTEMATIC REVIEW; WEB OF SCIENCE; BIBLIOGRAPHIC DATABASE; FACTUAL DATABASE; INTERNET; PEER REVIEW; PUBLICATION; SCIENCE; SEARCH ENGINE;

DATABASES, BIBLIOGRAPHIC; DATABASES, FACTUAL; HUMANS; INTERNET; PEER REVIEW, RESEARCH; PUBLICATIONS; SCIENCE; SEARCH ENGINE;

EID: 84945551837     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0138237     Document Type: Article

References (35)

1. Larsen PO, von Ins M. The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index. Scientometrics. 2010; 84:575-603. doi: 10.1007/s11192-010-0202-z PMID: 20700371
2. Pautasso M. Publication Growth in Biological Sub-Fields: Patterns, Predictability and Sustainability. Sustainability. 2012; 4:3234-3247.
3. Noorden RV. Open access: The true cost of science publishing. Nature. 2013; 495:426-429. doi: 10. 1038/495426a PMID: 23538808
4. Khabsa M, Giles CL. The number of scholarly documents on the public web. PLOS ONE. 2014; 9: e93949. doi: 10.1371/journal.pone.0093949 PMID: 24817403
5. Collaboration for Environmental Evidence (CEE). Guidelines for Systematic Review and Evidence Synthesis in Environmental Management. Version 4.2. 2013. Environmental Evidence: www. environmentalevidence.org/Documents/Guidelines/Guidelines4.2.pdf
6. Collins A, Miller J, Coughlin D, Kirk S. The Production of Quick Scoping Reviews and Rapid Evidence Assessments: A How to Guide - Joint Water Evidence Group. 2014: Beta Version 2.
7. Conservation Evidence. Synopses Methods. 2015. Available: http://conservationevidence.com/site/page?view=methods. Accessed 2015 Feb 24.
8. Bernes C, Carpenter SR, Gårdmark A, Larsson P, Persson L, Skov C, et al. What is the influence on water quality in temperate eutrophic lakes of a reduction of planktivorous and benthivorous fish? A systematic review. Env Evid. 2015; 2:9.
9. Haddaway NR, Bayliss HR. Retrieving data for ecological syntheses: a grey area. Biol Cons. 2015. doi: 10.1016/j.biocon.2015.08.018
10. Jennions MD, Møller AP. Publication bias in ecology and evolution: an empirical assessment using the 'trim and fill' method. Biol Rev Camb Philos Soc. 2002; 77:211-222. PMID: 12056747
11. Boeker M, Vach W, Motschall E. Google Scholar as replacement for systematic literature searches: good relative recall and precision are not enough. BMC Med Res Methodol. 2013; 13:131. doi: 10. 1186/1471-2288-13-131 PMID: 24160679
12. De Winter JC, Zadpoor AA, Dodou D. The expansion of Google Scholar versus Web of Science: a longitudinal study. Scientometrics 2014; 98:1547-1565.
13. Gehanno JF, Rollin L, Darmoni S. Is the coverage of Google Scholar enough to be used alone for systematic reviews. BMC Med Inform Decis Mak. 2013; 13:7. doi: 10.1186/1472-6947-13-7 PMID: 23302542
14. Giustini D, Kamel Boulos MN. Google Scholar is not enough to be used alone for systematic reviews. Online J Public Health Inform. 2013; 5:214. doi: 10.5210/ojphi.v5i2.4623 PMID: 23923099
15. Delgado López-Cózar E, Robinson-García N, Torres-Salinas D. The Google Scholar Experiment: how to index false papers and manipulate bibliometric indicators. J Assoc Inf Sci Technol. 2014; 65:446-454.
16. Haddaway NR. The Use of Web-scraping Software in Searching for Grey Literature. The Grey Journal. In press.
17. Shultz M. Comparing test searches in PubMed and Google Scholar. Journal of the Medical Library Association: JMLA. 2007; 95:442-445. PMID: 17971893
18. Reed J, Deakin L, Sunderland T. What are 'Integrated Landscape Approaches' and how effectively have they been implemented in the tropics: a systematic map protocol. 2015; 4:2.
19. Hughes KM, Kaiser MJ, Jennings S, McConnaughey RA, Pitcher R, Hilborn R, et al. Investigating the effects of mobile bottom fishing on benthic biota: a systematic review protocol. Env Evid. 2014; 3:23.
20. Roe D, Fancourt M, Sandbrook C, Sibanda M, Giuliani A, Gordon-Maclean A. Which components or attributes of biodiversity influence which dimensions of poverty. Env Evid. 2014; 3:3.
21. Garcia-Yi J, Lapikanonth T, Vionita H, Vu H, Yang S, Zhong Y, et al. What are the socio-economic impacts of genetically modified crops worldwide? A systematic map protocol. Env Evid. 2014; 3:24.
22. Jacso P. As we may search-Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases. Curr Sci Bangalore. 2005: 89;1537.
23. Falagas ME, Pitsouni EI, Malietzis GA, Pappas G. Comparison of PubMed, Scopus, web of science, and Google scholar: strengths and weaknesses. FASEB. 2008; 22:338-342.
24. Shariff SZ, Bejaimal SAD, Sontrop JM, Iansavichus AV, Haynes RB, Weir MA, et al. Retrieving clinical evidence: a comparison of PubMed and Google Scholar for quick clinical searches. J Med Internet Res. 2013; 15:e164. doi: 10.2196/jmir.2624 PMID: 23948488
25. Haddaway NR, Burden A, Evans CD, Healey JR, Jones DL, Dalrymple SE, et al. Evaluating effects of land management on greenhouse gas fluxes and carbon balances in boreo-temperate lowland peatland systems. Env Evid. 2014; 3:5.
26. Savilaakso S, Garcia C, Garcia-Ulloa J, Ghazoul J, Groom M, Guariguata MR, et al. Systematic review of effects on biodiversity from oil palm production. Env Evid. 2014; 3:1-21.
27. Sciberras M, Jenkins SR, Kaiser MJ, Hawkins SJ, Pullin AS. Evaluating the biological effectiveness of fully and partially protected marine areas. Env Evid. 2013; 2:1-31.
28. Pullin AS, Bangpan M, Dalrymple S, Dickson K, Haddaway NR, Healey JR, et al. Human well-being impacts of terrestrial protected areas. Env Evid. 2013; 2:19.
29. Haddaway NR, Styles D, Pullin AS. Evidence on the environmental impacts of farm land abandonment in high altitude/mountain regions: a systematic map. Env Evid. 2014; 3:17.
30. Whitlock R, Stewart GB, Goodman SJ, Piertney SB, Butlin RK, Pullin AS, et al. A systematic review of phenotypic responses to between-population outbreeding. Env Evid. 2013; 2:13.
31. Bernes C, Bråthen KA, Forbes BC, Speed JDM, Moen J. What are the impacts of reindeer/caribou (Rangifer tarandus L.) on arctic and alpine vegetation? Env Evid. 2015; 4:4.
32. Banks MA. The excitement of Google Scholar, the worry of Google Print. Biomed Digit Libr. 2005; 2:2. doi: 10.1186/1742-5581-2-2 PMID: 15784147
33. Anders ME, Evans DP. Comparison of PubMed and Google Scholar literature searches. Respir Care. 2010; 55:578-83. PMID: 20420728
34. Gurevitch J, Hedges LV. Statistical issues in ecological meta-analyses. Ecology. 1999; 80:1142-1149.
35. Haddaway NR, Bayliss HR. Shades of grey: two forms of grey literature important for reviews in conservation. Biol Conserv. doi: 10.1016/j.biocon.2015.08.018