Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories

Journal of Informetrics

Volumn 12, Issue 4, 2018, Pages 1160-1177

  Martín Martín, Alberto ^a   Orduna Malea, Enrique ^b   Thelwall, Mike ^c   Delgado López Cózar, Emilio ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

^c UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

Author keywords

Academic search engines; Bibliographic databases; Bibliometrics; Citation analysis; Citation overlap; Coverage; Google Scholar; Scientometrics; Scopus; Unique citations; Web of Science

Indexed keywords

INFORMATION SERVICES;

ACADEMIC SEARCH; BIBLIOGRAPHIC DATABASE; BIBLIOMETRICS; CITATION ANALYSIS; CITATION OVERLAP; COVERAGE; GOOGLE SCHOLAR; SCIENTOMETRICS; SCOPUS; UNIQUE CITATIONS; WEB OF SCIENCE;

SEARCH ENGINES;

EID: 85054503222     PISSN: 17511577     EISSN: 18755879     Source Type: Journal    
DOI: 10.1016/j.joi.2018.09.002     Document Type: Article

References (51)

1. N. Amara, and R. Landry Counting citations in the field of business and management: Why use Google Scholar rather than the Web of Science Scientometrics 93 3 2012 553 581 10.1007/s11192-012-0729-2
2. N. Bakkalbasi, K. Bauer, J. Glover, and L. Wang Three options for citation tracking: Google Scholar, Scopus and Web of Science Biomedical Digital Libraries 3 1 2006 7 10.1186/1742-5581-3-7
3. J. Bar-Ilan Citations to the "Introduction to informetrics" indexed by WOS, Scopus and Google Scholar Scientometrics 82 3 2010 495 506 10.1007/s11192-010-0185-9
4. D. Chavarro, I. Ràfols, and P. Tang To what extent is inclusion in the Web of Science an indicator of journal 'quality'? Research Evaluation 27 2 2018 106 118 10.1093/reseval/rvy001
5. Clarivate Analytics Web of Science & Google Scholar collaboration Retrieved June 5, 2018, from 2015 http://wokinfo.com/googlescholar/
6. Clarivate Analytics Emerging Sources Citation Index Backfile Retrieved from 2017 2005 2014 https://clarivate.com/wp-content/uploads/2017/10/M255-Crv-SAR-ESCI-infographic-FA.pdf
7. F.J. Damerau A technique for computer detection and correction of spelling errors Communications of the ACM 7 3 1964 171 176 10.1145/363958.363994
8. S.L. De Groote, and R. Raszewski Coverage of Google Scholar, Scopus, and Web of Science: A case study of the h-index in nursing Nursing Outlook 60 6 2012 391 400 10.1016/j.outlook.2012.04.007
9. D. De Solla Price A general theory of bibliometric and other cumulative advantage processes Journal of the American Society for Information Science 27 5 1976 292 306 10.1002/asi.4630270505
10. J.C.F. de Winter, A.A. Zadpoor, and D. Dodou The expansion of Google Scholar versus Web of Science: A longitudinal study Scientometrics 98 2 2014 1547 1565 10.1007/s11192-013-1089-2
11. E. Delgado López-Cózar, E. Orduna-Malea, and A. Martín-Martín Google scholar as a data source for research assessment W. Glaenzel, H. Moed, U. Schmoch, M. Thelwall, Springer handbook of science and technology indicators 2018 Springer
12. E. Delgado López-Cózar, N. Robinson-García, and D. Torres-Salinas The Google scholar experiment: How to index false papers and manipulate bibliometric indicators Journal of the Association for Information Science and Technology 65 3 2014 446 454 10.1002/asi.23056
13. M. Dowle, A. Srinivasan, J. Gorecki, M. Chirico, P. Stetsenko, T. Short, and et al. data.table: Extension of "data.frame Retrieved from 2018 https://cran.r-project.org/package=data.table
14. H. Else How I scraped data from Google Scholar Nature April 2018 10.1038/d41586-018-04190-5
15. Elsevier Scopus source list (April 2018) Retrieved from 2018 https://www.elsevier.com/--data/assets/excel-doc/0015/91122/ext-list-April-2018-2017-Metrics.xlsx
16. G. Halevi, H. Moed, and J. Bar-Ilan Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation - review of the literature Journal of Informetrics 11 3 2017 823 834 10.1016/J.JOI.2017.06.005
17. A.-W. Harzing A longitudinal study of Google Scholar coverage between 2012 and 2013 Scientometrics 98 1 2013 565 575 10.1007/s11192-013-0975-y
18. A.W. Harzing Publish or Perish Retrieved from 2007 http://www.harzing.com/pop.htm
19. A.-W. Harzing, and S. Alakangas Google Scholar, Scopus and the Web of Science: A longitudinal and cross-disciplinary comparison Scientometrics 106 2 2016 787 804 10.1007/s11192-015-1798-9
20. A.W.K. Harzing, and R. van der Wal Google Scholar as a new source for citation analysis Ethics in Science and Environmental Politics 8 1 2008 61 73 10.3354/esep00076
21. J. Jacimovic, R. Petrovic, and S. Zivkovic A citation analysis of Serbian Dental Journal using Web of Science, Scopus and Google Scholar Stomatoloski Glasnik Srbije 57 4 2010 201 211 10.2298/SGS1004201J
22. P. Jacsó Metadata mega mess in Google Scholar Online Information Review 34 1 2010 175 191 10.1108/14684521011024191
23. K. Kousha, and M. Thelwall Google Scholar citations and Google Web/URL citations: A multi-discipline exploratory analysis Journal of the American Society for Information Science and Technology 58 7 2007 1055 1065 10.1002/asi.20584
24. K. Kousha, and M. Thelwall Sources of Google Scholar citations outside the Science Citation Index: A comparison between four science disciplines Scientometrics 74 2 2008 273 294 10.1007/s11192-008-0217-x
25. J. Larsson, A.J.R. Godfrey, T. Kelley, D.H. Eberly, P. Gustafsson, and E. Huber Eulerr: Area-Proportional Euler and venn diagrams with circles or ellipses Retrieved from 2018 https://cran.r-project.org/package=eulerr
26. E.M. Lasda Bergman Finding Citations to Social Work Literature: The Relative Benefits of Using Web of Science, Scopus, or Google Scholar The Journal of Academic Librarianship 38 6 2012 370 379 10.1016/j.acalib.2012.08.002
27. V.I. Levenshtein Binary codes capable of correcting deletions, insertions, and reversals Soviet physics doklady Vol. 10 1966 707 710
28. A. Martín-Martín, and E. Delgado López-Cózar Reading Web of Science data into R Retrieved from 2016 https://github.com/alberto-martin/read.wos.R
29. A. Martín-Martín, E. Orduna-Malea, and E. Delgado López-Cózar Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: A multidisciplinary comparison Scientometrics 116 3 2018 2175 2188 10.1007/s11192-018-2820-9
30. L.I. Meho, and K. Yang Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar Journal of the American Society for Information Science and Technology 58 13 2007 2105 2125 10.1002/asi.20677
31. B. Minasny, A.E. Hartemink, A. McBratney, and H.-J. Jang Citations and the h index of soil researchers and journals in the Web of Science, Scopus, and Google Scholar PeerJ 1 2013 e183 10.7717/peerj.183
32. J. Mingers, and E.A.E.C.G. Lipitakis Counting the citations: A comparison of Web of Science and Google Scholar in the field of business and management Scientometrics 85 2 2010 613 625 10.1007/s11192-010-0270-0
33. H.F. Moed, J. Bar-Ilan, and G. Halevi A new methodology for comparing Google Scholar and Scopus Journal of Informetrics 10 2 2016 533 551 10.1016/j.joi.2016.04.017
34. P. Mongeon, and A. Paul-Hus The journal coverage of Web of Science and Scopus: A comparative analysis Scientometrics 106 1 2016 213 228 10.1007/s11192-015-1765-5
35. J. Ooms, and D. Sites cld2: Google's compact language detector 2 Retrieved from 2018 https://cran.r-project.org/package=cld2
36. E. Orduna-Malea, J.M. Ayllón, A. Martín-Martín, and E. Delgado López-Cózar Methods for estimating the size of Google Scholar Scientometrics 104 3 2015 931 949 10.1007/s11192-015-1614-6
37. E. Orduña-Malea, A. Martín-Martín, J.M. Ayllón, and E. Delgado López-Cózar La revolución Google Scholar: Destapando la caja de Pandora académica 2016 Universidad de Granada Granada
38. E. Orduna-Malea, A. Martín-Martín, and E. Delgado López-Cózar Classic papers: using Google Scholar to detect the highly-cited documents 23rd International Conference on Science and Technology Indicators 2018 10.31235/osf.io/zkh7p
39. D. Pauly, and K. Stergiou Equivalence of results from two citation analyses: Thomson ISI's Citation Index and Google's Scholar service Ethics in Science and Environmental Politics 9 2005 33 35 10.3354/esep005033
40. A.A.M. Prins, R. Costas, T.N. van Leeuwen, and P.F. Wouters Using Google Scholar in research evaluation of humanities and social science programs: A comparison with Web of Science data Research Evaluation 25 3 2016 264 270 10.1093/reseval/rvv049
41. R Core Team R: A language and environment for statistical computing Retrieved from 2014 R Core Team Vienna, Austria http://www.r-project.org/
42. S. Rahimi, and V. Chandrakumar A comparison of citation coverage of traditional and web citation databases in medical science Malaysian Journal of Library & Information Science 19 3 2014 1 11 Retrieved from http://jice.um.edu.my/index.php/MJLIS/article/view/1779
43. P. Sud, and M. Thelwall Evaluating altmetrics Scientometrics 98 2 2014 1131 1143 10.1007/s11192-013-1117-2
44. R. Tijssen, A. Nederhof, T. van Leeuwen, H. Hollanders, M. Kanerva, and P. van den Berg Wetenschaps- en Technologie- Indicatoren 2010 Retrieved from 2010 http://nowt.merit.unu.edu/docs/NOWT-WTI-2010.pdf
45. M. van der Loo, J. van der Laan, R Core Team, N. Logan, and C. Muir Stringdist: Approximate string matching and string distance functions Retrieved from 2018 https://cran.r-project.org/package=stringdist
46. T.N. van Leeuwen, H.F. Moed, R.J.W. Tijssen, M.S. Visser, and A.F.J. Van Raan Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance Scientometrics 51 1 2001 335 346 10.1023/A:1010549719484
47. R. Van Noorden Google Scholar pioneer on search engine's future Nature November 2014 10.1038/nature.2014.16269
48. A. Walker, and L. Braglia openxlsx: Read, Write and Edit XLSX Files Retrieved from 2018 https://cran.r-project.org/package=openxlsx
49. H. Wickham ggplot2: Elegant graphics for data analysis Retrieved from 2016 Springer-Verlag New York http://ggplot2.org
50. L. Wildgaard A comparison of 17 author-level bibliometric indicators for researchers in Astronomy, Environmental Science, Philosophy and Public Health in Web of Science and Google Scholar Scientometrics 104 3 2015 873 906 10.1007/s11192-015-1608-4
51. K. Yang, and L.I. Meho Citation Analysis: A Comparison of Google Scholar, Scopus, and Web of Science Proceedings of the American Society for Information Science and Technology 43 1 2007 1 15 10.1002/meet.14504301185