Errors of omission and their implications for computing scientometric measures in evaluating the publishing productivity and impact of countries

Online Information Review

Volumn 33, Issue 2, 2009, Pages 376-385

  Jacso, Peter ^a  

^a UNIVERSITY OF HAWAII   (United States)

Author keywords

Databases; Information retrieval; Productivity rate; Research

Indexed keywords

AUTHOR IDENTIFICATION; DATA ELEMENTS; DATABASES; DESIGN/METHODOLOGY/APPROACH; HIGH RATE; IMPACT FACTOR; PRODUCTIVITY RATE; REUTERS; SCIENTOMETRICS; SCOPUS DATABASE; THOMSON; WEB OF SCIENCE;

INFORMATION RETRIEVAL; INFORMATION SERVICES; INTERSYMBOL INTERFERENCE; LINGUISTICS; PRODUCTIVITY; PUBLISHING; RESEARCH; TECHNICAL WRITING;

DATABASE SYSTEMS;

EID: 70249111203     PISSN: 14684527     EISSN: None     Source Type: Journal    
DOI: 10.1108/14684520910951276     Document Type: Article

References (45)

1. Bar-Ilan, J. (2008), "Which h-index? A comparison of WoS, Scopus and Google Scholar", Scientometrics, Vol.74 No.2, pp. 257-271
2. Bar-Ilan, J., Levene, M. and Lim, A. (2007), "Some measures for comparing citation databases", Journal of Informetrics, Vol.1 No.1, pp. 26-34.
3. Bornmann, L. and Daniel, H. (2009), "The state of h index research: is the h index the ideal way to measure research performance?", EMBO Reports, Vol.10 No.1, pp. 2-6.
4. Bornmann, L., Mutz, R. and Daniel, H. (2008), "Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine", Journal of the American Society for Information Science and Technology, Vol.59 No.5, pp. 830-837
5. Bornmann, L., Marx, W., Schier, H., Rahm, E., Thor, A. and Daniel, H.-D. (2009), "Convergent validity of bibliometric Google Scholar data in the field of chemistry - citation counts for papers that were accepted by Angewandte Chemie International Edition or rejected but published elsewhere, using Google Scholar, Science Citation Index, Scopus, and Chemical Abstracts", Journal of Informetrics, Vol.3 No.1, pp. 27-35.
6. Butler, L. (2008), "Using a balanced approach to bibliometrics: quantitative performance measures in the Australian Research Quality Framework", Ethics in Science and Environmental Politics, Vol.8 No.1, pp. 83-92.
7. Cronin, B. and Meho, L. (2006), "Using the h-index to rank influential information scientists", Journal of the American Society for Information Science and Technology, Vol.57 No.9, pp. 1275-1278
8. Csajbók, E., Berhidi, A., Vasas, L. and Schubert, A. (2007), "Hirsch-index for countries based on essential science indicators data", Scientometrics, Vol.73 No.1, pp. 91-117.
9. Da Luz, M.P., Marques-Portella, C., Mendlowicz, M., Gleiser, S., Coutinho, E.S.F. and Figueira, I. (2008), "Institutional h-index: the performance of a new metric in the evaluation of Brazilian psychiatric post-graduation programs", Scientometrics, Vol.77 No.2, pp. 361-368
10. De Moya-Anegon, F., Chinchilla-Rodríguez, Z., Vargas-Quesada, B., Corera-Alvarez, E., González-Molina, A. and Herrero-Solana, V. (2007), "Coverage analysis of Scopus: a journal metric approach", Scientometrics, Vol.73 No.1, pp. 53-78.
11. Dess, H.M. (2006), "Scopus", Issues in Science and Technology Librarianship, Winter, available at: www.istl.org/06-winter/databases4.html
12. Fingerman, S. (2005), "Scopus: profusion and confusion", Online, Vol.29 No.2, pp. 36-38
13. Fingerman, S. (2006), "Web of Science and Scopus: current features and capabilities", Issues in Science and Technology Librarianship, Fall, available at: www.istl.org/06-fall/electronic2. html
14. Gavel, Y. and Iselid, L. (2008), "Web of Science and Scopus: a journal title overlap study", Online Information Review, Vol.32 No.1, pp. 8-21.
15. Goodman, D. and Deis, L. (2007), "Update on Scopus and Web of Science", The Charleston Advisor, Vol.8 No.3, pp. 15-18.
16. Gorman, G.E. (2008), "'They can't read, but they sure can count': flawed rules of the journal rankings game", Online Information Review, Vol.32 No.6, pp. 705-708
17. Hood, W.W. and Wilson, S.C. (2003), "Informetric studies using databases: opportunities and challenges", Scientometrics, Vol.58 No.3, pp. 587-608.
18. Jacsó, P. (1993), "Searching for skeletons in the database cupboard. Part I: errors of omission", Database, Vol.16 No. 1, pp. 38-49.
19. Jacsó, P. (1997), "Content evaluation of databases", Annual Review of Information Science and Technology, Vol.32, pp. 231-267, available at: www.jacso.info/PDFs/jacso-content-arist.pdf
20. Jacsó, P. (2001), Content Evaluation of Textual CD-ROM and Web Databases, Libraries Unlimited, Englewood, CO.
21. Jacsó, P. (2005a), ""As we may search - comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases", Current Science, Vol.89 No.9, pp. 1537-1547
22. Jacsó, P. (2005b), "Comparison and analysis of the citedness scores in Web of Science and Google Scholar", Lecture Notes in Computer Science, Vol.3815, pp. 360-369, available at: www.jacso. info/PDFs/jacso- comparison-analysis-of-citedness.pdf
23. Jacsó, P. (2006), "Deflated, inflated and phantom citation counts", Online Information Review, Vol.30 No.3, pp. 297-309, available at: www.jacso.info/PDFs/jacso-deflated-inflated.pdf
24. Jacsó, P. (2007), "The dimensions of cited reference enhanced database subsets", Online Information Review, Vol.31 No.5, pp. 694-705.
25. Jacsó, P. (2008a), "Google Scholar revisited", Online Information Review, Vol.32 No.1, pp. 102-114, available at: www.jacso.info/PDFs/ jacso-GS-revisited-OIR-2008-32-1.pdf
26. Jacsó, P. (2008b), "The plausibility of computing the h-index of scholarly productivity and impact using reference enhanced databases", Online Information Review, Vol.32 No.2, pp. 262-283, available at: www.jacso.info/PDFs/jacso-h-index-plausibility-OIR-2008-32-2.pdf
27. Jacsó, P. (2008c), "The pros and cons of computing the h-index using Google Scholar", Online Information Review, Vol.32 No.3, pp. 437-451, available at: www.jacso.info/PDFs/ jacso-pros-and-cons-of-computing- the-h-index.pdf
28. Jacsó, P. (2008d), "The pros and cons of computing the h-index using Scopus", Online Information Review, Vol.32 No.4, pp. 524-535, available at: www.jacso.info/ PDFs/jacso-pros-and-cons-of-computing-the-h- index-scopus.pdf
29. Jacsó, P. (2008e), "Testing the calculation of a realistic h-index in Google Scholar, Scopus and Web of Science for F.W. Lancaster", Library Trends, Vol.56 No.4, pp. 784-815, preprint available at: www.jacso.info/PDFs/lancaster.pdf
30. Jacsó, P. (2008f), "The pros and cons of computing the h-index using Web of Science", Online Information Review, Vol.32 No.5, pp. 673-687, available at: www.jacso.info/PDFs/ jacso-pros-and-cons-of-computing- the-h-index-using-wos.pdf
31. Leydesdorff, L. (2008), "Caveats for the use of citation indicators in research and journal evaluations", Journal of the American Society for Information Science and Technology, Vol.59 No.2, pp. 278-287
32. Meho, L.I. and Yang, K. (2007a), "Fusion approach to citation-based quality assessment", Proceedings of the 11th International Conference of the International Society for Scientometrics and Informetrics, Madrid, 25-27 June, available at: www.slis.indiana.edu/ faculty/meho-fusion-approach.pdf
33. Meho, L.I. and Yang, K. (2007b), "Impact of data sources on citation counts and rankings of LIS faculty: Web of Science versus Scopus and Google Scholar", Journal of the American Society for Information Science and Technology, Vol.58 No.13, pp. 2105-2125, open access preprint available at:
34. Neuhaus, C. and Daniel, H. (2008), "Data sources for performing citation analysis: an overview", Journal of Documentation, Vol.64 No.2, pp. 193-210.
35. Neuhaus, C., Neuhaus, E., Asher, A. and Wrede, C. (2006), "The depth and breadth of Google Scholar: an empirical study", Portal: Libraries and the Academy, Vol.6 No.2, pp. 127-141
36. Norris, M. and Oppenheim, C. (2007), "Comparing alternatives to the Web of Science for coverage of the social sciences literature", Journal of Informetrics, Vol.1 No.2, pp. 161-169
37. Pereira De Araújo, A.F. (2008), "Increasing discrepancy between absolute and effective indexes of research output in a Brazilian academic department", Scientometrics, Vol. 74 No.3, pp. 425-437
38. Rousseau, R. (2007), "The influence of missing publications on the Hirsch index", Journal of Informetrics, Vol.1 No.1, pp. 2-7.
39. Van Raan, A.F.J. (2005), "Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups", Scientometrics, Vol.69 No.1, pp. 117-120
40. Vanclay, J.K. (2007), "On the robustness of the h-index", Journal of the American Society for Information Science and Technology, Vol.58 No.10, pp. 1547-1550
41. White, B. (2006), "Examining the claims of Google Scholar as a serious information source", New Zealand Library & Information Management Journal, Vol.50 No.1, pp. 11-24, available at: http://eprints.rclis. org/7657
42. Yang, K. and Meho, L.I. (2006), "Citation analysis: a comparison of Google Scholar, Scopus, and Web of Science", Proceedings of the 69th Annual Meeting of the American Society for Information Science and Technology (ASIST) 43, p. 43, available at: http://eprints.rclis.org/ archive/00008121/01/Yang- citation.pdf
43. Dialog (2009), "Dialog", available at: www.dialog.com
44. Scopus (2009), "Scopus in detail: facts & figures", available at: www.info.scopus.com/detail/facts
45. Thomson Reuters (2009), "Web of Science", available at: www.thomsonreuters.com/ products-services/scientific/Web-of-Science