Skewness of citation impact data and covariates of citation distributions: A large-scale empirical analysis based on Web of Science data

Journal of Informetrics

Volumn 11, Issue 1, 2017, Pages 164-175

  Bornmann, Lutz ^a   Leydesdorff, Loet ^b  

^a MAX PLANCK INSTITUTE   (Germany)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Citation impact; Factors influencing citations; Impact factors; Normalization; Percentile shares

Indexed keywords

HIGHER ORDER STATISTICS; REGRESSION ANALYSIS;

CITATION IMPACT; FACTORS INFLUENCING CITATIONS; IMPACT FACTOR; NORMALIZATION; PERCENTILE SHARES;

INFORMATION ANALYSIS;

EID: 85007109204     PISSN: 17511577     EISSN: 18755879     Source Type: Journal    
DOI: 10.1016/j.joi.2016.12.001     Document Type: Article

References (48)

1. Albarrán, P., Ruiz-Castillo, J., References made and citations received by scientific articles. Journal of the American Society for Information Science and Technology 62:1 (2011), 40–49, 10.1002/asi.21448.
2. Albarrán, P., Crespo, J., Ortuño, I., Ruiz-Castillo, J., The skewness of science in 219 sub-fields and a number of aggregates. Scientometrics 88:2 (2011), 385–397, 10.1007/s11192-011-0407-9.
3. Alberts, B., Impact factor distortions. Science, 340(6134), 2013, 10.1126/science.1240319 [787.].
4. Benavent-Pérez, M., Gorraiz, J., Gumpenberger, C., Moya-Anegón, F., The different flavors of research collaboration: A case study of their influence on university excellence in four world regions. Scientometrics 93:1 (2012), 41–58, 10.1007/s11192-012-0638-4.
5. Bornmann, L., Daniel, H.-D., What do citation counts measure? A review of studies on citing behavior. Journal of Documentation 64:1 (2008), 45–80, 10.1108/00220410810844150.
6. Bornmann, L., Leydesdorff, L., Does quality and content matter for citedness? A comparison with para-textual factors and over time. Journal of Informetrics 9:3 (2015), 419–429, 10.1016/j.joi.2015.03.001.
7. Bornmann, L., Marx, W., Methods for the generation of normalized citation impact scores in bibliometrics: Which method best reflects the judgements of experts?. Journal of Informetrics 9:2 (2015), 408–418.
8. Bornmann, L., Marx, W., The journal impact factor and alternative metrics. EMBO Reports 17:8 (2016), 1094–1097, 10.15252/embr.201642823.
9. Bornmann, L., de Moya-Anegón, F., Leydesdorff, L., Do scientific advancements lean on the shoulders of giants? A bibliometric investigation of the Ortega hypothesis. PLoS One, 5(10), 2010, e11344.
10. Bornmann, L., Marx, W., Gasparyan, A.Y., Kitas, G.D., Diversity, value and limitations of the journal impact factor and alternative metrics. Rheumatology International 32:7 (2012), 1861–1867, 10.1007/s00296-011-2276-1.
11. Bornmann, L., Leydesdorff, L., Mutz, R., The use of percentiles and percentile rank classes in the analysis of bibliometric data: opportunities and limits. Journal of Informetrics 7:1 (2013), 158–165.
12. Cameron, A.C., Trivedi, P.K., Regression analysis of count data. 2. ed., 2013, Cambridge University Press, Cambridge, UK.
13. Didegah, F., Thelwall, M., Determinants of research citation impact in nanoscience and nanotechnology. Journal of the American Society for Information Science and Technology 64:5 (2013), 1055–1064, 10.1002/asi.22806.
14. Didegah, F., Thelwall, M., Article properties associating with the citation impact of individual articles in the social sciences. Wouters, P., (eds.) Proceedings of the science and technology indicators conference 2014 leiden context counts: pathways to master big and little data, 2014, University of Leiden, Leider, the Netherlands, 169–175.
15. Digital Science (2016). Publication patterns in research underpinning impact in REF2014. London, UK : Digital Science.
16. Fok, D., Franses, P.H., Modeling the diffusion of scientific publications. Journal of Econometrics 139:2 (2007), 376–390, 10.1016/j.jeconom.2006.10.021.
17. Garfield, E., The history and meaning of the journal impact factor. Journal of the American Medical Association 295:1 (2006), 90–93.
18. Gillmor, C.S., Citation characteristics of JATP literature. Journal of Atmospheric and Terrestrial Physics 37:11 (1975), 1401–1404.
19. Gini, C. (1997, 1909). Concentration and dependency ratios. Rivista di Politica Economica, 87, 769-789.
20. Glänzel, W., Moed, H., Opinion paper: thoughts and facts on bibliometric indicators. Scientometrics 96:1 (2013), 381–394, 10.1007/s11192-012-0898-z.
21. Glänzel, W., Schoepflin, U., A bibliometric study on aging and reception processes of scientific literature. Journal of Information Science 21:1 (1995), 37–53, 10.1177/016555159502100104.
22. Glänzel, W., The application of characteristic scores and scales to the evaluation and ranking of scientific journals. Journal of Information Science 37:1 (2011), 40–48, 10.1177/0165551510392316.
23. Hicks, D., Wouters, P., Waltman, L., de Rijcke, S., Rafols, I., Bibliometrics: The Leiden Manifesto for research metrics. Nature 520:7548 (2015), 429–431.
24. Jann, B., Assessing inequality using percentile shares. Stata Journal 16:2 (2016), 264–300.
25. Katz, J.S., Scale independent indicators and research evaluation. Science & Public Policy 27:1 (2000), 23–36.
26. Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Curry, S., A simple proposal for the publication of journal citation distributions. bioRxiv, 2016, 10.1101/062109.
27. Leydesdorff, L., Bornmann, L., Mutz, R., Opthof, T., Turning the tables in citation analysis one more time: Principles for comparing sets of documents. Journal of the American Society for Information Science and Technology 62:7 (2011), 1370–1381.
28. Leydesdorff, L., Hammarfelt, B., Salah, A.A.A., The structure of the arts & humanities citation index: A mapping on the basis of aggregated citations among 1,157 journals. Journal of the American Society for Information Science and Technology 62:12 (2011), 2414–2426.
29. Leydesdorff, L., Wouters, P., Bornmann, L., Professional and citizen bibliometrics: complementarities and ambivalences in the development and use of indicators—A state-of-the-art report. Scientometrics, 2016, 10.1007/s11192-016-2150-8.
30. Lozano, G.A., Larivière, V., Gingras, Y., The weakening relationship between the impact factor and papers' citations in the digital age. Journal of the American Society for Information Science and Technology 63:11 (2012), 2140–2145, 10.1002/asi.22731.
31. Merton, R.K., Social conflict over styles of sociological work. Storer, N.W., (eds.) The Sociology of Science: Theoretical and Empirical Investigations, 1973, Chicago University Press, Chicago and London, 47–69.
32. Milojević, S., Radicchi, F., & Bar-Ilan J. (2016). Validity of Basing Authors' Publication Strategy on Journal Impact Factors. Retrieved September, 1, 2016, from http://arxiv.org/abs/1607.03179.
33. Neophytou, J. (2013). Bibliometrics for journal editors–an overview. In S. P., M.H. & P. A (Eds.), Science Editors’ Handbook: European Association of Science Editors ( www.ease.org.uk).
34. Onodera, N., Yoshikane, F., Factors affecting citation rates of research articles. Journal of the Association for Information Science and Technology 66:4 (2014), 739–764, 10.1002/asi.23209.
35. Opthof, T., Leydesdorff, L., Caveats for the journal and field normalizations in the CWTS (Leiden) evaluations of research performance. Journal of Informetrics 4:3 (2010), 423–430.
36. Perneger, T.V., Citation analysis of identical consensus statements revealed journal-related bias. Journal of Clinical Epidemiology 63:6 (2010), 660–664, 10.1016/j.jclinepi.2009.09.012.
37. Reich, E.S., Science publishing: The golden club. Nature 502:7471 (2013), 291–293.
38. Robson, B.J., Mousquès, A., Can we predict citation counts of environmental modelling papers? Fourteen bibliographic and categorical variables predict less than 30% of the variability in citation counts. Environmental Modelling & Software 75 (2016), 94–104, 10.1016/j.envsoft.2015.10.007.
39. Seglen, P.O., The skewness of science. Journal of the American Society for Information Science 43:9 (1992), 628–638.
40. StataCorp (2015). Stata statistical software: release 14. College Station, TX, USA : Stata Corporation.
41. Tahamtan, I., Safipour Afshar, A., Ahamdzadeh, K., Factors affecting number of citations: A comprehensive review of the literature. Scientometrics 107:3 (2016), 1195–1225, 10.1007/s11192-016-1889-2.
42. Thomson Reuters (2016). The world's most influential scientific minds. Bethesda, MD, USA: Thomson Reuters.
43. Valderas, J.M., Why do team-authored papers get cited more?. Science, 317(5844), 2007, 1496, 10.1126/science.317.5844.1496b.
44. Webster, G.D., Jonason, P.K., Schember, T.O., Hot topics and popular papers in evolutionary psychology: analyses of title words and citation counts in evolution and human behavior, 1979–2008. Evolutionary Psychology 7:3 (2009), 348–362.
45. Yu, T., Yu, G., Li, P.-Y., Wang, L., Citation impact prediction for scientific papers using stepwise regression analysis. Scientometrics 101:2 (2014), 1233–1252, 10.1007/s11192-014-1279-6.
46. de Bellis, N., Bibliometrics and citation analysis: From the science citation index to cybermetrics. 2009, Scarecrow Press, Lanham, MD, USA.
47. de Solla Price, D.J., Little science, big science. 1963, Columbia University Press, New York, NY, USA.
48. van Raan, A.F.J., Advances in bibliometric analysis: Research performance assessment and science mapping. Blockmans, W., Engwall, L., Weaire, D., (eds.) Bibliometrics: Use and abuse in the review of research performance, 2014, Portland Press, London, UK, 17–28.