A systematic empirical comparison of different approaches for normalizing citation impact indicators

Journal of Informetrics

Volumn 7, Issue 4, 2013, Pages 833-849

  Waltman, Ludo ^a   van Eck, Nees Jan ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

Citation; Classification system; Normalization; Source normalization

Indexed keywords

BIBLIOMETRIC INDICATORS; CITATION; CLASSIFICATION SYSTEM; EMPIRICAL - COMPARISONS; FIELD CLASSIFICATION; NORMALIZATION; SCIENTIFIC JOURNALS; SOURCE NORMALIZATION;

COMPUTER APPLICATIONS;

EID: 84883509525     PISSN: 17511577     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.joi.2013.08.002     Document Type: Article

References (45)

1. Abramo G., Cicero T., D'Angelo C.A. Revisiting the scaling of citations for research assessment. Journal of Informetrics 2012, 6(4):470-479.
2. Braun T., Glänzel W. United Germany: The new scientific superpower?. Scientometrics 1990, 19(5-6):513-521.
3. Buela-Casal G., Perakakis P., Taylor M., Checa P. Measuring internationality: Reflections and perspectives on academic journals. Scientometrics 2006, 67(1):45-65.
4. Crespo J.A., Li Y., Herranz N., Ruiz-Castillo J. The effect on citation inequality of differences in citation practices at the Web of Science subject category level. Journal of the American Society for Information Science and Technology 2013, (in press).
5. Crespo J.A., Li Y., Ruiz-Castillo J. The measurement of the effect on citation inequality of differences in citation practices across scientific fields. PLoS ONE 2013, 8(3):e58727.
6. Glänzel W., Schubert A., Thijs B., Debackere K. A priori vs. a posteriori normalisation of citation indicators. The case of journal ranking. Scientometrics 2011, 87(2):415-424.
7. Leydesdorff L., Bornmann L. How fractional counting of citations affects the impact factor: Normalization in terms of differences in citation potentials among fields of science. Journal of the American Society for Information Science and Technology 2011, 62(2):217-229.
8. Leydesdorff L., Bornmann L., Mutz R., Opthof T. Turning the tables on citation analysis one more time: Principles for comparing sets of documents. Journal of the American Society for Information Science and Technology 2011, 62(7):1370-1381.
9. Leydesdorff L., Opthof T. Scopus's source normalized impact per paper (SNIP) versus a journal impact factor based on fractional counting of citations. Journal of the American Society for Information Science and Technology 2010, 61(11):2365-2369.
10. Leydesdorff L., Radicchi F., Bornmann L., Castellano C., De Nooy W. Field-normalized impact factors: A comparison of rescaling versus fractionally counted IFs. Journal of the American Society for Information Science and Technology. 2013, (in press).
11. Leydesdorff L., Zhou P., Bornmann L. How can journal impact factors be normalized across fields of science? An assessment in terms of percentile ranks and fractional counts. Journal of the American Society for Information Science and Technology 2013, 64(1):96-107.
12. Li Y., Radicchi F., Castellano C., Ruiz-Castillo J. Quantitative evaluation of alternative field normalization procedures. Journal of Informetrics 2013, 7(3):746-755.
13. Lundberg J. Lifting the crown-citation z-score. Journal of Informetrics 2007, 1(2):145-154.
14. Michels C., Schmoch U. The growth of science and database coverage. Scientometrics 2012, 93(3):831-846.
15. Moed H.F. Measuring contextual citation impact of scientific journals. Journal of Informetrics 2010, 4(3):265-277.
16. Moed H.F., De Bruin R.E., Van Leeuwen T.N. New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications. Scientometrics 1995, 33(3):381-422.
17. Newman M.E.J. Fast algorithm for detecting community structure in networks. Physical Review E 2004, 69(6):066133.
18. Newman M.E.J., Girvan M. Finding and evaluating community structure in networks. Physical Review E 2004, 69(2):026113.
19. Radicchi F., Castellano C. Testing the fairness of citation indicators for comparison across scientific domains: The case of fractional citation counts. Journal of Informetrics 2012, 6(1):121-130.
20. Radicchi F., Castellano C. Why Sirtes's claims (Sirtes, 2012) do not square with reality. Journal of Informetrics 2012, 6(4):615-618.
21. Radicchi F., Castellano C. A reverse engineering approach to the suppression of citation biases reveals universal properties of citation distributions. PLoS ONE 2012, 7(3):e33833.
22. Radicchi F., Fortunato S., Castellano C. Universality of citation distributions: Toward an objective measure of scientific impact. Proceedings of the National Academy of Sciences 2008, 105(45):17268-17272.
23. Schubert A., Braun T. Cross-field normalization of scientometric indicators. Scientometrics 1996, 36(3):311-324.
24. Sirtes D. Finding the Easter eggs hidden by oneself: Why Radicchi and Castellano's (2012) fairness test for citation indicators is not fair. Journal of Informetrics 2012, 6(3):448-450.
25. Small H., Sweeney E. Clustering the science citation index using co-citations. I. A comparison of methods. Scientometrics 1985, 7(3-6):391-409.
26. Tijssen R.J.W., Visser M.S., Van Leeuwen T.N. Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?. Scientometrics 2002, 54(3):381-397.
27. Van Eck N.J., Waltman L., Van Raan A.F.J., Klautz R.J.M., Peul W.C. Citation analysis may severely underestimate the impact of clinical research as compared to basic research. PLoS ONE 2013, 8(4):e62395.
28. Van Leeuwen T.N., Moed H.F., Tijssen R.J.W., Visser M.S., Van Raan A.F.J. Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance. Scientometrics 2001, 51(1):335-346.
29. Van Leeuwen T.N., Visser M.S., Moed H.F., Nederhof T.J., Van Raan A.F.J. The holy grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence. Scientometrics 2003, 57(2):257-280.
30. Van Raan A.F.J., Van Leeuwen T.N., Visser M.S. Severe language effect in university rankings: Particularly Germany and France are wronged in citation-based rankings. Scientometrics 2011, 88(2):495-498.
31. Van Raan T., Van Leeuwen T., Visser M. Non-English papers decrease rankings. Nature 2011, 469:34.
32. Waltman L., Schreiber M. On the calculation of percentile-based bibliometric indicators. Journal of the American Society for Information Science and Technology 2013, 64(2):372-379.
33. Waltman L., Van Eck N.J. The relation between Eigenfactor, audience factor, and influence weight. Journal of the American Society for Information Science and Technology 2010, 61(7):1476-1486.
34. Waltman L., Van Eck N.J. A new methodology for constructing a publication-level classification system of science. Journal of the American Society for Information Science and Technology 2012, 63(12):2378-2392.
35. Waltman L., Van Eck N.J. Source normalized indicators of citation impact: An overview of different approaches and an empirical comparison. Scientometrics 2013, 96(3):699-716.
36. Waltman L., Van Eck N.J., Noyons E.C.M. A unified approach to mapping and clustering of bibliometric networks. Journal of Informetrics 2010, 4(4):629-635.
37. Waltman L., Van Eck N.J., Van Leeuwen T.N., Visser M.S. Some modifications to the SNIP journal impact indicator. Journal of Informetrics 2013, 7(2):272-285.
38. Waltman L., Van Eck N.J., Van Leeuwen T.N., Visser M.S., Van Raan A.F.J. Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics 2011, 5(1):37-47.
39. Zhou P., Leydesdorff L. Fractional counting of citations in research evaluation: A cross- and interdisciplinary assessment of the Tsinghua University in Beijing. Journal of Informetrics 2011, 5(3):360-368.
40. Zitt M. Citing-side normalization of journal impact: A robust variant of the audience factor. Journal of Informetrics 2010, 4(3):392-406.
41. Zitt M. Behind citing-side normalization of citations: Some properties of the journal impact factor. Scientometrics 2011, 89(1):329-344.
42. Zitt M., Bassecoulard E. Internationalization of scientific journals: A measurement based on publication and citation scope. Scientometrics 1998, 41(1-2):255-271.
43. Zitt M., Ramanana-Rahary S., Bassecoulard E. Correcting glasses help fair comparisons in international science landscape: Country indicators as a function of ISI database delineation. Scientometrics 2003, 56(2):259-282.
44. Zitt M., Ramanana-Rahary S., Bassecoulard E. Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation. Scientometrics 2005, 63(2):373-401.
45. Zitt M., Small H. Modifying the journal impact factor by fractional citation weighting: The audience factor. Journal of the American Society for Information Science and Technology 2008, 59(11):1856-1860.