Alternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers

Scientometrics

Volumn 92, Issue 2, 2012, Pages 355-365

  Leydesdorff, Loet ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Citation; Impact; Journal; Nonparametric; Source normalization

Indexed keywords

EID: 84864286541     PISSN: 01389130     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11192-012-0660-6     Document Type: Article

References (55)

1. Abassi, A., Hossain, L., & Leydesdorff, L. (in press). Betweenness centrality as a driver of preferential attachment in the evolution of research collaboration networks. Journal of Informetrics.
2. Adams, J., Cooke, N., Law, G., Marshall, S., Mount, D., Smith, D., & Stephenson, J. (2000). The role of selectivity and the characteristics of excellence. Report to the Higher Education Funding Council for England (p. 76). Leeds, UK/Philadelphia, PA: Evidence Ltd., Higher Education Policy Unit, University of Leeds, ISI; Retrieved on January 18, 2012 from http://www. evidence. co. uk/downloads/selectivity-report. pdf.
3. Althouse, B. M., West, J. D., Bergstrom, C. T., & Bergstrom, T. (2009). Differences in impact factor across fields and over time. Journal of the American Society for Information Science and Technology, 60(1), 27-34.
4. Bensman, S. J. (1996). The structure of the library market for scientific journals: The case of chemistry. Library Resources & Technical Services, 40, 145-170.
5. Bensman, S. J., & Leydesdorff, L. (2009). Definition and identification of journals as bibliographic and subject entities: Librarianship vs. ISI journal citation reports (JCR) methods and their effect on citation measures. Journal of the American Society for Information Science and Technology, 60(6), 1097-1117.
6. Bornmann, L., de Moya-Anegón, F., & Leydesdorff, L. (in press). The new excellence indicator in the world report of the SCImago Institutions Rankings 2011. Journal of Informetrics.
7. Bornmann, L., & Leydesdorff, L. (2011). Which cities produce excellent papers worldwide more than can be expected? A new mapping approach-using Google Maps-based on statistical significance testing. Journal of the American Society for Information Science and Technology, 62(10), 1954-1962.
8. Bornmann, L., & Mutz, R. (2011). Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization. Journal of Informetrics, 5(1), 228-230.
9. Boyack, K. W., & Klavans, R. (2011). Multiple dimensions of journal specificity: Why journals can't be assigned to disciplines. In E. Noyons, P. Ngulube, & J. Leta (Eds.), The 13th conference of the international society for scientometrics and informetrics (Vol. I, pp. 123-133). Durban, South Africa: ISSI, Leiden University and the University of Zululand.
10. Boyack, K. W., Klavans, R., & Börner, K. (2005). Mapping the backbone of science. Scientometrics, 64(3), 351-374.
11. CWTS. (2011). The Leiden ranking 2011/2012: Data collection and indicators. http://www. leidenranking. com/leidenranking. pdf. Retrieved on Dec 10, 2011.
12. Doreian, P., & Fararo, T. J. (1985). Structural equivalence in a journal network. Journal of the American Society for Information Science, 36, 28-37.
13. Fujigaki, Y. (1998). Filling the gap between discussions on science and scientists' everyday activities: Applying the autopoiesis system theory to scientific knowledge. Social Science Information, 37(1), 5-22.
14. Garfield, E. (1972). Citation analysis as a tool in journal evaluation. Science, 178(Number 4060), 471-479.
15. Garfield, E. (1979). Is citation analysis a legitimate evaluation tool? Scientometrics, 1(4), 359-375.
16. Garfield, E. (2006). The history and meaning of the journal impact factor. JAMA, 295(1), 90-93.
17. Gingras, Y., & Larivière, V. (2011). There are neither "king" nor "crown" in scientometrics: Comments on a supposed "alternative" method of normalization. Journal of Informetrics, 5(1), 226-227.
18. Glänzel, W., Thijs, B., Schubert, A., & Debackere, K. (2009). Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance. Scientometrics, 78(1), 165-188.
19. Leydesdorff, L. (1986). The development of frames of references. Scientometrics, 9(3-4), 103-125.
20. Leydesdorff, L. (1998). Theories of citation? Scientometrics, 43(1), 5-25.
21. Leydesdorff, L. (2002). Dynamic and evolutionary updates of classificatory schemes in scientific journal structures. Journal of the American Society for Information Science and Technology, 53(12), 987-994.
22. Leydesdorff, L. (2004). Clusters and maps of science journals based on bi-connected graphs in the journal citation reports. Journal of Documentation, 60(4), 371-427.
23. Leydesdorff, L. (2006). Can scientific journals be classified in terms of aggregated journal-journal citation relations using the journal citation reports? Journal of the American Society for Information Science and Technology, 57(5), 601-613.
24. Leydesdorff, L. (2008). Caveats for the use of citation indicators in research and journal evaluation. Journal of the American Society for Information Science and Technology, 59(2), 278-287.
25. Leydesdorff, L. (2011). Comparison of the integrated citation impacts of journals, nations, and institutions in the set journals of "nanoscience & nanotechnology". Paper presented at the Atlanta conference on science and innovation policy, Atlanta, GA; September 15-17.
26. Leydesdorff, L., & Amsterdamska, O. (1990). Dimensions of citation analysis. Science, Technology and Human Values, 15(3), 305-335.
27. Leydesdorff, L., & Bornmann, L. (2011a). How fractional counting affects the impact factor: Normalization in terms of differences in citation potentials among fields of science. Journal of the American Society for Information Science and Technology, 62(2), 217-229.
28. Leydesdorff, L., & Bornmann, L. (2011b). Integrated impact indicators (I3) compared with impact factors (IFs): An alternative design with policy implications. Journal of the American Society for Information Science and Technology, 62(7), 1370-1381.
29. Leydesdorff, L., & Bornmann, L. (in press). Mapping (USPTO) patent data using overlays to Google maps.
30. Leydesdorff, L., & Bornmann, L. (in press). Testing differences statistically with the Leiden Ranking. Scientometrics.
31. Leydesdorff, L., Bornmann, L., Mutz, R., & Opthof, T. (2011). Turning the tables in citation analysis one more time: Principles for comparing sets of documents. Journal of the American Society for Information Science and Technology, 62(7), 1370-1381.
32. Leydesdorff, L., Cozzens, S. E., & van den Besselaar, P. (1994). Tracking areas of strategic importance using scientometric journal mappings. Research Policy, 23, 217-229.
33. Leydesdorff, L., & Opthof, T. (2010). Scopus' source normalized impact per paper (SNIP) versus the journal impact factor based on fractional counting of citations. Journal of the American Society for Information Science and Technology, 61(11), 2365-2396.
34. Lundberg, J. (2007). Lifting the crown-citation z-score. Journal of Informetrics, 1(2), 145-154.
35. Martin, B., & Irvine, J. (1983). Assessing basic research: Some partial indicators of scientific progress in radio astronomy. Research Policy, 12, 61-90.
36. Moed, H. F. (2010). Measuring contextual citation impact of scientific journals. Journal of Informetrics, 4(3), 265-277.
37. Moed, H. F., De Bruin, R. E., & van Leeuwen, T. N. (1995). New bibliometric tools for the assessment of national research performance: Database description, overview of indicators and first applications. Scientometrics, 33(3), 381-422.
38. National Science Board. (2010). Science and engineering indicators. Washington DC: National Science Foundation. http://www. nsf. gov/statistics/seind10/.
39. Opthof, T., & Leydesdorff, L. (2010). Caveats for the journal and field normalizations in the CWTS ("Leiden") evaluations of research performance. Journal of Informetrics, 4(3), 423-430.
40. Price, D. J. d. S. (1965). Networks of scientific papers. Science, 149(no. 3683), 510-515.
41. Radicchi, F., & Castellano, C. (2012). Testing the fairness of citation indicators for comparison across scientific domains: The case of fractional citation counts. Journal of Informetrics, 6(1), 121-130.
42. Rafols, I., & Leydesdorff, L. (2009). Content-based and algorithmic classifications of journals: Perspectives on the dynamics of scientific communication and indexer effects. Journal of the American Society for Information Science and Technology, 60(9), 1823-1835.
43. Rafols, I., Leydesdorff, L., O'Hare, A., Nightingale, P., & Stirling, A. (in press). How journal rankings can suppress interdisciplinary research: A comparison between innovation studies and business & management. Research Policy.
44. Rousseau, R. (in press). Basic properties of both percentile rank scores and the I3 indicator. Journal of the American Society for Information Science and Technology. doi: 10. 1002/asi. 21684.
45. Rousseau, R., & Leydesdorff, L. (2011). Non-consistency, non-cited items, and the impact factor: A consequence of the arithmetic. ISSI Newsletter, 7(1), 10-14.
46. Schubert, A., & Braun, T. (1986). Relative indicators and relational charts for comparative assessment of publication output and citation impact. Scientometrics, 9(5), 281-291.
47. Seglen, P. O. (1992). The skewness of science. Journal of the American Society for Information Science, 43(9), 628-638.
48. Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. British Medical Journal, 314, 498-502.
49. Tijssen, R., de Leeuw, J., & van Raan, A. F. J. (1987). Quasi-correspondence analysis on square scientometric transaction matrices. Scientometrics, 11(5-6), 347-361.
50. Tijssen, R., Visser, M., & van Leeuwen, T. (2002). Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? Scientometrics, 54(3), 381-397.
51. van Raan, A. F. J., van Leeuwen, T. N., Visser, M. S., van Eck, N. J., & Waltman, L. (2010). Rivals for the crown: Reply to Opthof and Leydesdorff. Journal of Informetrics, 4(3), 431-435.
52. Vanclay, J. K. (in press). Impact factor: Outdated artifact or stepping-stone of journal certification? Scientometrics.
53. Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & van Raan, A. F. J. (2011). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics, 5(1), 37-47.
54. Zhou, P., & Leydesdorff, L. (2011). Fractional counting of citations in research evaluation: A cross- and interdisciplinary assessment of the Tsinghua University in Beijing. Journal of Informetrics, 5(3), 360-368.
55. Zitt, M., & Small, H. (2008). Modifying the journal impact factor by fractional citation weighting: The audience factor. Journal of the American Society for Information Science and Technology, 59(11), 1856-1860.