The Leiden ranking 2011/2012: Data collection, indicators, and interpretation

Journal of the American Society for Information Science and Technology

Volumn 63, Issue 12, 2012, Pages 2419-2432

  Waltman, Ludo ^a   Calero Medina, Clara ^a   Kosten, Joost ^a   Noyons, Ed C M ^a   Tijssen, Robert J W ^a   Van Eck, Nees Jan ^a   Van Leeuwen, Thed N ^a   Van Raan, Anthony F J ^a   Visser, Martijn S ^a   Wouters, Paul ^a  

^a LEIDEN UNIVERSITY   (Netherlands)

Author keywords

bibliometrics; citation analysis

Indexed keywords

BIBLIOMETRIC; BIBLIOMETRICS; CITATION ANALYSIS; CITATION IMPACT; DATA COLLECTION; HIGHER EDUCATION; NON-ENGLISH LANGUAGES; SCIENTIFIC COLLABORATION; STABILITY INTERVAL;

DATA ACQUISITION; PUBLISHING; SOCIETIES AND INSTITUTIONS;

EDUCATION;

EID: 84870490986     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.22708     Document Type: Article

References (42)

1. Aguillo, I.F., Bar-Ilan, J., Levene, M., &, Ortega, J.L., (2010). Comparing university rankings. Scientometrics, 85 (1), 243-256.
2. Aguillo, I.F., Ortega, J.L., &, Fernández, M., (2008). Webometric Ranking of World Universities: Introduction, methodology, and future developments. Higher Education in Europe, 33 (2-3), 233-244.
3. Aksnes, D.W., Schneider, J.W., &, Gunnarsson, M., (2012). Ranking national research systems by citation indicators. A comparative analysis using whole and fractionalised counting methods. Journal of Informetrics, 6 (1), 36-43.
4. Baty, P., (2011). Change for the better. Retrieved from http://www.timeshighereducation.co.uk/world-university-rankings/2011-2012/ analysis-rankings-methodology.html
5. Billaut, J.-C., Bouyssou, D., &, Vincke, P., (2010). Should you believe in the Shanghai ranking? An MCDM view. Scientometrics, 84 (1), 237-263.
6. Bookstein, F.L., Seidler, H., Fieder, M., &, Winckler, G., (2010). Too much noise in the Times Higher Education rankings. Scientometrics, 85 (1), 295-299.
7. Bornmann, L., De Moya-Anegõn, F., &, Leydesdorff, L., (2012). The new excellence indicator in the World Report of the SCImago Institutions Rankings 2011. Journal of Informetrics, 6 (2), 333-335.
8. Butler, D., (2010). University rankings smarten up. Nature, 464, 16-17.
9. Calero-Medina, C., Lõpez-Illescas, C., Visser, M.S., &, Moed, H.F., (2008). Important factors when interpreting bibliometric rankings of world universities: An example from oncology. Research Evaluation, 17 (1), 71-81.
10. Colliander, C., &, Ahlgren, P., (2011). The effects and their stability of field normalization baseline on relative performance with respect to citation impact: A case study of 20 natural science departments. Journal of Informetrics, 5 (1), 101-113.
11. Dehon, C., McCathie, A., &, Verardi, V., (2010). Uncovering excellence in academic rankings: A closer look at the Shanghai ranking. Scientometrics, 83 (2), 515-524.
12. Efron, B., &, Tibshirani, R., (1993). An introduction to the bootstrap. London: Chapman & Hall.
13. Enserink, M., (2007). Who ranks the university rankers? Science, 317 (5841), 1026-1028.
14. Florian, R.V., (2007). Irreproducibility of the results of the Shanghai academic ranking of world universities. Scientometrics, 72 (1), 25-32.
15. Gauffriau, M., Larsen, P.O., Maye, I., Roulin-Perriard, A., &, Von Ins, M., (2008). Comparisons of results of publication counting using different methods. Scientometrics, 77 (1), 147-176.
16. Hazelkorn, E., (2007). The impact of league tables and ranking systems on higher education decision making. Higher Education Management and Policy, 19 (2), 87-110.
17. Hazelkorn, E., (2008). Learning to live with league tables and ranking: The experience of institutional leaders. Higher Education Policy, 21 (2), 193-215.
18. Ioannidis, J.P.A., Patsopoulos, N.A., Kavvoura, F.K., Tatsioni, A., Evangelou, E., Kouri, I., Liberopoulos, G, (2007). International ranking systems for universities and institutions: A critical appraisal. BMC Medicine, 5 (30).
19. Leydesdorff, L., &, Bornmann, L., (in press). Testing differences statistically with the Leiden ranking. Scientometrics.
20. Liu, N.C., &, Cheng, Y., (2005). The Academic Ranking of World Universities. Higher Education in Europe, 30 (2), 127-136.
21. Liu, N.C., Cheng, Y., &, Liu, L., (2005). Academic ranking of world universities using scientometrics - A comment to the "fatal attraction." Scientometrics, 64 (1), 101-109.
22. Lõpez-Illescas, C., De Moya-Anegõn, F., &, Moed, H.F., (2011). A ranking of universities should account for differences in their disciplinary specialization. Scientometrics, 88 (2), 563-574.
23. NordForsk (2011). Comparing research at Nordic universities using bibliometric indicators. Oslo: NordForsk.
24. Rauhvargers, A., (2011). Global university rankings and their impact. European University Association.
25. Saisana, M., d'Hombres, B., &, Saltelli, A., (2011). Rickety numbers: Volatility of university rankings and policy implications. Research Policy, 40 (1), 165-177.
26. Schneider, J.W., (2011). Caveats for using statistical significance tests in research assessments. arXiv:1112.2516v1.
27. Sheldrick, G.M., (2008). A short history of SHELX. Acta Crystallographica Section A, 64 (1), 112-122.
28. Spiegelhalter, D., &, Goldstein, H., (2009). Comment: Citation statistics. Statistical Science, 24 (1), 21-24.
29. Tijssen, R.J.W., (2011). Joint research publications: A performance indicator of university-industry collaboration. Evaluation in Higher Education, 5 (2), 19-40.
30. Tijssen, R.J.W., Visser, M.S., &, Van Leeuwen, T.N., (2002). Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? Scientometrics, 54 (3), 381-397.
31. Tijssen, R.J.W., Waltman, L., &, Van Eck, N.J., (2011). Collaborations span 1,553 kilometres. Nature, 473, 154.
32. Usher, A., &, Savino, M., (2006). A world of difference: A global survey of university league tables. Toronto: Educational Policy Institute.
33. Van Leeuwen, T.N., Moed, H.F., Tijssen, R.J.W., Visser, M.S., &, Van Raan, A.F.J., (2001). Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance. Scientometrics, 51 (1), 335-346.
34. Van Raan, A.F.J., (2005a). Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62 (1), 133-143.
35. Van Raan, A.F.J., (2005b). Reply to the comments of Liu et al. Scientometrics, 64 (1), 111-112.
36. Van Raan, A.F.J., Van Leeuwen, T.N., &, Visser, M.S., (2011a). Severe language effect in university rankings: Particularly Germany and France are wronged in citation-based rankings. Scientometrics, 88 (2), 495-498.
37. Van Raan, T., Van Leeuwen, T., &, Visser, M., (2011b). Non-English papers decrease rankings. Nature, 469, 34.
38. Van Vught, F.A., &, Westerheijden, D.F., (2010). Multidimensional ranking: A new transparency tool for higher education and research. Higher Education Management and Policy, 22 (3), 31-56.
39. Van Vught, F., &, Ziegele, F., (Eds.). (2012). Multidimensional ranking: The design and development of U-Multirank. Berlin: Springer.
40. Waltman, L., Tijssen, R.J.W., &, Van Eck, N.J., (2011). Globalisation of science in kilometres. Journal of Informetrics, 5 (4), 574-582.
41. Waltman, L., Van Eck, N.J., Van Leeuwen, T.N., Visser, M.S., &, Van Raan, A.F.J., (2011). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics, 5 (1), 37-47.
42. Zitt, M., &, Filliatreau, G., (2007). Big is (made) beautiful: Some comments about the Shanghai ranking of world-class universities. In, J. Sadlak, &, N.C. Liu, (Eds.), The world-class university and ranking: Aiming beyond status (pp. 141-160). UNESCO-CEPES, Institute of Higher Education, Shanghai Jiao Tong University, and Cluj University Press.