What proportion of excellent papers makes an institution one of the best worldwide? Specifying thresholds for the interpretation of the results of the SCImago institutions ranking and the leiden ranking

Journal of the Association for Information Science and Technology

Volumn 65, Issue 4, 2014, Pages 732-736

  Bornmann, Lutz ^a   De Moya Anegón, Felix ^b  

^a MAX PLANCK INSTITUTE   (Germany)

^b The Consejo Superior de Investigaciones Científicas   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

IN CONTEXTS; INSTITUTIONAL IMPACT; WEB OF SCIENCE;

EID: 84899635082     PISSN: 23301635     EISSN: 23301643     Source Type: Journal    
DOI: 10.1002/asi.23047     Document Type: Article

References (24)

1. Abramo, G., D'Angelo, C.A., & Costa, F.D. (2010). Testing the trade-off between productivity and quality in research activities. Journal of the American Society for Information Science and Technology, 61(1), 132-140.
2. Albarrán, P., Crespo, J., Ortuño, I., & Ruiz-Castillo, J. (2011). The skewness of science in 219 sub-fields and a number of aggregates. Scientometrics, 88(2), 385-397.
3. Bornmann, L. (2013). How to analyze percentile citation impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes and top-cited papers. Journal of the American Society for Information Science and Technology, 64(3), 587-595.
4. Bornmann, L. (In press). Assigning publications to multiple subject categories for bibliometric analysis: an empirical case study based on percentiles. Journal of Documentation.
5. Bornmann, L., & de Moya Anegón, F. (2011). Some interesting insights from aggregated data published in the World Report SIR 2010. Journal of Informetrics, 5(3), 486-488.
6. Bornmann, L., de Moya Anegón, F., & Leydesdorff, L. (2012). The new Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011. Journal of Informetrics, 6(2), 333-335.
7. Bornmann, L., Leydesdorff, L., & Mutz, R. (2013). The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits. Journal of Informetrics, 7(1), 158-165.
8. Bornmann, L., & Marx, W. (2013). How good is research really? EMBO Reports, 14(3), 226-230.
9. Bornmann, L., Mutz, R., Marx, W., Schier, H., & Daniel, H.-D. (2011). A multilevel modelling approach to investigating the predictive validity of editorial decisions: Do the editors of a high-profile journal select manuscripts that are highly cited after publication? Journal of the Royal Statistical Society, Series A (Statistics in Society), 174(4), 857-879.
10. Boyack, K.W. (2004). Mapping knowledge domains: Characterizing PNAS. Proceedings of the National Academy of Sciences of the United States of America, 101, 5192-5199.
11. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
12. Coleman, B.J., Bolumole, Y.A., & Frankel, R. (2012). Benchmarking individual publication productivity in logistics. Transportation Journal, 51(2), 164-196.
13. El Emam, K., Arbuckle, L., Jonker, E., & Anderson, K. (2012). Two h-index benchmarks for evaluating the publication performance of medical informatics researchers. Journal of Medical Internet Research, 14(5).
14. Garfield, E. (1979). Citation indexing-its theory and application in science, technology, and humanities. New York: John Wiley & Sons.
15. Guerrero-Bote, V.P., & de Moya-Anegon, F. (2012). A further step forward in measuring journals' scientific prestige: The SJR2 indicator. Journal of Informetrics, 6(4), 674-688.
16. Hemlin, S. (1996). Research on research evaluations. Social Epistemology, 10(2), 209-250.
17. Kreiman, G., & Maunsell, J.H.R. (2011). Nine criteria for a measure of scientific output. Frontiers in Computational Neuroscience, 5.
18. Leydesdorff, L., Bornmann, L., Mutz, R., & Opthof, T. (2011). Turning the tables in citation analysis one more time: Principles for comparing sets of documents. Journal of the American Society for Information Science and Technology, 62(7), 1370-1381.
19. National Science Board. (2012). Science and engineering indicators 2012. Arlington, VA: National Science Foundation (NSB 12-01).
20. SCImago Reseach Group. (2012). SIRWorld Report 2012. Granada, Spain: University of Granada.
21. Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E.C.M., Tijssen, R.J.W., van Eck, N.J⋯. (2012a). The Leiden Ranking 2011/2012: data collection, indicators, and interpretation. Retrieved from: http://arxiv.org/ abs/1202.3941
22. Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E.C.M., Tijssen, R.J.W., van Eck, N.J⋯. (2012b). The Leiden Ranking 2011/2012: data collection, indicators, and interpretation. Journal of the American Society for Information Science and Technology, 63(12), 2419-2432.
23. Waltman, L., & Schreiber, M. (2013). On the calculation of percentilebased bibliometric indicators. Journal of the American Society for Information Science and Technology, 64(2), 372-379.
24. Waltman, L., van Eck, N.J., van Leeuwen, T.N., Visser, M.S., & van Raan, A.F.J. (2011). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics, 5(1), 37-47.