National research assessment exercises: A comparison of peer review and bibliometrics rankings

Scientometrics

Volumn 89, Issue 3, 2011, Pages 929-941

  Abramo, Giovanni ^a,b   D'Angelo, Ciriaco Andrea ^b   Costa, Flavia Di ^b  

^a CNR   (Italy)

^b UNIVERSITY OF ROME TOR VERGATA   (Italy)

Author keywords

Bibliometrics; Italy; Peer review; Research assessment; Research productivity; University

Indexed keywords

EID: 80255135933     PISSN: 01389130     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11192-011-0459-x     Document Type: Review

References (21)

1. Abramo, G., & D'Angelo, C. A. (2011). Evaluating research: From informed peer review to bibliometrics. Scientometrics, 87(3), 499-514.
2. Abramo, G., D'Angelo, C. A., & Caprasecca, A. (2009). Allocative efficiency in public research funding: Can bibliometrics help? Research Policy, 38(1), 206-215.
3. Abramo, G., D'Angelo, C. A., & Di Costa, F. (2008). Assessment of sectoral aggregation distortion in research productivity measurements. Research Evaluation, 17(2), 111-121.
4. Abramo, G., D'Angelo, C. A., & Viel, F. (2010). Peer review research assessment: A sensitivity analysis of performance rankings to the share of research product evacuate. Scientometrics, 85(3), 705-720.
5. Aksnes, D. W., & Taxt, R. E. (2004). Peers reviews and bibliometric indicators: A comparative study at Norvegian University. Research Evaluation, 13(1), 33-41.
6. D'Angelo, C. A., Giuffrida, C., & Abramo, G. (2011). A heuristic approach to author name disambiguation in large-scale bibliometric databases. Journal of the American Society for Information Science and Technology, 62(2), 257-269.
7. ERA. (2010). The Excellence in Research for Australia Initiative http://www. arc. gov. au/era/.
8. Franceschet, M., & Costantini, A. (2011). The first Italian research assessment exercise: A bibliometric perspective. Journal of Informetrics, 5(2), 275-291.
9. Horrobin, D. F. (1990). The philosophical basis of peer review and the suppression of innovation. Journal of the American Medical Association, 263(10), 1438-1441.
10. Lundberg, J. (2007). Lifting the crown-citation z-score. Journal of Informetrics, 1(2), 145-154.
11. MacRoberts, M. H., & MacRoberts, B. R. (1996). Problems of citation analysis. Scientometrics, 36(3), 435-444.
12. Moed, H. F. (2002). The impact-factors debate: The ISI's uses and limits. Nature, 415, 731-732.
13. Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer.
14. Moxam, H., & Anderson, J. (1992). Peer review. A view from the inside. Science and Technology Policy, 5(1), 7-15.
15. Oppenheim, C. (1997). The correlation between citation counts and the 1992 research assessment exercise ratings for British research in genetics, anatomy and archaeology. Journal of Documentation, 53, 477-487.
16. Oppenheim, C., & Norris, M. (2003). Citation counts and the research assessment exercise V: Archaeology and the 2001 RAE. Journal of Documentation, 56(6), 709-730.
17. Pendlebury, D. A. (2009). The use and misuse of journal metrics and other citation indicators. Scientometrics, 57(1), 1-11.
18. REF. (2009). Report on the pilot exercise to develop bibliometric indicators for the Research Excellence Framework. http://www. hefce. ac. uk/pubs/hefce/2009/09_39/.
19. Rinia, E. J., van Leeuwen, Th. N., van Vuren, H. G., & van Raan, A. F. J. (1998). Comparative analysis of a set of bibliometric indicators and central peer review criteria: Evaluation of condensed matter physics in the Netherlands. Research Policy, 27(1), 95-107.
20. van Raan, A. F. J. (2005). Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1), 133-143.
21. VTR. (2006). Valutazione Triennale (2001-2003) della Ricerca italiana (italian Triennal Assessment Excercise). Risultati delle valutazioni dei Panel di Area. http://vtr2006. cineca. it/php5/vtr_rel_civr_rapp_panel_menu. php?info=-&sel_lingua=EN&decritta=1&versione=2&aggiorna=0&info=. Accessed July 5, 2010).