Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification

Journal of Informetrics

Volumn 10, Issue 2, 2016, Pages 408-438

  Marzolla, Moreno ^a  

^a UNIVERSITY OF BOLOGNA   (Italy)

Author keywords

ASN; Bibliometrics; Evaluation of individuals; Italy; National Scientific Qualification

Indexed keywords

INFORMATION SCIENCE;

BIBLIOMETRIC INDICATORS; BIBLIOMETRICS; EVALUATION CRITERIA; EVALUATION OF INDIVIDUALS; ITALY; NATIONAL SCIENTIFIC QUALIFICATION; QUANTITATIVE INDICATORS; SCIENTIFIC DISCIPLINE;

QUALITY CONTROL;

EID: 84960893450     PISSN: 17511577     EISSN: 18755879     Source Type: Journal    
DOI: 10.1016/j.joi.2016.01.009     Document Type: Article

References (38)

1. Abbasi A., Hossain L., Leydesdorff L. Betweenness centrality as a driver of preferential attachment in the evolution of research collaboration networks. Journal of Informetrics 2012, 6:403-412. 10.1016/j.joi.2012.01.002.
2. Abramo G., D'Angelo C.A. An assessment of the first "scientific habilitation" for university appointments in Italy. Economia Politica 2015, 1-29. 10.1007/s40888-015-0016-9.
3. Albarrán P., Crespo J.A., Ortu no I., Ruiz-Castillo J. The skewness of science in 219 sub-fields and a number of aggregates. Scientometrics 2011, 88:385-397. 10.1007/s11192-011-0407-9.
4. Banfi A., De Nicolao G. La valutazione della ricerca fra scienza e feticismo dei numeri. Il Mulino, I/2013 2013, 88-95.
5. Bastian M., Heymann S., Jacomy M. Gephi: An open source software for exploring and manipulating networks. International AAAI Conference on Weblogs and Social Media 2009, Accessed 23.11.15. http://www.aaai.org/ocs/index.php/ICWSM/09/paper/view/154.
6. Bennion A., Locke W. The early career paths and employment conditions of the academic profession in 17 countries. European Review 2010, 18:S7-S33. 10.1017/S1062798709990299.
7. Bliss C.I. The method of probits. Science 1934, 79:38-39. 10.1126/science.79.2037.38.
8. Canfora G., Elbaum S. Report on the technical track of ICSE 2015 2015, Accessed 23.11.15. http://www.icse-conferences.org/sc/ICSE/2015/ICSE2015-Technical-Track-Report-Canfora-Elbaum.pdf.
9. Csardi G., Nepusz T. The igraph software package for complex network research. InterJournal, Complex Systems 2006, 1695. Accessed 23.11.15. http://igraph.org.
10. Degli Esposti M., Geraci M. Thirty years of higher-education policy in Italy: Vicos ricorsi and beyond?. Bulletin of Italian Politics 2010, 2:111-122. Accessed 23.11.15. http://www.gla.ac.uk/media/media_191028_en.pdf.
11. Dettmar K.J.H. What we waste when faculty hiring goes wrong. The Chronicle of Higher Education 2004, Accessed 16.01.16. http://chronicle.com/article/What-We-Waste-When-Faculty/10023.
12. Enders J. A chair systems in transition: Appointments, promotions, and gate-keeping in German higher education. Higher Education 2001, 41:3-25. 10.1023/A:1026790026117.
13. Gerosa M. Competition for academic promotion in Italy. The Lancet 2001, 357:1208.
14. Hicks D., Wouters P., Waltman L., de Rijcke S., Rafols I. Bibliometrics: The Leiden Manifesto for research metrics. Nature 2015, 520:429-431. 10.1038/520429a.
15. IEEE (2013). Appropriate use of bibliometric indicators for the assessment of journals, research proposals, and individuals. Adopted by the IEEE Board of Directors 9 September 2013. Accessed 23.11.15. http://www.ieee.org/publications_standards/publications/rights/ieee_bibliometric_statement_sept_2013.pdf.
16. Institute de France (2011). On the proper use of bibliometrics to evaluate individual researchers. Report presented on 17 January 2011 to the Minister of Higher Education and Research. Accessed 23.11.15. http://www.academie-sciences.fr/activite/rapport/avis170111gb.pdf.
17. Kelly C.D., Jennions M.D. The h index and career assessment by numbers. Trends in Ecology & Evolution 2006, 21:167-170. 10.1016/j.tree.2006.01.005.
18. Koenig A. Patterns and antipatterns. Journal of Object-Oriented Programming 1995, 8:46-48.
19. Laloë F., Mosseri R. Bibliometric evaluation of individual researchers: Not even right. . . not even wrong!. Europhysics News 2009, 40:26-29. 10.1051/epn/2009704.
20. Levenshtein V.I. Binary codes capable of correcting deletions, insertions, and reversals. Doklady Akademii Nauk SSSR 1965, 163:845-848.
21. Marzolla M. Quantitative analysis of the Italian national scientific qualification. Journal of Informetrics 2015, 9:285-316. 10.1016/j.joi.2015.02.006.
22. Musselin C. Towards a european academic labour market? Some lessons drawn from empirical studies on academic mobility. Higher Education 2004, 48:55-78. 10.1023/B:HIGH.0000033770.24848.41.
23. Newman M.E.J. The structure of scientific collaboration networks. Proceedings of the National Academy of Sciences of the United States of America 2001, 98:404-409. 10.1073/pnas.98.2.404.
24. Okubo Y. Bibliometric indicators and analysis of research systems: Methods and examples. OECD Science, Technology and Industry Working Papers 1997, 10.1787/208277770603.
25. Pautasso M. The italian university habilitation and the challenge of increasing the representation of women in academia. Challenges 2015, 6:26-41. 10.3390/challe6010026.
26. Report E.R.A. Excellence in Research for Australia 2012-National Report 2012, Australian Research Council, Accessed 23.11.15. http://archive.arc.gov.au/file-search/ERA.
27. Ruggles R., Brodie H. An empirical approach to economic intelligence in World War II. Journal of the American Statistical Association 1947, 42:72-91. http://www.jstor.org/stable/2280189.
28. Sahel J.-A. Quality versus quantity: Assessing individual research performance. Science Translational Medicine, Vol. 3 2011, 84cm13. 10.1126/scitranslmed.3002249.
29. Shashok K. Content and communication: How can peer review provide helpful feedback about the writing?. BMC Medical Research Methodology 2008, 8:3. 10.1186/1471-2288-8-3.
30. Sidiropoulos A., Katsaros D., Manolopoulos Y. Generalized Hirsch h-index for disclosing latent facts in citation networks. Scientometrics 2007, 72:253-280. 10.1007/s11192-007-1722-z.
31. Sivertsen G. Publication patterns in all fields. In Celebrating Scholarly Communication Studies - A Festschrift for Olle Persson at his 60th Birthday 2009, 55-60. ISSI volume 05-S. http://issi-society.org/ollepersson60/ollepersson60.pdf Accessed 25.11.15.
32. Smalheiser N.R., Torvik V.I. Author name disambiguation. Annual Review of Information Science and Technology 2009, 43:1-43. 10.1002/aris.2009.1440430113.
33. Tukey J.W. Exploratory Data Analysis. Addison-Wesley series in behavioral science 1977, Addison-Wesley Publishing Company.
34. van den Brink M., Fruytier B., Thunnissen M. Talent management in academia: Performance systems and hrm policies. Human Resource Management Journal 2013, 23:180-195. 10.1111/j.1748-8583.2012.00196.x.
35. van Rijnsoever F.J., Hessels L.K. Factors associated with disciplinary and interdisciplinary research collaboration. Research Policy 2011, 40:463-472. 10.1016/j.respol.2010.11.001.
36. Vanclay J.K. An evaluation of the Australian research council's journal ranking. Journal of Informetrics 2011, 5:265-274. 10.1016/j.joi.2010.12.001.
37. Vicker L.A., Royer H.J. The complete academic search manual: A systematic approach to successful and inclusive hiring 2006, Stylus Publishing.
38. Wagner C.S., Roessner J.D., Bobb K., Klein J.T., Boyack K.W., Keyton J., et al. Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature. Journal of Informetrics 2011, 5:14-26. 10.1016/j.joi.2010.06.004.