Structured evaluation of the scientific output of academic research groups by recent h-based indicators

Journal of Informetrics

Volumn 5, Issue 1, 2011, Pages 64-74

  Franceschini, Fiorenzo ^a   Maisano, Domenico ^a  

^a POLITECNICO DI TORINO   (Italy)

Author keywords

Academic research group; Bibliometric positioning; Ch index; H Index; H Spectrum; Research evaluation; Scientific production; Successive h indices

Indexed keywords

EID: 78650519799     PISSN: 17511577     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.joi.2010.08.003     Document Type: Article

References (51)

1. Ajiferuke I., Wolfram D. Citer analysis as a measure of research impact: Library and information science as a case study. Scientometrics 2010, 83(3):623-638.
2. Alonso S., Cabrerizo F., Herrera-Viedma E., Herrera F. h-Index: A review focused in its variants, computation and standardization for different scientific fields. Journal of Informetrics 2009, 3(4):273-289.
3. Bach L., Llerena P. Indicators of higher-education institutes and public-research organizations technology transfer activities: Insights from France. Science and Public Policy 2007, 34(10):709-721.
4. Bar-Ilan J. Citations to the " Introduction to informetrics" indexed by WOS, Scopus and Google Scholar. Scientometrics 2010, 82(3):495-506.
5. Batista P.D., Campiteli M.G., Kinouchi O., Martinez A.S. Is it possible to compare researchers with different scientific interests?. Scientometrics 2006, 68(1):179-189.
6. Billaut J.C., Bouyssou D., Vincke P. Should you believe in the Shanghai ranking? An MCDM view. Scientometrics 2010, 84(1):237-263.
7. Bornmann L., Mutz R., Daniel H.D. Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine. Journal of the American Society for Information Science and Technology 2008, 59(5):830-837.
8. Bornmann L. Towards the ideal method of measuring research performance: Some comments to the Opthof and Laydesdorff (2010) paper. Journal of Informetrics 2010, 4(3):441-443.
9. Buela-Casal G., Gutiérrez-Martínez O., Bermúdez-Sánchez M.P., Vadillo-Muñoz O. Comparative study of international academic rankings of universities. Scientometrics 2007, 71(3):349-365.
10. Burrell Q.L. Hirsch index or Hirsch rate? Some thoughts arising from Liang's data. Scientometrics 2007, 73(1):19-28.
11. Cai Liu N., Cheng Y., Liu L. Academic ranking of world universities using scientometrics-A comment to the " Fatal Attraction" Scientometrics 2005, 64(1):101-109.
12. Cai Liu N., Cheng Y., Liu L. A first approach to the classification of the top 500 world universities by their disciplinary characteristics using scientometrics. Scientometrics 2006, 68(1):135-150.
13. Cronin B. Hyperauthorship: A postmodern perversion or evidence of a structural shift in scholarly communication practices?. Journal of the American Society for Information Science and Technology 2001, 52(7):558-569.
14. Da Luz M.P, Marques-Portella C., Mendlowicz M., Gleiser S., Coutinho E.S.F., Figueira I. Institutional h-index: The performance of a new metric in the evaluation of Brazilian Psychiatric Post-graduation Programs. Scientometrics 2008, 77(2):361-368.
15. Egghe L. The Hirsch-index and related impact measures. Annual Review of Information Science and Technology (ARIST) 2010, 44:64-114.
16. Franceschini F., Maisano D. Analysis of the Hirsch index's operational properties. European Journal of Operational Research 2010, 203(2):494-504. 10.1016/j.ejor.2009.08.001.
17. Franceschini F., Maisano D. The Hirsch spectrum: A novel tool for analysing scientific journals. Journal of Informetrics 2010, 4(1):64-73. 10.1016/j.joi.2009.08.003.
18. Franceschini F., Maisano D. The citation triad: an overview of a scientist's publication output based on Ferrers diagrams. Journal of Informetrics 2010, 4(4):503-511.
19. Franceschini, F., & Maisano, D. (in pressa). Bibliometric positioning of scientific Manufacturing journals: A comparative analysis, Scientometrics.
20. Franceschini, F., & Maisano, D. (in pressb). Influence of database mistakes on journal citation analysis: Remarks on Franceschini and Maisano QREI (2010), Quality and Reliability Engineering International.
21. Franceschini F., Maisano D., Perotti A., Proto A. Analysis of the ch-index, an indicator to evaluate the diffusion of scientific research output by citers. Scientometrics 2010, 85(1):203-217. 10.1007/s11192-010-0165-0.
22. Glänzel W. On the opportunities and limitations of the h-index. Science Focus 2006, 1(1):10-11.
23. Goffman W. Mathematical approach to the spread of scientific ideas-The history of mast cell research. Nature 1966, 212:449-452.
24. Harzing A.W., van der Wal R. Google Scholar as a new source for citation analysis. Ethics in Science and Environmental Politics 2008, 8(11):61-73.
25. Henzinger M., Sunol J., Weber I. The stability of the h-index. Scientometrics 2010, 84:465-479.
26. Hirsch J.E. An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences of the United States of America 2005, 102:16569-16572.
27. Jacso P. Deflated, inflated and phantom citation counts. Online Information Review 2006, 30(3):297-309.
28. Kellner A.W.A, Ponciano L.C.M.O. H-index in the Brazilian Academy of Sciences-Comments and concerns. Anais da Academia Brasileira de Ciências (Annals of the Brazilian Academy of Sciences) 2008, 80(4):771-781.
29. Lazaridis T. Ranking university departments using the mean h-index. Scientometrics 2010, 82(2):211-216.
30. Lindsey D. The relationship between performance indicators for academic research and funding-Developing a measure of return on investment in science. Scientometrics 1991, 20(1):221-234.
31. Lombardi J.V., Craig D.D., Capaldi E.D., Gater D.S. The myth of number one: Indicators of research university performance-The top American research universities 2002, retrieved from http://mup.asu.edu/MythNumberOne.pdf.
32. MIUR (2010). Ministero dell'Istruzione dell'Università e della Ricerca http://cercauniversita.cineca.it/php5/settori/index.php.
33. Moed, H. F. (2005). Hirsch index is a creative and appealing construct but be cautious when using it to evaluate individual scholars, retrieved from http://www.cwts.nl/hm/Comments_on_Hirsch_Index_2005_12_16.pdf.
34. Moed, H. F. (2006). Bibliometric rankings of world universities, CWTS Report 2006-01, available at http://www.cwts.nl/hm/bibl_rnk_wrld_univ_full.pdf.
35. Molinari A., Molinari J.F. A new methodology for ranking scientific institutions. Scientometrics 2008, 75(1):163-174.
36. Molinari A., Molinari J.F. Mathematical aspects of a new criterion for ranking scientific institutions based on the h-index. Scientometrics 2008, 75(2):339-356.
37. Noyons E., Van Raan A.F.J. Dealing with the data flood. Mining data, text and multimedia 2002, 64-72. The Hague: STT, Beweton. J. Meij (Ed.).
38. Opthof T., Laydesdorff L. Caveats for the journal and field normalizations in the CWTS (" Leiden") evaluation of research performance. Journal of Informetrics 2010, 4(3):423-430.
39. Orr D. Research assessment as an instrument for steering higher education-A comparative study. Journal of Higher Education Policy and Management 2004, 26(3):345-362.
40. Prathap G. Hirsch-type indices for ranking institutions' scientific research output. Current Science 2006, 91:1439.
41. Rousseau R. Reflections on recent developments of the h-index and h-type indices. Proceedings of WIS 2008, Fourth International Conference on Webometrics, Informetrics and Scientometrics & Ninth COLLNET Meeting 2008.
42. Ruanea F., Tol R.S.J. Rational (successive) h-indices: An application to economics in the Republic of Ireland. Scientometrics 2007, 75(2):395-405.
43. Schubert A. Successive h-indices. Scientometrics 2007, 70(1):201-205.
44. Schubert A. Using the h-index for assessing single publications. Scientometrics 2009, 78(3):559-565.
45. Thor, A., & Bornmann, L. (2010). Web application to calculate the single publication h index (and further metrics) based on Google Scholar, http://labs.dbs.uni-leipzig.de/gsh/.
46. Van den Berghe H., Houben J.A., de Bruin R.A., Moed H.F., Kint A., Luwel M., Spruyt E.H.J. Bibliometric indicators of university research performance in Flanders. Journal of the American Society for Information Science 1998, 49(1):59-67.
47. Van Raan A.F.J. The Pandora's box of citation analysis: measuring scientific excellence, the last evil?. The web of knowledge: A Festschrift in honor of Eugene Garfield, ASIS Monograph Series 2000, 301-319. Information Today Inc., Medford, NJ. B. Cronin, H.B. Atkins (Eds.).
48. Van Raan A.F.J. Fatal attraction: Ranking of universities by bibliometric methods. Scientometrics 2005, 62(1):133-143.
49. Van Raan A.F.J. Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups. Scientometrics 2006, 67(3):491-502.
50. Van Raan A.F.J. statistical properties of bibliometric indicators: Research group indicator distributions and correlations. Journal of the American Society for Information Science and Technology 2006, 57(3):408-430.
51. Zachos G. Research output evaluation of two university departments in Greece with the use of bibliometric indicators. Scientometrics 1991, 21(2):195-221.