Correlation between Journal Impact Factor and Citation Performance: An experimental study

Journal of Informetrics

Volumn 7, Issue 2, 2013, Pages 357-370

  Finardi, Ugo ^a,b  

^a CNR   (Italy)

^b UNIVERSITY OF TURIN   (Italy)

Author keywords

Article citations; Correlation coefficients; Garfield; Impact factor misuses; Journal Impact Factor; Time evolution

Indexed keywords

ARTICLE CITATIONS; CORRELATION COEFFICIENT; GARFIELD; IMPACT FACTOR; TIME EVOLUTIONS;

EID: 84873688036     PISSN: 17511577     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.joi.2012.12.004     Document Type: Article

References (51)

1. Albarrán P., Ruiz-Castillo J. References made and citations received by scientific articles. Journal of the American Society for Information Science and Technology 2011, 62(1):40-49.
2. Albarrán P., Crespo J.A., Ortuño I., Ruiz-Castillo J. A comparison of the scientific performance of the U.S. and the European Union at the turn of the 21st century. Scientometrics 2010, 85(1):329-344.
3. Amez L. Citation measures at the micro level: Influence of publication age, field, and uncitedness. Journal of the American Society for Information Science and Technology 2012, 63(7):1459-1465.
4. Archambault E., Larivière V. History of the journal impact factor: Contingencies and consequences. Scientometrics 2009, 79(3):635-649.
5. Balaban A.T. Positive and negative aspects of citation indices and journal impact factor. Scientometrics 2012, 92(2):241-247.
6. Bensman S.J. Garfield and the impact factor. Annual Review of Information Science and Technology 2007, 41(1):93-155.
7. Bensman, S.J. (2007). Garfield and the Impact Factor: The creation, utilization, and validation of a citation measure: Part 2, The probabilistic, statistical, and sociological bases of the measure, unpublished, available at: (accessed December 2012). http://garfield.library.upenn.edu/bensman/bensmanegif22007.pdf.
8. Bensman S.J. The impact factor: Its place in Garfield's thought, in science evaluation, and in library collection management. Scientometrics 2012, 92(2):263-275. 10.1007/s11192-011-0601-9.
9. Campanario J.M. Some research ideas on Journal Impact Factor as a crucial topic in science dynamics. Scientometrics 2012, 92(2):293-295. 10.2007/s11192-012-0650-8.
10. Fieller E.C., Pearson E.S. Tests for rank correlation coefficients. II. Biometrika 1961, 48(1/2):29-40.
11. Fieller E.C., Harley H.O., Pearson E.S. Tests for rank correlation coefficients. I. Biometrika 1957, 44(3/4):470-481.
12. Fisher R.A. Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika 1915, 10(4):507-521.
13. Fisher R.A. On the " Probable Error" of a coefficient of correlation deduced from a small sample. Metron 1921, I(4):3-32.
14. Franceschet M. Journal influence factors. Journal of Informetrics 2010, 4(3):239-248.
15. Garfield E. Citation indexes for science: A new dimension in documentation through association of ideas. Science 1955, 122(3159):108-111.
16. Garfield E. Citation analysis as a tool for journal evaluation. Science 1972, 178:471-479.
17. Garfield E. The Thomson Reuters impact factor (accessed 20.07.12). http://thomsonreuters.com/products_services/science/free/essays/impact_factor/.
18. Garfield E. The impact factor and using it correctly. Der Unfallchirurg 1997, 48(2):413.
19. Garfield E. The agony and the ecstasy - The history and meaning of the journal impact factor. Paper presented by Eugene Garfield at international congress on peer review and biomedical publication 2005.
20. Garfield E. The history and meaning of the journal impact factor. Journal of the American Medical Association 2006, 295(1):90-93.
21. Garfield E., Sher I.H. New factors in the evaluation of scientific literature through citation indexing. American Documentation 1963, 14(3):195-201.
22. Garfield E., Sher I.H. New tools for improving and evaluating the effectiveness of research. Research program effectiveness, Proceedings of the conference sponsored by the office of naval research 1966, 135-146. M.C. Yovits, D.M. Gilford, R.H. Wilcox, E. Staveley, H.D. Lemer (Eds.).
23. Glänzel W., Thijs B., Schubert A., Debackere K. Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance. Scientometrics 2009, 78(1):165-188.
24. Herranz N., Ruiz-Castillo J. Sub-field normalization in the multiplicative case: Average-based citation indicators. Journal of Informetrics 2012, 6(XX):543-556.
25. Howell D.C. Statistical methods for psychology 2010, Cengage Wadsworth, Belmont, USA, ISBN 978-0-495-59784-1.
26. Ingwersen P. The pragmatics of a diachronic journal impact factor. Scientometrics 2012, 92(2):319-324. 10.1007/s11192-012-0701-1.
27. Leydesdorff L. Can scientific journals be classified in terms of aggregated journal-journal citation relations using the journal citation reports?. Journal of the American Society for Information Science and Technology 2006, 57(5):601-6013.
28. Leydesdorff L. Caveats for the use of citation indicators in research and journal evaluations. Journal of the American Society for Information Science and Technology 2008, 59(2):278-287.
29. Liang, L., Rousseau, R., Zhong, Z. (2012), Non-English journals and papers in physics and chemistry: Bias in citations? Scientometrics, doi:10.1007/s11192-012-0828-0.
30. Moed H.F. Measuring contextual citation impact of scientific journals. Journal of Informetrics 2010, 4(3):265-277.
31. Moed H.F., Colledge L., Reedijk J., Moya-Anegon F., Guerrero-Bote V., Plume A., et al. Citation-based metrics are appropriate tools in journal assessment provided that they are accurate and used in an informed way. Scientometrics 2012, 92(2):367-376. 10.1007/s11192-012-0679-8.
32. Mutz R., Daniel H.-D. Skewed citation distribution and bias factor: Solutions to two core problems with the journal impact factor. Journal of Informetrics 2012, 6(2):169-176.
33. Pearson E.S., Snow B.A.S. Tests for rank correlation coefficients. III. Distribution of the Transformed Kendall coefficient. Biometrika 1962, 49(1/2):185-191.
34. Pendlebury D.A. The use and misuse of journal metrics and other citation indicators. Archivum Immunologiae et Therapiae Experimentalis 2009, 57(1):1-11.
35. Pendlebury D.A., Adams J. Comments on a critique of the Thomson Reuters journal impact factor. Scientometrics 2012, 92(2):395-401.
36. Potì B., Cerulli G., Romagnosi S. The different impact on scientific output of academic-owned vs. academic-invented patents: Evidence from a panel of Italian academic inventors. International Journal of Business Innovation and Research 2012, 64:433-457.
37. Rousseau R. Updating the journal impact factor or total overhaul?. Scientometrics 2012, 92(2):413-417. 10.1007/s11192-012-0649-1.
38. Seglen P.O. Causal relationship between article citedness and journal impact. Journal of the American Society for Information Science and Technology 1994, 45(1):1-11.
39. Seglen P.O. Why the impact factor of journals should not be used for evaluating research. British Medical Journal 1997, 314(7079):498-502.
40. The impact factor game. PLoS Medicine 2006, 3(6). The PLoS Medicine Editors, pp. e291 (0707-0708).
41. van Leeuwen T. Discussing some basic critique on Journal Impact Factors: Revision of earlier comments. Scientometrics 2012, 92(2):443-455.
42. Vanclay J.K. Bias in the journal impact factor. Scientometrics 2009, 78(1):3-12.
43. Vanclay J.K. Impact factor: Outdated artefact or stepping-stone to journal certification?. Scientometrics 2011, 92(2):211-238. 10.1007/s11192-011-0561-0.
44. Vieira E.S., Gomes J.A.N.F. Citations to scientific articles: Its distribution and dependence on the article features. Journal of Informetrics 2010, 4(1):1-13.
45. Vinkler P. Relations of relative scientometric indicators. Scientometrics 2003, 58(3):687-694.
46. Vinkler P. Introducing the Current Contribution Index for characterizing the recent, relevant impact of journals. Scientometrics 2009, 79(2):409-420.
47. Vinkler P. The Garfield impact factor, one of the fundamental indicators in scientometrics. Scientometrics 2012, 92(2):471-483. 10.1007/s11192-012-0688-7.
48. Vinkler P. The case of scientometricians with the " absolute relative" impact indicator. Journal of Informetrics 2012, 6(2):254-264.
49. Wessa, P. (2012). Free statistics software, office for research development and education, version 1.1.23-r7, URL http://www.wessa.net/.
50. Wilhite A.W., Fong E.A. Coercive citation in academic publishing. Science 2012, 335(6068):542-543.
51. Wu J. Investigating the universal distribution of normalized indicators and developing field-independent index. Journal of Informetrics 2013, 7(1):63-71.