Diversity, value and limitations of the journal impact factor and alternative metrics

Rheumatology International

Volumn 32, Issue 7, 2012, Pages 1861-1867

  Bornmann, Lutz ^a   Marx, Werner ^b   Gasparyan, Armen Yuri ^c   Kitas, George D ^c,d  

^a MAX PLANCK INSTITUTE   (Germany)

^b MAX PLANCK INSTITUT FÜR FESTKÖRPERFORSCHUNG   (Germany)

^c RUSSELLS HALL HOSPITAL   (United Kingdom)

^d UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

Bibliometrics; Biomedical journals; H Index; Impact factor; Periodicals as topic; Rheumatology

Indexed keywords

BIBLIOMETRICS; JOURNAL IMPACT FACTOR; PRIORITY JOURNAL; PUBLICATION; REVIEW; SCIENTIFIC LITERATURE;

JOURNAL IMPACT FACTOR; PERIODICALS AS TOPIC; RHEUMATOLOGY;

EID: 84863986501     PISSN: 01728172     EISSN: 1437160X     Source Type: Journal    
DOI: 10.1007/s00296-011-2276-1     Document Type: Review

References (54)

1. Archambault É, Lariviére V (2009) History of the journal impact factor: Contingencies and consequences. Scientometrics 79:635-649. doi:10.1007/s11192-007-2036-x
2. Gasparyan AY, Banach M (2009) A medium of science communication in our times. Arch Med Sci 5:1-2
3. Habibzadeh F (2008) Journal impact factor: Uses and misuses. Arch Iran Med 11:453-454
4. Gasparyan AY (2010) Thoughts on impact factors and editing of medical journals. InXamm Allergy Drug Targets 9:2-5. doi:10.2174/187152810791292908
5. Bornmann L, LeydesdorV L, Marx W (2007) Citation environment of angewandte chemie. CHIMIA 61:104-109. doi:10.2533/chimia. 2007.104
6. Retzer V, Jurasinski G (2009) Towards objectivity in research evaluation using bibliometric indicators: A protocol for incorporating complexity. Basic Appl Ecol 10:393-400. doi:10.1016/j.baae.2008.09.001
7. EASE statement on inappropriate use of impact factors. (2007), Eur Sci Ed 33:99-100
8. HoeVel C (1998) Journal impact factors. Allergy 53:1225
9. GarWeld E (2006) The history and meaning of the journal impact factor. JAMA 295:90-93. doi:10.1001/jama.295.1.90 (Pubitemid 43042694)
10. Seglen PO (1997) Why the impact factor of journals should not be used for evaluating research. BMJ 314:498-502 (Pubitemid 27081238)
11. Oswald AJ (2007) An examination of the reliability of prestigious scholarly journals: Evidence and implications for decision-makers. Economica 74:21-31. doi:10.1111/j.1468-0335.2006.00575.x (Pubitemid 46099889)
12. Metze K (2010) Bureaucrats, researchers, editors, and the impact factor: A vicious circle that is detrimental to science. Clin (Sao Paulo) 65:937-940. doi:10.1590/S1807-59322010001000002
13. Krell FT (2010) Should editors inXuence journal impact factors? Learn Publ 23:59-62. doi:10.1087/20100110
14. Dimitrov JD, Kaveri SV, Bayry J (2010) Metrics: Journal's impact factor skewed by a single paper. Nature 466:179. doi:10.1038/466179b
15. Rossner M, Van Epps H, Hill E (2008) Irreproducible results: A response to Thomson ScientiWc. J Exp Med 205:260-261. doi:10.1084/jem.20080053 (Pubitemid 351281590)
16. Rossner M, Van Epps H, Hill E (2007) Show me the data. J Cell Biol 179:1091-1092. doi:10.1083/jcb.200711140 (Pubitemid 350277727)
17. Golubic R, Rudes M, Kovacic N, Marusic M, Marusic A (2008) Calculating impact factor: How bibliographical classiWcation of journal items aVects the impact factor of large and small journals. Sci Eng Ethics 14:41-49. doi:10.1007/s11948-007-9044-3
18. González L, Campanario JM (2007) Structure of the impact factor of journals included in the social sciences citation index: Citations from documents labeled "editorial material". J Am Soc Inf Sci Technol 58:252-262. doi:10.1002/asi.v58:2 (Pubitemid 46134075)
19. Togia A, Tsigilis N (2006) Impact factor and education journals: A critical examination and analysis. Int J Educ Res 45:362-379. doi:10.1016/j.ijer.2007.02.001
20. Caramelli B, Silva MRE (2010) Brazilian medical journals are now facing a big challenge. Eur Sci Ed 36:38-39
21. Satyanarayana K (2010) Impact factor and other indices to assess science, scientists and scientiWc journals. Indian J Physiol Pharmacol 54:197-212
22. Bornmann L, Daniel H-D (2008) What do citation counts measure? A review of studies on citing behavior. J Documentation 64:45-80. doi:10.1108/ 00220410810844150
23. Tomlinson S (2000) The research assessment exercise and medical research. BMJ 320:636-639 (Pubitemid 30175842)
24. Brown H (2007) How impact factors changed medical publishing-And science. BMJ 334:561-564. doi:10.1136/bmj.39142.454086.AD (Pubitemid 46588113)
25. Adler R, Ewing J, Taylor P (2009) Citation statistics. Stat Sci 24:1-14. doi:10.1214/09-STS285
26. Habibzadeh F, Yadollahie M (2011) Evidence-based journalism. Croat Med J 52:212-213. doi:10.3325/cmj.2011.52.212
27. Frey BS, Rost K (2010) Do rankings reXect research quality? J Appl Econ 13:1-38. doi:10.1016/S1514-0326(10)60002-5
28. Moed HF, Van Leeuwen TN, Reedijk J (1996) A critical analysis of the journal impact factors of angewandte chemie and the journal of the American chemical society: Inaccuracies in published impact factors based on overall citations only. Scientometrics 37:105-116. doi:10.1007/BF02093487 (Pubitemid 126449899)
29. Marx W (2001) Angewandte chemie in light of the science citation index. Angew Chem Int Ed 40:139-141. doi:10.1002/1521-3773(20010105)40:13.0.CO;2-4
30. http://www.peerproject.eu/fileadmin/media/PEER-leaflet-2011.pdf. Accessed 15 Sept 2011
31. Bornmann L, Neuhaus C, Daniel H-D (2011) The eVect of a twostage publication process on the journal impact factor: A case study on the interactive open access journal atmospheric chemistry and physics. Scientometrics 86:93-97. doi:10.1007/s11192-010-0250-4
32. Pöschl U (2004) Interactive journal concept for improved scientiWc publishing and quality assurance. Learn Publ 17:105-113. doi:10.1087/ 095315104322958481 (Pubitemid 38516671)
33. Bergstrom CT, West JD, Wiseman MA (2008) The eigenfactor metrics. J Neurosci 28:11433-11434. doi:10.1523/JNEUROSCI. 0003-08.2008
34. Rizkallah J, Sin DD (2010) Integrative approach to quality assessment of medical journals using impact factor, eigenfactor, and article inXuence scores. PLoS One 5:e10204. doi:10.1371/journal. pone.0010204
35. Fersht A (2009) The most inXuential journals: Impact factor and eigenfactor. Proc Natl Acad Sci USA 106:6883-6884. doi:10.1073/pnas.0903307106
36. Mathur VP, Sharma A (2009) Impact factor and other standardized measures of journal citation: A perspective. Indian J Dent Res 20:81-85
37. Licinio J (2006) Molecular psychiatry: The highest immediacy index in the Weld of psychiatry. Mol Psychiatr 11:324. doi:10.1038/sj.mp.4001820
38. Gasparyan AY, Ayvazyan L, Kitas GD (2011) Biomedical journal editing: Elements of success. Croat Med J 52:423-428. doi:10.3325/cmj.2011.52.423
39. The SJR indicator: A new indicator of journals' scientiWc prestige. Available at http://arxiv.org/ftp/arxiv/papers/0912/0912.4141.pdf. Accessed 15 Sept 2011
40. Gonzalez-Pereira B, Guerrero-Bote VP, Moya-Anegon F (2010) A new approach to the metric of journals' scientiWc prestige: The SJR indicator. J Inf 4:379-391. doi:10.1016/j.joi.2010.03.002
41. Gasparyan AY (2011) Get indexed and cited, or perish. Eur Sci Ed 37:66
42. http://www.scimagojr.com/journalrank.php. Accessed 15 Sept 2011
43. Falagas ME, Kouranos VD, Arencibia-Jorge R, Karageorgopoulos DE (2008) Comparison of SCImago journal rank indicator with journal impact factor. FASEB J 22:2623-2628. doi:10.1096/fj.08-107938
44. Bornmann L, Daniel H-D (2009) The state of h index research. Is the h index the ideal way to measure research performance. EMBO Rep 10:2-6. doi:10.1038/embor.2008.233
45. Hirsch JE (2005) An index to quantify an individual's scientiWc research output. Proc Natl Acad Sci USA 102:16569-16572. doi:10.1073/pnas.0507655102 (Pubitemid 41688817)
46. Braun T, Glänzel W, Schubert A (2006) A Hirsch-Type index for journals. Scientometrics 69:169-173. doi:10.1007/s11192-006-0147-4 (Pubitemid 44386718)
47. Kanter SL (2009) Understanding the journal's impact. Acad Med 84:1169-1170. doi:10.1097/ACM.0b013e3181b7ffa6
48. http://www.bioinformation.net/. Accessed 15 Sept 2011
49. Chen M, Zhao MH, Kallenberg CG (2011) The impact factor of rheumatology journals: An analysis of 2008 and the recent 10 years. Rheumatol Int 31:1611-1615. doi:10.1007/s00296-010-1541-z
50. Bornmann L, Marx W (2011) The h index as a research performance indicator. Eur Sci Ed 37:77-80
51. Bornmann L, Marx W, Schier H (2009) Hirsch-Type index values for organic chemistry journals: A comparison of new metrics with the Journal Impact Factor. Eur J Org Chem 2009:1471-1476. doi:10.1002/ejoc.200801243
52. Rieder S, Bruse CS, Michalski CW, KleeV J, Friess H (2010) The impact factor ranking-A challenge for scientists and publishers. Langenbecks Arch Surg 395(Suppl 1):69-73. doi:10.1007/s00423-010-0623-4
53. KovaciT N, HuiT M, Ivanis A (2008) Citation analysis of the croatian medical journal: The Wrst 15 years. Croat Med J 49:12-17. doi:10.3325/cmj.2008. 1.12 (Pubitemid 351346737)
54. http://rescomp.stanford.edu/cheshire/EinsteinQuotes.html. Accessed 17 Sept 2011