Journals ranking and impact factors: How the performance of journals is measured

The Future of the Academic Journal: Second Edition

Volumn , Issue , 2014, Pages 259-298

  Craig, Iain D ^a   Ferguson, Liz ^b   Finch, Adam T ^c  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b Wiley STM publishing division   (United Kingdom)

^c CSIRO   (Australia)

Author keywords

Alternative bibliometrics; Journal Impact factor; Journals ranking

Indexed keywords

EID: 85017588593     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1533/9781780634647.259     Document Type: Chapter

References (67)

1. Assessment Framework and Guidance on Submissions In Research Excellence Framework 2012, Available from:, (accessed 25 April 2013). http://www.ref.ac.uk/media/ref/content/pub/assessmentframeworkandguidanceonsubmissions/GOS%20including%20addendum.pdf.
2. Bensman S. Garfield and the impact factor. Annual Review of Information Science and Technology 2007, 41(1):93-155.
3. Bibliometrics Pilot Exercise (n.d.). In Higher Education Funding Council for England. Available from: http://www.ref.ac.uk/background/bibliometrics (accessed 25 April 2013).
4. Bibliometrics and the Research Excellence Framework (n.d.). In Higher Education Funding Council for England. Available from: http://www3imperial.ac.uk/pls/portallive/docs/1/46819696.PDF. (accessed 25 April 2013).
5. Bollen J., Van de Sompel H., Rodriguez M.A. Towards usage-based impact metrics: first results from the MESUR Project 2008, 231-240. Doi: 10.1 145/1378889.1378928. Available from:. http://www.dx.doi.org/10.1145/1378889.1378928.arXiv:0804.3791v1.
6. Bornmann L., Mutz R., Daniel H.-D. Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine. Journal of the American Society for Information Science and Technology 2008, 59(5):830-837.
7. Butkovich N.J. Use studies: a selective review. Library Resources & Technical Services 1996, 40:359-368.
8. Cameron B.D. Trends in the usage of ISI bibliometric data: uses, abuses, and implications. Libraries and the Academy 2005, 5:105-125.
9. Campbell P. Escape from the impact factor. Ethics in Science and Environmental Politics 2008, 8:5-7.
10. Case D., Higgins G. How can we investigate citation behavior? A study of reasons for citing literature in communication. Journal of the American Society for Information Science 2000, 51(7):635-645.
11. Costas R., Bordons M. The h-index: advantages, limitations and its relation with other bibliometric indicators at the micro level. Journal of Informetrics 2007, 1(3):193-203.
12. Creagh S. Journal rankings ditched: the experts respond. The Conversation 2011, (June). Available from:, (accessed 19 April 2013). http://www.theconversation.com/journal-rankings-ditched-the-experts-respond-1598.
13. Davis P. The emergence of a citation cartel. The Scholarly Kitchen 2012, (10 April). Available from:, (accessed 22 April 2013). http://www.scholarlykitchen.sspnet.org/2012/04/10/emergence-of-a-citation-cartel/.
14. Egghe L. An improvement of the h-index: the g-index. ISSI Newsletter 2006, 2(1):8-9.
15. ERA Evaluation Handbook 2012, In Australian Research Council. Available from:, (accessed 25 April 2013). http://www.arc.gov.au/pdf/era12/ERA%202012%20Evaluation%20Handbook_final%20for%20web_protected.pdf.
16. ERIH (n.d.) Context and Background of ERIH. In European Science Foundation. Available from: http://www.esf.org/research-areas/humanities/research-infrastructures-including-erih/context-and-background-of-erih.html (accessed 29 October 2008).
17. ERIH Foreword (n.d.) In European Science Foundation. Available from: http://www.esf.org/hosting-experts/scientific-review-groups/humanities/erih-european-reference-index-for-the-humanities/erih-foreword.html (accessed 25 April 2013).
18. ERIH Summary Guidelines (n.d.) In European Science Foundation. Accessed 29 October 2008. No longer available.
19. Ewing J. Measuring journals. Notices of the American Mathematical Society 2006, 53:1049-1053.
20. Excellence in Research for Australia In Australian Research Council 2008, 2 October, Available from:, (accessed 29 October 2008). http://www.arc.gov.au/era.
21. Falagas M.E., Pitsouni E.I., Malietzis G.A., Pappas G. Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses. The FASEB Journal 2008, 22(2):338-342.
22. Garfield E. Citation indexes to science: a new dimension in documentation through association of ideas. Science 1955, 122(3159):108-111.
23. Harnad S. Open access scientometrics and the UK Research Assessment Exercise 2007, 27-33. I, Madrid, Spain, 25-7 June. D. Torres-Salinas, H. Moed (Eds.).
24. Hirsch J.E. An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences USA 2005, 102(46):16569-16572.
25. Jin B.H., Liang L., Rousseau R., Egghe L. The R- and AR-indices: complementing the h-index. Chinese Science Bulletin 2007, 52(6):855-863.
26. Journal Citation Report Notices 2008, Available from:, (accessed 29 October 2008). http://www.admin-apps.isiknowledge.com/JCR/static_html/notices/notices.htm.
27. Journal Citation Report Notices 2011, Available from:, (accessed 25 April 2013). http://www.admin-apps.webofknowledge.com/JCR/static_html/notices/notices.htm.
28. Journals under Threat A Joint Response from History of Science, Technology and Medicine Editors 2008, 19 October, Available from:, (accessed 29 October 2008). http://www.listserv.liv.ac.uk/cgi-bin/wa?A2=ind0810&L=classicists&T=0&P=5072.
29. Journal Usage Factor (n.d.) Results, recommendations and next steps. Available from: http://www.projectcounter.org/documents/Journal_Usage_Factor_extended_report_July.pdf (accessed 25 April 2013).
30. Journal Usage Factor Exploratory data analysis 2011, Available from:, (accessed 25 April 2013). http://www.projectcounter.org/documents/CIBER_final_report_July.pdf.
31. Kessler M.M. Bibliographic coupling between scientific papers. American Documentation 1963, 14:10-25.
32. Ketcham C.M., Crawford J.M. The impact of review articles. Laboratory Investigation 2007, 87(12):1174-1185.
33. Kosmulski M. A new Hirsch-type index saves time and works equally well as the original h-index. ISSI Newsletter 2006, 2(3):4-6.
34. Lehmann S.J. Measures for Measures. Nature 2006, 44:1003-1004.
35. Leydesdorff L., Felt U. Edited volumes, monographs and book chapters in the Book Citation Index (BKCI) and Science Citation Index (SCI, SoSCI, A&HCI). Journal of Scientometric Research 2012, 1(1):28-34.
36. Marshakova I. System of documentation connections based on references (SCI). Nauchno-Tekhnicheskaya Informatsiya Seriya 1973, 2(6):3-8.
37. McVeigh, M.E. (n.d.) Journal self-citation in the Journal Citation Reports - Science Edition (2002). In Thomson Reuters. Available from: http://wokinfo.com/essays/journal-self-citation-jcr/ (accessed 29 October 2008).
38. McVeigh M.E., Mann S.J. The Journal Impact Factor denominator: defining citable (counted) items. Journal of the American Medical Association 2009, 302(10):1107-1109.
39. Moed H.F. Citation Analysis in Research Evaluation 2005, 126. Springer, Dordrecht.
40. Moed H.F. UK Research Assessment Exercises: informed judgements on research quality or quantity?. Scientometrics 2008, 74(1):153-161.
41. Moed H.F., Van Leeuwen Th.N. Improving the accuracy of Institute for Scientific Information's journal impact factors. Journal of the American Society for Information Science 1995, 46(6):461-467.
42. Moed H.F., Van Leeuwen Th.N., Reedijk J. A critical analysis of the journal impact factors of Angewandte Chemie and the Journal of the American Chemical Society inaccuracies in published impact factors based on overall citations only. Scientometrics 1996, 37(1):105-116.
43. Monastersky R. The number that's devouring science. The Chronicle of Higher Education 2005, 52(8):A12.
44. Morris S. Mapping the journal publishing landscape: how much do we know?. Learned Publishing 2007, 20(4):299-310.
45. Morrison H.G. Freedom for scholarship in the Internet age. Unpublished thesis, Simon Fraser University 2012, Available from:, (accessed 19 April 2013). http://www.summit.sfu.ca/system/files/iritems1/12537/etd7530_HMorrison.pdf.
46. Newman D. Journal use reports: easier collection development 2005, February, In Thomson Reuters. Available from:, (accessed 29 October 2008). http://www.scientific.thomsonreuters.com/news/2006-01/8310175.
47. Nicholas D., Huntington P., Jamali H.R., Tenopir C. What deep log analysis tells us about the impact of big deals: case study OhioLINK. Journal of Documentation 2006, 62(4):482-508.
48. Peters H.P.F., Van Raan A.F.J. On determinants of citation scores: a case study in chemical engineering. Journal of the American Society for Information Science 1994, 45(1):39-49.
49. Pinski G., Narin F. Citation influence for journal aggregates of scientific publications: theory with application to literature of physics. Information Processing & Management 1976, 12(5):297-312.
50. Potter C.V., Dean J.L., Kybett A.P., Kidd R., James M., et al. Comment: 2004's fastest organic and biomolecular chemistry!. Organic and Biomolecular Chemistry 2004, 2(24):3535-3540.
51. Price J. Are they any use? Hazards of price-per-use comparisons in e-journal management 2007, 17 April, Available from:, (accessed 4 January 2008). http://www.uksg.org/sites/uksg.org/files/jprice:plenary_presentation_2007.pps.
52. Pudovkin A.I., Garfield E. Rank-normalized impact factor: a way to compare journal performance across subject categories. Proceedings of the American Society for Information Science and Technology 2004, 41(1):507-551.
53. Reedijk J., Moed H.F. Is the impact of impact factor decreasing?. Journal of Documentation 2008, 64(2):183-192.
54. Research Excellence Framework Consultation on the assessment and funding of higher education research post-2008 2007, November, In Higher Education Funding Council for England. Available from:, (accessed 29 October 2008). http://www.hefce.ac.uk/pubs/hefce/2007/07_34/.
55. Rowlands I., Nicholas D. New journal publishing models: the 2005 CIBER survey of journal author behaviour and attitudes 2005, In UCL Centre for Publishing. Available from:, (accessed 29 October 2008). http://www.publishing.ucl.ac.uk/papers/2005aRowlands_Nicholas.pdf.
56. Schonfeld R., King D., Okerson A., Fenton E. The Nonsubscription Side of Periodicals: Changes in Library Operations and Cost between Print and Electronic Formats 2004, Council of Library and Information Resources, Washington, DC.
57. Schubert A., Glänzel W. A systematic analysis of Hirsch-type indices for journals. Journal of Informetrics 2007, 1(3):179-184.
58. Seglen P.O. The skewness of science. Journal of the American Society for Information Science and Technology 1992, 43(9):628-638.
59. Seglen P.O. Why the impact factor of journals should not be used for evaluating research. BMJ 1997, 314(7079):498-502.
60. Small H. Co-citation in the scientific literature: a new measurement of the relationship between two documents. Journal of the American Society of Information Science 1973, 24(4):265-269.
61. Sombatsompop N., Markpin T., Premkamolnetr N. A modified method for calculating the impact factors of journals in ISI Journal Citation Reports: polymer science category in 1997-2001. Scientometrics 2004, 60(2):217-235.
62. Standardized Usage Statistics Harvesting Initiative (SUSHI) (n.d.). In National Information Standards Organization. Available from: http://www.niso.org/workrooms/sushi(accessed 29 October 2008).
63. Technology Overview (n.d.). In Google - Corporate Information. Available from: http://www.google.com/corporate/tech.html (accessed 29 October 2008).
64. Testa J. The Thomson Scientific journal selection process 2012, In Thomson Reuters. Available from:, (accessed 22 April 2013). http://www.thomsonreuters.com/products_services/science/free/essays/journal_selection_process/.
65. The PLoS Medicine Editors The impact factor game. PLoS Medicine 2006, 3(6):e291.
66. Tsay M., Chen Y.-L. Journals of general and internal medicine and surgery: an analysis and comparison of citation. Scientometrics 2005, 64(1):17-30.
67. Weale A.R., Bailey M., Lear P.A. The level of non-citation of articles within a journal as a measure of quality: a comparison to the impact factor. BMC Medical Research Methodology 2004, 4(14). 10.1186/1471-2288-4-14.