The Assessment of Science: The Relative Merits of Post-Publication Review, the Impact Factor, and the Number of Citations

PLoS Biology

Volumn 11, Issue 10, 2013, Pages

  Eyre Walker, Adam ^a   Stoletzki, Nina ^b  

^a UNIVERSITY OF SUSSEX   (United Kingdom)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CITATION ANALYSIS; JOURNAL IMPACT FACTOR; MEASUREMENT ERROR; PEER REVIEW; PUBLICATION; QUALITATIVE ANALYSIS; SCIENTIFIC LITERATURE; SCORING SYSTEM;

DATABASES AS TOPIC; HUMANS; JOURNAL IMPACT FACTOR; PEER REVIEW, RESEARCH; PERIODICALS AS TOPIC; SCIENCE;

EID: 84886624151     PISSN: 15449173     EISSN: 15457885     Source Type: Journal    
DOI: 10.1371/journal.pbio.1001675     Document Type: Article

References (21)

1. Allen L, Jones C, Dolby K, Lynn D, Walport M, (2009) Looking for landmarks: the role of expert review and bibliometric analysis in evaluating scientific publication outputs. PloS ONE 4: e5910 doi:10.1371/journal.pone.0005910.
2. Wardle DA, (2010) Do 'Faculty of 1000' (F1000) ratings of ecological publications serve as reasonable predictors of their future impact? Ideas in Ecology and Evolution 3: 11-15.
3. Mahdi S, D'Este P, Neely A (2008) Citation counts: are they good predictors of RAE scores? Available: http://dspace.lib.cranfield.ac.uk/handle/1826/2248.
4. RAE manager (2009) RAE Manager's report. Available: http://www.rae.ac.uk/pubs/2009/manager/manager.pdf.
5. PA Consulting Group (2008) RAE 2008 Accountability Review. Available http://www.hefce.ac.uk/media/hefce/content/pubs/2009/rd0809/rd08_09.pdf.
6. HM Treasury, Department of Trade and IndustryDepartment for Education and SkillsDepartment of Health (2006) Science and innovation investment framework 2004-2014: next steps available at http://webarchive.nationalarchives.gov.uk//http://www.hm-treasury.gov.uk/media/7/8/bud06_science_332v1.pdf.
7. Bollen J, Van de Sompel H, Hagberg A, Chute R, (2009) A principal component analysis of 39 scientific impact measures. PloS ONE 4: e6022 doi:10.1371/journal.pone.0006022.
8. Eyre-Walker A, Stoletzki N (2013) The assessment of science: the relative merits of post-publication review, the impact factor and the number of citations. Dryad data packages 'Wellcome Trust data' and 'F1000 data'. Available: http://dx.doi.org/10.5061/dryad.2h4j5.
9. Opthof T, (1997) Sense and nonsense about the impact factor. Cardiovasc Res 33: 1-7.
10. Knothe G, (2006) Comparative citation analysis of duplicate or highly related publications. J Am Soc Inf Sci Tec 57: 1830-1839.
11. Lariviere V, Gingras Y, (2010) The impact factor's matthew effect: a natural experiment in bibliometrics. J Am Soc Inf Sci Tec 61: 424-427.
12. Seglen PO, (1994) Causal relationship between article citedness and journal impact. J Am Soc Information Sci 45: 1-11.
13. Wardle DA, (1995) Journal citation impact factors and parochial citation practices. Bull Ecol Soc Am 76: 102-104.
14. Paris G, De Leo G, Menozzi P, Gatto M, (1998) Region-based citation bias in science. Nature 396: 210.
15. Leimu R, Koricheva J, (2005) What determines the citation frequency of ecological papers? Trends Ecol Evol 20: 28-32.
16. Baldi S, (1998) Normative versus social constructivist processes in the allocation of citations: anetwork-analytic model. Am Sociol Rev 63: 829-846.
17. Davenport E, Snyder H, (1995) Who cites women? Whom do women cite? An exploration of gender and scholarly citation in sociology. J Doc 51: 404-410.
18. Seglen PO, (1997) Why the impact factor of journals should not be used for evaluating research. BMJ 314: 498-502.
19. Editors (2006) The impact factor game. It is time to find a better way to assess the scientific literature. PLoS Med 3: e291 doi:10.1371/journal.pmed.0030291.
20. REF manager (2012) Panel criteria and working methods. Available: http://www.ref.ac.uk/media/ref/content/pub/panelcriteriaandworkingmethods/01_12.pdf. Higher Education Funding Council of England.
21. RAE manager (2006) RAE 2008 Panel criteria and working methods: Panel D. Available: http://rae.ac.uk/pubs/2006/01/docs/d14.pdf. Higher Education Funding Council of England.