Validating research performance metrics against peer rankings

Ethics in Science and Environmental Politics

Volumn 8, Issue 1, 2008, Pages 103-107

  Harnad, Stevan ^a,b  

^a UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Bibliometrics; Citation analysis; Journal impact factor; Metric validation; Multiple regression; Peer review; Research assessment; Scientometrics; Web metrics

Indexed keywords

MEASUREMENT METHOD; MULTIPLE REGRESSION; PERFORMANCE ASSESSMENT; PREDICTION; RANKING;

EID: 44849083931     PISSN: None     EISSN: 16118014     Source Type: Journal    
DOI: 10.3354/esep00088     Document Type: Article

References (24)

1. Bradley FH (1897/2002) Appearance and reality: a metaphysical essay. Adamant Media Corporation, Boston, MA
2. Brody T, Harnad S, Carr L (2006) Earlier web usage statistics as predictors of later citation impact. J Am Soc Information Sci Technol (JASIST) 57:1060-1072. http://eprints.ees.soton.ac,uk/10713/
3. Brody T, Carr L, Gingras Y, Hajjem C, Harnad S, Swan A (2007) Incentivizing the open access research web: publication-archiving, data-archiving and scientometrics. CTWatch. Quarterly 3(3). http://eprints.ecs.soton.ac.uk/14418/
4. Butler L (2008) Using a balanced approach to bibliometrics: quantitative performance measures in the Australian Research Ouality Framework. Ethics Sci Environ Polit 8: 83-92
5. Campbell P (2008) Escape from the impact factor. Ethics Sci Environ Polit 8:5-7
6. Hajjem C, Harnad S, Gingras Y (2005) Ten-year cross-disciplinary comparison of the growth of open access and how it increases research citation impact. IEEE Data Eng Bull 28(4):39-47. http://epyints.ecs,soton.ac.uk/11688/
7. Harnad S (1985) Rational disagreement in peer review. Sci Technoi Human Values 10:55-62. http://cogprints.org/2128/
8. Harnad S (2004a) The invisible hand of peer review. In: Shatz B (ed) Peer review: a critical inquiry. Rowland & Littlefield, Lanham, MD, p 235-242. http://cogprints.org/1646/
9. Harnad S (2004b) Enrich impact measures through open access analysis. BMJ 2004:329. http://bmj.bmjjournals.com/cgi/eletters/329/7471/0-h#80657
10. Harnad S (2007) Open access scientometrics and the UK research assessment exercise. In: Torres-Salinas D, Moed HF (eds) Proc 11th Annu Meet Int Soc Scientometrics and Informetrics, 25-27 Jun 2007 Madrid, p 27-31 http://eprints.ecs.soton.ac.uk/13804/
11. Harnad S, Brody T (2004) Comparing the impact of open access (OA) vs. non-OA articles in the same journals. D-Lib 10. www.dlib.orcr/dlib/june04/ harnad/06harnad.html
12. Harzing AWK, van der Wal R (2008) Google Scholar as a new source for citation analvsis. Ethics Sci Environ Polit 8:61-73
13. Hirsch JE (2005) An index to quantify an individual's scientific research output. Proc Natl Acad Sci. 102:16569-16572. www.pnas.org/cgi/content/abstract/102/46/16569
14. Hitchcock S, Woukeu A, Brody T, Carr L, Hall W, Harnad S (2003) Evaluating Citebase, an open access web-based citation-ranked search and impact discovery service. http://eprints.ecs.soton.ac.uk-18204/
15. Holmes A, Oppenheimer C (2001) Use of citation analysis to predict the outcome of the 2001 Research Assessment Exercise for Unit of Assessment (UoA) 61: Library and Information Management. Information Research 6(2), http://informationr.net/ir/6-2/paper1.03.html
16. Memberg J M (1999) Hubs, authorities, and cummunities. ACM Computing Sunveys 31(4). www.cs.brown.edu/memex/ACM_HypertextTestbed/papers/10.html
17. Kline P (20001 The new psychometrics: science, psychology and measurement. Routledge, London
18. Lawrence S (2001) Online or invisible? Nature 411:521.
19. Moed HF (2005) Citation analysis in research evaluation. Springer, New York
20. Norris M, Oppenheim C (2003) Citation counts and the Research Assessment Exercise V: archaeology and the 2001 RAE. J Documentation 59(6)709-730. www.garfield.library.upeann.edu/papers/oppenheim.pdf
21. Oppenheim C (1996) Do citations count? Citation indexing and the research assessment exercise. Serials 9:155-161. http://uksg.metapress.com/index/5YCDB0M2K3XGAYAL6.pdf
22. Page L, Brin S, Motwani R, Winograd T (1999) The PageRank citation ranking: bringing order to the web. http://dbpubs.stanford.edu:8090/pub/ 1999-66
23. Shadbot N, Brody T, Carr L, Harnad S (2006) The open research web: a preview of the optimal and the inevitable. In: Jacobs N (ed) Open access: key strategic, technical and economic aspects. Chandos, London. http://eprints.ecs.soton.ac.uk/12453/
24. Smith AT, Eysenck M (2002) The correlation between RAE ratings and citation counts in psychology. Tech Rep. http://cogprint.org/2749/