Evaluating research - peer review team assessment and journal based bibliographic measures: New Zealand PBRF research output scores in 2006

New Zealand Economic Papers

Volumn 47, Issue 2, 2013, Pages 140-157

  Anderson, David L ^a,b   Smart, Warren ^c   Tressler, John ^d  

^a QUEEN S UNIVERSITY   (Canada)

^b UNIVERSITY OF WAIKATO   (New Zealand)

^c Ministry of Education   (New Zealand)

^d UNIVERSITY OF WAIKATO   (New Zealand)

Author keywords

bibliometrics; journal weighting schemes; PBRF; research measurement

Indexed keywords

EID: 84880618865     PISSN: 00779954     EISSN: 19434863     Source Type: Journal    
DOI: 10.1080/00779954.2013.772879     Document Type: Article

References (33)

1. Abelson, P. 2009. The ranking of economics journals by the Economic Society of Australia. Economic Papers, 28 (2): 176 - 180. doi: 10.1111/j.1759-3441.2009.00020.x
2. Adams, J. 2008. Strategic review of the performance-based research fund: the assessment process. Report Prepared for the TEC by Evidence Ltd,
3. Anderson, D. L. and Tressler, J. 2008. Research output in New Zealand economics departments 2000-2006. New Zealand Economic Papers, 42 (2): 155 - 189. doi: 10.1080/00779950809544420
4. Anderson, D. L. and Tressler, J. 2009. The 'Excellence in Research for Australia' scheme: A test drive of draft journal weights with New Zealand data. Agenda, 16 (4): 7 - 25.
5. Anderson, D. L. and Tressler, J. 2011. Ranking economics departments in terms of residual productivity: New Zealand economics departments, 2000-2006. Australian Economic Papers, 50 (4): 157 - 168. doi: 10.1111/j.1467-8454.2011.00418.x
6. Anderson, D. L. and Tressler, J. 2012. The impact of journal weighting scheme characteristics on research output measurement in economics: The case of New Zealand. Review of Economics and Institutions, 3 (3): Article 4 doi: 10.5202/rei.v3i3.95
7. Bauwens, L. 1998. A new method to rank university research and researchers in economics in Belgium Unpublished paper, CORE, Universite Catholique de Louvain, Louvain, Belgium. (www.core.ucl.ac.be/econometrics/bauwens/rankings/method.doc)
8. Chang, C. L., McAleer, M. and Oxley, L. 2011. What makes a great journal great in economics? The singer not the song. Journal of Economic Surveys, 25 (2): 326 - 361. doi: 10.1111/j.1467-6419.2010.00648.x
9. Excellence for Research in Australia. 2010. Final Journal Rankings. Retrieved from http://www.arc.gov.au/era/era_2010/archive/era_journal_list.htm
10. Franceschet, M. and Costantino, A. 2011. The first Italian research assessment exercise: A bibliometric perspective. Journal of Informetrics, 5 (2): 275 - 291. doi: 10.1016/j.joi.2010.12.002
11. Geary, J., Marriott, L. and Rowlinson, M. 2004. Journal rankings in business and management and the 2001 research assessment exercise in the UK. British Journal of Management, 15 (2): 95 - 141. doi: 10.1111/j.1467-8551.2004.00410.x
12. Gibson, J. 2000. Research productivity in New Zealand University economics departments: Comments and update. New Zealand Economic Papers, 34 (1): 73 - 87. doi: 10.1080/00779950009544316
13. Gibson, J., Anderson, D. L. and Tressler, J. 2012. Which journal rankings best explain academic salaries? Evidence from the University of California, University of Waikato. Working Papers in Economicswww.RePEc.org
14. Journal Citation Reports (JCR). 2008. Impact Factor, Economics. Retrieved from http://www.wokinfo.com/products_tools/analytical/jcr/
15. Kalaitzidakis, P., Mamuneas, T. and Stengos, T. 2003. Rankings of academic journals and institutions in economics. Journal of the European Economic Association, 1 (6): 1346 - 1366. doi: 10.1162/154247603322752566
16. Kalaitzidakis, P., Mamuneas, T. and Stengos, T. 2010. An updated ranking of academic journals in economics, Guelph, Canada: Economics Department, University of Guelph. Working Paper 9/2010
17. Kodrzycki, Y. K. and Yu, P. 2006. New approaches to ranking economics journals. B.E. Journal of Economic Analysis and Policy: Contributions to Economic Analysis and Policy, 5 (1): Article 24
18. Laband, D. and Piette, M. 1994. The relative impact of economics journals. Journal of Economic Literature, 32 (2): 640 - 666.
19. Liebowitz, S. J. and Palmer, J. P. 1984. Assessing the relative impact of economics journals. Journal of Economic Literature, 22 (1): 77 - 88.
20. Macri, J., McAleer, M. and Sinha, D. 2010. On the robustness of alternative ranking methodologies: Australian and New Zealand departments 1988 to 2002. Applied Economics, 42: 1247 - 1268.
21. Macri, J. and Sinha, D. 2006. Rankings methodology for international comparisons of institutions and individuals: An application to economics in Australia and New Zealand. Journal of Economic Surveys, 20 (1): 111 - 156. doi: 10.1111/j.0950-0804.2006.00277.x
22. Mason, P., Steagall, J. and Fabritius, M. 1997. Economics journal rankings by type of school: Perceptions versus citations. Quarterly Journal of Business and Economics, 36 (1): 69 - 79.
23. Mingers, J., Watson, K. and Scaparra, P. 2009. Estimating business and management Journal quality from the 2008 research assessment exercise in the UK, United Kingdom: Kent Business School. Working Paper No. 205
24. Nederhof, A. J. and van Raan, A. F.J. 1993. A bibliographic analysis of six economics research groups: A comparison with peer review. Research Policy, 82: 353 - 368. doi: 10.1016/0048-7333(93)90005-3
25. Norris, M. and Oppenheim, C. 2003. Citation counts and the research assessment exercise V: Archaeology and the 2001 RAE. Journal of Documentation, 59 (6): 709 - 730. doi: 10.1108/00220410310698734
26. OECD. 2010. Performance-based funding for public research in tertiary education institutions. Workshop Proceedings, OECD Publishing, http://dx.doi.org/10.1787/9789264094611-en
27. Research Papers in Economics (RePEc). IDEAS/RePEc Recursive Discounted Impact Factors for Journals, Retrieved from http://ideas.repec.org/top/top.journals.rdiscount.html
28. Sinha, D. and Macri, J. 2002. Rankings of Australian economics departments, 1988-2000. Economic Record, 78 (241): 136 - 146. doi: 10.1111/1475-4932.00019
29. Smart, W. 2007. " Quality vs impact: A comparison of performance-based research fund quality scores with citations ". In Ministry of Education Wellington
30. Taylor, J. 2011. The assessment of research quality in UK universities: Peer review or metrics. British Journal of Management, 22: 202 - 217. doi: 10.1111/j.1467-8551.2010.00722.x
31. TEC. 2011. " Performance based research fund: Quality evaluation guidelines ". In Tertiary Education Commission, Wellington: Te Amorangi Mātaunanga Matua.
32. TEC. 2005. " Performance based research fund guidelines (2006) ". In Tertiary Education Commission, Wellington: Te Amorangi Mātaunanga Matua.
33. Towe, J. and Wright, D. 1995. Research published by Australian economics and econometric departments: 1988-93. Economic Record., 71 (212): 8 - 17. doi: 10.1111/j.1475-4932.1995.tb01867.x