Citation Metrics: Serious Drawbacks, Perverse Incentives, and Strategic Options for Heterodox Economics

American Journal of Economics and Sociology

Volumn 69, Issue 5, 2010, Pages 1376-1408

  Kapeller, Jakob ^a  

^a JOHANNES KEPLER UNIVERSITY LINZ   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77955870603     PISSN: 00029246     EISSN: 15367150     Source Type: Journal    
DOI: 10.1111/j.1536-7150.2010.00750.x     Document Type: Article

References (52)

1. Adler, R., J. Ewing, and P. Taylor (2008). "Citation Statistics." URL: (dl. 01-04-09).
2. Amin, M., and M. Mabe (2000). "Impact Factors: Use and Abuse. Perspectives in Publishing, October 2000: 1-6.
3. Backhouse, R. E. (2004). "A Suggestion for Clarifying the Study of Dissent in Economics. Journal of the History of Economic Thought 26: 261-271.
4. Bedeian, A. G. (2003). "The Manuscript Review Process: The Proper Roles of Authors, Referees, and Editors Journal of Management Inquiry 12: 331-338.
5. Bergstrom, T. C., and R. Lavaty (2007). "How Often Do Economists Self-Archive?" eScholarshipRepository, University of California Santa Barbara, Department of Economics. URL: (dl. 15-05-09).
6. Cronin, B. (2008). "Journal Citation Among Heterodox Economists 1995-2007: Dynamics of Community Emergence. On the Horizon 16: 226-240.
7. Cronin, B., H. Snyder, and H. Atkins (1997). "Comparative Citation Rankings of Authors in Monographic and Journal Literature: A Study of Sociology. Journal of Documentation 53: 263-273.
8. Davis, W. L. (2004). "Preference Falsification in the Economics Profession. Econ Journal Watch 1: 359-367.
9. Davis, W. L. (2007). "Economists' Opinion of Economists' Work. American Journal for Economics and Sociology 66: 267-288.
10. Diamond, A. M. (1989). "The Core Journals of Economics. Current Contents 12: 3-9.
11. Dobusch, L. (2009). "Von Open Access zu Free Knowledge." In Gerechtigkeit. Eds. B. Blaha and J. Weidenholzer Wien: Braumüller.
12. Dobusch, L., and J. Kapeller (2009). "Why is Economics Not an Evolutionary Science? New Answers to Veblen's Old Question. Journal of Economic Issues 43(4): 867-898.
13. Dolfsma, W., and L. Leydesdorff (2008). "Journals as Constituents of Scientific Discourse: Economic Heterodoxy. On the Horizon 16: 214-225.
14. Earl, P. E. (2008). "Heterodox Economics and the Future of Academic Publishing. On the Horizon 16: 205-213.
15. European Commission (2004). Mapping of Excellence in Economics. Luxemburg.
16. Evans, J. T., H. I. Nadjari, and S. A. Burchell (1990). "Quotational and Reference Accuracy in Surgical Journals-A Continuing Peer-Review Problem. Journal of the American Medical Association 263: 1353-4.
17. Förster, H. v. (1993). Wissen und Gewissen-Versuch einer Brücke. Frankfurt: Suhrkamp.
18. Fröhlich, G. (2008). "Wissenschaftskommunikation und ihre Dysfunktionen: Wissenschafts-journale, Peer Review, Impact Faktoren." In WissensWelten. Eds. H. Hettwer, M. Lehmkuhl, H. Wormer, and F. Zotta Gütersloh: Bertelsmann.
19. Gans, J., and G. B. Shepherd (1994). "How are the Mighty Fallen: Rejected Classical Articles by Leading Economists. Journal of Economic Perspectives 8: 165-180.
20. Garfield, E. (1990). "How ISI Selects Journals for Coverage: Quantitative and Qualitative Considerations. Current Contents 22: 5-13.
21. Garfield, E. (1994). "The Thomson Scientific Impact Factor." URL: (dl. 24-03-09).
22. Garfield, E. (1998). "Long-Term vs. Short-Term Journal Impact (Part II). Scientist 12: 12-13. URL: (dl. 15-04-09).
23. Garfield, E. (2005). "The Agony and the Ecstasy-The History and Meaning of the Journal Impact Factor." Presentation at the International Congress on Peer Review and Biomedical Publication, Chicago, September 16, 2005. URL: (dl. 17-05-09).
24. Green, K. (1998). "The Gender Composition of Editorial Boards in Economics." Royal Economic Society's Committee on Women in Economics. URL: (dl. 22-03-09).
25. Hirschman, A. O. (1970). Exit, Voice, and Loyalty: Responses to Decline in Firms, Organizations, and States. Cambridge, MA: Harvard University Press.
26. Hooydonk, G. v., and G. Milis-Proost (1998). "Measuring Impact by a Full Option Method and the Notion of Bibliometric Spectra. Scientometrics 41: 169-183.
27. Jong-a-Pin, R., and J. De Haan (2008). "Growth Accelerations and Regime Changes: A Correction. Econ Journal Watch 5: 51-58.
28. Kapeller, J. (2010). "Some Critical Notes on Citation Metrics and Heterodox Economics. Review of Radical Political Economics 42: 330-337.
29. Klein, D. B., and E. Chiang (2004). "The Social Science Citation Index: A Black Box-With an Ideological Bias? Econ Journal Watch 1: 134-165.
30. Lee, F. S. (2007). "The Research Assessment Exercise, the State and the Dominance of Mainstream Economics in British Universities. Cambridge Journal of Economics 31: 309-325.
31. Lee, F. S. (2008a). "A Comment on the Citation Impact of Feminist Economics. Feminist Economics 14: 137-142.
32. Lee, F. S. (2008b). "A Case for Ranking Heterodox Journals and Departments. On the Horizon 16: 241-251.
33. Lee, F. S. (2009a). "Informational Directory for Heterodox Economists: Graduate and Undergraduate Programs, Journals, Publishers and Book Series, Associations, Blogs, and Institutes and other Websites." URL: (dl. 20-01-09).
34. Lee, F. S. (2009b). "Challenging the Mainstream: Essays on the History of Heterodox Economics in the Twentieth Century-The Appendix." URL: (dl. 14-05-09).
35. Lee, F. S., and W. Elsner (2008). "Publishing, Ranking and the Future of Heterodox Economics. On the Horizon 16: 176-184.
36. Merton, R. K. (1968). "The Matthew Effect in Science. The Reward and Communication Systems of Science are Considered. Science 159: 56-63.
37. Myrdal, G. (1963). Das politische Element in der nationalökonomischen Doktrinbildung. Köln: Junker & Dünnhaupt.
38. Neuhaus, D., and H. D. Daniel (2006) "Data Sources for Performing Citation Analysis: An Overview. Journal of Documentation 64: 193-210.
39. Novarese, M., and C. Zimmermann (2008). "Heterodox Economics and the Dissemination of Research Through the Internet: The Experience of RePEc and NEP On the Horizon 16: 198-204.
40. Opthof, T. (1997). "Sense and Nonsense About the Impact Factor. Cardiovascular Research 33: 1-7.
41. rd Edition. Tübingen: Mohr.
42. Reardon, J. (2008). "Barriers to Entry: Heterodox Publishing in Mainstream Journals. On the Horizon 16: 185-197.
43. Reedijk, J., and H. F. Moed (2006). "Is the Impact of Journal Impact Factors Decreasing? Journal of Documentation 64: 183-192.
44. Rossner, M., H. Van Epps, and E. Hill (2007). "Show Me the Data. Journal of Cell Biology 179: 1091-1092.
45. Rossner, M., H. Van Epps, and E. Hill (2008). "Irreproducible Results: A Response to Thomson Scientific. Journal of Experimental Medicine 205: 260.
46. Seglen, P. O. (1997). "Why the Impact Factor of Journals Should Not be Used for Evaluating Research. British Medical Journal 314: 498-502.
47. Shepherd, G. B. (1995). Rejected. Leading Economists Ponder the Publication Process. Sun Lakes.
48. Starr, M. (2010). "Increasing the Impact of Heterodox Work: Insights from RoSE." Paper presented at the 2010 ASSA-conference (Atlanta, January 3 2010).
49. Stekeler-Weithofer, P. (2009). "Das Problem der Evaluation von Beiträgen zur Philosophie-Ein streitbarer Zwischenruf. Deutsche Zeitschrift für Philosophie 57: 149-158.
50. Testa, J. (1998). "The ISI-Database: The Journal Selection Process." URL: (dl. 15-04-09).
51. Testa, J. (2009). "The Thomson Reuters Journal Selection Process." URL: (dl. 15-04-09).
52. Thomson Scientific (2008): "Preserving the Integrity of the Journal Impact Factor: Guidelines from the Scientific Business of Thomson Reuters." URL: (dl. 24-03-09).