Publish and perish? Bibliometric analysis, journal ranking and the assessment of research quality in tourism

Tourism Management

Volumn 32, Issue 1, 2011, Pages 16-27

  Michael Hall, C ^a,b,c  

^a UNIVERSITY OF CANTERBURY   (New Zealand)

^b UNIVERSITY OF OULU   (Finland)

^c LINNAEUS UNIVERSITY   (Sweden)

Author keywords

Economization; Institutional context; Journal impact; Journal prestige; Journal ranking; Neoliberalism; SCImago; Scopus

Indexed keywords

DATABASE; NEOLIBERALISM; PERFORMANCE ASSESSMENT; QUALITATIVE ANALYSIS; RANKING; TOURISM MANAGEMENT;

SCOPUS;

EID: 78649864591     PISSN: None     EISSN: 02615177     Source Type: Journal    
DOI: 10.1016/j.tourman.2010.07.001     Document Type: Article

References (93)

1. Adler N.J., Harzing A. When knowledge wins: transcending the sense and nonsense of academic rankings. The Academy of Management Learning and Education 2009, 8:72-95.
2. Adler R., Ewing J., Taylor P. Citation statistics. A report from the International Mathematical Union (IMU) in cooperation with the International Council of Industrial and Applied Mathematics (ICIAM) and the Institute of Mathematical Statistics (IMS) 2008, Joint Committee on Quantitative Assessment of Research.
3. Association of Business Schools (ABS) ABS launches academic journal quality guide version 4 2010, Accessed from:. http://www.the-abs.org.uk/%3Fid%3D257.
4. Australian Business Deans Council ABDC journal list rating by FoR code Accessed from:. http://www.abdc.edu.au/3.43.0.0.1.0.htm.
5. Australian Business Deans Council Australian business deans council journal quality list Accessed from:. http://www.abdc.edu.au/3.43.0.0.1.0.htm.
6. Australian Research Council ERA 2010 submission guidelines 2009, Author, Canberra.
7. Australian Research Council Discipline matrices Accessed from:. http://www.arc.gov.au/era/key_docs10.htm.
8. Australian Research Council ERA 2010 ranked journal list 2009, Author, Canberra, Accessed from:. http://www.arc.gov.au/era/key_docs10.htm.
9. Australian Research Council. (12 June 2009d). Research performance analysis. ERA News, 3-4. Accessed from: http://www.arc.gov.au/era/key_docs10.htm.
10. Baneyx A. " Publish or perish" as citation metrics used to analyze scientific output in the humanities: international case studies in economics, geography, social sciences, philosophy, and history. Archivum Immunologiae et Therapiae Experimentalis 2008, 56(6):363-371.
11. Bao J. Tourism geography as the subject of doctoral dissertations in China, 1989-2000. Tourism Geographies 2002, 4:148-152.
12. Batista P.D., Campiteli M.G., Konouchi O. Is it possible to compare researchers with different scientific interests?. Scientometrics 2006, 68(1):179-189.
13. Baum T. RE: ABS 2010 list in tourism and hospitality [online forum comment] Accessed from:. mailto:owner-trinet-l@lists.hawaii.edu.
14. Bollen J., Van de Sompel H., Hagberg A., Chute R. A principal component analysis of 39 scientific impact measures. PLoS One 2009, 4(6):e6022.
15. Broadus R.N. Toward a definition of " bibliometrics" Scientometrics 1987, 12(5-6):373-379.
16. Buhalis D. RE: ABS 2010 list in tourism and hospitality [online forum comment] Accessed from:. mailto:owner-trinet-l@lists.hawaii.edu.
17. Çali{dotless}skan K., Callon M. Economization, part 1: shifting attention from the economy towards processes of economization. Economy and Society 2009, 38:369-398.
18. Callon M. Introduction: the embeddedness of economic markets in economics. The laws of the markets 1998, 1-57. Blackwell, Oxford. M. Callon (Ed.).
19. Cheng C., Li X., Petrick J.F., O'Leary J.T. An examination of tourism journal development. Tourism Management 2010, 32(1):53-61.
20. Coles T. Tourism studies and the governance of higher education in the United Kingdom. Tourism Geographies 2009, 11(1):23-42.
21. Coles T., Hall C.M. The geography of tourism is dead. Long live geographies of tourism and mobility. Current Issues in Tourism 2006, 9:289-292.
22. Coles T., Hall C.M., Duval D.T. Tourism and post-disciplinary enquiry. Current Issues in Tourism 2006, 9:293-319.
23. Egghe L. Theory and practice of the g-index. Scientometrics 2006, 69(1):131-152.
24. Falagas M.E., Kouranos V.D., Arencibia-Jorge R., Karageorgopoulos D.E. Comparison of SCImago journal rank indicator with journal impact factor. The FASEB Journal: Official Publication of the Federation of American Societies for Experimental Biology 2008, 22:2623-2628.
25. Franceschet M. A cluster analysis of scholar and journal bibliometric indicators. Journal of the American Society for Information Science and Technology 2009, 60:1950-1964.
26. Franceschet M. The difference between popularity and prestige in the sciences and in the social sciences: a bibliometric analysis. Journal of Informetrics 2010, 4:55-63.
27. Garfield E. Citation indexing: Its theory and application in science, technology, and humanities 1979, John Wiley, New York.
28. Geary J., Marriott L., Rowlinson M. Journal rankings in business and management and the 2001 Research Assessment in the UK. British Journal of Management 2004, 15:95-141.
29. Gibson C., Klocker N. Academic publishing as 'creative' industry, and recent discourse of 'creative economies': some critical reflections. Area 2004, 36:423-434.
30. Hall C.M. Tourism as the subject of post-graduate dissertations in Australia. Annals of Tourism Research 1991, 18:520-523.
31. Hall C.M. Systems of surveillance and control: commentary on 'An analysis of institutional contributors to three major academic tourism journals: 1992-2001'. Tourism Management 2005, 26(5):653-656.
32. Hall C.M. The impact of tourism knowledge: Google Scholar, citations and the opening up of academic space. e-Review of Tourism Research (eRTR) 2006, 4(5). Accessed from:. http://ertr.tamu.edu/index.php%3Foption%3Dcom_content%26view%3Darticle%26id%3D206%3Avolume-4-issue-5-october-2006-applied-research-notes-3%26catid%3D73%3Avolume-4-issue-1-6-2006%26Itemid%3D54.
33. Hall C.M. Tourism and regional competitiveness. Advances in tourism research 2007, 217-230. Elsevier, Oxford. J. Tribe, D. Airey (Eds.).
34. Hall, C. M. (2010a). A citation analysis of tourism recreation research. Tourism Recreation Research, 35(3).
35. Hall, C. M. (2010b). Academic capitalism, academic responsibility and tourism academics: Or, the silence of the lambs? Tourism Recreation Research, 35(3).
36. Hall C.M., Page S. Progress in tourism management: from the geography of tourism to geographies of tourism - a review. Tourism Management 2009, 30:3-16.
37. Hall C.M., Williams A.M., Lew A.A. Tourism: conceptualizations, institutions, and issues. A companion to tourism 2004, 3-21. Blackwell, Malden, MA. A.A. Lew, C.M. Hall, A.M. Williams (Eds.).
38. Harvey L. Assessment and evaluation in the new ERA Australasian Association for Institutional Research Forum, Accessed from:. http://www.arc.gov.au/media/ARC_Presentations.htm.
39. Hicks D. The difficulty of achieving full coverage of international social science literature and the bibliometric consequences. Scientometrics 1999, 44(2):193-215.
40. Hicks D. The four literatures of social science. Handbook of quantitative science and technology research: The use of publication and patent statistics in studies of S&T systems 2004, 473-496. Springer, Dordrecht. H.F. Moed, W. Glänzel, U. Schmoch (Eds.).
41. Hirsch J.E. An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences of the United States of America 2005, 102(46):16569-16572.
42. Howey R.M., Savage K.S., Verbeeten M.J., Hoof H.B.V. Tourism and hospitality research journals cross-citations among research communities. Tourism Management 1999, 20:133-139.
43. ISI Web of Knowledge (2010). Journal citation reports, 2008 JCR social science edition, Journals from subject categories hospitality, leisure, sport & tourism. Accessed from: http://thomsonreuters.com/products_services/science/science_products/a-z/journal_citation_reports.
44. Jafari J., Aaser D. Tourism as the subject of doctoral dissertations. Annals of Tourism Research 1988, 15:407-429.
45. Jamal T., Smith B., Watson E. Ranking, rating and scoring of tourism journals: interdisciplinary challenges and innovations. Tourism Management 2008, 29(1):66-78.
46. Jogaratnam G., Chon K., McCleary K., Mena M., Yoo J. An analysis of institutional contributors to three major academic tourism journals: 1992-2001. Tourism Management 2005, 26(5):641-648.
47. Jogaratnam G., McCleary K., Mena M., Yoo J.J. An analysis of hospitality and tourism research: institutional contributions. Journal of Hospitality and Tourism Research 2005, 29:356-371.
48. Kelly A., Morris H., Harvey C. Modelling the outcome of the UK business and management studies RAE 2008 with reference to the ABS Journal Quality Guide Accessed from Association of Business Schools website:. http://www.the-abs.org.uk/.
49. The association of business schools, academic journal quality guide, subject area listing (revised 1 June 2009) 2009, Accessed from Association of Business Schools website:. http://www.the-abs.org.uk/%3Fid%3D257, A. Kelly, H. Morris, M. Rowlinson, C. Harvey (Eds.).
50. The association of business schools, academic journal quality guide, Version 3. Introduction: Context, purpose and method (March 2009) 2009, Accessed from Association of Business Schools website:. http://www.the-abs.org.uk/%3Fid%3D257, A. Kelly, H. Morris, M. Rowlinson, C. Harvey (Eds.).
51. Laing J.H., Weiler B. Postgraduate tourism research in Australia: A trend analysis 1969-2005. In where the bloody hell are we?. Proceedings of the eighteenth international research conference of the council for Australian University tourism and hospitality education (CAUTHE), Gold Coast, 11-14 February, 2008 2008, Griffith University, Gold Coast.
52. Lange T. Journal quality and rankings. Paper presented at progressing excellence in management research and journal rankings for the services industries 2010, University of Bournemouth, Bournemouth.
53. Law R., Chon K. Evaluating research performance in tourism and hospitality: the perspective of university program heads. Tourism Management 2007, 28:1203-1211.
54. Law R., van der Veen R. The popularity of prestigious hospitality journals: a Google Scholar approach. International Journal of Contemporary Hospitality Management 2008, 20:113-125.
55. Leydesdorff L. The challenge of scientometrics: The development, measurement, and self-organization of scientific communications 2001, Universal Publishers, Boca Raton, FL. 2nd ed.
56. Leydesdorff L. How are new citation-based journal indicators adding to the bibliometric toolbox?. Journal of the American Society for Information Science & Technology 2009, 60:1327-1336.
57. Macdonald S., Kam J. Ring a ring o'roses: quality journals and gamesmanship in management studies. Journal of Management Studies 2007, 44:640-655.
58. Macdonald S., Kam J. Publishing in top journals - a never-ending fad?. Scandinavian Journal of Management 2009, 25:221-224.
59. McKercher B. A case for ranking tourism journals. Tourism Management 2005, 26:649-651.
60. McKercher B. A citation analysis of tourism scholars. Tourism Management 2008, 29:1226-1232.
61. McKercher B., Law R., Lam T. Rating tourism and hospitality journals. Tourism Management 2006, 27(6):1235-1252.
62. Meho L.I., Yang K. Impact of data sources on citation counts and rankings of LIS faculty: web of science versus scopus and google scholar. Journal of the American Society for Information Science and Technology 2007, 58(13):2105-2125.
63. Meho L.I., Yang K. Citation counting, citation ranking, and h-index of human-computer interaction researchers: a comparison of scopus and web of science. Journal of the American Society for Information Science and Technology 2008, 59(11):1711-1726.
64. Meyer-Arendt K.J. Commentary: tourism geography as the subject of north American doctoral dissertations and master's theses, 1951-98. Tourism Geographies 2000, 2(2):140-156.
65. Meyer-Arendt K.J., Justice C. Tourism as the subject of North American doctoral dissertations, 1987-2000. Annals of Tourism Research 2002, 29:1171-1174.
66. Mingers J., Watson K., Scaparra P. Estimating business and management journal quality from the 2008 Research Assessment Exercise in the UK (Working Paper No. 205) 2009, Kent Business School, University of Kent, Canterbury.
67. Page S.J. Evaluating research performance in tourism: the UK experience. Tourism Management 2003, 24(6):607-622.
68. Page S.J. Academic ranking exercises: do they achieve anything meaningful? - a personal view. Tourism Management 2005, 26(5):663-666.
69. Paul R.J. Measuring research quality: the United Kingdom Government's Research Assessment Exercise. European Journal of Information Systems 2008, 17(4):324-329.
70. Pechlaner H., Zehrer A., Abfalter D. How can scientific quality be assessed? An exploratory study of tourism and hospitality journals. Tourism 2002, 50:395-399.
71. Pechlaner H., Zehrer A., Matzler K., Abfalter D. A ranking of international tourism and hospitality journals. Journal of Travel Research 2004, 42(4):328-332.
72. Pendlebury D.A. The use and misuse of journal metrics and other citation indicators. Archivum Immunologiae et Therapiae Experimentalis 2009, 57(1):1-11.
73. Petsko G.A. Having an impact (factor). Genome Biology 2008, 9:107. 10.1186/gb-2008-9-7-107.
74. Research Assessment Exercise RAE2008 subject overview reports: UOA 36 business and management studies Accessed from:. http://www.rae.ac.uk/pubs/2009/ov/.
75. Research Assessment Exercise RAE2008 subject overview reports: UOA 46 sports-related studies Accessed from:. http://www.rae.ac.uk/pubs/2009/ov/.
76. Ryan C. The ranking and rating of academics and journals in tourism research. Tourism Management 2005, 26(5):657-662.
77. Select Committee on Science and Technology Select committee on science and technology, tenth reports, House of Commons, session 2003-04 Accessed from:. http://www.publications.parliament.uk/pa/cm200304/cmselect/cmsctech/399/39912.htm.
78. SCImago SJR-SCImago journal & country rank Accessed from:. http://www.scimagojr.com.
79. Sheldon P. Journals in tourism and hospitality: the perception of publishing faculty. Journal of Tourism Studies 1990, 1:42-48.
80. Sheldon P. An authorship analysis of tourism research. Annals of Tourism Research 1991, 18:473-484.
81. Singh S. RE: ABS 2010 list in tourism and hospitality [online forum comment] Accessed from:. mailto:owner-trinet-l@lists.hawaii.edu.
82. Stein J.G. The cult of efficiency 2002, House of Anansi Press, Toronto. 2nd ed.
83. Tewdwr-Jones M. Return of the indicators: the research assessment exercise 2008. Environment and Planning B: Planning and Design 2005, 32:317-322.
84. Van Raan A.F.J. Measuring science. Capita selecta of current main issues. Handbook of quantitative science and technology research: The use of publication and patent statistics in studies of S&T systems 2006, 19-50. Springer, Dordrecht. H.F. Moed, W. Glänzel, U. Schmoch (Eds.).
85. Vinkler P. The evaluation of research by scientometric indicators 2010, Woodhead Publishing, Abington.
86. Visser G. Tourism geographies and the South African National Research foundation's researcher rating system: international connections and local disjunctures. Tourism Geographies 2009, 11:43-72.
87. Weale A.R., Bailey M., Lear P.A. The level of non-citation of articles within a journal as a measure of quality: a comparison to the impact factor. BMC Medical Research Methodology 2004, 4(14). Accessed from:. http://www.biomedcentral.com/1471-2288/4/14.
88. Weiner G. The academic journal: has it a future?. Education Policy Analysis Archives 2001, 9(9). Accessed from:. http://olam.ed.asu.edu/epaa.
89. Winter T. Asian tourism and the retreat of Anglo-western centrism in tourism theory. Current Issues in Tourism 2009, 12:21-31.
90. Woodside A.G. Journal and author impact metrics: an editorial. Journal of Business Research 2009, 62:1-4.
91. Xiao H., Smith S.L.J. The making of tourism research: insights from a social sciences journal. Annals of Tourism Research 2006, 33:490-507.
92. Xiao H., Smith S.L.J. The use of tourism knowledge: research propositions. Annals of Tourism Research 2007, 34:310-331.
93. Zhao W., Ritchie J.R.B. An investigation of academic leadership in tourism research: 1985-2004. Tourism Management 2007, 28:476-490.