Moving best practice forward: Delphi characteristics, advantages, potential problems, and solutions

International Journal of Tourism Research

Volumn 11, Issue 5, 2009, Pages 415-437

  Donohoe, Holly M ^a   Needham, Roger D ^a  

^a UNIVERSITY OF OTTAWA   (Canada)

Author keywords

Delphi; Expert panel; Research design

Indexed keywords

BEST MANAGEMENT PRACTICE; DELPHI ANALYSIS; DESIGN; RESEARCH; TOURISM MANAGEMENT;

EID: 70350756017     PISSN: 10992340     EISSN: 15221970     Source Type: Journal    
DOI: 10.1002/jtr.709     Document Type: Review

References (93)

1. Alberts DJ. 2007. Stakeholders or subject matter experts, who should be consulted? Energy Policy 35: 2336-2246.
2. Andranovoch G. 1995. Developing Community Participation and Consensus: The Delphi Technique. Community Ventures. Western Regional Extension Publication: Los Angeles, CA.
3. Archer B. 1980. Forecasting demand: quantitative and intuitive techniques. Tourism Management 1(1): 5-12.
4. Ayton P, Ferrel WR, Stewart TR. 1999. Commentaries on 'The Delphi Technique as a Forecasting Tool: Issues and Analysis' by Rowe and Wright. International Journal of Forecasting 15: 377-381.
5. Bardecki MJ. 1984. Participant's response to the delphi method: an attitudinal perspective. Technological Forecasting and Social Change 25: 281-92.
6. Bijl R. 1992. Delphi in a future scenario study on mental health and mental health care. Futures 24(3): 232-250.
7. Bonnemaizon A, Cova B, Louyot M-C. 2007. Relationship marketing in 2015: a Delphi approach. European Management Journal 25(1): 50-59.
8. Bramante AC. 1989. Establishing a basis for the development of an undergraduate curriculum. In Recreation and Leisure Studies in Brazil: A Delphi Approach. Eugene: Microform Publications, University of Oregon, College of Human Development and Performance.
9. Briedenhann J, Butts S. 2006. The application of the Delphi technique to rural tourism project evaluation. Current Issues in Tourism 9(2): 171-190.
10. Briedenhann J, Wickens E. 2007. Developing cultural tourism in South Africa: potential and pitfalls. In Cultural Tourism: Global and Local. Perspectives, Richards G (ed). The Haworth Hospitality Press: Binghamton, NY; 69-90.
11. Brown CA. 2007. The opt-in/opt-out feature in a multi-stage Delphi method study. International Journal of Social Research Methodology 10(2): 135-144.
12. Cantrill JA, Sibbald B, Buetow S. 1996. The Delphi and nominal group techniques in health services research. International Journal of Pharmacy Practice 4(2): 67-74.
13. Cavalli-Sforza V, Ortolano L. 1984. Delphi forecasts of land-use - transportation interactions. Journal of Transportation Engineering 10(3): 324-339.
14. Chevron JR. 1998. The Delphi process: a strategic branding methodology. Journal of Consumer Marketing 15(3): 254-264.
15. Choi HC, Sirakaya E. 2006. Sustainability indicators for managing community tourism. Tourism Management 27: 1274-1289.
16. Crisp J, Pelletier D, Duffield C, Adams A, Nagy S. 1997. The Delphi method? Nursing Research 46(2): 116-118.
17. Dalbecq AL, Van de Ven AH, Gustafson DH. 1975. Group Techniques for Program Planning: A Guide to Nominal and Delphi Processes. Scott, Foresman and Co.: Glenview, IL.
18. Dalkey N, Helmer O. 1963. An experimental application of the Delphi method to the use of experts. Management Science 9(3): 458-467.
19. Dalkey NC, Helmer O. 1951. The Use of Experts for the Estimation of Bombing Requirements - A Project Delphi Experiment, RM-727-PR, November, 1951.
20. Day J, Bobeva M. 2005. A generic toolkit for the successful management of Delphi studies. The Electronic Journal of Business Research Methodology 3(2): 103-116.
21. de Meyrick J. 2003. The Delphi method and health research. Health Education 103(1): 7-16.
22. de Villiers MR, de Villiers PJT, Kent AP. 2005. The Delphi technique in health sciences education research. Medical Teacher 27(7): 639-643.
23. Donohoe H, Needham RD. 2007. Rethinking ecotourism. In Leisure in Context: Implications for Human Development and Well-Being, Donohoe HM, Li Wen Jie (eds). Zhejiang University Press: Hangzhou, China; 181-187.
24. Duboff RS. 2007. The wisdom of (expert) crowds. Harvard Business Review September: 28.
25. English JM, Kernan GL. 1976. The predication of air travel and aircraft technology to the year 2000 using the Delphi method. Transportation Research 10(1): 1-8.
26. Garrod B. 2003. Defining marine ecotourism: a Delphi study. In Marine Ecotourism: Issues and Experiences, Garrod B, Wilson JC (eds). Channel View Publications: Clevedon, 17-36.
27. Garrod B, Fyall A. 2000. Managing heritage tourism. Annals of Tourism Research 27(3): 682-708.
28. Garrod B, Fyall. A.. 2005. Revisiting Delphi: The Delphi Technique in Tourism Research. In Tourism Research Methods: Integrating Theory and Practice, Ritchie BW, Burns P, Palmer C (eds). CAB International: Wallingford; 85-98.
29. Gokhale AA. 2001. Environmental initiative prioritization with a Delphi approach: a case study. Environmental Management 28(2): 187-193.
30. Goldschmidt PG. 1975. Scientific inquiry or political critique? Remarks on Delphi assessment, expert opinion, forecasting, and group process by H. Sackman. Technological Forecasting and Social Change 7: 195-213.
31. Gordon TJ. 1994. The Delphi method. AC/UNU Millennium Project: Futures Research Methodology. Online documents available at URL: http://www.futurovenezuela.org/_curso/5-delphi.pdf. Accessed September 2007.
32. Green H, Hunter C. 1992. The environmental impact assessment of tourism development. In Perspectives on Tourism Policy, Johnson P, Thomas B (eds). Mansell: London, 29-48.
33. Green H, Hunter C, Moore B. 1990a. The application of the Delphi technique in tourism. Annals of Tourism Research 17: 270-279.
34. Green H, Hunter C, Moore B. 1990b. Assessing the environmental impact of tourism development: use of the Delphi technique. Tourism Management June: 11-120.June
35. Hanafin S, Brooks A-M, Carroll E, Fitzgerald E, Gabhainn SN, Sixsmith J. 2007. Achieving consensus in developing a national set of child well-being indicators. Social Indicators Research 80: 79-104.
36. Hayes T. 2007. Delphi study of the future of marketing of higher education. Journal of Business Research 60: 927-931.
37. Hurd A, McLean D. 2004. An analysis of the perceived competencies of CEOs in public park and recreation agencies. Managing Leisure 9: 96-110.
38. Jung-Erceg P, Pandza K, Armbruster H, Dreher C. 2007. Absorptive capacity in european manufacturing: a Delphi study. Industrial Management and Data Systems 107(1): 37-51.
39. Kaynak E, Bloom J, Leibold M. 1994. Using the Delphi technique to predict future tourism potential. Marketing Intelligence and Planning 12(7): 18-29.
40. Kaynak E, Macauley JA. 1984. The Delphi technique in the measurement of tourism market potential: the case of Nova Scotia. Tourism Management 5(2): 87-101.
41. Kaynak E, Marandu EE. 2006. Tourism market potential analysis in Botswana: a Delphi study. Journal of Travel Research 45: 227-237.
42. Kearsley GW, Mitchell RD, Croy WG. 1999. Sustainable Tourism Project Delphi Report. Research Paper Number 7, Centre for Tourism, University of Otago, Dunedin: 1-19. Available at: http://www.business.otago.ac.nz/ TOURISM/research/electronicpubs/delphi/index.html (accessed December 2007).
43. Kuo N-W, Chiu Y-T. 2006. The assessment of agritourism policy based on SEA combination with HIA. Land Use Policy 23: 560-570.
44. Landeta J. 2006. Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change 73: 467-482.
45. Lang T. 1995. An overview of four futures methodologies. Manoa 7: 1-43.
46. Larréché J.-C., Moinpour R. 1983. Managerial judgment in marketing: the concept of expertise. Journal of Marketing Research 20(2): 110-121.
47. Linstone HA. 2002. Eight basic pitfalls: a checklist. In The Delphi Approach: Techniques and Applications, Turoff M, Linstone, HA (eds). Addison-Wesley Publishing Company Inc.: Reading, MA; 559-571. Available at: http://www.is.njit.edu/pubs/delphibook (accessed November 2007).
48. Linstone HA. 1978. The Delphi technique. In Handbook of Futures Research, Fowles, J (ed.). Greenwood Place: London, 271-300.
49. Linstone HA, Simmonds WHC 1977. Future Research: New Directions. Addison-Wesley: London.
50. Linstone HA, Turoff M. 2002. General applications: introduction. In The Delphi Approach: Techniques and Applications, Turoff M, Linstone HA (eds). Addison-Wesley Publishing Company Inc.: Reading, MA; 71-79. Available at: http://www.is.njit.edu/pubs/delphibook (accessed November 2007).
51. Linstone HA, Turoff M. 1975. The Delphi Method: Techniques and Applications. Addison-Wesley Publishing Company, Inc.: London.
52. Liu JC. 2000. 1988. Hawaii tourism to the year 2000: a Delphi forecast. Tourism Management 9(4): 279-290.
53. Lloyd J, La Lopa JM, Braunlich CG. 2000. Predicting changes in Hong Kong's hotel industry given the change in sovereignty from Britain to China in 1997. Journal of Travel Research 38: 405-410.
54. Martino JP. 1980. Book review. Technological Forecasting and Social Change 16(3): 269-273.
55. McKercher B, Cros H. 2002. Challenges in achieving sustainable cultural tourism. In The Partnership Between Tourism and Cultural Heritage Management. The Haworth Hospitality Press: Binghamton, NY; 11-24.
56. Mead DM, Mosely LG. 2001. The use of the Delphi as a research approach. Nurse Researcher 8: 4-37.
57. Miller GA. 2001a. The development of indicators for the promotion of sustainable tourism. Unpublished Doctoral Thesis, University of Surrey, UK.
58. Miller G. 2001b. The development of indicators for sustainable tourism: results of a Delphi survey of tourism researchers. Tourism Management 22: 351-362.
59. Mitroff II, Turoff M. 1975. Philosophical and methodological foundations of Delphi. In The Delphi Method: Techniques and Applications, Linstone HA and Turoff, M (eds). Addison-Wesley Publishing Company, Inc: London; 17-36.
60. Moeller GH 1975. The Delphi technique: an approach to identifying events that will shape the future of outdoor recreation. Indicators of Change in the Recreation Environment: A National Research Symposium, Conference Proceedings: 211-218. Harrisburg, Pennsylvania, 1975.
61. Moeller GH, Shafer EL. 1994. The Delphi technique: a tool for long-range travel and tourism planning. In Travel, Tourism and Hospitality Research: A Handbook for Managers and Researchers, 2nd edn, Ritchie JRB, Goeldner CR (eds). John Wiley & Sons, Inc.: New York; 473-480.
62. Mullen PM. 2003. Delphi myths and reality. Journal of Health Organization and Management 17(1): 37-52.
63. Murray TJ. 1979. Delphi methodologies: a review and critique. Urban Systems 4: 153-158.
64. Needham RD, de Loë R. 1990. The policy Delphi: purpose, structure, and application. The Canadian Geographer 34(2): 133-142.
65. Okoli C, Pawlowski SD. 2004. The Delphi method as a research toll: an example, design considerations and applications. Information and Management Systems 42: 15-29.
66. O'Connor P, Frew AJ. 2004. An evaluation of methodology for hotel electronic channels of distribution. Hospitality Management 23: 179-199.
67. Pan SQ, Vega M, Vella AJ, Archer BH, Parlett GR. 1995. Mini-Delphi approach: an improvement on single round techniques. Progress in Tourism and Hospitality Research 2(1): 27-39.
68. Phillimore J, Goodson L. 2004. Progress in qualitative research in tourism. In Qualitative Research in Tourism: Ontologies, Epistemologies and Methodologies, Phillimore J, Goodson L (eds). Routledge: London, 3-29.
69. Powell C. 2003. The Delphi technique: myths and realities. Journal of Advanced Nursing 41(4): 376-382.
70. Rieger WG. 1986. Directions in Delphi developments: dissertations and their quality. Technological Forecasting and Social Change 29: 195-204.
71. Riley Robert G. 1990. An Exploratory Study of Quality Assurance Methodology in Therapeutic Recreation Using the Delphi Technique. Eugene: Microform Publications, College of Human Development and Performance, University of Oregon.
72. Ritchie JRB, Goeldner CR. 1994. Travel, Tourism and Hospitality Research. John Wiley and Sons: New York.
73. Rosenthal EJ. 1976. Delphi technique. In Encyclopaedia of Educational Evaluation, Andreson S (ed). Jossey-Bass: San Francisco, CA; 121-122.
74. Rowe G, Wright G. 1999. The Delphi technique as forecasting tool: issues and analysis. International Journal of Forecasting 15: 353-375.
75. Rowe G, Wright G, Bolger F. 1991. Delphi: a re-evaluation of research and theory. Technological Forecasting and Social Change 39: 235-251.
76. Sackman H. 1975. Delphi Assessment, Expert Opinion, Forecasting, and Group Processes. Rand Corporation: Santa Monica, CA.
77. Seely RL, Iglarsh H, Edgell D. 1980. Utilising the Delphi technique at international conferences: a method for forecasting international tourism conditions. Travel Research Journal 1: 30-35.
78. Spenceley A. 2003. Managing sustainable nature-based tourism in Southern Africa: A practical assessment tool. Unpublished Doctoral Thesis, University of Greenwich, UK.
79. Spenceley A. 2005. Nature-based tourism and environmental sustainability in South Africa. Journal of Sustainable Tourism 13(2): 136-170.
80. Sunstein CR. 2006. Infotopia: How Many Minds Produce Knowledge. Oxford University Press: Oxford; New York.
81. Taylor RE, Judd LL. 1994. Delphi Forecasting. In Tourism Marketing and Management Handbook, 2nd edn, Witt SF, Moutinho L (eds). Prentice Hall: New York; London, 535-543.
82. Tideswell C, Mules T, Faulkner B. 2001. An integrative approach to tourism forecasting: a glance in the rearview mirror. Journal of Travel Research 40: 162-171.
83. Tsaur Sheng-Hshiung, Lin Yu-Chiang, Lin Jo-Hui.. 2006. Evaluating ecotourism sustainability from the integrated perspective of resource, community and tourism. Tourism Management 27: 640-653.
84. Turoff M. 1970. The design of a policy Delphi. Technological Forecasting and Social Change 2(2): 149-171.
85. Vaugeois N, Rollins R, Hammer K, Randall C, Clark B, Balmer K. 2005. Realizing improved knowledge transfer in the leisure industry: a new agenda and strategies to link researchers and professionals. Travel and Tourism Research Association Canada Chapter Conference Proceedings (2005) Kelowna, BC, Canada, 2005.
86. Veal AJ. 1992. Research Methods for Leisure and Tourism: A Practical Guide. Longman Group UK Limited: Essex, UK.
87. Wall G, Mathieson A. 2006. Tourism: Change Impacts and Opportunities. Pearson Education Limited: Essex, England.
88. Weber K, Ladkin A. 2003. The convention industry in Australia and the United Kingdom: key issues and competitive forces. Journal of Travel Research 42: 125-132.
89. Wheeler B, Hart T, Whysall P. 1990. Application of the Delphi technique: a reply to Green, Hunter and. Moore. Tourism Management June: 121-122.
90. Wolfers J, Zitzewitz E. 2004. Five Open Questions about Prediction Markets. IZA Discussion Paper No. 1975. Available at: http://ssrn.com/abstract=884483
91. Wolfers J, Zitzewitz E (2004) Prediction Markets. NBER Working Paper No. W10504. Available at: http://ssrn.com/abstract=552109
92. Wright TSA. 2006. Giving 'Teeth' to an environmental policy: a Delphi study at Dalhousie University. Journal of Cleaner Production 14: 761-768.
93. Yeong YW, Keng KA, Leng, TL. 1989. A Delphi forecast for the Singapore tourism industry: future scenario and marketing implications. European Journal of Marketing 23(11): 15-26.