Review of Delphi-based scenario studies: Quality and design considerations

Technological Forecasting and Social Change

Volumn 78, Issue 9, 2011, Pages 1603-1615

  Nowack, Martin ^a   Endrikat, Jan ^a   Guenther, Edeltraud ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Delphi technique; Foresight; Quality criteria; Scenario development; Scenario planning; Systematic research review

Indexed keywords

DELPHI TECHNIQUE; FORESIGHT; QUALITY CRITERIA; SCENARIO DEVELOPMENT; SCENARIO PLANNING; SYSTEMATIC RESEARCH;

FORECASTING; RESEARCH;

DESIGN;

DELPHI ANALYSIS; FUTURE PROSPECT; PLANNING METHOD; QUALITATIVE ANALYSIS; TREND ANALYSIS;

EID: 82455212073     PISSN: 00401625     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.techfore.2011.03.006     Document Type: Article

References (89)

1. Bishop P., Hines A., Collins T. The current state of scenario development: an overview of techniques. Foresight 2007, 9(1):5-25.
2. MacKay B., McKiernan P. Creativity and dysfunction in strategic processes: the case of scenario planning. Futures 2010, 42(4):271-281.
3. Gupta U.G., Clarke R.E. Theory and applications of the Delphi technique: a bibliography (1975-1994). Technol. Forecast. Soc. Change. 1996, 53(2):185-211.
4. Preble J.F. Public sector use of the Delphi technique. Technol. Forecast. Soc. Change. 1983, 23(1):75-88.
5. Landeta J. Current validity of the Delphi method in social sciences. Technol. Forecast. Soc. Change. 2006, 73(5):467-482.
6. Rowe G., Wright G. The Delphi technique as a forecasting tool: issues and analysis. Int. J. Forecast. 1999, 15(4):353-375.
7. Woudenberg F. An evaluation of Delphi. Technol. Forecast. Soc. Change. 1991, 40(2):131-150.
8. Chermack T.J., Lynham S.A., Ruona W.E.A. A review of scenario planning literature. Futures Res. Quart. 2001, 17(2):7-32.
9. Cornelius P., Romani M., Van De Putte A. Three decades of scenario planning in shell. Calif. Manage. Rev. 2005, 48(1):95-109.
10. Bradfield R., Wright G., Burt G., Cairns G., Van Der Heijden K. The origins and evolution of scenario techniques in long range business planning. Futures 2005, 37(8):795-812.
11. Brjeson L., Hjer M., Dreborg K., Ekvall T., Finnveden G. Scenario types and techniques: towards a user's guide. Futures 2006, 38(7):723-739.
12. van Notten P.W.F., Rotmans J., van Asselt M.B.A., Rothman D.S. An updated scenario typology. Futures 2003, 35(5):423-443.
13. Varum C.A., Melo C. Directions in scenario planning literature - a review of the past decades. Futures 2010, 42(4):355-369.
14. Cooper H.M. Synthesizing research: a guide for literature reviews 1998, 216. Sage Publications, Inc, Thousand Oaks, London, New Delhi. 3.th ed.
15. Fink A. Conducting research literature reviews: from paper to the Internet 2009, 272. Sage Publications, Los Angeles, London, New Delhi, Singapore, Washington D.C. 3.th ed.
16. Krippendorff K. Content Analysis: an Introduction to its Methodology 2004, 413. Sage Publications, Inc, Thousand Oaks, London, New Delhi. 2.th ed.
17. Steinert M. A dissensus based online Delphi approach: an explorative research tool. Technol. Forecast. Soc. Change. 2009, 76(3):291-300.
18. Martino J.P. A review of selected recent advances in technological forecasting. Technol. Forecast. Soc. Change. 2003, 70(8):719-733.
19. Endacott R., Clifford C.M., Tripp J.H. Can the needs of the critically ill child be identified using scenarios? Experiences of a modified Delphi study. J. Adv. Nurs. 1999, 30(3):665-676.
20. Ptri S. Industry- and company-level factors influencing the development of the forest energy business - insights from a Delphi Study. Technol. Forecast. Soc. Change. 2010, 77(1):94-109.
21. Martelli A. Scenario building and scenario planning: state of the art and prospects of evolution. J. Futures Res. Q. 2001, 17(3):57-74.
22. Millett S.M. The future of scenarios: challenges and opportunities. Strategy Leadersh. 2003, 31(2):16-24.
23. Nakicenovic N., Alcamo J., Davis G., de Vries B., Fenhann J., Gaffin S., et al. Special report on emissions scenarios: a special report of Working Group III of the Intergovernmental Panel on Climate Change 2000, Cambridge University Press, New York. United Nations Environment Programme, World Meteorological Organization (Eds.).
24. Bishop P., Hines A., Collins T. The current state of scenario development: An overview of techniques. Foresight 2007, 9(1):5-25.
25. Schoemaker P.J.H. Scenario planning: a tool for strategic thinking. Sloan Manage. Rev. 1995, 36(2):25-40.
26. Schnaars S.P. How to develop and use scenarios. Long Range Plann. 1987, 20(1):105-114.
27. Goodwin P., Wright G. Enhancing strategy evaluation in scenario planning: a role for decision analysis. J. Manage. Stud. 2001, 38(1):1-16.
28. Schoemaker P.J.H. When and how to use scenario planning: a heuristic approach with illustration. J. Forecast. 1991, 10(6):549.
29. Hassan R.M., Scholes R., Ash N. Ecosystems and human well-being: current state and trends: findings of the Condition and Trends Working Group of the Millennium Ecosystem Assessment 2005, 901. Island Press, Washington.
30. Marcus A. Strategic foresight: A new look at scenarios 2009, 209. Palgrave Macmillan, Basingstoke.
31. Hogarth R.M., Makridakis S. Forecasting and planning: an evaluation. Manage. Sci. 1981, 27(2):115-138.
32. Tversky A., Kahneman D. Judgment under uncertainty: Heuristics and Biases. Sci. 1974, 185:1124-1131.
33. van Notten P.W.F., Sleegers A.M., van Asselt M.B.A. The future shocks: on discontinuity and scenario development. Technol. Forecast. Soc. Change. 2005, 72(2):175-194.
34. Phelps R., Chan C., Kapsalis S.C. Does scenario planning affect performance? Two exploratory studies. J. Bus. Res. 2001, 51(3):223-232.
35. Linneman R.E., Kennell J.D. Shirt-sleeve approach to long-range plans. Harv. Bus. Rev. 1977, 55(2):141-150.
36. Chermack T.J., Lynham S.A., Ruona W.E.A. A Review of scenario planning literature. Futures Res. Quarterly. Summer 2001, 7-31.
37. Linstone H.A., Turoff M. The Delphi Method: Techniques and Applications 1975, 621. Addison-Wesley Publ., Reading/Mass.
38. Leibenstein H. Bandwagon, snob, and Veblen effects in the theory of consumers demand. Q. J. Econ. 1950, 64(2):183-207.
39. Hill K.Q., Fowles J. The methodological worth of the Delphi forecasting technique. Technol. Forecast. Soc. Change. 1975, 7(2):179-192.
40. Turoff M. The Policy Delphi. The Delphi Method: Techniques and Applications 1975, Addison-Wesley Publ., Reading/Mass. H.A. Linstone, M. Turoff (Eds.).
41. Linstone H.A. Eight basic pitfalls: a checklist in the Delphi method. The Delphi Method: Techniques and Applications 1975, Addison-Wesley Publ., Reading/Mass. H.A. Linstone, M. Turoff (Eds.).
42. Tapio P. Disaggregative policy Delphi: using cluster analysis as a tool for systematic scenario formation. Technol. Forecast. Soc. Change. 2002, 70(1):83-101.
43. Turoff M. The design of a policy Delphi. Technol. Forecast. Soc. Change. 1970, 2(2):149-171.
44. Kuusi O., Meyer M. Technological generalizations and leitbilder-the anticipation of technological opportunities. Technol. Forecast. Soc. Change. 2002, 69(6):625-639.
45. Rikkonen P., Tapio P. Future prospects of alternative agro-based bioenergy use in Finland-constructing scenarios with quantitative and qualitative Delphi data. Technol. Forecast. Soc. Change. 2009, 76(7):978-990.
46. Gordon T., Pease A. RT Delphi: an efficient, round-less almost real time Delphi method. Technol. Forecast. Soc. Change. 2006, 73(4):321-333.
47. Hder M., Hder S. Die Delphi-Technik in den Sozialwissenschaften-Methodische Forschung und innovative Anwendungen 2000, 236. Westdeutscher Verlag, Wiesbaden.
48. Okoli C., Pawlowski S.D. The Delphi method as a research tool: an example, design considerations and applications. Inform. Manage. 2004, 42(1):15-29.
49. Schmidt R., Lyytinen K., Keil M., Cule P. Identifying software project risks: an international Delphi study. J. Manage. Inf. Syst. 2001, 17(4):5-36.
50. Schoemaker P.J.H. When and how to use scenario planning: a heuristic approach with illustration. J. Forecast. 1991, 10(6):549-564.
51. Schoemaker P.J.H. Multiple scenario development: its conceptual and behavioral foundation. Strateg. Manage. J. 1993, 14(3):193-213.
52. Chermack T.J. Assessing the quality of scenarios in scenario planning. Futures Res. Q. 2006, 22(4):23-35.
53. Stewart C.C. Integral scenarios: reframing theory, building from practice. Futures 2008, 40(2):160-172.
54. Alcamo J. Environmental futures: the practise of environmental scenario analysis. Developments in Integrated Environmental Assessment-Volume 2 2008, Elsevier, Amsterdam. 1.th ed. A.J. Jakeman (Ed.).
55. Schoemaker P.J.H. When and how to use scenario planning: a heuristic approach with illustration. J. Forecast. 1991, 10(6):549-564.
56. Miles M.B., Huberman A.M. Qualitative Data Analysis: an Expanded Sourcebook 1994, 338. SAGE publications, Inc, Thousands Oaks, London, New Delhi. 2.th ed.
57. Woodman R.W., Sawyer J.E., Griffin R.W. Toward a theory of organizational creativity. Acad. Manag. R. 1993, 18(2):293-321.
58. Abadie F., Friedewald M., Weber K.M. Adaptive foresight in the creative content industries: anticipating value chain transformations and need for policy action. Sci. Public Pol. 2010, 37(1):19-30.
59. Hupkes G. Delphi opinion poll Fuchan I. Transportation 1974, 3(1):59-81.
60. Pal A., Maji S., Sharma O.P., Babu M.K.G. Vehicular emissions: estimation, future prediction and control strategies for the capital city of India. Int. J. Appl. Eng. Res. 2009, 4(7):1391-1411.
61. Al-Saleh Y. Renewable energy scenarios for major oil-producing nations: the case of Saudi Arabia. Futures 2009, 41(9):650-662.
62. Ariel A. Delphi forecast of the dry bulk shipping industry in the year 2000. Marit. Policy Manage. 1989, 16(4):305-336.
63. Bijl R. Delphi in a future scenario study on mental health and mental health care. Futures 1992, 24(3):232-250.
64. Czaplicka-Kolarz K., Stańczyk K., Kapusta K. Technology foresight for a vision of energy sector development in Poland till 2030. Delphi survey as an element of technology foresighting. Technol. Forecast. Soc. Change. 2009, 76(3):327-338.
65. Eschenbach T.G., Geistauts G.A. A Delphi forecast for Alaska. Interfaces 1985, 15(6):100-109.
66. Fleming J.E. The future of U.S. government-corporate relations. Long Range Plann. 1979, 12(4):20-26.
67. Gmez-Limn J.A., Gmez-Ramos A., Sanchez Fernandez G. Foresight analysis of agricultural sector at regional level. Futures 2009, 41(5):313-324.
68. Gordon T.J. Energy forecasts using a Roundlessapproach to running a Delphi study. Foresight 2007, 9(2):27-35.
69. Hjer M. Transport telematics in urban systems-a backcasting Delphi study. Transport. Res. 1998, 3(6):445-463.
70. Kropp F. Changing values: a 2020 vision. J. Euromarket. 2003, 12(3):79-97.
71. Postma T.J.B.M., Alers J.C., Terpstra S., Zuurbier A. Medical technology decisions in The Netherlands: how to solve the dilemma of technology foresight versus market research?. Technol. Forecast. Soc. Change. 2007, 74(9):1823-1833.
72. Shiftan Y., Kaplan S., Hakkert S. Scenario building as a tool for planning a sustainable transportation system. Transport. Res. 2003, 8(5):323-342.
73. Sviden O. Scenarios: on expert generated scenarios for long range infrastructure planning of transportation and energy systems. Technol. Forecast. Soc. Change. 1988, 33(2):159-178.
74. Tseng F., Cheng A., Peng Y. Assessing market penetration combining scenario analysis, Delphi, and the technological substitution model: the case of the OLED TV market. Technol. Forecast. Soc. Change. 2009, 76(7):897-909.
75. Volman M. A variety of roles for a new type of teacher educational technology and the teaching profession. Teach. Teach. Educ. 2005, 21(1):15-31.
76. von der Gracht H.A., Darkow I. Scenarios for the logistics services industry: a Delphi-based analysis for 2025. Int. J. Prod. Econ. 2010, 127(1):46-59.
77. Waissbluth M., de Gortari A. A methodology for science and technology planning based upon economic scenarios and Delphi techniques - the case of Mexican agroindustry. Technol. Forecast. Soc. Change. 1990, 37(4):383-397.
78. Wilenius M., Tirkkonen J. Climate in the making. Futures 1997, 29(9):845-862.
79. Zuber P.L.F., Mann J.M., Paccaud F., Reich M.R., Turoff M. Introducing a first AIDS vaccine in Switzerland: a policy Delphi analysis. Soc. Prev. Med. 1996, 41(2):126-127.
80. Svidn O. Future information systems for road transport: a Delphi panel-derived scenario. Technol. Forecast. Soc. Change. 1988, 33(2):159-178.
81. Phaal R., Farrukh C.J.P., Probert D.R. Technology roadmapping: a planning framework for evolution and revolution. Technol. Forecast. Soc. Change. 2004, 71(1-2):5-26.
82. Gmez-Limn J.A., Gmez-Ramos A., Sanchez Fernandez G. Foresight analysis of agricultural sector at regional level. Futures 2009, 41(5):313-324.
83. Leonard D., Sensiper S. The role of tacit knowledge in group innovation. Knowledge, Groupware and the Internet 2000, Butterworth-Heinemann, Boston. D.E. Smith (Ed.).
84. Porter M.E. Competitive advantage 1985, 557. Free Press, New York.
85. Porter M.E. The five competitive forces that shape strategy. Harv. Bus. Rev. 2008, 86(1):78-93.
86. Van Asselt M., Storms C., Rijkens-Klomp N., Rotmans J. Towards visions for a sustainable Europe: an overview and assessment of the last decade of European scenario studies 1998, 96. ICIS Masstricht University, Maastricht.
87. Tibbs H. Sustainability. Deeper News J. Glob. Bus. Netw. 1999, 10(1):1-76.
88. Freeman R.E. Strategic management: a stakeholder approach 2010, 292. Cambridge University Press, Cambridge. 2010th ed.
89. Fassin Y. The stakeholder model refined. J. Bus. Ethics 2009, 84(1):113-135.