Assessing Delphi panel composition for strategic foresight - A comparison of panels based on company-internal and external participants

Technological Forecasting and Social Change

Volumn 84, Issue , 2014, Pages 215-229

  Förster, Bernadette ^a   von der Gracht, Heiko ^a  

^a EBS BUSINESS SCHOOL   (Germany)

Author keywords

Advice seeking; Decision making; Delphi; Expert; Multiple stakeholder

Indexed keywords

DECISION MAKING; DECISION SUPPORT SYSTEMS;

ADVICE SEEKING; DECISION SUPPORTS; DELPHI; EXPERT; FORECASTING TOOLS; MULTIPLE STAKEHOLDERS; RECENT RESEARCHES; STRATEGIC FORESIGHT;

INDUSTRY;

ACCURACY ASSESSMENT; DECISION MAKING; DELPHI ANALYSIS; EXPERT SYSTEM; FORECASTING METHOD; QUALITATIVE ANALYSIS; QUANTITATIVE ANALYSIS; STRATEGIC APPROACH;

EID: 84898432186     PISSN: 00401625     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.techfore.2013.07.012     Document Type: Article

References (102)

1. Day G.S., Schoemaker P.J.H. Driving through the fog: managing at the edge. Long Range Plan. 2004, 37:127-142.
2. Yaniv I. Receiving other people's advice: influence and benefit. Organ. Behav. Hum. Decis. Process. 2004, 93:1-13.
3. Schrah G.E., Dalal R.S., Sniezek J.A. No decision-maker is an island: integrating expert advice with information acquisition. J. Behav. Decis. Mak. 2006, 19:43-60.
4. Harvey N., Fischer I. Taking advice: accepting help, improving judgment, and sharing responsibility. Organ. Behav. Hum. Decis. Process. 1997, 70:117-133.
5. Miller E.M. Risk, uncertainty, and divergence of opinion. J. Finance 1977, 32:1151-1168.
6. Landeta J., Barrutia J. People consultation to construct the future: a Delphi application. Int. J. Forecast. 2011, 27(1):134-151.
7. Will M. Talking about the future within an SME?: corporate foresight and the potential contributions to sustainable development. Manag. Environ. Qual. Int. J. 2008, 19:234-242.
8. Hiltunen E. Crowdsourcing the future: the foresight process at Finpro. J. Futur. Stud. 2011, 16:189-196.
9. Decker C., Welpe I.M., Ankenbrand B.H. How to motivate people to put their money where their mouth is: what makes employees participate in electronic prediction markets?. Technol. Forecast. Soc. Chang. 2011, 78:1002-1015.
10. Miemis V., Smart J., Brigis A. Open foresight. J. Futur. Stud. 2012, 17:91-97.
11. Dalal S., Khodyakov D., Srinivasan R., Straus S., Adams J. ExpertLens: a system for eliciting opinions from a large pool of non-collocated experts with diverse knowledge. Technol. Forecast. Soc. Chang. 2011, 78:1426-1444.
12. Landeta J. Current validity of the Delphi method in social sciences. Technol. Forecast. Soc. Chang. 2006, 73:467-482.
13. Parenté R., Anderson-Parenté J. A case study of long-term Delphi accuracy. Technol. Forecast. Soc. Chang. 2011, 78:1705-1711.
14. Hussler C., Muller P., Rondé P. Is diversity in Delphi panelist groups useful? Evidence from a French forecasting exercise on the future of nuclear energy. Technol. Forecast. Soc. Chang. 2011, 78:1642-1653.
15. Rowe G., Wright G., Bolger F. Delphi: a reevaluation of research and theory. Technol. Forecast. Soc. Chang. 1991, 39:235-251.
16. Menon T., Thompson L., Choi H.-S. Tainted knowledge vs. tempting knowledge: people avoid knowledge from internal rivals and seek knowledge from external rivals. Manag. Sci. 2006, 52:1129-1144.
17. Tichy G. The over-optimism among experts in assessment and foresight. Technol. Forecast. Soc. Chang. 2004, 71:341-363.
18. Ecken P., Gnatzy T., von der Gracht H.A. Desirability bias in foresight: consequences for decision quality based on Delphi results. Technol. Forecast. Soc. Chang. 2011, 78:1654-1670.
19. Yaniv I., Milyavsky M. Using advice from multiple sources to revise and improve judgments. Organ. Behav. Hum. Decis. Process. 2007, 103:104-120.
20. Soll J.B., Larrick R.P. Strategies for revising judgment: how (and how well) people use others' opinions. J. Exp. Psychol. Learn. Mem. Cogn. 2009, 35:780-805.
21. Yaniv I. Group diversity and decision quality: amplification and attenuation of the framing effect. Int. J. Forecast. 2011, 27:41-49.
22. Mannix E., Neale M.A. What differences make a difference?. Psychol. Sci. Public Interest 2005, 6:31-55.
23. Wiersema M.F., Bantel K.A. Top management team demography and corporate strategic change. Acad. Manag. J. 1992, 35:91-121.
24. Preble J.F. The selection of Delphi panels for strategic planning purposes. Strateg. Manag. J. 1984, 5:157-170.
25. Campbell S.M., Shield T., Rogers A., Gask L. How do stakeholder groups vary in a Delphi technique about primary mental health care and what factors influence their ratings?. Qual. Saf. Health Care 2004, 13:428-434.
26. Fraser G., Pilpel D., Kosecoff J., Brook R. Effect of panel composition on appropriateness ratings. Int. J. Qual. Health Care 1994, 6:251-255.
27. Kahneman D. Maps of bounded rationality: psychology for behavioral economics. Am. Econ. Rev. 2003, 93:1449-1475.
28. Alexiev A.S., Jansen J.J.P., Van den Bosch F.A.J., Volberda H.W. Top management team advice seeking and exploratory innovation: the moderating role of TMT heterogeneity. J. Manag. Stud. 2010, 47:1343-1364.
29. Menon T., Pfeffer J. Valuing internal vs. external knowledge: explaining the preference for outsiders. Manag. Sci. 2003, 49:497-513.
30. Tourish D. Critical upward communication: ten commandments for improving strategy and decision making. Long Range Plan. 2005, 38:485-503.
31. Wright G., Cairns G., Goodwin P. Teaching scenario planning: lessons from practice in academe and business. Eur. J. Oper. Res. 2009, 194:323-335.
32. Preble J.F. A comparison of intracompany and intercompany LEAP forecasts. Technol. Forecast. Soc. Chang. 1984, 26:389-397.
33. Javidan M. Core competence: what does it mean in practice?. Long Range Plan. 1998, 31:60-71.
34. Green A.O., Hunton-Clarke L. A typology of stakeholder participation for company environmental decision-making. Bus. Strateg. Environ. 2003, 12:292-299.
35. Preble J.F. Toward a comprehensive model of stakeholder management. Bus. Soc. Rev. 2005, 110:407-431.
36. Jolson M.A., Rossow G.L. The Delphi process in marketing decision making. J. Mark. Res. 1971, 8:443-448.
37. Rowe G., Wright G. The Delphi technique as a forecasting tool: issues and analysis. Int. J. Forecast. 1999, 15:353-375.
38. Lamberson P., Page S.E. Optimal forecasting groups. Manag. Sci. 2012, 58:805-810.
39. Kerr N.L., Tindale R.S. Group-based forecasting?: a social psychological analysis. Int. J. Forecast. 2011, 27:14-40.
40. Bolger F., Wright G. Improving the Delphi process: lessons from social psychological research. Technol. Forecast. Soc. Chang. 2011, 78:1500-1513.
41. Gnatzy T., Warth J., von der Gracht H., Darkow I.-L. Validating an innovative real-time Delphi approach - a methodological comparison between real-time and conventional Delphi studies. Technol. Forecast. Soc. Chang. 2011, 78:1681-1694.
42. Johnson T.R., Budescu D.V., Wallsten T.S. Averaging probability judgments: Monte Carlo analyses of asymptotic diagnostic value. J. Behav. Decis. Mak. 2001, 14:123-140.
43. Bonaccio S., Dalal R.S. Advice taking and decision-making: an integrative literature review, and implications for the organizational sciences. Organ. Behav. Hum. Decis. Process. 2006, 101:127-151.
44. Sniezek J.A., Schrah G.E., Dalal R.S. Improving judgement with prepaid expert advice. J. Behav. Decis. Mak. 2004, 17:173-190.
45. Soll J.B. Intuitive theories of information: beliefs about the value of redundancy. Cogn. Psychol. 1999, 38:317-346.
46. Mojzisch A., Schulz-Hardt S. Information sampling in group decision making: sampling biases and their consequences. Information Sampling and Adaptive Cognition 2006, 299-325. Cambridge University Press, Cambridge; New York. K. Fiedler, P. Juslin (Eds.).
47. Wittenbaum G.M., Park E.S. The collective preference for shared information. Curr. Dir. Psychol. Sci. 2001, 10:70-73.
48. Naim M., Aryee G., Potter A. Determining a logistics provider's flexibility capability. Int. J. Prod. Econ. 2010, 127:39-45.
49. Wadhwa S., Saxena A., Chan F.T.S. Framework for flexibility in dynamic supply chain management. Int. J. Prod. Res. 2008, 46:1373-1404.
50. Chermack T.J., Lynham S.A., van der Merwe L. Exploring the relationship between scenario planning and perceptions of learning organization characteristics. Futures 2006, 38:767-777.
51. Vasconcelos F.C., Ramirez R. Complexity in business environments. J. Bus. Res. 2011, 64:236-241.
52. Wright G., Van Der Heijden K., Burt G., Bradfield R., Cairns G. Scenario planning interventions in organizations: an analysis of the causes of success and failure. Futures 2008, 40:218-236.
53. von der Gracht H.A., Darkow I.-L. Scenarios for the logistics services industry: a Delphi-based analysis for 2025. Int. J. Prod. Econ. 2010, 127:46-59.
54. Covin J.G., Slevin D.P. The influence of organization structure on the utility of an entrepreneurial top management style. J. Manag. Stud. 1988, 25:217-234.
55. Barthélemy J., Quélin B.V. Complexity of outsourcing contracts and ex post transaction costs: an empirical investigation. J. Manag. Stud. 2006, 43:1775-1797.
56. Cavana R., Delahaye B., Sekaran U. Applied Business Research: Qualitative and Quantitative Methods 2000, Wiley, Singapore.
57. Piecyk M.I., McKinnon A.C. Forecasting the carbon footprint of road freight transport in 2020. Int. J. Prod. Econ. 2010, 128:31-42.
58. Armstrong J.S., Overton T.S. Estimating nonresponse bias in mail surveys. J. Mark. Res. 1977, 14:396-402.
59. Rowe G., Wright G. Expert opinions in forecasting: the role of the Delphi technique. Principles of Forecasting: A Handbook for Researchers and Practitioners 2001, 125-144. Kluwer Academic Publishers, Boston. J.S. Armstrong (Ed.).
60. Salancik J.R., Wenger W., Helfer E. The construction of Delphi event statements. Technol. Forecast. Soc. Chang. 1971, 3:65-73.
61. Porter M.E. The five competitive forces that shape strategy. Anglais 2008, 86:78-93.
62. Parenté F.J., Anderson-Parenté J.K. Delphi inquiry systems. Judgmental Forecasting 1987, 129-156. John Wiley & Sons, Chichester. G. Wright, P. Ayton (Eds.).
63. Klassen R.D., Whybark D.C. Barriers to the management of international operations. J. Oper. Manag. 1994, 11:385-396.
64. Czinkota M.R., Ronkainen I.A. International business and trade in the next decade: report from a Delphi study. J. Int. Bus. Stud. 1997, 28:827-844.
65. Dalkey N., Helmer O. An experimental application of the Delphi method to the use of experts. Manag. Sci. 1963, 9:458-467.
66. Duboff R.S. The wisdom of (expert) crowds. Anglais 2007, 85:28.
67. McDermott W.B. Foresight is an illusion. Long Range Plan. 1996, 29:190-194.
68. Sackman H. Delphi Assessment: Expert Opinion, Forecasting, and Group Process 1974, The RAND Corporation, Santa Monica, California.
69. Goodman C.M. The Delphi technique: a critique. J. Adv. Nurs. 1987, 12:729-734.
70. Skulmoski G., Hartman F., Krahn J. The Delphi method for graduate research. J. Inf. Technol. Educ. 2007, 6:1-21.
71. Gupta U.G., Clarke R.E. Theory and applications of the Delphi technique: a bibliography (1975-1994). Technol. Forecast. Soc. Chang. 1996, 53:185-211.
72. Nowack M., Endrikat J., Guenther E. Review of Delphi-based scenario studies: quality and design considerations. Technol. Forecast. Soc. Chang. 2011, 78:1603-1615.
73. Kuwahara T. Technology forecasting activities in Japan. Technol. Forecast. Soc. Chang. 1999, 60:5-14.
74. Di Zio S., Pacinelli A. Opinion convergence in location: a spatial version of the Delphi method. Technol. Forecast. Soc. Chang. 2011, 78:1565-1578.
75. Gordon T., Pease A. RT Delphi: an efficient, "round-less" almost real time Delphi method. Technol. Forecast. Soc. Chang. 2006, 73:321-333.
76. Anderson J.C., Rungtusanatham M. A theory of quality management underlying the Deming management method. Acad. Manag. Rev. 1994, 19:472-509.
77. Dajani J.S., Sincoff M.Z., Talley W.K. Stability and agreement criteria for the termination of Delphi studies. Technol. Forecast. Soc. Chang. 1979, 13:83-90.
78. Nakatsu R.T., Iacovou C.L. A comparative study of important risk factors involved in offshore and domestic outsourcing of software development projects: a two-panel Delphi study. Inf. Manag. 2009, 46:57-68.
79. Kastein M.R., Jacobs M., van der Hell R.H., Luttik K., Touw-Otten F.W.M.M. Delphi, the issue of reliability: a qualitative Delphi study in primary health care in the Netherlands. Technol. Forecast. Soc. Chang. 1993, 44:315-323.
80. Martin J.S., Chaney L.H. Determination of content for a collegiate course in intercultural business communication by three Delphi panels. J. Bus. Commun. 1992, 29:267-283.
81. Campbell M.J. Teaching non-parametric statistics to students in health sciences. ICOTS 7 2006, IASE, ISI, Salvador, Bahia, Brazil.
82. Hart A. Mann-Whitney test is not just a test of medians: differences in spread can be important. Br. Med. J. 2001, 323:391-393.
83. Meijering J.V., Kampen J.K., Tobi H. Quantifying the development of agreement among experts in Delphi studies. Technol. Forecast. Soc. Chang. 2013, (Available online 8 February 2013, ISSN 0040-1625). 10.1016/j.techfore.2013.01.003.
84. von der Gracht H.A. Consensus measurement in Delphi studies: review and implications for future quality assurance. Technol. Forecast. Soc. Chang. 2012, 79:1525-1536.
85. Linstone H.A., Turoff M. Delphi: a brief look backward and forward. Technol. Forecast. Soc. Chang. 2011, 78:1712-1719.
86. Warth J., von der Gracht H.A., Darkow I.-L. A dissent-based approach for multi-stakeholder scenario development - the future of electric drive vehicles. Technol. Forecast. Soc. Chang. 2013, 80:566-583.
87. Rayens M.K., Hahn E.J. Building consensus using the policy Delphi method. Policy Polit. Nurs. Pract. 2000, 1:308-315.
88. Ray P.K., Sahu S. Productivity management in India: a Delphi study. Int. J. Oper. Prod. Manag. 1990, 10:25-51.
89. De Vet E., Brug J., De Nooijer J., Dijkstra A., De Vries N.K. Determinants of forward stage transitions: a Delphi study. Health Educ. Res. 2005, 20:195-205.
90. Warth J., von der Gracht H.A., Darkow I.-L. A dissent-based approach for multi-stakeholder scenario development - the future of electric drive vehicles. Technol. Forecast. Soc. Chang. 2013, 80(4):566-583.
91. Miles M.B., Huberman A.M. Qualitative Data Analysis: A Sourcebook of New Methods 2005, Sage, Thousand Oaks. 2nd ed.
92. Teece D.J. Strategies for managing knowledge assets: the role of firm structure and industrial context. Long Range Plan. 2000, 33:35-54.
93. Turoff M. The design of a policy Delphi. Technol. Forecast. Soc. Chang. 1970, 2:149-171.
94. Lempert R.J., Groves D.G., Popper S.W., Bankes S.C. A general, analytic method for generating robust strategies and narrative scenarios. Manag. Sci. 2006, 52:514-528.
95. Geist M.R. Using the Delphi method to engage stakeholders: a comparison of two studies. Eval. Program Plann. 2010, 33:147-154.
96. Rauch W. The decision Delphi. Technol. Forecast. Soc. Chang. 1979, 15:159-169.
97. Brouthers K.D., Andriessen F., Nicolaes I. Driving blind: strategic decision-making in small companies. Long Range Plan. 1998, 31:130-138.
98. Catling H., Rodgers P. Forecasting the textile scene: an aid to the planning of a research programme. R&D Manag. 1971, 1:141-146.
99. Goodwin P., Wright G. Enhancing strategy evaluation in scenario planning: a role for decision analysis. J. Manag. Stud. 2001, 38:1-16.
100. Jawahar I.M., McLaughlin G.L. Toward a descriptive stakeholder theory: an organizational life cycle approach. Acad. Manag. Rev. 2001, 26:397-414.
101. Berman S.L., Wicks A.C., Kotha S., Jones T.M. Does stakeholder orientation matter? The relationship between stakeholder management models and firm financial performance. Acad. Manag. J. 1999, 42:488-506.
102. Perrott B.E. Managing strategic issues in the public service. Long Range Plan. 1996, 29:337-345.