The Delphi technique as a forecasting tool: Issues and analysis

International Journal of Forecasting

Volumn 15, Issue 4, 1999, Pages 353-375

  Rowe, Gene ^a   Wright, George ^b  

^a INSTITUTE OF FOOD RESEARCH   (United Kingdom)

^b UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

Delphi; Interacting groups; Statistical group; Structured groups

Indexed keywords

EID: 0000895370     PISSN: 01692070     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0169-2070(99)00018-7     Document Type: Article

References (64)

1. Armstrong J.S. Long range forecasting: from crystal ball to computer. 2nd ed. 1985;Wiley, New York.
2. Armstrong J.S., Lusk E.J. Return postage in mail surveys: a meta-analysis. Public Opinion Quarterly. 51:(2):1987;233-248.
3. Ashton R.H. Combining the judgments of experts: how many and which ones? Organizational Behaviour and Human Decision Processes. 38:1986;405-414.
4. Bardecki M.J. Participants' response to the Delphi method: an attitudinal perspective. Technological Forecasting and Social Change. 25:1984;281-292.
5. Best R.J. An experiment in Delphi estimation in marketing decision making. Journal of Marketing Research. 11:1974;448-452.
6. Bolger F., Wright G. Assessing the quality of expert judgment: issues and analysis. Decision Support Systems. 11:1994;1-24.
7. Boje D.M., Murnighan J.K. Group confidence pressures in iterative decisions. Management Science. 28:1982;1187-1196.
8. Brockhoff K. The performance of forecasting groups in computer dialogue and face to face discussions. Linstone H., Turoff M. The Delphi method: techniques and applications. 1975;Addison-Wesley, London.
9. Brockhoff K. Forecasting quality and information. Journal of Forecasting. 3:1984;417-428.
10. Cohen J. The Earth is round ( p<.05 ). American Psychologist. December:1994;997-1003.
11. Dagenais F. The reliability and convergence of the Delphi technique. The Journal of General Psychology. 98:1978;307-308.
12. Dalkey N.C., Brown B., Cochran S.W. The Delphi method III: use of self-ratings to improve group estimates. Technological Forecasting. 1:1970;283-291.
13. Dalkey N.C., Helmer O. An experimental application of the Delphi method to the use of experts. Management Science. 9:1963;458-467.
14. Deutsch M., Gerard H.B. A study of normative and informational social influences upon individual judgment. Journal of Abnormal and Social Psychology. 51:1955;629-636.
15. Dietz T. Methods for analyzing data from Delphi panels: some evidence from a forecasting study. Technological Forecasting and Social Change. 31:1987;79-85.
16. Einhorn H.J., Hogarth R.M., Klempner E. Quality of group judgment. Psychological Bulletin. 84:1977;158-172.
17. Erffmeyer R.C., Erffmeyer E.S., Lane I.M. The Delphi technique: an empirical evaluation of the optimal number of rounds. Group and Organization Studies. 11:(1):1986;120-128.
18. Erffmeyer R.C., Lane I.M. Quality and acceptance of an evaluative task: the effects of four group decision-making formats. Group and Organization Studies. 9:(4):1984;509-529.
19. Felsenthal D.S., Fuchs E. Experimental evaluation of five designs of redundant organizational systems. Administrative Science Quarterly. 21:1976;474-488.
20. Fischer G.W. When oracles fail - a comparison of four procedures for aggregating subjective probability forecasts. Organizational Behavior and Human Performance. 28:1981;96-110.
21. Gowan J.A., McNichols C.W. The efforts of alternative forms of knowledge representation on decision making consensus. International Journal of Man-Machine Studies. 38:1993;489-507.
22. Gustafson D.H., Shukla R.K., Delbecq A., Walster G.W. A comparison study of differences in subjective likelihood estimates made by individuals, interacting groups, Delphi groups and nominal groups. Organizational Behavior and Human Performance. 9:1973;280-291.
23. Helmer O. Foreward. Linstone H., Turoff M. The Delphi method: techniques and applications. 1975;Addison-Wesley, London.
24. Hill K.Q., Fowles J. The methodological worth of the Delphi forecasting technique. Technological Forecasting and Social Change. 7:1975;179-192.
25. Hogarth R.M. A note on aggregating opinions. Organizational Behaviour and Human Performance. 21:1978;40-46.
26. Hornsby J.S., Smith B.N., Gupta J.N.D. The impact of decision-making methodology on job evaluation outcomes. Group and Organization Management. 19:1994;112-128.
27. Hudak R.P., Brooke P.P., Finstuen K., Riley P. Health care administration in the year 2000: practitioners' views of future issues and job requirements. Hospital and Health Services Administration. 38:(2):1993;181-195.
28. Isenberg D.J. Group polarization: a critical review and meta-analysis. Journal of Personality and Social Psychology. 50:1986;1141-1151.
29. Jolson M.A., Rossow G. The Delphi process in marketing decision making. Journal of Marketing Research. 8:1971;443-448.
30. Kastein M.R., Jacobs M., Van der Hell R.H., Luttik K., Touw-Otten F.W.M.M. Delphi, the issue of reliability: a qualitative Delphi study in primary health care in the Netherlands. Technological Forecasting and Social Change. 44:1993;315-323.
31. Larreché J.C., Moinpour R. Managerial judgment in marketing: the concept of expertise. Journal of Marketing Research. 20:1983;110-121.
32. Leape L.L., Freshour M.A., Yntema D., Hsiao W. Small group judgment methods for determining resource based relative values. Medical Care. 30:1992;NS28-NS39.
33. Linstone H.A. Eight basic pitfalls: a checklist. Linstone H., Turoff M. The Delphi method: techniques and applications. 1975;Addison-Wesley, London.
34. Linstone H.A. The Delphi technique. Fowles J. Handbook of futures research. 1978;Greenwood Press, Westport, CT.
35. Linstone H.A., Turoff M. The Delphi method: techniques and applications. 1975;Addison-Wesley, London.
36. Lock A. Integrating group judgments in subjective forecasts. Wright G., Ayton P. Judgmental forecasting. 1987;Wiley, Chichester.
37. Lunsford D.A., Fussell B.C. Marketing business services in central Europe. Journal of Services Marketing. 7:(1):1993;13-21.
38. Martino J. Technological forecasting for decision making. 2nd ed. 1983;American Elsevier, New York.
39. Miner F.C. A comparative analysis of three diverse group decision making approaches. Academy of Management Journal. 22:(1):1979;81-93.
40. Mulgrave N.W., Ducanis A.J. Propensity to change responses in a Delphi round as a function of dogmatism. Linstone H., Turoff M. The Delphi method: techniques and applications. 1975;Addison-Wesley, London.
41. Myers D.G. Polarizing effects of social comparisons. Journal of Experimental Social Psychology. 14:1978;554-563.
42. Neiderman F., Brancheau J.C., Wetherbe J.C. Information systems management issues for the 1990s. MIS Quarterly. 15:(4):1991;474-500.
43. Olshfski D., Joseph A. Assessing training needs of executives using the Delphi technique. Public Productivity and Management Review. 14:(3):1991;297-301.
44. Ono R., Wedermeyer D.J. Assessing the validity of the Delphi technique. Futures. 26:1994;289-304.
45. Parenté F.J., Anderson J.K., Myers P., O'Brien T. An examination of factors contributing to Delphi accuracy. Journal of Forecasting. 3:(2):1984;173-182.
46. Parenté F.J., Anderson-Parenté J.K. Delphi inquiry systems. Wright G., Ayton P. Judgmental forecasting. 1987;Wiley, Chichester.
47. Riggs W.E. The Delphi method: an experimental evaluation. Technological Forecasting and Social Change. 23:1983;89-94.
48. Rohrbaugh J. Improving the quality of group judgment: social judgment analysis and the Delphi technique. Organizational Behavior and Human Performance. 24:1979;73-92.
49. Rosenthal R. Combining results of independent studies. Psychological Bulletin. 85:(1):1978;185-193.
50. Rowe G., Wright G. The impact of task characteristics on the performance of structured group forecasting techniques. International Journal of Forecasting. 12:1996;73-89.
51. Rowe G., Wright G., Bolger F. The Delphi technique: a re-evaluation of research and theory. Technological Forecasting and Social Change. 39:(3):1991;235-251.
52. Sackman H. Delphi critique. 1975;Lexington Books, Lexington, MA.
53. Saito M., Sinha K. Delphi study on bridge condition rating and effects of improvements. Journal of Transport Engineering. 117:1991;320-334.
54. Scheibe M., Skutsch M., Schofer J. Experiments in Delphi methodology. Linstone H., Turoff M. The Delphi method: techniques and applications. 1975;Addison-Wesley, London.
55. Sniezek J.A. An examination of group process in judgmental forecasting. International Journal of Forecasting. 5:1989;171-178.
56. Sniezek J.A. A comparison of techniques for judgmental forecasting by groups with common information. Group and Organization Studies. 15:(1):1990;5-19.
57. Sniezek J.A. Groups under uncertainty: an examination of confidence in group decision making. Organizational Behavior and Human Decision Processes. 52:(1):1992;124-155.
58. Spinelli T. The Delphi decision-making process. Journal of Psychology. 113:1983;73-80.
59. Stewart T.R. The Delphi technique and judgmental forecasting. Climatic Change. 11:1987;97-113.
60. Taylor R.G., Pease J., Reid W.M. A study of survivability and abandonment of contributions in a chain of Delphi rounds. Psychology: A Journal of Human Behavior. 27:1990;1-6.
61. Van de Ven A.H., Delbecq A.L. The effectiveness of nominal, Delphi, and interacting group decision making processes. Academy of Management Journal. 17:(4):1974;605-621.
62. Van Dijk J.A.G.M. Delphi questionnaires versus individual and group interviews: a comparison case. Technological Forecasting and Social Change. 37:1990;293-304.
63. Welty G. The necessity, sufficiency and desirability of experts as value forecasters. Leinfellner W., Kohler E. Developments in the methodology of social science. 1974;Reidel, Boston.
64. Wright G., Lawrence M.J., Collopy F. The role and validity of judgment in forecasting. International Journal of Forecasting. 12:1996;1-8.