A systematic assessment of rigor in information systems ranking-type Delphi studies

Information and Management

Volumn 50, Issue 5, 2013, Pages 207-217

  Paré, Guy ^a   Cameron, Ann Frances ^a   Poba Nzaou, Placide ^b   Templier, Mathieu ^a  

^a HEC MONTRÉAL   (Canada)

^b UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

Author keywords

Descriptive review; Information systems research; Ranking type Delphi; Rigor

Indexed keywords

DELPHI METHOD; DELPHI STUDY; RANKING-TYPE DELPHI; RETENTION RATE; RIGOR; SYSTEMATIC ASSESSMENT;

DECISION MAKING; RESEARCH; SURVEYS;

INFORMATION SYSTEMS;

EID: 84877349087     PISSN: 03787206     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.im.2013.03.003     Document Type: Article

References (58)

1. M. Adler, and E. Ziglio Gazing into the Oracle 1996 Jessica Kingsley Publishers Bristol, PA
2. H.A. Akkermans, P. Bogerd, E. Yucesan, and L.N. Van Wassenhove The impact of ERP on supply chain management: exploratory findings from a European Delphi study European Journal of Operational Research 146 2003 284 301
3. J.S. Armstrong Long-Range Forecasting 1978 John Wiley & Sons New York, NY
4. I. Benbasat, and R.W. Zmud The identity crisis within the IS discipline: defining and communicating the discipline's core properties MIS Quarterly 27 2003 183 194
5. M.C. Boudreau, D. Gefen, and D.W. Straub Validation in IS research: a state-of-the-art assessment MIS Quarterly 25 2001 1 16
6. J. Brancheau, and J. Wetherbe Key issues in information systems management MIS Quarterly 1 1987 23 45
7. J. Brancheau, B. Janz, and J. Wetherbe Key issues in information systems management: 1994-95 SIM Delphi results MIS Quarterly 20 1996 225 242
8. N.C. Dalkey The Delphi Method: An Experimental Study of Group Opinion 1969 The Rand Corporation Santa Monica, CA
9. N.C. Dalkey, and O. Helmer An experimental application of the Delphi method to the use of experts Management Science 9 1963 458 467
10. E.M. Daniel, and A. White The future of inter-organizational system linkages: findings of an international Delphi European Journal of Information Systems 14 2005 188 203 (Pubitemid 41111292)
11. A. Delbecq, A. Van de Ven, and D. Gustafson D Group Techniques for Program Planning 1975 Scott Foresman and Company Glenview, IL
12. W.G. Dickson, R.L. Leitheiser, J.C. Wetherbe, and M. Nechis Key information systems issues for the 1980's MIS Quarterly 8 1984 135 159
13. L. Dubé, and G. Paré Rigor in information systems positivist case research: current practices, trends, and recommendations MIS Quarterly 27 2004 597 636
14. M.D. Gallego, and P.L.S. Bueno Designing a forecasting analysis to understand the diffusion of open source software in the year 2010 Technological Forecasting and Social Change 75 2008 672 686 (Pubitemid 351737227)
15. P.G. Goldschmidt Scientific inquiry or political critique Technological Forecasting and Social Change 7 1975 195 213
16. R. Gonzalez, J. Gasco, and J. Llopis Information systems outsourcing: a Delphi study from Spain Business Process Management Journal 16 2010 244 263
17. T.J. Gordon, O. Helmer, Report on a long-range forecasting study, The Rand Corporation, 1964, 71 pp. Retrieved on http://www.rand.org/content/dam/ rand/pubs/papers/2005/P2982.pdf (February 28, 2013).
18. P. Gottschalk Studies of key issues in IS management around the world International Journal of Information Management 20 2000 169 180
19. U.G. Gupta, and R.E. Clarke Theory and applications of the Delphi technique: a bibliography (1975-1994) Technological Forecasting and Social Change 53 1996 185 211 (Pubitemid 28088726)
20. C. Hsu, and B. Sandford Minimizing non-response in the Delphi process: how to respond to non-response Practical Assessment, Research & Evaluation 12 2007 62 78
21. C.Y. Huang, J.Z. Shyu, and G.H. Tzeng Reconfiguring the innovation policy portfolios for Taiwan's SIP Mall industry Technovation 27 2007 744 765 (Pubitemid 350007768)
22. D.A. Jenkins, and T.E. Smith Applying Delphi methodology in family therapy research Contemporary Family Therapy 16 1994 411 430
23. V. Kasi, M. Keil, L. Mathiassen, and K. Pedersen The post mortem paradox: a Delphi study of IT specialist perceptions European Journal of Information Systems 17 2008 62 78
24. A.J. Klee The utilization of expert opinion in decision-making AICHE Journal 18 1972 1107 1115
25. J.R. Landis, and G.G. Kock The measurement of observer agreement for categorical data Biometrics 33 1977 159 174 (Pubitemid 8054849)
26. L.S. Lee, and R.M. Anderson An exploratory investigation of the antecedents of the IT project management capability e-Service Journal 5 2006 27 42
27. A. Lee, and G. Hubona A scientific basis for rigor in information systems research MIS Quarterly 33 2009 237 262
28. H.A. Linstone The Delphi Method: Techniques and Applications 1977 Addison-Wesley Reading, MA
29. H.A. Linstone, and M. Turoff The Delphi Method: Techniques and Applications 1975 Addison-Wesley Reading, MA
30. H.A. Linstone, and M. Turoff The Delphi Method: Techniques and Applications Second edition 2002 Addison-Wesley Reading, MA
31. B.G. Ludwig, Internationalizing extension: an exploration of the characteristics evident in a state university extension system that achieves internationalization, Unpublished doctoral dissertation, The Ohio State University, Columbus, Ohio, 1994.
32. S. Makridakis, and S. Wheelwright Forecasting Methods and Applications 1978 John Wiley New York, NY
33. J.P. Martino Technology Forecasting for Decision Making 1983 Elsevier Science Publishing New York, NY
34. L.E. Miller Determining what could/should be: the Delphi technique and its application Proceedings of the 2006 Annual Meeting of the Mid-Western Educational Research Association Columbus, OH 2006
35. V.W. Mitchell The Delphi technique: an exposition and application Technology Analysis and Strategic Management 3 1991 333 358
36. I. Mitroff, and M. Turoff Philosophical and methodological foundations of Delphi H.A. Linstone, M. Turoff, The Delphi Method: Techniques and Applications 2002 Turoff and Linstone Newark, NJ 17 34
37. R.M. Müller, S. Linders, and L. Pires Business intelligence and service-oriented architecture: a Delphi study Information Systems Management 27 2010 168 187
38. R. Nakatsu, and C.L. Iacovou A comparative study of important risk factors involved in offshore and domestic outsourcing of software development projects: a two-panel Delphi study Information & Management 46 2009 57 68
39. S. Nambisan, R. Agarwal, and M. Tannirum Organizational mechanisms for enhancing user innovation in information technology MIS Quarterly 23 1989 365 395
40. D. Nevo, and Y.E. Chan A Delphi study of knowledge management systems: scope and requirements Information & Management 44 2007 583 597 (Pubitemid 47211729)
41. K.H. Oh, Forecasting through hierarchical Delphi, Unpublished doctoral dissertation, The Ohio State University, Columbus, Ohio, 1974.
42. C. Okoli, and S.D. Pawlowski The Delphi method as a research tool: an example, design considerations and applications Information & Management 42 2004 15 29
43. G. Paré, M.C. Trudel, and M. Jaana Stand-alone literature reviews in information systems research: development of a taxonomy of review types and assessment of current practices Proceedings of the Administrative Sciences Association of Canada (ASAC) Conference St John's, Newfoundland, Canada, June 9-12 2012 46 81
44. A. Plüddemann, C. Heneghan, M. Thompson, N. Roberts, N. Summerton, L. Linden-Phillips, C. Packer, and C.P. Price Prioritization criteria for the selection of new diagnostic technologies for evaluation BMC Health Services Research 10 2010 109 http://www.biomedcentral.com/1472-6963/10/109
45. W. Rauch The decision Delphi Technological Forecasting and Social Change 15 1979 159 169
46. M.K. Rayens, and E.J. Hahn Building consensus using the policy Delphi method Policy, Politics & Nursing Practice 1 2000 308 315
47. N.G. Reid The Delphi technique its contribution to the evaluation of professional practice R. Ellis, Professional Competence and Quality Assurance in the Caring Professions 1988 Chapman & Hall London 230 262
48. W.G. Rieger Directions in Delphi developments: dissertations and their quality Technological Forecasting and Social Change 29 1986 195 204
49. W.E. Riggs The Delphi technique: an experimental evaluation Technological Forecasting and Social Change 23 1983 89 94
50. H. Sackman Delphi Assessment, Expert Opinion, Forecasting, and Group Processes 1974 The Rand Corporation Santa Monica, CA
51. K. Saranto, and M. Talberg Enhancing evidence-based practice - a controlled vocabulary for nursing practice and research International Journal of Medical Informatics 70 2003 249 253 (Pubitemid 36959715)
52. S. Scala, and R. McGrath Advantages and disadvantages of electronic data interchange - an industry perspective Information & Management 25 1993 85 91
53. M. Scheibe, M. Skutsch, and J. Schofer Experiments in Delphi methodology H.A. Linstone, M. Turoff, The Delphi Method: Techniques and Applications 2002 Turoff and Linstone Newark, NJ 257 281
54. R.C. Schmidt Managing Delphi surveys using nonparametric statistical techniques Decision Sciences 28 1997 763 774
55. R.C. Schmidt, K. Lyytinen, M. Keil, and P. Cule Identifying software project risks: an international Delphi study Journal of Management Information Systems 17 2001 5 36 (Pubitemid 32716732)
56. S. Siegel, and N.J. Castellan Nonparametric Statistics for the Behavioral Sciences 1988 McGraw-Hill New York, NY
57. M. Turoff The Policy Delphi H.A. Linstone, M. Turoff, The Delphi Method: Techniques and Applications 2002 Turoff and Linstone Newark, NJ 257 281
58. G. Xu, and A.J. Gutiérrez An exploratory study of killer applications and critical success factors in m-commerce Journal of Electronic Commerce in Organizations 4 2006 63 79 (Pubitemid 44506509)