An exploration of the use of simple statistics to measure consensus and stability in Delphi studies

BMC Medical Research Methodology

Volumn 7, Issue , 2007, Pages

  Holey, Elizabeth A ^a   Feeley, Jennifer L ^b   Dixon, John ^a   Whittaker, Vicki J ^a  

^a TEESSIDE UNIVERSITY   (United Kingdom)

^b KING S MILL HOSPITAL   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CONSENSUS; CONTROLLED STUDY; DELPHI STUDY; HUMAN; MEDICAL RESEARCH; STATISTICAL ANALYSIS; THEMATIC ANALYSIS; EVALUATION; QUALITY CONTROL; UNITED KINGDOM;

CONSENSUS; DATA INTERPRETATION, STATISTICAL; DELPHI TECHNIQUE; EVALUATION STUDIES AS TOPIC; GREAT BRITAIN; HUMANS; QUALITY CONTROL;

EID: 38749140256     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-7-52     Document Type: Article

References (29)

1. Consensus development methods, and their use in clinical guideline development. MK Murphy NA Black DL Lamping CM McKee CF Sanderson J Askham T Marteau, Health Technol Assess 1998 2 3 i 88 9561895
2. AL Delbecq AH Van de Ven DH Guftafson, A Guide to Nominal Group Techniques for Program Planning and Delphi Processes Glenview, Illinois: Scott Forman and Co 1974
3. Studying the future: A Delphi survey of how multi-disciplinary clinical staff view the likely development of two community mental health centres over the course of the next two years. B Beech, J Adv Nurs 1997 25 331 338 10.1046/j.1365-2648.1997.1997025331.x 9044008
4. Indicators of the appropriateness of long-term prescribing in general practice in the United Kingdom: Consensus development, face and content validity. JA Cantrill B Sibbald S Buetow, Qual Health Care 1998 7 130 135 10185138
5. Practical application of the Delphi technique in a bicultural mental health nursing study in New Zealand. DJ Hardy AP O'Brien CJ Gaskin AJ O'Brien E Morrison-Ngatal G Skews T Ryan N McNulty, J Adv Nurs 2004 46 95 109 10.1111/j.1365-2648.2003.02969.x 15030446
6. A Delphi study of self-care in a community population of people with multiple sclerosis. L O'Hara LH De Souza L Ide, Clin Rehabil 2000 14 62 71 10.1191/026921500666135189 10688346
7. Quality indicators for the management of medical conditions in nursing home residents. D Saliba D Solomon L Rubenstein R Young J Schnelle C Roth N Wenger, J Am Med Dir Assoc 2004 5 297 309 15357887
8. Development of a tool to rate the quality assessment of randomised controlled trails using a Delphi technique. F Sindhu L Carpenter K Seers, J Adv Nurs 1997 25 1262 1268 10.1046/j.1365-2648.1997.19970251262.x 9181425
9. Emergency calls not requiring an urgent ambulance response: Expert consensus. M Wollard, Prehospital Emergency Care 2003 7 384 391 10.1080/10903120390936626 12879391
10. M Adler E Ziglio (Eds), Gazing into the Oracle: The Delphi Method and its Application to Social Policy and Public Health London: Jessica Kinglsey Publishers 1996
11. HA Linstone M Turoff, The Delphi Method Techniques and Applications Massachusetts: Addision Wesley Publishing Co 1975
12. Committee and consensus: How many heads are better than one? P Caws, J Med Philos 1991 16 375 391 1895023
13. Stability and agreement criteria for the termination of Delphi studies. JS Dajani MZ Sincoff WK Talley, Technol Forecast Soc 1979 13 83 90 10.1016/0040-1625(79)90007-6
14. The Delphi technique: Methodological discussion. PL Williams C Webb, J Adv Nurs 1994 19 180 186 10.1111/j.1365-2648.1994.tb01066.x 8138622
15. The Delphi method? J Crisp D Pelletier C Duffield A Adams S Nagy, Nurs Res 1997 46 16 118 10.1097/00006199-199703000-00010
16. Experiments in Delphi Methodology. M Scheibe M Skutsch J Schofer, The Delphi Method: Techniques and Applications Massachusetts: Addison-Wesley, Linstone HA, Turoff M, 1975 262 287
17. Individual stability in Delphi studies. WW Chaffin WK Talley, Technol Forecast Social 1980 16 67 73 10.1016/0040-1625(80)90074-8
18. An accessible analytical approach for investigating what happens between the rounds of a Delphi study. J Greatorex T Dexter, J Adv Nurs 2000 32 1016 1024 10.1046/j.1365-2648.2000.01569.x 11095243
19. Interdisciplinary practice - a matter of teamwork: An integrated literature review. A McCallin, J Clin Nurs 2001 10 419 428 10.1046/j.1365-2702. 2001.00495.x 11822488
20. I Holloway S Wheeler, Qualitative Research in Nursing Oxford: Blackwell Science Ltd 2 2002
21. J Sim C Wright, Research in Health Care, Concepts, Designs & Methods Cheltenham: Nelson-Thorne Ltd 2000
22. The Delphi technique: characteristics and sequence model. MR Couper, ANS Adv Nurs Sci 1984 7 1 72 77 6435511
23. J Watson, Men and Health: Report of a Delphi Study to Scope Themes for Evidence-Based Reviews National Institute for Clinical Excellence 2004 http://www.nice.org.uk/nicemedia/documents/menandhealth_delphi.pdf http://www.nice.org.uk
24. FP Maxwell, A-Z Medical Statistics: A Comparison for Clinical Appraisal London: Arnold 1998
25. DG Altman, Practical Statistics for Medical Research London: Chapman & Hall/CRC 1999
26. MedCalc. http://www.medcalc.be/manual/kappa.php
27. P Armitage G Berry JNS Matthews, Statistical Methods in Medical Research Oxford: Blackwell Science Ltd 4 2002
28. DM Anthony, Understanding Advanced Statistics: A Guide for Nurses and Health Care Researchers New York: Churchill Livingstone 1999
29. JL Fliess, Statistical Methods for Rates and Proportions New York: John Wiley & Sons 1981