Stability of response characteristics of a Delphi panel: Application of bootstrap data expansion

BMC Medical Research Methodology

Volumn 5, Issue , 2005, Pages

  Akins, Ralitsa B ^a   Tolson, Homer ^b   Cole, Bryan R ^b  

^a TEXAS A AND M HEALTH SCIENCE CENTER   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER; DATA ANALYSIS; HEALTH CARE QUALITY; HEALTH CARE UTILIZATION; HEALTH SERVICE; HEALTH SURVEY; HUMAN; MEDICAL EDUCATION; MEDICAL EXPERT; MEDICAL PRACTICE; PATIENT SAFETY; RATING SCALE; REVIEW; CONSENSUS DEVELOPMENT; DELPHI STUDY; EDUCATION; EPIDEMIOLOGY; MEDICAL ERROR; PERSONNEL; PREVENTION AND CONTROL; PROCEDURES; PSYCHOMETRY; QUESTIONNAIRE; REPRODUCIBILITY; SAFETY; SAMPLE SIZE; STANDARDS; STATISTICAL ANALYSIS; TOTAL QUALITY MANAGEMENT; VALIDATION STUDY;

CONSENSUS DEVELOPMENT CONFERENCES AS TOPIC; DATA INTERPRETATION, STATISTICAL; DELPHI TECHNIQUE; HUMANS; MEDICAL ERRORS; PSYCHOMETRICS; QUALITY INDICATORS, HEALTH CARE; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; RESEARCH PERSONNEL; SAFETY MANAGEMENT; SAMPLE SIZE; SAMPLING STUDIES; TOTAL QUALITY MANAGEMENT;

EID: 29244484010     PISSN: 14712288     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-5-37     Document Type: Review

References (52)

1. Williams PL, Webb C: The Delphi technique: a methodological discussion. J Adv Nurs 1994, 19:180-6.
2. Fischer RG: The Delphi method: a description, review and criticism. J Acad Librariansh 1978, 4(2):64-70.
3. Wilhelm WJ: Alchemy of the Oracle: the Delphi technique. The Delta Pi Epsilon Journal 2001, 43(1):6-26.
4. Reid NG: The Delphi technique: its contribution to the evaluation of professional practice. In Professional competence and quality assurance in the caring professions Edited by: Ellis R. New York, NY: Chapman and Hall; 1988.
5. Malone DC, Abarca J, Hansten PD, Grizzle AJ, Armstrong EP, Van Bergen RC, Duncan-Edgar BS, Solomon SL, Lipton RB: Identification of serious drug-drug interactions: results of the partnership to prevent drug-drug interactions. Am J Geriatr Pharmacother 2005, 3(2):65-76.
6. Strasser S, London L, Kortenbout E: Developing a competence framework and evaluation tool for primary care nurses in South Africa. Educ Health 2005, 18(2):133-144.
7. De Vet E, Brug J, De Nooijer J, Dijkstra A, De Vries NK: Determinants of forward stage transitions: a Delphi study. Health Educ Res 2005, 20(2):195-205.
8. Howell S, Kemp C: Defining early number sense: a participatory Australian study. J Educ Psychol 2005, 25(5):555-571.
9. Nekolaichuk CL, Fainsinger RL, Lawlor PG: A validation study of a pain classification system for advanced cancer patients using content experts: the Edmonton Classification System for cancer pain. Palliat Med 2005, 19:466-476.
10. Armstrong D, Marshall JK, Chiba N, Enns R, Fallone CA, Fass R, Hollingworth R, Hunt RH, Kahrilas PJ, Mayrand S, Moayyedi P, Paterson WG, Sadowski D, van Zanten SJ: Canadian consensus conference on the management of gastroesophageal reflux disease in adults - update 2004. Can J Gastroenterol 2005, 19(1):15-35.
11. Stolee P, Esbaugh J, Aylward S, Cathers T, Harvey DP, Hillier LM, Keat N, Feightner JW: Factors associated with the effectiveness of continuing education in long-term care. Gerontologist 2005, 45(3):399-405.
12. Al-Marzouki S, Roberts I, Marshall T, Evans S: The effect of scientific misconduct on the results of clinical trials: a Delphi survey. Contemp Clin Trials 2005, 26(3):331-337.
13. McKenna H, Keeney S, Bradley M: Nurse leadership within primary care: The perceptions of community nurses, GPs, policy makers and members of the public. J Nurs Manag 2004, 12:69-76.
14. Mcilfatrick SJ, Keeney S: Identifying cancer nursing research priorities using the Delphi technique. J Adv Nurs 2003, 42(6):629-636.
15. Coico R, Kachur E, Lima V, Lipper S: Guidelines for preklership bioterrorism curricula. Acad Med 2004, 79(4):366-375.
16. Telford R, Boote JD, Cooper CL: What does it mean to involve consumers successfully in NHS research? A consensus study. Health Expect 2004, 7(3):209-220.
17. Meadows AB, Maine LL, Keyes EK, Pearson K, Finstuen K: Pharmacy executive leadership issues and associated skills, knowledge and abilities. J Am Pharm Assoc 2005, 45(1):55-62.
18. Kelly KP, Porock D: A survey of paediatric oncology nurses' perceptions of parent educational needs. J Pediatr Oncol Nurs 2005, 22(1):58-66.
19. Cypert FR, Gant WL: The Delphi technique: A case study. Phi Delta Kappan 1971:272-273.
20. Barnette JJ, Danielson LC, Algozzine RF: Delphi methodology: an empirical investigation. Educational Research Quarterly 1978, 3(1):67-73.
21. Synnott G, McKie D: International issues in PR: Researching research and prioritising priorities. Journal of Public Relations Research 1997, 9(4):259-282.
22. Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs 2000, 32(4):1008-1015.
23. Robinson AR, Hohmann KB, Rifkin JI, Topp D, Gilroy CM, Pickard JR, Anderson RJ: Physician and public opinions on quality of health care and the problem of medical errors. Arch Intern Med 2002, 162(19):2186-2190.
24. Sexton JB, Helmreih RL, Rowan K, Vella K, Boyden J, Neilands TB, Roberts PR, Thomas EJ: The safety attitude questionnaire: a psychometric validation. Technical report The University of Texas Center of Excellence for Patient Safety Research and Practice, Austin, Texas; 2003. AHRQ Grants 1PO1HS1154401 and U18HS1116401
25. Baldrige National Quality Program: 2005 Healthcare criteria for performance excellence 2005 [http://www.quality.nist.gov/HealthCare_Criteria. htm]. Gaithersburg, MD: United States Department of Commerce, Technology Administration, National Institute of Standards and Technology
26. Linstone HA, Turoff M: The Delphi Method: techniques and applications Reading, MA: Addison-Wesley Publishing Company; 1975.
27. Adler M, Ziglio E: Gazing into the Oracle: the Delphi method and its application to social policy and public health Bristol, PA: Jessica Kingsley Publishers, Ltd; 1996.
28. Rotondi A, Gustafson D: Theoretical, methodological and practical issues arising out of the Delphi method. In Gazing into the Oracle: the Delphi method and its application to social policy and public health Edited by: Adler M, Ziglio E. Bristol, PA: Jessica Kingsley Publishers, Ltd; 1996:34-55.
29. Akins RB: A Process-centered tool for evaluating patient safety performance and guiding strategic improvement. Advances in patient safety: from research to implementation 2005, 4:109-125 [http://www.ahrq.gov/downloads/pub/ advances/vol4/Akins.pdf]. Rockville, MD: Agency for Healthcare Research and Quality
30. Efron B, Tibshirani R: An introduction to the bootstrap. In Monographs on statistics and applied probability, No 57 London: Chapman and Hall; 1993.
31. Edgington ES: Randomization tests New York: M. Dekker; 1995.
32. Good P: Permutation tests: a practical guide for resampling methods for testing hypotheses New York: Springer-Verlag; 2000.
33. Henderson AR: The bootstrap: a technique for data-driven statistics. Using computer intensive analyses to explore experimental data. Clin Chim Acta 2005, 359:1-26.
34. Linden A, Adams JL, Roberts N: Evaluating disease management program effectiveness: an introduction to the bootstrap technique. Disease Management & Health Outcomes 2005, 13(3):159-167.
35. Lloyd CJ: On comparing the accuracy of competing tests of the same hypotheses of simulation data. J Stat Plan Inference 2005, 128:497-508.
36. Calzone KA, Jenkins J, Masny A: Core competencies in cancer genetics for advanced practice oncology nurses. Oncol Nurs Forum 2002, 29(9):1327-1333.
37. Wang CC, Wang Y, Zhang K, Fang J, Liu W, Luo S, Tang S, Wang S, Li VC: Reproductive health indicators for China rural areas. Soc Sci Med 2003, 57:217-225.
38. Catlin AJ, Carter BS: Creation of a neonatal end-of-life palliative care protocol. J Perinat Neonal Nurs 2002, 21(4):37-49.
39. Sharp D, Liebenau A, Stocks N, Bennewith O, Evans M, Jones WB, Peters T, Goldberg D, Gunnell D: Locally developed guidelines for the aftercare of deliberate self-harm patients in general practice. Primary Health Care Research and Development 2003, 4:21-28.
40. Escobar A, Qintana JM, Arostegui I, Azkarate J, Guenaga JI, Arenaza JC, Garai I: Development of explicit criteria for total knee replacement. Int J Technol Assess Health Care 2003, 19(1):57-70.
41. McBride AJ, Pates R, Ramadan R, McGowan C: Delphi survey of experts' opinions on strategies used by community pharmacists to reduce over-the-counter drug misuse. Addiction 2003, 98:487-497.
42. Jones J, Hunter D: Consensus methods for medical and health services research. Br Med J 1995, 311(7001):376-380.
43. Elnicki DM, Lescisin DA, Case S: Improving the National Board of Medical Examiners Internal Medicine Subject Exam for use in clerkship evaluation. J Gen Intern Med 2002, 17:435-440.
44. Ziglio E: The Delphi method and its contribution to decision making. In Gazing into the Oracle: the Delphi method and its application to social policy and public health Edited by: Adler M, Ziglio E. Bristol, PA: Jessica Kingsley Publishers, Ltd; 1996:3-33.
45. Bernstein SJ, Laouri M, Hilborne LH, Leape LL, Kahan JP, Park RE, Kamberg CJ, Brook RH: Coronary Angiography: a literature review and ratings of appropriateness and necessity The New York City Rand Institute, JRA-03. Santa Monica, CA: The Rand Corporation; 1992.
46. Maetzel A, Strand V, Tugwell P, Wells G, Bombardier C: Economic comparison of Leflunomide and Methotrexate in patients with rheumatoid arthritis. Pharmacoeconomics 2002, 20(1):61-70.
47. Manktelow B, Abrams K, Draper E: A comparison of six methods of estimating confidence intervals for an indirectly standardized outcome ratio. J Epidemiol Community Health :A36.
48. Peris F, Martinez E, Badia X, Brosa M: Iatrogenic cost factors incorporating mild and moderate adverse events in the economic comparison of Aceclofenac and other NSAIDs. Pharmacoeconomics 2001, 19(7):779-790.
49. Neymark N, Adriaenssen I, Gorlia T, Caleo S, Bolla M, Brochon D: Cost-effectiveness of the addition of early hormonal therapy in locally advanced prostate cancer: results decisively determined by the cut-off time point chosen for the analysis. Eur J Cancer 2001, 37:1768-1774.
50. Chen M, Kianifard F: A nonparametric procedure associated with a clinically meaningful efficacy measure. Biostatistics 2000, 1:293-298.
51. Bredell H, Crookes RL, Heynes du PA, Schoub BD, Morris L: Molecular investigation of two possible cases of accidental HIV-1 transmission in South Africa. AIDS Res Hum Retroviruses 2003, 19(7):613-617.
52. MacNab YC, Farrel PJ, Gustafson P, Wen S: Estimation in Bayesian disease mapping. Biometrics 2004, 60:865-873.