Methods to elicit experts' beliefs over uncertain quantities: Application to a cost effectiveness transition model of negative pressure wound therapy for severe pressure ulceration

Statistics in Medicine

Volumn 30, Issue 19, 2011, Pages 2363-2380

  Soares, Marta O ^a   Bojke, Laura ^a   Dumville, Jo ^a   Iglesias, Cynthia ^a   Cullum, Nicky ^a   Claxton, Karl ^a  

^a UNIVERSITY OF YORK   (United Kingdom)

Author keywords

Cost effectiveness; Decision analytic models; Elicitation; Expert; Negative pressure wound therapy

Indexed keywords

ARTICLE; COST EFFECTIVENESS ANALYSIS; DATA COLLECTION METHOD; DECISION SUPPORT SYSTEM; DECUBITUS; DISEASE SEVERITY; ELICITATION EXERCISE; EVIDENCE BASED PRACTICE; HEALTH BELIEF; MEDICAL EXPERT; PHYSICIAN ATTITUDE; UNCERTAINTY; VACUUM ASSISTED CLOSURE; VALIDATION STUDY; WOUND HEALING;

DECISION SUPPORT TECHNIQUES; EXPERT TESTIMONY; HUMANS; NEGATIVE-PRESSURE WOUND THERAPY; NURSES; PRESSURE ULCER; SEVERITY OF ILLNESS INDEX; TECHNOLOGY ASSESSMENT, BIOMEDICAL;

EID: 79960558160     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.4288     Document Type: Article

References (58)

1. Claxton K. Exploring uncertainty in cost-effectiveness analysis. Pharmacoeconomics. 2008; 9: 781-798.
2. O'hagan A. Uncertain Judgements: Eliciting Experts' Probabilities. John Wiley & Sons, 2006.
3. Garthwaite PH, Kadane JB, O'hagan A. Statistical methods for eliciting probability distributions. Journal of the American Statistical Association. 2005; 100: 680-701.
4. O'hagan A, Stevens JW. Bayesian methods for design and analysis of cost-effectiveness trials in the evaluation of health care technologies. Statistical Methods in Medical Research. 2002 11(6): 469-490.
5. Stevenson MD, Oakley JE, Chick SE, Chalkidou K. The cost-effectiveness of surgical instrument management policies to reduce the risk of vCJD transmission to humans. Journal of the Operational Research Society. 2008 60(4): 506-518.
6. Claxton K, Sculpher M, Drummond M. A rational framework for decision making by the National Institute For Clinical Excellence (NICE). Lancet. 2002; 360(9334): 711-715, DOI: S0140-6736(02)09832-X [pii] 10.1016/S0140-6736(02)09832-X.
7. Philbeck TE Jr, Whittington KT, Millsap MH, Briones RB, Wight DG, Schroeder WJ. The clinical and cost effectiveness of externally applied negative pressure wound therapy in the treatment of wounds in home healthcare Medicare patients. Ostomy Wound Management. 1999; 45(11): 41-44, 46-50.
8. Witkowski W, Jawien A, Witkiewicz W, Zon B. Initial multi-centre observations upon the effect of a new topical negative pressure device upon patient and clinician experience and the treatment of wounds. International Wound Journal. 2009; 6(2): 167-174, DOI: IWJ586 [pii] 10.1111/j.1742-481X.2009.00586.x.
9. Seternes A, Myhre HO, Dahl T. Early results after treatment of open abdomen after aortic surgery with mesh traction and vacuum-assisted wound closure. European Journal of Vascular and Endovascular Surgery. 2010; 40(1): 60-64, DOI: S1078-5884(10)00134-6 [pii] 10.1016/j.ejvs.2010.02.018.
10. Dosluoglu HH, Loghmanee C, Lall P, Cherr GS, Harris LM, Dryjski ML. Management of early (<30 day) vascular groin infections using vacuum-assisted closure alone without muscle flap coverage in a consecutive patient series. Journal of Vascular Surgery. 2010; 51(5): 1160-1166, DOI: S0741-5214(09)02341-6 [pii] 10.1016/j.jvs.2009.11.053.
11. Apelqvist J, Armstrong DG, Lavery LA, Boulton AJ. Resource utilization and economic costs of care based on a randomized trial of vacuum-assisted closure therapy in the treatment of diabetic foot wounds. American Journal of Surgery. 2008; 195(6): 782-788, DOI: S0002-9610(08)00006-8 [pii] 10.1016/j.amjsurg.2007.06.023.
12. Gabriel A, Heinrich C, Shores J, Cho D, Baqai W, Moores D, Miles D, Gupta S. Outcomes of vacuum-assisted closure for the treatment of wounds in a paediatric population: case series of 58 patients. Journal of Plastic, Reconstructive & Aesthetic Surgery. 2009; 62(11): 1428-1436, DOI: S1748-6815(08)00770-5 [pii] 10.1016/j.bjps.2008.06.033.
13. Kelm J, Schmitt E, Anagnostakos K. Vacuum-assisted closure in the treatment of early hip joint infections. International Journal of Medical Sciences. 2009; 6 (5): 241-246.
14. Pham C, Middleton P, Maddern G. Vacuum-assisted closure for the management of wounds: an accelerated systematic review. in Surgical 2003, A.S.a.E.R.o.N.I. Procedures.
15. Fisher A, Brady B. Vacuum assisted wound closure therapy. in Issues in Emerging Health Technologies C.C.C.f.H.T. Assessment, Editor. 2003.
16. Centre for Evidence Based Purchasing, Evidence Review: Vacuum Assisted Closure Therapy, N.P.a.S. Agency, Editor, 2008.
17. Ubbink DT, Westerbos SJ, Evans D, Land L, Vermeulen H. Topical negative pressure for treating chronic wounds. Cochrane Database of Systematic Reviews. 2008; (3): CD001898. DOI: 10.1002/14651858.CD001898.pub2.
18. Gregor S, Maegele M, Sauerland S, Krahn JF, Peinemann F, Lange S. Negative pressure wound therapy: a vacuum of evidence? Archives of Surgery. 2008; 143(2): 189-196, DOI: 143/2/189 [pii] 10.1001/archsurg.2007.54.
19. Vikatmaa P, Juutilainen V, Kuukasjarvi P, Malmivaara A. Negative pressure wound therapy: a systematic review on effectiveness and safety. European Journal of Vascular and Endovascular Surgery. 2008; 36(4): 438-448, DOI: S1078-5884(08)00333-X [pii] 10.1016/j.ejvs.2008.06.010.
20. Costa V, Brophy JMM. Vacuum-assisted wound closure therapy (V.A.C (R)), 2005. Technology Assessment Unit of the McGill University Health Centre (MUHC).
21. Ontario Health Technology Advisory Committee. Negative Pressure Wound Therapy: Update, 2006. Health Technology Policy Assessment.
22. Topical negative pressure for chronic wounds?Drug and Therapeutics Bulletin. 2007; 45(8): 57-61.
23. Chaloner K, Rhame FS. Quantifying and documenting prior beliefs in clinical trials. Statistics in Medicine. 2001; 20(4): 581-600.
24. Jenkinson D. The Elicitation of Probabilities-A Review of the Statistical Literature, 2005. BEEP working paper. Available at [consulted in 23-02-20 11].
25. Clemen RT, Winkler RL. Combining probability distributions from experts in risk analysis. Risk Analysis. 1999; 19(2): 187-203.
26. Sabin M. Competence in Practice Based Calculation: Issues for Nurse Education, Napier University: Edinburgh, 2001.
27. Zuashkiani A, Banjevic D, Jardine AKS. Estimating parameters of proportional hazards model based on expert knowledge and statistical data. Journal of the Operational Research Society. 2008; 60(12): 1621-1636.
28. Kadane JB, Wolfson LJ. Experiences in elicitation. Journal of the Royal Statistical Society. Series D (The Statistician). 1998; 47(1): 3-19.
29. Choy SL, O'Leary R, Mengersen K. Elicitation by design in ecology: using expert opinion to inform priors for Bayesian statistical models. Ecology. 2009; 90(1): 265-277.
30. Gavasakar U. A comparison of two elicitation methods for a prior distribution for a binomial parameter. Management Science. 1988; 34(6): 784-790.
31. Chaloner KM, Duncan GT. Assessment of a beta prior distribution: PM elicitation. Journal of the Royal Statistical Society. Series D (The Statistician). 1983; 32(1/2): 174-180.
32. van Noortwijk J, Dekker A, Cooke R, Mazzuchi T. Expert judgment in maintenance optimization. IEEE Transactions on Reliability. 1992; 41: 427-432.
33. Roosen J, Hennessy DA. Capturing experts' uncertainty in welfare analysis: an application to organophosphate use regulation in U.S. apple production. American Journal of Agricultural Economics. 2001 83(1): 166-182.
34. McKenna C, McDaid C, Suekarran S, Hawkins N, Claxton K, Light K, Chester M, Cleland J, Woolacott N, Sculpher M. Enhanced external counterpulsation for the treatment of stable angina and heart failure: a systematic review and economic analysis. Health Technology Assessment. 2009; 13(24).
35. Speight PM, Palmer S, Moles DR, Downer MC, Smith DH, Henriksson M, Augustovski F. The cost-effectiveness of screening for oral cancer in primary care. Health Technology Assessment. 2006; 10(14): 1-144, iii-iv, DOI: 99-46-02 [pii].
36. Welton NJ, Ades AE. Estimation of Markov chain transition probabilities and rates from fully and partially observed data: uncertainty propagation, evidence synthesis, and model calibration. Medical Decision Making. 2005; 25(6): 633-645, DOI: 10.1177/0272989x05282637.
37. Singpurwalla ND, Song MS. Analysis of Weibull lifetime data incorporating expert opinion. InProbability and Bayesian Statistics, Viertl R (ed), Plenum, New York, 1987; 431-442.
38. Singpurwalla ND. An interactive PC-based procedure for reliability assessment incorporating expert opinion and survival data. Journal of the American Statistical Association. 1988; 83 (43-51).
39. Kaminsky MP, Krivtsov VV. An Approach to Evaluating the Joint Prior Distribution of Weibull Parameters, 3rd International Conference on Mathematical Methods in Reliability, Santa Fe, New Mexico, 2004.
40. Jager P, Bertsche B. A new approach to gathering failure behavior information about mechanical components based on expert knowledge. In Reliability and Maintainability, 2004 Annual Symposium - RAMS, 2004.
41. Kadane JB. Predictive and structural methods for eliciting prior distributions. In Bayesian Analysis in Econometrics and Statistics, Zellner A (ed), North-Holland, Amsterdam, 1980; 89-93.
42. McAlister FA. Commentary: relative treatment effects are consistent across the spectrum of underlying risks... usually. International Journal of Epidemiology. 2002; 31(1): 76-77, DOI: 10.1093/ije/31.1.76.
43. Ouchi F. A literature review on the use of expert opinion in probabilistic risk analysis. In World Bank Research Working Paper 3201, 2004.
44. Cooke R. Experts in Uncertainty: Opinion and Subjective Probability in Science, Oxford University Press: Oxford, 1991.
45. Gosling J, Oakley J, O'hagan A. Nonparametric elicitation for heavy-tailed prior distributions. Bayesian Analysis. 2007; 2(693-718).
46. Leal J, Wordsworth S, Legood R, Blair E. Eliciting expert opinion for economic models: an applied example. Value in Health. 2007; 10(3): 195-203.
47. Gosling J. On the elicitation of continuous, symmetric, unimodal distributions, 2008. Available from:.
48. Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, Woolacoot N, Glanville J. Review of guidelines for good practice in decision-analytic modelling in health technology assessment. Health Technology Assessment. 2004; 8(36).
49. Caldwell DM, Ades AE, Higgins JPT. Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ. 2005; 331(7521): 897-900, DOI: 10.1136/bmj.331.7521.897.
50. Nixon RM, Bansback N, Brennan A. Using mixed treatment comparisons and meta-regression to perform indirect comparisons to estimate the efficacy of biologic treatments in rheumatoid arthritis. Statistics in Medicine. 2007; 26(6): 1237-1254.
51. White IR, Pocock SJ, Wang D. Eliciting and using expert opinions about influence of patient characteristics on treatment effects: a Bayesian analysis of the CHARM trials. Statistics in Medicine. 2005; 24(24): 3805-3821.
52. Winkler RL, Poses RM. Evaluating and combining physicians' probabilities of survival in an intensive care unit. Management Science. 1993; 39(12): 1526-1543, DOI: 10.1287/mnsc.39.12.1526.
53. Stevens JW, O'hagan A, Miller P. Case study in the Bayesian analysis of a cost-effectiveness trial in the evaluation of health care technologies: depression. Pharmaceutical Statistics. 2003; 2(1):51-68, DOI: 10.1002/Pst.043.
54. Stevens JW, O'hagan A. Incorporation of genuine prior information in cost-effectiveness analysis of clinical trial data. International Journal of Technology Assessment in Health Care. 2002; 18(4): 782-790.
55. Stevenson MD, Oakley JE, Lloyd Jones M, Brennan A, Compston JE, McCloskey EV, Selby PL. The cost-effectiveness of an RCT to establish whether 5 or 10 years of bisphosphonate treatment is the better duration for women with a prior fracture. Medical Decision Making. 2009; 29(6): 678-689, DOI: 0272989X09336077 [pii] 10.1177/0272989X09336077.
56. Bojke L, Claxton K, Bravo-Vergel Y, Sculpher M, Palmer S, Abrams K. Eliciting distributions to populate decision analytic models. Value in Health. 2010; 13(5): 557-564, DOI: 10.1111/j.1524-4733.2010.00709.x.
57. National Institute for Health and Clinical Excellence. Guide to the methods of technology appraisal, NICE: London, 2008.
58. Oakley JE, O'hagan A. Uncertainty in prior elicitations: a nonparametric approach. Biometrika. 2007; 94(2): 427-441, DOI: 10.1093/biomet/asm031.