Methods to elicit beliefs for Bayesian priors: a systematic review

Journal of Clinical Epidemiology

Volumn 63, Issue 4, 2010, Pages 355-369

  Johnson, Sindhu R ^a,b   Tomlinson, George A ^b,c   Hawker, Gillian A ^b,d   Granton, John T ^a   Feldman, Brian M ^b,e  

^a UNIVERSITY HEALTH NETWORK   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

^c UNIVERSITY HEALTH NETWORK   (Canada)

^d WOMEN S COLLEGE HOSPITAL   (Canada)

^e HOSPITAL FOR SICK CHILDREN   (Canada)

Author keywords

Bayesian; Belief elicitation; Bias; Priors; Reliability; Validity

Indexed keywords

ARTICLE; BAYES THEOREM; CLINICAL ASSESSMENT TOOL; CLINICAL EVALUATION; CONCEPTUAL FRAMEWORK; CROSS-SECTIONAL STUDY; DATA BASE; FEASIBILITY STUDY; FEEDBACK SYSTEM; HUMAN; METHODOLOGY; NONRESPONSE BIAS; PRIORITY JOURNAL; QUESTIONNAIRE; REFERENCE VALUE; RELIABILITY; RESPONSE VARIABLE; STATISTICAL ANALYSIS; SYSTEMATIC REVIEW; VALIDATION PROCESS; VALIDITY;

BAYES THEOREM; BIAS (EPIDEMIOLOGY); CLINICAL TRIALS AS TOPIC; DECISION MAKING; HUMANS; PROBABILITY; REPRODUCIBILITY OF RESULTS; RESEARCH PERSONNEL; TREATMENT OUTCOME;

EID: 77249165496     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2009.06.003     Document Type: Article

References (70)

1. Berry D.A. Bayesian clinical trials. Nat Rev Drug Discov 5 (2006) 27-36
2. Spiegelhalter D.J., Abrams K.R., and Myles J.P. An overview of the Bayesian approach (2004), John Wiley & Sons Ltd, Chichester Bayesian approaches to clinical trials and health-care evaluation 49-120
3. Chaloner K., and Rhame F.S. Quantifying and documenting prior beliefs in clinical trials. Stat Med 4 (2001) 581-600
4. Carlin B.P., Chaloner K., Church T., Louis T.A., and Matts J.P. Bayesian approaches for monitoring clinical trials with an application to toxoplasmic encephalitis prophylaxis. Statistician 42 (1993) 355-367
5. White I.R., Pocock S.J., and Wang D. Eliciting and using expert opinions about influence of patient characteristics on treatment effects: a Bayesian analysis of the CHARM trials. Stat Med 24 (2005) 3805-3821
6. Moye L.A. Bayesians in clinical trials: asleep at the switch. Stat Med 27 (2008) 469-482
7. Spiegelhalter D.J. Incorporating Bayesian ideas into health-care evaluation. Stat Sci 19 (2004) 156-174
8. Singh J.A., Solomon D.H., Dougados M., Felson D., Hawker G., Katz P., et al. Development of classification and response criteria for rheumatic diseases. Arthritis Rheum 55 (2006) 348-352
9. Johnson S.R., Hawker G.A., and Davis A.M. The health assessment questionnaire disability index and scleroderma health assessment questionnaire in scleroderma trials: an evaluation of their measurement properties. Arthritis Rheum 53 (2005) 256-262
10. Streiner D.L., and Norman G.R. Health measurement scales. 3rd edition (2003), Oxford University Press, NewYork A practical guide to their development and use
11. Liang M.H. Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments. Med Care 38 9 Suppl (2000) II84-II90
12. Feinstein A.R. The theory and evaluation of sensibility. In: Feinstein A.R. (Ed). Clinimetrics (1987), Yale University Press, New Haven 141-165
13. Errington R.D., Ashby D., Gore S.M., Abrams K.R., Myint S., Bonnett D.E., et al. High energy neutron treatment for pelvic cancers: study stopped because of increased mortality. BMJ 302 (1991) 1045-1051
14. Bergus G.R., Chapman G.B., Gjerde C., and Elstein A.S. Clinical reasoning about new symptoms despite preexisting disease: sources of error and order effects. Fam Med 27 (1995) 314-320
15. Chaloner K., Church T., Louis T.A., and Matts J.P. Graphical elicitation of a prior distribution for a clinical trial. Statistician 42 (1993) 341-353
16. Freedman L.S., and Spiegelhalter D.J. The assessment of subjective opinion and its use in relation to stopping rules for clinical trials. Statistician 32 (1983) 153-160
17. Chaloner K. Elicitation of prior distributions. In: Berry D.A., and Stangl D.K. (Eds). Bayesian biostatistics (1996), Marcel Dekker Inc, New York 141-156
18. de Vet H.C., Kessels A.G., Leffers P., and Knipschild P.G. A randomized trial about the perceived informativeness of new empirical evidence. Does beta-carotene prevent (cervical) cancer?. J Clin Epidemiol 46 (1993) 509-517
19. Evans J.S., Handley S.J., Over D.E., and Perham N. Background beliefs in Bayesian inference. Mem Cogn 2 (2002) 179-190
20. Spiegelhalter D.J., Freedman L.S., and Parmar M.K. Applying Bayesian ideas in drug development and clinical trials. Stat Med 12 (1993) 1501-1511
21. Flournoy N. A clinical experiment in bone marrow transplantation: estimating a percentage point of a quantal response curve. In: Gatsonis C., Hodges J.S., Kass R.E., and Singpurwalla N.D. (Eds). Lecture notes in statistics (1994), Sringer-Verlag, New York 324-335
22. Garthwaite P.H., and Dickey J.M. An elicitation method for multiple linear regression models. J Behav Decis Making 4 (1991) 17-31
23. Garthwaite P.H., and Dickey J.M. Elicitation of prior distributions for variable selection problems in regression. Ann Stat 20 (1992) 1697-1719
24. Gustafson D.H., Sainfort F., Eichler M., Adams L., Bisognano M., and Steudel H. Developing and testing a model to predict outcomes of organizational change. Health Serv Res 38 (2003) 751-776
25. Hughes M.D. Practical reporting of Bayesian analyses of clinical trials. Drug Inf J 3 (1991) 381-393
26. Spiegelhalter D.J., and Freedman L.S. A predictive approach to selecting the size of a clinical trial, based on subjective clinical opinion. Stat Med 5 1 (1986) 1-13
27. Hutton J.L., and Owens R.G. Bayesian sample size calculation and prior beliefs about child sexual abuse. Statistician 42 (1993) 399-404
28. Johnson N.P., Fisher R.A., Braunholtz D.A., Gillett W.R., and Lilford R.J. Survey of Australasian clinicians' prior beliefs concerning lipiodol flushing as a treatment for infertility: a Bayesian study. Aust NZ J Obstet Gyn 4 (2006) 298-304
29. Jones P., Johanson R., Baldwin K.J., Lilford R., and Jones P. Changing belief in obstetrics: impact of two multicentre randomised controlled trials. Lancet 352 (1998) 1988-1989
30. Kadane J.B. Progress toward a more ethical method for clinical trials. J Med Philos 11 (1986) 385-404
31. Kadane J.B. An application of robust Bayesian analysis to a medical experiment. J Stat Plan Infer 40 (1994) 221-232
32. Kadane J.B., and Wolfson L.J. Experiences in elicitation. Statistician 47 (1998) 3-19
33. Lehmann H.P., and Goodman S.N. Bayesian communication: a clinically significant paradigm for electronic publication. J Am Med Technol 3 (2000) 254-266
34. Li Y., and Krantz D.H. Experimental tests of subjective Bayesian methods. Psychol Rec 55 (2005) 251-277
35. Lilford R. Formal measurement of clinical uncertainty: prelude to a trial in perinatal medicine. The Fetal Compromise Group. BMJ 308 (1994) 111-112
36. Lilford R.J., and Braunholtz D. The statistical basis of public policy: a paradigm shift is overdue. BMJ 7057 (1996) 603-607
37. O'Hagan A. Eliciting expert beliefs in substantial practical application. Statistician 47 (1998) 21-35
38. Parmar M.K., Spiegelhalter D.J., and Freedman L.S. The CHART trials: Bayesian design and monitoring in practice. CHART Steering Committee. Stat Med 13 (1994) 1297-1312
39. Parmar M.K., Griffiths G.O., Spiegelhalter D.J., Souhami R.L., Altman D.G., and van der S.E. Monitoring of large randomised clinical trials: a new approach with Bayesian methods. Lancet 358 (2001) 375-381
40. Ramachandran G. Retrospective exposure assessment using Bayesian methods. Ann Occup Hyg 45 (2001) 651-667
41. Tan S.-B., Chung Y.-F., Tai B.-C., Cheung Y.-B., and Machin D. Elicitation of prior distributions for a phase III randomized controlled trial of adjuvant therapy with surgery for hepatocellular carcinoma. Control Clin Trials 2 (2003) 110-121
42. Van Der Wilt G.J., Rovers M., Straatman H., Van Der B.S., Van Den B.P., and Zielhuis G. Policy relevance of Bayesian statistics overestimated?. Int J Technol Assess 4 (2004) 488-492
43. Rovers M.M., Van Der Wilt G.J., Van Der B.S., Straatman H., Ingels K., and Zielhuis G.A. Bayes' theorem: a negative example of a RCT on grommets in children with glue ear. Eur J Epidemiol 1 (2005) 23-28
44. Winkler R.L. The assessment of prior distributions in Bayesian analysis. J Am Stat Assoc 62 (1967) 776-800
45. Van der Fels-Klerx I.H., Goossens L.H., Saatkamp H.W., and Horst S.H. Elicitation of quantitative data from a heterogeneous expert panel: formal process and application in animal health. Risk Anal 22 (2002) 67-81
46. Carter B.L., Butler C.D., Rogers J.C., and Holloway R.L. Evaluation of physician decision making with the use of prior probabilities and a decision-analysis model. Arch Fam Med 2 (1993) 529-534
47. Normand S.L., Frank R.G., and McGuire T.G. Using elicitation techniques to estimate the value of ambulatory treatments for major depression. Med Decis Making 22 (2002) 245-261
48. Parmar M.K.B., Ungerleider R.S., and Simon R. Assessing whether to perform a confirmatory randomized clinical trial. J Natl Cancer I 22 (1996) 1645-1651
49. Winkler R.L. Probabilistic prediction: some experimental results. J Am Stat Assoc 66 (1971) 675-685
50. Clemen R.T., and Wolmark N. Combining probability distributions from experts in risk analysis. Risk Anal 19 (1999) 187-203
51. Murphy A.H., and Winkler R.L. Reliability of subjective probability forecasts of precipitation and temperature. Appl Statist 26 (1977) 41-47
52. Wallsten T.S., and Budescu D.V. Encoding subjective probabilities: a psychological and psychometric review. Manage Sci 29 (1983) 151-173
53. Spiegelhalter D.J., Freedman L.S., and Parmar M.K. Bayesian approaches to randomized trials. J R Statist Soc A 157 (1994) 357-416
54. Hogarth R.M. Cognitive processes and the assessment of subjective probability distributions. J Am Stat Assoc 70 (1975) 271-294
55. Evans J.S., Brooks P., and Pollard P. Prior beliefs and statistical inference. Br J Psychiatry 76 (1985) 469-477
56. Winkler R.L. The quantification of judgement: some methodological suggestions. J Am Stat Assoc 62 (1967) 1105-1120
57. Savage L.J. Elicitation of personal probabilities and expectations. J Am Stat Assoc 66 (1971) 783-801
58. Dumouchel W. A Bayesian model and a graphical elicitation procedure for multiple comparisons. Bayesian Stat 3 (1988) 127-145
59. Genest C., and Zidek J.V. Combining probability distributions: a critique and an annotated bibliography. Stat Sci 1 (1986) 114-148
60. Hawker G.A., and Gignac M.A. How meaningful is our evaluation of meaningful change in osteoarthritis?. J Rheumatol 33 (2006) 639-641
61. O'Hagan A., Buck C.E., Daneshkhah A., Eiser J.R., Garthwaite P.H., Jenkinson D.J., et al. Fundamentals of probability and judgement (2006), John Wiley & Sons Ltd, Chichester Uncertain judgements. Eliciting experts' probabilites 1-24
62. Trochim W.M. The research methods knowledge base. 2nd edition. (2006), Atomic Dog Publishing, Cincinnati, Ohio
63. Morgan M.G., and Henrion M. Human judgement about and with uncertainty (1990), Cambridge University Press, Cambridge Uncertainty. A guide to dealing with uncertainty in quantitative risk and policy analysis 102-140
64. McClish D.K., and Powell S.H. How well can physicians estimate mortality in a medical intensive care unit?. Med Decis Making 9 (1989) 125-132
65. O'Hagan A., Buck C.E., Daneshkhah A., Eiser J.R., Garthwaite P.H., Jenkinson D.J., et al. The psychology of judgement under uncertainty (2006), John Wiley & Sons Ltd, Chichester Uncertain judgements. Eliciting experts' probabilites 33-60
66. Hiance A., Chevret S., and Levy V. A practical approach for eliciting expert prior beliefs about cancer survival in phase III randomized trial. J Clin Epidemiol 62 (2009) 431-437
67. Abrams K., Ashby D., and Errington D. Simple Bayesian analysis in clinical trials: a tutorial. Control Clin Trials 5 (1994) 349-359
68. Kadane J.B., Dickey J.M., Winkler R.L., Smith W.S., and Peters S.C. Interactive elicitation of opinion for a normal linear model. J Am Stat Assoc 75 (1980) 845-854
69. Kadane J.B. Subjective Bayesian analysis for surveys with missing data. Statistician 42 (1992) 415-426
70. Ten Centre Study Group. Ten centre trial of artificial surfactant (artificial lung expanding compound) in very premature babies. Br Med J (Clin Res Ed) 294 (1987) 991-996