Statistical methods for eliciting probability distributions

Journal of the American Statistical Association

Volumn 100, Issue 470, 2005, Pages 680-701

  Garthwaite, Paul H ^a   Kadane, Joseph B ^b   O'Hagan, Anthony ^c  

^a OPEN UNIVERSITY   (United Kingdom)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

Bayesian; Group decision; Heuristics and biases; Prior distribution; Subjective probability

Indexed keywords

EID: 20444457583     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214505000000105     Document Type: Article

References (142)

1. Al-Awadhi, S. A., and Garthwaite, P. H. (1998), "An Elicitation Method for Multivariate Normal Distributions," Communications in Statistics, Part A - Theory and Methods, 27, 1123-1142.
2. _ (2001), "Prior Distribution Assessment for a Multivariate Normal Distribution: An Experimental Study," Journal of Applied Statistics, 28, 5-23.
3. Alpert, M., and Raiffa, H. (1969), "A Progress Report on the Training of Probability Assessors," unpublished manuscript. Harvard University;
4. reprinted in Judgement and Uncertainty: Heuristics and Biases, eds. D. Kahneman et al., Cambridge, U.K.: Cambridge University Press, 1982, pp. 306-334.
5. Arrow, K. (1951, 1963), Social Choice and Individual Values, New York: Wiley.
6. Barclay, S., and Peterson, C. R. (1973), "Two Methods for Assessing Probability Distributions," Technical Report 73-1, Decisions and Designs, Inc.
7. Barclay, S., and Randall, L. S. (1975), "Interactive Decision Analysis Aids for Intelligence Analysis," Technical Report Dt/TR 75-4, Decisions and Designs, Inc.
8. Bar-Hillel, M. (1973), "On the Subjective Probability of Compound Events," Organizational Behavior and Human Performance, 9, 396-406.
9. Beach, L. R., and Scopp, T. S. (1968), "Intuitive Statistical Inferences About Variances," Organizational Behavior and Human Performance, 3, 109-123.
10. Beach, L. R., and Swenson, R. G. (1966), "Intuitive Estimation of Means," Psychonomic Science, 5, 161-162.
11. Bedrick, E. J., Christensen, R., and Johnson, W. (1996), "A New Perspective on Priors for Generalized Linear Models," Journal of the American Statistical Association, 91, 1450-1460.
12. Berger, J. O. (1994), "An Overview of Robust Bayesian Analysis" (with discussion). Test, 3, 5-124.
13. Berger, J. O., and O'Hagan, A. (1988), "Ranges of Posterior Probabilities for Unimodal Priors With Specified Quantiles," in Bayesian Statistics 3, eds. J. M. Bernardo et al., Oxford, U.K.: Oxford University Press, pp. 45-66.
14. Beyth-Marom, R. (1982), "How Probable Is Probable? A Numerical Translation of Verbal Probability Expressions," Journal of Forecasting, 1, 257-269.
15. Black, P., and Laskey, K. (1989), "Models for Elicitation in Bayesian ANOVA: Implementation and Application," in ASA Proceedings of the Statistical Computing Section, American Statistical Association, pp. 247-252.
16. Chaloner, K. (1996), "The Elicitation of Prior Distributions," in Case Studies in Bayesian Biostatistics, eds. D. Berry and D. Stangl, New York: Marcel Dekker, pp. 141-156.
17. Chaloner, K. M., Church, T., Matts, J. P., and Louis, T. A. (1993), "Graphical Elicitation of a Prior Distribution for an AIDS Clinical Trial," The Statistician, 42, 341-353.
18. Chaloner, K. M., and Duncan, G. T. (1983), "Assessment of a Beta Distribution: PM Elicitation," The Statistician, 32, 174-180.
19. _ (1987), "Some Properties of the Dirichlet-Multinomial Distribution and Its Use in Prior Elicitation," Communications in Statistics, Part A - Theory and Methods, 16, 511-523.
20. Chen, M.-H., Ibrahim, I. G., and Yiannoutsos, C. (1999), "Prior Elicitation, Variable Selection and Bayesian Computation for Logistic Regression Models," Journal of the Royal Statistical Society, Ser. B, 61, 223-242.
21. Chuang, D. T. (1984), "Further Theory of Stable Decisions," in Robustness of Bayesian Analyses, ed. J. B. Kadane, Amsterdam: North-Holland, pp. 165-228.
22. Clemen, R. T., Fischer, G. W., and Winkler, R. L. (2000), "Assessing Dependence: Some Experimental Results," Management Science, 46, 1100-1115.
23. Clemen, R. T., and Reilly, T. (1999), "Correlations and Copulas for Decision and Risk Analysis," Management Science, 45, 208-223.
24. Cooke, R. M. (1991), Experts in Uncertainty: Opinion and Subjective Probability in Science, Oxford, U.K.: Oxford University Press.
25. Cooke, R. M., and Goossens, L. H. J. (2000), "Procedures Guide for Structured Expert Judgment in Accident Consequence Modelling," Radiation Protection Dosimetry, 90, 303-309.
26. Dalal, S., and Hall, W. J. (1983), "Approximating Priors by Mixtures of Natural Conjugate Priors," Journal of the Royal Statistical Society, Ser. B, 45, 278-286.
27. de Finetti, B. (1962), "Does It Make Sense to Speak of 'Good Probability Appraisers'?" in The Scientist Speculates - An Anthology of Partly-Baked Ideas, ed. 1. J. Good, London: Heineman, pp. 356-364.
28. DeGroot, M. H. (1974), "Reaching a Consensus," Journal of the American Statistical Association, 69, 118-121.
29. Diaconis, P., and Ylvisaker, D. (1985), "Quantifying Prior Opinion," in Bayesian Statistics 2, eds. J. M. Bernardo et al., Amsterdam: North-Holland, pp. 133-156.
30. Dickey, J. (1980), "Beliefs About Beliefs, a Theory of Stochastic Assessments of Subjective Probabilities," in Bayesian Statistics, eds. J. Bernardo, M. H. DeGroot, D. V. Lindley, and A. F. M. Smith, Valencia, Spain: Valencia University Press, pp. 471-487.
31. Dickey, J. M., Dawid, A. P., and Kadane, J. B. (1986), "Subjective Probability Assessment Methods for Multivariate-t and Matrix-t Models," in Bayesian Inference and Decision Techniques: Essays in Honor of Bruno de Finetti, eds. P. K. Goel and A. Zellner, New York: Elsevier, pp. 177-195.
32. Edwards, W., and Phillips, L. D. (1964), "Man as Transducer for Probabilities in Bayesian Command and Control Systems," in Human Judgements and Optimality, eds. G. L. Bryan and M. W. Shelley, New York: Wiley, pp. 305-313.
33. Einhorn, H. J. (1971), "Use of Nonlinear, Noncompensatory Models as a Function of Task and Amount of Information," Organizational Behaviour and Human Performance, 6, 1-27.
34. Erlick, D. E. (1964), "Absolute Judgment of Discrete Quantities Randomly Distributed Over Time," Journal of Experimental Psychology, 67, 475-482.
35. Fischhoff, B., and Beyth, R. (1975), "I knew It Would Happen: Remembered Probabilities of Once-Future Things," Organizational Behavior and Human Performance, 13, 1-16.
36. Fischhoff, B., Slovic, P., and Lichtenstein, S. (1978), "Fault Trees: Sensitivity of Estimated Failure Probabilities to Problem Representation," Journal of Experimental Psychology: Human Perception and Performance, 4, 330-334.
37. French, S. (1985), "Group Consensus Probability Distributions: A Critical Survey," in Bayesian Statistics 2, eds. J. M. Bernardo et al., Amsterdam: North-Holland, pp. 83-210.
38. Garthwaite, P. H. (1983), "Assessment of Prior Distributions for Normal Linear Models," unpublished doctoral thesis, University College of Wales at Aberystwyth.
39. _ (1989), "Fractile Assessments for a Linear Regression Model: An Experimental Study," Organizational Behavior and Human Performance, 43, 188-206.
40. Garthwaite, P. H., and Al-Awadhi, S. A. (2001), "Non-Conjugate Prior Distribution Assessment for Multivariate Normal Sampling," Journal of the Royal Statistical Society, Ser. B, 63, 95-110.
41. _ (2003), "Quantifying Opinion About a Logistic Regression Using Interactive Graphics," unpublished manuscript. The Open University, Dept. of Statistics.
42. Garthwaite, P. H., and Dickey, J. M. (1988), "Quantifying Expert Opinion in Linear Regression Problems," Journal of the Royal Statistical Society, Ser. B, 50, 462-474.
43. _ (1991), "An Elicitation Method for Multiple Linear Regression Models," Journal of Behavioral Decision Making, 4, 17-31.
44. _ (1992), "Elicitation of Prior Distributions for Variable-Selection Problems in Regression," The Annals of Statistics, 20, 1697-1719.
45. _ (1996), "Quantifying and Using Expert Opinion for Variable-Selection Problems in Regression" (with discussion), Chemometrics and Intelligent Laboratory Systems, 35, 1-43.
46. Garthwaite, P. H., and O'Hagan, A. (2000), "Quantifying Expert Opinion in the U.K. Water Industry: An Experimental Study," The Statistician, 49, 455-477.
47. Gavasjcar, U. (1988), "A Comparison of Two Elicitation Methods for a Prior Distribution fora Binomial Parameter," Management Science, 34, 784-790.
48. Genest, C., and Schervish, M. J. (1985), "Modelling Expert Judgments for Bayesian Updating," The Annals of Statistics, 13, 1198-1212.
49. Genest, C., and Zidek, J. V. (1986), "Combining Probability Distributions: A Critique and an Annotated Bibliography" (with discussion). Statistical Science, 1, 114-148.
50. Gigerenzer, G. (1996), "On Narrow Norms and Vague Heuristics: A Reply to Kahneman and Tversky," Psychological Review, 103, 592-596.
51. Gokhale, D. V., and Press, S. J. (1982), "Assessment of a Prior Distribution for the Correlation Coefficient in a Bivariate Normal Distribution," Journal of the Royal Statistical Society, Ser. A, 145, 237-249.
52. Goldstein, M. (1999), "Bayes Linear Analysis," in Encyclopedia of Statistical Sciences (update volume 3), eds. S. Kotz et al., New York: Wiley, pp. 29-34.
53. Goodman, J. (1988), "Existence of Compromises in Simple Group Decisions," unpublished doctoral dissertation, Carnegie Mellon University, Dept. of Statistics.
54. Hammerton, M. (1975), "A Case of Radical Probability Estimation," Journal of Experimental Psychology, 101, 242-254.
55. Hampton, J. M., Moore, P. G., and Thomas, H. (1973), "Subjective Probability and Its Measurement," Journal of the Royal Statistical Society, Ser. A, 136, 21-42.
56. Hofstatter, P. R. (1939), "Uber die Schatzung von Gruppeneigenschaften," Zeitschrift fur Psychologie, 145, 1-44.
57. Hogarth, R. M. (1975), "Cognitive Processes and the Assessment of Subjective Probability Distributions," Journal of the American Statistical Association, 70, 271-294.
58. _ (1987), Judgement and Choice (2nd ed.), Chichester, U.K.: Wiley.
59. Howard, R. A., and Matheson, J. (1984), "Influence Diagrams," in Readings on the Principles and Applications of Decision Analysis, eds. R. A. Howard and J. Matheson, Palo Alto, CA: Strategic Decision Group, pp. 719-762.
60. Huber, G. P. (1974), "Methods for Quantifying Subjective Probabilities and Multi-Attribute Utilities," Decision Sciences, 5, 430-458.
61. Ibrahim, J. G., and Laud, P. W. (1994), "A Predictive Approach to the Analysis of Designed Experiments," Journal of the American Statistical Association, 89, 309-319.
62. Inhelder, B., and Piaget, J. (1958), The Growth of Logical Thinking From Childhood to Adolescence, New York: Basic Books.
63. Jenkins, H. M., and Ward, W. C. (1965), "The Judgment of Contingency Between Responses and Outcomes," Psychological Monographs, 79, 1-17.
64. Johnson, E. J., Hershey, J., Meszaros, J., and Kunreuther, H. (1993), "Framing, Probability Distortions, and Insurance Decisions," Journal of Risk and Uncertainty, 7, 35-51.
65. Kadane, J. B. (1980), "Predictive and Structural Methods for Eliciting Prior Distributions," in Bayesian Analysis in Econometrics and Statistics: Essays in Honor of Harold Jeffreys, ed. A. Zellner, Amsterdam: North-Holland, pp. 89-93.
66. _ (ed.) (1996), Bayesian Methods and Ethics in a Clinical Trial Design, New York: Wiley.
67. Kadane, J. B., Chan, N. H., and Wolfson, L. J. (1996), "Priors for Unit Root Models," Journal of Econometrics, 75, 99-111.
68. Kadane, J. B., and Chuang, D. T. (1978), "Stable Decision Problems," The Annals of Statistics, 6, 1095-1110.
69. Kadane, J. B., Dickey, J., Winkler, R., Smith, W., and Peters, S. (1980), "Interactive Elicitation of Opinion for a Normal Linear Model," Journal of the American Statistical Association, 75, 845-854.
70. Kadane, J. B., and Schum, D. A. (1996), A Probabilistic Analysis of the Sacco and Vanzetti Evidence, New York: Wiley.
71. Kadane, J. B., and Winkler, R. L. (1988), "Separating Probability Elicitation From Utilities," Journal of the American Statistical Association, 83, 357-363.
72. Kadane, J. B., and Wolfson, L. I. (1998), "Experiences in Elicitation" (with discussion), The Statistician, 47, 1-20.
73. Kahneman, D., and Tversky, A. (1973), "On the Psychology of Prediction," Psychological Review, 80, 237-251.
74. Keren, G. (1991), "Calibration and Probability Judgments: Conceptual and Methodological Issues," Acta Psychologica, 77, 217-273.
75. Koehler, J. J. (1996), "The Base Rate Fallacy Reconsidered: Normative, Descriptive and Methodological Challenges," Behavioral and Brain Sciences, 19, 1-17.
76. Koriat, A., Lichtenstein, S., and Fischhoff, B. (1980), "Reasons for Confidence," Journal of Experimental Psychology: Human Learning and Memory, 6, 107-118.
77. Kunda, Z., and Nisbett, R. E. (1986), "The Psychometrics of Everyday Life," Cognitive Psychology, 18, 195-224.
78. Lathrop, R. G. (1967), "Perceived Variability," Journal of Experimental Psychology, 73, 498-502.
79. Laud, P. W., and Ibrahim, J. G. (1995), "Predictive Model Selection," Journal of the Royal Statistical Society, Ser. B, 57, 247-262.
80. Lehrer, K. (1976), "When Rational Disagreement Is Impossible," Nous, 10, 327-332.
81. Lichtenstein, S., and Fischhoff, B. (1980), "Training for Calibration," Organizational Behavior and Human Performance, 26, 149-171.
82. Lichtenstein, S., Fischhoff, B., and Phillips, L. D. (1982), "Calibration of Probabilities: The State of the Art to 1980," in Judgement and Uncertainty: Heuristics and Biases, eds. D. Kahneman et al., Cambridge, U.K.: Cambridge University Press, pp. 306-334.
83. Lichtenstein, S., and Newman, J. R. (1967), "Empirical Scaling of Common Verbal Phrases Associated With Numerical Probabilities," Psychonomic Science, 9, 563-564.
84. Lindley, D. V. (1985), "Reconciliation of Discrete Probability Distributions," in Bayesian Statistics 2, eds. J. M. Bernardo et al., Amsterdam: North-Holland, pp. 375-390.
85. Lindley, D. V., Tversky, A., and Brown, R. V. (1979), "On the Reconciliation of Probability Assessments" (with discussion). Journal of the Royal Statistical Society, Ser A, 142, 146-180.
86. Madansky, A. (1978), "Externally Bayesian Groups," unpublished manuscript, University of Chicago.
87. Matheson, J. E., and Winkler, R. L. (1976), "Scoring Rules for Continuous Probability Distributions," Management Science, 22, 1087-1096.
88. McConway, K. J. (1981), "Marginalization and Linear Opinion Pools," Journal of the American Statistical Association, 76, 410-414.
89. Meyer, M. A., and Booker, J. M. (2001), Eliciting and Analyzing Expert Judgment: A Practical Guide, Philadelphia: ASA/Society of Industrial and Applied Mathematics.
90. Morgan, M. G., and Henrion, M. (1990), Uncertainty: A Guide to Dealing With Uncertainty in Quantitative Risk and Policy Analysis, Cambridge, U.K.: Cambridge University Press.
91. Morris, P. A. (1974), "Decision Analysis Expert Use," Management Science, 20, 1233-1241.
92. Mosteller, F., and Yountz, C. (1990), "Quantifying Probabilistic Expressions" (with discussion), Statistical Science, 5, 2-34.
93. Murphy, A. H., and Winkler, R. L. (1974), "Credible Interval Temperature Forecasting: Some Experimental Results," Monthly Weather Review, 102, 784-794.
94. Nash, H. (1964), "The Judgment of Linear Proportions," American Journal of Psychology, 77, 480-484.
95. Nisbett, R. E., Borgida, E., Crandall, R., and Reed, H. (1976), "Popular Induction: Information Is Not Necessarily Informative," in Cognition and Social Behaviour, Hillsdale, MD: Lawrence Erlbaum, pp. 113-133.
96. Oakley, J. E., and O'Hagan, A. (2002), "Uncertainty in Prior Elicitations: A Nonparametric Approach," Research Report No. 521/02, University of Sheffield, Dept of Probability and Statistics.
97. Oberkampf, W. L., Helton, J. C., Joslyn, C. A., Wojtkiewicz, S. F., and Ferson, S. (2004), "Challenge Problems: Uncertainty in System Response Given Uncertain Parameters," Reliability Engineering and System Safety, 85, 11-19.
98. O'Hagan, A. (1988), Probability: Methods and Measurement, London: Chapman & Hall.
99. _ (1998), "Eliciting Expert Beliefs in Substantial Practical Applications" (with discussion). The Statistician, 47, 21-35.
100. O'Hagan, A., and Forster, J. J. (2004), Kendall's Advanced Theory of Statistics, Vol. 2B, Bayesian Inference (2nd ed.), London: Edward Arnold.
101. O'Hagan, A., and Oakley, J. E. (2004), "Probability Is Perfect, but We Can't Elicit It Perfectly," Reliability Engineering and System Safety, 85, 239-248.
102. Oman, S. D. (1985), "Specifying a Prior Distribution in Structured Regression Problems," Journal of the American Statistical Association, 80, 190-195.
103. Peterson, C. R., and Beach, L. R. (1967), "Man as an Intuitive Statistician," Psychological Bulletin, 68, 29-46.
104. Peterson, C. R., and Miller, A. (1964), "Mode, Median and Mean as Optimal Strategies," Journal of Experimental Psychology, 68, 363-367.
105. Peterson, C. R., Snapper, K. J., and Murphy, A. H. (1972), "Credible Interval Temperature Forecasts," Bulletin of the American Meteorological Society, 53, 966-970.
106. Phillips, L. D. (1999), "Group Elicitation of Probability Distributions: Are Many Heads Better Than One?" in Decision Science and Technology: Reflections on the Contributions of Ward Edwards, eds. J. Shanteau et al., Norwell, MA: Kluwer Academic, pp. 313-330.
107. Pill, J. (1971), "The Delphi Method: Substance, Context, a Critique, and an Annotated Bibliography," Socio-Economic Planning and Sciences, 5, 57-71.
108. Pitz, G. F. (1965), "Response Variables in the Estimation of Relative Frequency," Perceptual and Motor Skills, 21, 867-873.
109. _ (1966), "The Sequential Judgment of Proportion," Psychonomic Seience, 4, 397-398.
110. Raiffa, H. (1968), Decision Analysis: Introductory Lectures on Choice Under Uncertainty, Reading, MA: Addison-Wesley.
111. Schaefer, R. E., and Borcherding, K. (1973), "The Assessment of Subjective Probability Distributions: A Training Experiment," Acta Psychologies, 37, 117-129.
112. Seaver, D. A., von Winterfeldt, D., and Edwards, W. (1978), "Eliciting Subjective Probability Distributions on Continuous Variables," Organizational Behavior and Human Performance, 21, 379-391.
113. Seidenfeld, T., Schervish, M. J., and Kadane, J. B. (1989), "On the Shared Preferences of Two Decision Makers," Journal of Philosophy, 86, 225-244.
114. Shuford, E. H. (1961), "Percentage Estimation of Proportion as a Function of Element Type, Exposure Type, and Task," Journal of Experimental Psychology 61, 430-436.
115. Simpson, W., and Voss, J. F. (1961), "Psychophysical Judgments of Probabilistic Stimulus Sequences," Journal of Experimental Psychology, 62, 416-422.
116. Singpurwalla, N. D., and Song, M. S. (1987), "The Analysis of Weibull Life-time Data Incorporating Expert Opinion," in Probability and Bayesian Statistics, ed. R. Viertl, New York: Plenum, pp. 431-442.
117. Slovic, P. (1972), "From Shakespeare to Simon: Speculations - and Some Evidence - About Man's Ability to Process Information," Oregon Research Institute Monograph, Vol. 12, No. 2.
118. Slovic, P., and Fischhoff, B. (1977), "On the Psychology of Experimental Surprises," Organizational Behavior and Human Performance, 3, 544-551.
119. Slovic, P., and Lichtenstein, S. C. (1968), "The Relative Importance of Probabilities and Payoffs in Risk Taking," Journal of Experimental Psychology Monograph Supplement, 78, No. 3, Part 2.
120. _ (1971), "Comparison of Bayesian and Regression Approaches to the Study of Information Processing in Judgement," Organizational Behavior and Human Performance, 6, 649-744.
121. Smedslund, J. (1963), "The Concept of Correlation in Adults," Scandinavian Journal of Psychology, 4, 165-173.
122. Spencer, J. (1961), "Estimating Averages," Ergonomics, 4, 317-328.
123. _ (1963), "A Further Study of Estimating Averages," Ergonomics, 6, 255-265.
124. Spetzler, C. S., and Stael von Holstein, C.-A. S. (1975), "Probability Encoding in Decision Analysis," Management Science, 22, 340-358.
125. Stael von Holstein, C.-A. S. (1971), "An Experiment in Probabilistic Weather Forecasting," Journal of Applied Meteorology, 10, 635-645.
126. Stevens, S. S., and Galanter, E. H. (1957), "Ratio Scales and Category Scales for a Dozen Perceptual Continua," Journal of Experimental Psychology, 54, 377-411.
127. Tversky, A. (1974), "Assessing Uncertainty," Journal of the Royal Statistical Society, Ser. B, 36, 148-159.
128. Tversky, A., and Kahneman, D. (1971), "The Belief in the Law of Small Numbers," Psychological Bulletin, 76, 105-110.
129. _ (1973), "Availability: A Heuristic for Judging Frequency and Probability," Cognitive Psychology, 5, 207-232.
130. _ (1974), "Judgment Under Uncertainty: Heuristics and Biases," Science, 185, 1124-1131.
131. Tversky, A., and Koehler, D. J. (1994), "Support Theory: A Nonextensional Representation of Subjective Probability," Psychological Review, 10, 547-567.
132. Wallsten, T. S., and Budescu, D. V. (1983), "Encoding Subjective Probabilities: A Psychological and Psychometric Review," Management Science, 29, 151-173.
133. Wallsten, T. S., Budescu, D. V., Rapoport, A., Zwick, R., and Forsyth, B. (1986), "Measuring Vague Meanings of Probability Terms," Journal of Experimental Psychology: General, 115, 348-365.
134. Ward, W. C., and Jenkins, H. M. (1965), "The Display of Information and the Judgment of Contingency," Canadian Journal of Psychology, 19, 231-241.
135. Wiggins, N., and Hoffman, P. J. (1968), "Three Models of Clinical Judgement," Journal of Abnormal Psychology, 73, 70-77.
136. Windschitl, P. D., and Wells, G. L. (1996), "Measuring Psychological Uncertainty: Verbal versus Numeric Methods," Journal of Experimental Psychology: Applied, 2, 343-364.
137. Winkler, R. L. (1967), "The Assessment of Prior Distributions in Bayesian Analysis," Journal of the American Statistical Association, 62, 776-800.
138. _ (1972), Introduction to Bayesian Inference and Decision, New York: Holt, Rinehart & Winston.
139. _ (1980), "Prior Information, Predictive Distributions, and Bayesian Model Building," in Bayesian Analysis in Econometrics and Statistics: Essays in Honor of Harold Jeffreys, ed. A. Zellner, Amsterdam: North-Holland, pp. 95-109.
140. Wolfson, L. J. (1995), "Elicitation of Priors and Utilities for Bayesian Analysis," unpublished doctoral thesis, Carnegie Mellon University, Dept. of Statistics.
141. Youssef, Z. I., and Peterson, C. R. (1973), "Intuitive Cascaded Inferences," Organizational Behavior and Human Performance, 10, 349-358.
142. Zellner, A. (1972), "On Assessing Informative Prior Distributions for Regression Coefficients," unpublished manuscript.