Combining probability distributions: A critique and an annotated bibliography

Statistical Science

Volumn 1, Issue 1, 1986, Pages 114-148

  Genest, Christian ^a   Zidek, James V ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Bayesian inference; Consensus; Expert opinions; Group decisions; Pooling; Reconciliation

Indexed keywords

EID: 84972539429     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/ss/1177013825     Document Type: Article

References (129)

1. Beach, B. H. (1975). Expert judgment about uncertainty: Bayesian decision making in realistic settings. Org. Behav. Hum. Perform. 14 10-59.
2. Benson, P. G. and Nichols, M. L. (1982). An investigation of motivational bias in subjective predictive probability distributions. Decision Sci. 13 225-239.
3. Bernardo, J. M. (1979). Expected information as expected utility. Ann. Statist. 7 686-690.
4. Chaloner, K. M. and Duncan, G. T. (1983). Assessment of a beta prior distribution: PM elicitation. Statistician 32 174-180.
5. Dawid, A. P. (1982a). Intersubjective statistical models. In Exchangeability in Probability and Statistics (Koch, G. and Spizzichino, F., eds). North Holland, Amsterdam.
6. Dawid, A. P. (1982b). The well-calibrated Bayesian (with discussion). J. Amer. Statist. Assoc. 77 605-613.
7. de Finetti, B. (1970). Teoria delle probabilità. Giulio Einaudi editore, Turino. English language edition: Theory of Probability, vol. 1 (1974), vol. 2 (1975). John Wiley, New York.
8. Fine, T. L. (1973). Theories of Probability. Academic Press, New York.
9. Fishburn, P. C. (1983). Ellsberg revisited: a new look at comparative probability. Ann. Statist. 11 1047-1059.
10. French, S. (1982). On the axiomatisation of subjective probabili-ties. Theory and Decision 14 19-33.
11. Gokhale, D. V. and Press, S. J. (1982). Assessment of a prior distribution for the correlation coefficient in a bivariate normal distribution. J. R. Statist. Soc. Ser. A 145 237-249.
12. Hardy, G. H., Littlewood, J. E. and Polya, G. (1934). Inequalities. Cambridge University Press, Cambridge.
13. Kadane, J. B., Dickey, J. M., Winkler, R. L., Smith, W. S. and Peters, S. C. (1980). Interactive elicitation of opinion for a normal linear model. J. Amer. Statist. Assoc. 75 845-854.
14. Keeney, R. L. and Raiffa, H. (1976). Decisions with Multiple Objectives: Preferences and Value Tradeoffs. John Wiley, New York.
15. Kraft, C. H., Pratt, J. W. and Seidenberg, A. (1959). Intuitive probability on finite sets. Ann. Math. Statist. 30 408-419.
16. Lehrer, K. (1975). Social consensus and rational agnoiology. Synthese 31 141-160.
17. Lindley, D. V. (1982). Scoring rules and the inevitability of probability (with discussion). Int. Statist. Rev. 50 1-26.
18. Nash, J. F., Jr. (1950). The bargaining problem. Econometrica 18 155-162.
19. Pill, J. (1971). The Delphi method: substance, context, a critique and an annotated bibliography. Socio-Econ. Plan. Sci. 5 57-71.
20. Press, S. J. (1978). Qualitative controlled feedback for forming group judgment and making decisions. J. Amer. Statist. Assoc. 73 526-535.
21. Press, S. J. (1980). Bayesian inference in group judgment formulation and decision making using qualitative controlled feedback. Proceedings of the First Valencia International Meeting on Bayesian Statistics, 397-414.
22. Roberts, H. V. (1965). Probabilistic prediction. J. Amer. Statist. Assoc. 60 50-62.
23. Savage, L. J. (1954). The Foundations of Statistics. John Wiley, New York.
24. Seidenfeld, T. (1979). Why I am not an objective Bayesian: some reflections prompted by Rosenkrantz. Theory and Decision 11 413-440.
25. Shafer, G. R. (1976). A Mathematical Theory of Evidence. Princeton University Press, Princeton, NJ.
26. Shafer, G. R. (1983). A subjective interpretation of conditional probability. J. Phil. Logic 12 453-466.
27. Slovic, P., Fischoff, B. and Lichtenstein, S. (1977). Behavioral decision theory. Annu. Rev. Psychol. 28 1-39.
28. Smith, C. A. B. (1961). Consistency in statistical inference and decision. J. R. Statist. Soc. Ser. B 23 1-37.
29. Stone, M. (1976). Strong inconsistency from uniform priors. J. Amer. Statist. Assoc. 71 114-125.
30. Tversky, A. and Kahneman, D. (1974). Judgment under uncertainty: heuristics and biases. Science 185 1124-1131.
31. Vincent, S. B. (1912). The function of the viborissae in the behavior of the white rat. Behav. Monogr. 1 No 5.
32. Walley, P. (1981). Coherent Lower (and Upper) Probabilities. Statistics Research Report, University of Warwick.
33. Walley, P. and Fine, T. L. (1982). Towards a frequentist theory of upper and lower probability. Ann. Statist. 10 741-761.
34. Weerahandi, S. and Zidek, J. V. (1983). Elements of multi-Bayesian decision theory. Ann. Statist. 11 1032-1046.
35. Winkler, R. L. (1967). The assessment of prior distributions in Bayesian analysis. J. Amer. Statist. Assoc. 62 776-800.
36. Winkler, R. L. (1971). Probabilistic prediction: some experimental results. J. Amer. Statist. Assoc. 66 675-685.
37. Winkler, R. L. (1982). Research directions in decision making under uncertainty (with discussion). Decision Sci. 13 517-553.
38. Aczél J. (1984). On weighted synthesis of judgements. Aequat. Math. 27 288-307.
39. Aczél, J. and Alsina, C. (1984). Characterizations of some classes of quasilinear functions with applications to triangular norms and to synthesizing judgements. Methods Oper. Res. 48 3-22.
40. Aczél, J., Kannappan, P. L., Ng, C. T. and Wagner, C. G. (1981). Functional equations and inequalities in rational group decision making. General Inequalities 3: Proceedings of the Third International Conference on General Inequalities, Oberwolfach.
41. Aczel, J., Ng, C. T. and Wagner, C. G. (1984). Aggregation theorems for allocation problems. SIAM J. Alg. Disc. Meth. 5 1-8.
42. Aczél, J. and Saaty, T. L. (1983). Procedures for synthesizing ratio judgements. J. Math. Psych. 27 93-102.
43. Aczél, J. and Wagner, C. G. (1980). A characterization of weighted arithmetic means. SIAM J. Alg. Disc. Meth. 1 259-260.
44. Aczél, J. and Wagner, C. G. (1981). Rational group decision making generalized: the case of several unknown functions. C. R. Math. Rep. Acad. Sci. Can. 3 139-142.
45. Agnew, C. E. (1985). Multiple probability assessments by dependent experts. J. Amer. Statist. Assoc. 80 343-347.
46. Aumann, R. J. (1976). Agreeing to disagree. Ann. Statist. 4 1236-1239.
47. Bacharach, M. (1972)*. Scientific Disagreement. Unpublished manuscript, Christ Church, Oxford.
48. Bacharach, M. (1975). Group decisions in the face of differences of opinion. Manag. Sci. 22 182-191.
49. Bacharach, M. (1979). Normal Bayesian dialogues. J. Amer. Statist Assoc. 74 837-846.
50. Baird, D. (1985). Lehrer-Wagner consensual probabilities do not adequately summarize the available information. Synthese 62 47-62.
51. Berger, R. L. (1981). A necessary and sufficient condition for reaching a consensus using DeGroot’s method. J. Amer. Statist. Assoc. 76 415-418.
52. Bordley, R. F. (1982). A multiplicative formula for aggregating probability assessments. Manag. Sci. 28 1137-1148.
53. Bordley, R. F. (1983a). A Bayesian model of group polarization. Org. Behav. Hum. Perform. 32 262-274.
54. Bordley, R. F. (1983b)*. Bayesian Group Decision Theory. Conference on Information Pooling and Group Decision Making, Irvine, CA, March 1983.
55. Bordley, R. F. and Wolff, R. W. (1981). On the aggregation of individual probability estimates. Manag. Sci. 27 959-964.
56. Chatterjee, S. (1975). Reaching a consensus; some limit theorems. Proc. Int. Statist Inst 159-164.
57. Chatterjee, S. and Seneta E. (1977). Towards consensus: some convergence theorems on repeated averaging. J. Appl. Prob. 14 89-97.
58. Clemen, R. T. (1984). Modeling Dependent Information: a Bayesian Approach. Ph.D. dissertation, Indiana University.
59. Clemen, R. T. (1986). Calibration and the aggregation of probabilities. Manag. Sci. 32 in press.
60. Clemen, R. T. and Winkler, R. L. (1985). Limits for the precision and value of information from dependent sources. Oper. Res. 33 427-442.
61. Cohen, J. E., Hajnal, J. and Newman C. M. (1983). Approaching consensus can be delicate when positions harden. Unpublished manuscript.
62. Dalkey, N. C. (1972). An impossibility theorem for group probability functions. P-4862, The Rand Corporation, Santa Monica, CA.
63. Dalkey, N. C. (1975). Toward a theory of group estimation. In The Delphi Method: Techniques and Applications. (Linstone, H. A. and Turoff, M., eds). Addison-Wesley, Reading, MA.
64. Dalkey, N. C. (1977). Group decision theory. Technical Report No 7749, School of Engineering and Applied Science, University of California, Los Angeles, CA.
65. de Finetti, B. (1954). Media di decisioni e media di opinioni. Bull. Inst. Int. Statist. 34 144-157.
66. DeGroot, M. H. (1974). Reaching a consensus. J. Amer. Statist. Assoc. 69 118-121.
67. Dickey, J. M. and Freeman, P. (1975). Population-distributed personal probabilities. J. Amer. Statist. Assoc. 70 362-364.
68. Eisenberg, E. and Gale, D. (1959). Consensus of subjective probabilities: the pari-mutuel method. Ann. Math. Statist. 30 165-168.
69. Fischer, G. W. (1981). When oracles fail-A comparison of four procedures for aggregating subjective probability forecasts. Org. Behav. Hum. Perform. 28 96-110.
70. Forrest, P. (1985). The Lehrer/Wagner theory of consensus and the zero weight problem. Synthese 62 75-78.
71. Freeling, A. N. S. (1981). Reconciliation of multiple probability assessments. Org. Behav. Hum. Perform. 28 395-414.
72. French, S. (1980). Updating of belief in the light of someone else’s opinion. J. R. Statist. Soc. Ser. A 143 43-48.
73. French, S. (1981)*. Consensus of opinion. Eur. J. Oper. Res. 7 332-340.
74. French, S. (1985)*. Group consensus probability distributions: a critical survey. In Bayesian Statistics 2 (Bernardo, J. M., et al., eds). North Holland, Amsterdam, 183-201.
75. Geanakoplos, J. D. and Polemarchakis, H. M. (1982). We can’t disagree forever. J. Econ. Theory 28 192-200.
76. Genest, C. (1983). Towards a consensus of opinion. Ph.D. dissertation, University of British Columbia.
77. Genest, C. (1984a). A conflict between two axioms for combining subjective distributions. J. R. Statist. Soc. Ser. B 46 403-405.
78. Genest, C. (1984b). A characterization theorem for externally Bayesian groups. Ann. Statist. 12 1100-1105.
79. Genest, C. (1984c). Pooling operators with the marginalization property. Can. J. Statist. 12 153-163.
80. Genest, C., Mcconway, K. J. and Schervish, M. J. (1986). Characterization of externally Bayesian pooling operators. Ann. Statist. 14 in press.
81. Genest, C. and Schervish, M. J. (1985). Modeling expert judg-ments for Bayesian updating. Ann. Statist. 13 1198-1212.
82. Genest, C. and Wagner, C. G. (1984). Further evidence against independence preservation in expert judgement synthesis. Technical Report No 84-10, Department of Statistics and Actuarial Science, University of Waterloo.
83. Genest, C., Weerahandi, S. and Zidek, J. V. (1984). Aggregating opinions through logarithmic pooling. Theory and Decision 17 61-70.
84. Hogarth, R. M. (1975)*. Cognitive processes and the assessment of subjective probability distributions (with discussion). J. Amer. Statist. Assoc. 70 271-294.
85. Hogarth, R. M. (1977)*. Methods for aggregating opinions. In Decision Making and Change in Human Affairs (Jungermann, H. and DeZeeuw, G., eds). D. Reidel Publishing Co., Dordrecht, Holland.
86. Laddaga, R. (1977). Lehrer and the consensus proposal. Synthese 36 473-477.
87. Lehrer, K. (1976). When rational disagreement is impossible. Nous 10 327-332.
88. Lehrer, K. (1983). Rationality as weighted averaging. Synthese 57 283-295.
89. Lehrer, K. (1985). Consensus and the ideal observer. Synthese 62 109-120.
90. Lehrer, K. and Wagner, C. G. (1981)*. Rational Consensus in Science and Society. D. Reidel Publishing Co., Dordrecht, Holland.
91. Lehrer, K. and Wagner, C. G. (1983). Probability amalgamation and the independence issue: a reply to Laddaga. Synthese 55 339-346.
92. Levi, I. (1985). Consensus as shared agreement and outcome of inquiry. Synthese 62 3-11.
93. Lindley, D. V. (1983). Reconciliation of probability distributions. Oper. Res. 31 866-880.
94. Lindley, D. V. (1985). Reconciliation of discrete probability distributions. In Bayesian Statistics 2 (Bernardo, J. M., et al., eds). North Holland, Amsterdam, 375-390.
95. Lindley, D. V., Tversky, A. and Brown, R. V. (1979). On the reconciliation of probability assessments (with discussion). J. R. Statist. Soc. Ser. A 142 146-180.
96. Loewer, B. and Laddaga, R. (1985). Destroying the consensus. Synthese 62 79-95.
97. Madansky, A. (1964). Externally Bayesian groups. RM-4141-PR, The Rand Corporation, Santa Monica, CA.
98. Madansky, A. (1978). Externally Bayesian groups. Unpublished manuscript, University of Chicago.
99. McConway, K. J. (1978). The combination of experts’ opinions in probability assessment: some theoretical considerations. Ph.D. dissertation, University College London.
100. McConway, K. J. (1981). Marginalization and linear opinion pools. J. Amer. Statist. Assoc. 76 410-414.
101. Morris, P. A. (1971). Bayesian expert resolution. Ph.D. dissertation, Stanford University.
102. Morris, P. A. (1974). Decision analysis expert use. Manag. Sci. 20 1233-1241.
103. Morris, P. A. (1977). Combining expert judgments: a Bayesian approach. Manag. Sci. 23 679-693.
104. Morris, P. A. (1983). An axiomatic approach to expert resolution. Manag. Sci. 29 24-32.
105. Moskowitz, H. and Bajgier, S. M. (1978). Validity of the DeGroot model for achieving consensus in panel and Delphi groups. Unpublished manuscript, Purdue University.
106. Norvig, T. (1967). Consensus of subjective probabilities: a convergence theorem. Ann. Math. Statist. 38 221-225.
107. Nurmi, H. (1985). Some properties of the Lehrer-Wagner method for reaching rational consensus. Synthese 62 13-24.
108. Raiffa, H. (1968). Decision Analysis: Introductory Lectures on Choices under Uncertainty. Addison-Wesley, Reading, MA.
109. Ratcliff, R. (1979). Group reaction time distributions and an analysis of distribution statistics. Psych. Bull. 86 446-461.
110. Savage, L. J. (1971). Elicitation of personal probabilities and expectations. J. Amer. Statist. Assoc. 66 783-801.
111. Schervish, M. J. (1983). Combining expert judgments. Technical Report No 294, Department of Statistics, Carnegie-Mellon University.
112. Schmitt, F. F. (1985). Consensus, respect, and weighted averaging. Synthese 62 25-46.
113. Staël Von Holstein, C-A. S. (1970). Assessment and evaluation of subjective probability. Economics Research Institute at the Stockholm School of Economics.
114. Stone, M. (1961). The opinion pool. Ann. Math. Statist. 32 1339-1342.
115. Thomas, E. A. C. and Ross, B. H. (1980). On appropriate procedures for combining probability distributions within the same family. J. Math. Psych. 21 136-152.
116. Toda, M. (1956). Information-receiving behavior of man. Psych. Rev. 63 204-212.
117. Wagner, C. G. (1978). Consensus through respect: a model of rational group decision-making. Phil. Stud. 34 335-349.
118. Wagner, C. G. (1980). The formal foundations of Lehrer’s theory of consensus. In Profile (Bogdan, R. J., ed). D. Reidel Publishing Co., Dordrecht, Holland.
119. Wagner, C. G. (1982). Allocation, Lehrer models, and the consensus of probabilities. Theory and Decision 14 207-220.
120. Wagner, C. G. (1984). Aggregating subjective probabilities: some limitative theorems. Notre Dame J. Formal Log. 25 233-240.
121. Wagner, C. G. (1985). On the formal properties of weighted aver-aging as a method of aggregation. Synthese 62 97-108.
122. Walley, P. (1982)*. The elicitation and aggregation of beliefs. Statistics Research Report, University of Warwick.
123. Weerahandi, S. and Zidek, J. V. (1978). Pooling prior distribu-tions. Report No 78-34, Institute of Applied Mathematics and Statistics, University of British Columbia.
124. Weerahandi, S. and Zidek, J. V. (1981)*. Multi-Bayesian statis-tical decision theory. J. R. Statist. Soc. Ser. A 144 85-93.
125. West, M. (1984). Bayesian aggregation. J. R. Statist. Soc. Ser. A 147 600-607.
126. Winkler, R. L. (1968)*. The consensus of subjective probability distributions. Manag. Sci. 15 B61-B75.
127. Winkler, R. L. (1981). Combining probability distributions from dependent information sources. Manag. Sci. 27 479-488.
128. Winkler, R. L. and Cummings, L. L. (1972). On the choice of a consensus distribution in Bayesian analysis. Org. Behav. Hum. Perform. 7 63-76.
129. Zeckhauser, R. (1968). Group decision and allocation. Discussion paper No 51, Harvard Institute of Economic Research, Cambridge, MA.