Collective revelation: A mechanism for self-verified, weighted, and truthful predictions

Proceedings of the ACM Conference on Electronic Commerce

Volumn , Issue , 2009, Pages 265-273

  Goel, Sharad ^a   Reeves, Daniel M ^a   Pennock, David M ^a  

^a YAHOO RESEARCH   (United States)

Author keywords

Forecasting; Mechanism design; Polls; Prediction markets

Indexed keywords

BALANCED MECHANISM; BAYESIAN; DECISION MAKERS; ELICITATION METHODS; EXPERT OPINION; GROUND TRUTH; MECHANISM DESIGN; POLLS; PREDICTION MARKETS; PREDICTION METHODS; PROPER SCORING RULES;

ELECTRIC CONDUCTIVITY MEASUREMENT; ELECTRONIC COMMERCE; FORECASTING; SURVEYS;

MACHINE DESIGN;

EID: 77950566893     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1566374.1566413     Document Type: Conference Paper

References (27)

1. G. Brier. Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78:1-3, 1950.
2. Yiling Chen, Stanko Dimitrov, Rahul Sami, Daniel M. Reeves, David M. Pennock, Robin D. Hanson, Lance Fortnow, and Rica Gonen. Gaming prediction markets: Equilibrium strategies with a market maker. Algorithmica, to appear.
3. Norman Dalkey and Olaf Helmer. An experimental application of the Delphi method to the use of experts. Management Science, 9, 1963.
4. Paul H. Garthwaite, Joseph B. Kadane, and Anthony O'Hagan. Statistical methods for eliciting probability distributions. Journal of the American Statistical Association, 100(470):680-700, 2005.
5. nd edition, 2004.
6. Allan Gibbard. Manipulation of voting schemes: A general result. Econometrica, 41:587-601, 1973.
7. I.J. Good. Rational decisions. JRSS-B, 1952.
8. Jerry R. Green and Jean-Jacques Laffont. Incentives in Public Decision-Making. North-Holland Publishing Company, 1979.
9. D.J. Johnstone. The parimutuel Kelly probability scoring rule. Decision Analysis, 4(2):66, 2007.
10. Radu Jurca and Boi Faltings. Incentives for expressing opinions in online polls. In ACM Conference on Electronic Commerce, 2008.
11. D.M. Kilgour and Y. Gerchak. Elicitation of probabilities using competitive scoring rules. Decision Analysis, 1(2):108-113, 2004.
12. Nicolas Lambert, John Langford, Jennifer Wortman, Yiling Chen, Daniel Reeves, Yoav Shoham, and David Pennock. Self-financed wagering mechanisms for forecasting. In ACM Conference on Electronic Commerce, pages 170-179, 2008.
13. Nicolas Lambert and Yoav Shoham. Truthful surveys. Lecture Notes in Computer Science, 5385:154-165, 2008.
14. Andrew Mas-Colell, Michael D. Whinston, and Jerry R. Green. Microeconomics Theory. Oxford University Press, New York, NY, 1995.
15. James E. Matheson and Robert L. Winkler. Scoring rules for continuous probability distributions. Management Science, 22(10):1087-1096, 1976.
16. Paul Milgrom and Nancy L. Stokey. Information, trade and common knowledge. Journal of Economic Theory, 26(1):17-27, 1982.
17. Nolan Miller, Paul Resnick, and Richard Zeckhauser. Eliciting informative feedback: The peer-prediction method. Management Science, 51:1359-1373, 2005.
18. A. Murphy and R. Winkler. Probability forecasting in meteorology. Journal of the American Statistical Association, 79(387):489-500, 1984.
19. R. Nelson and D. Bessler. Subjective probabilities and scoring rules: Experimental evidence. Journal of Agricultural Economics, 71(2):363-369, 1989.
20. F. O'Carroll. Subjective probabilities and short-term economic forecasts: An empirical investigation. Applied Statistics, 26(3):269-278, 1977.
21. Drazen Prelec. A Bayesian truth serum for subjective data. Science, 306:462-466, 2004.
22. Leonard J. Savage. Elicitation of personal probabilities and expectations. Journal of the American Statistical Association, 66(336):783-801, 1971.
23. D. Spiegelhalter. Probabilistic prediction in patient management and clinical trials. Stat. Med., 5:421-433, 1986.
24. James Surowiecki. The Wisdom of Crowds. Doubleday, 2004.
25. Robert L. Winkler. The assessment of prior distributions in Bayesian analysis. Journal of the American Statistical Association, 62(319):776-800, 1967.
26. Robert L. Winkler. Probabilistic prediction: Some experimental results. Journal of the American Statistical Association, 66(336):675-685, 1971.
27. Robert L. Winkler, J. Muñoz, J.L. Cervera, J.M. Bernardo, G. Blattenberger, J.B. Kadane, D.V. Lindley, A.H. Murphy, R.M. Oliver, and D. Ríos-Insua. Scoring rules and the evaluation of probabilities. TEST/Springer, 5(1):1-60, 1996.