An empirical comparison of algorithms for aggregating expert predictions

Proceedings of the 22nd Conference on Uncertainty in Artificial Intelligence, UAI 2006

Volumn , Issue , 2006, Pages 106-113

  Dani, Varsha ^a   Madani, Omid ^b   Pennock, David ^b   Sanghai, Sumit ^c   Galebach, Brian ^d  

^a THE UNIVERSITY OF CHICAGO   (United States)

^b YAHOO RESEARCH   (United States)

^c University of Washington   (United States)

^d ProbabilitySportscom ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN ESTIMATIONS; EMPIRICAL COMPARISON; EMPIRICAL COMPARISON OF ALGORITHMS; OFFLINE; PREDICTION ACCURACY; QUADRATIC LOSS; SOLUTION METHODS;

ADAPTIVE ALGORITHMS; BAYESIAN NETWORKS; PROBLEM SOLVING;

FORECASTING;

EID: 79952424804     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. C.L. Blake, E. Keogh, and C.J. Merz. UCI repository of machine learning databases, 1998.
2. N. Cesa-Bianchi, Y. Freund, D. Helbold, D. Haussler, R. Schapire, and M. Warmuth. How to use expert advice. JACM, 44(3):427-485, 1997. (Pubitemid 127634586)
3. Y. Chen, C. Chu, T. Mullen, and D. M. Pennock. Information markets vs. multiple experts: An empirical comparison. In Electronic Commerce, 2005.
4. Chih-Chung Chang and Chih-Jen Lin. LIBSVM: A library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
5. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39, 1977.
6. A. Gammerman, Y. Kalnishkan, and V. Vovk. On-line prediction with kernels and the complexity approximation principle. In UAI'04, 2004.
7. Christian Genest and James V. Zidek. Combining probability distributions: A critique and an annotated bibliography. Statistical Science, 1(1):114-148, 1986.
8. J. M. Kahn. A generative Bayesian model for aggregating experts' probabilities. In UAI'04, 2004.
9. J. Kivinen and M. K. Warmuth. Exponentiated gradient versus gradient descent for linear predictors. Information and Computation, 132(1), 1997.
10. J. Langford and B. Zadrozny. Estimating class membership probabilities using classifier learners. In AISTAT, 2005.
11. Keung-Chi Ng and Bruce Abramson. Consensus diagnosis-A simulation study. IEEE Transactions on Systems, Man, and Cybernetics, 22(5), 1992.
12. NewsFutures. www.newsfutures.com, 2005.
13. ProbabilitySports. www.probabilitysports.com, 2005.
14. David M. Pennock and Michael P. Wellman. Representing aggregate belief through the competitive equilibrium of a securities market. In Thirteenth Conference on Uncertainty in Artificial Intelligence, pages 392-400, Providence, RI, USA, July 1997.
15. David M. Pennock and Michael P. Wellman. A market framework for pooling opinions. Technical Report 2001-081, NEC Research Institute, 2001.
16. E. Servan-Schreiber, J. Wolfers, D. Pennock, and B. Galebach. Prediction markets: Does money matter? Electronic Markets, 14(3), 2004.
17. TradeSports. www.tradesports.com.
18. V. G. Vovk. Aggregating strategies. In COLT, pages 371-386, 1990.
19. Robert L. Winkler and Allan H. Murphy. Good probability assessors. J. Applied Meteorology, 7:751-758, 1968.
20. Justin Wolfers and Eric Zitzewitz. Prediction markets. Journal of Economic Perspectives, 18(2), 2004.
21. Justin Wolfers and Eric Zitzewitz. Interpreting prediction market prices as probabilities. Technical report, University of Pennsylvania Wharton School of Business, 2005. http://bpp.wharton.upenn.edu/jwolfers/Papers/ InterpretingPredictionMarketPrices.pdf.