A robust Bayesian truth serum for small populations

Proceedings of the National Conference on Artificial Intelligence

Volumn 2, Issue , 2012, Pages 1492-1498

  Witkowski, Jens ^a   Parkes, David C ^b  

^a UNIVERSITY OF FREIBURG   (Germany)

^b HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BINARY INFORMATION; GROUND TRUTH; INCENTIVE COMPATIBILITY; INCENTIVE COMPATIBLE; NUMERICALLY ROBUST; PREDICTION METHODS; SCORING RULES; SMALL POPULATION; UNOBSERVABLE;

BODY FLUIDS; FORECASTING;

ARTIFICIAL INTELLIGENCE;

EID: 84868274369     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Chen, Y., and Pennock, D. M. 2010. Designing Markets for Prediction. AI Magazine 31:42-52.
2. Gneiting, T., and Raftery, A. E. 2007. Strictly Proper Scoring Rules, Prediction, and Estimation. Journal of the American Statistical Association 102:359-378.
3. John, L. K.; Loewenstein, G.; and Prelec, D. 2011. Measuring the Prevalence of Questionable Research Practices with Incentives for Truth-telling. Psychological Science. to appear.
4. Jurca, R., and Faltings, B. 2007. Robust Incentive-Compatible Feedback Payments. In Trust, Reputation and Security: Theories and Practice, volume 4452 of LNAI. Springer-Verlag. 204-218.
5. Jurca, R., and Faltings, B. 2008. Incentives for Expressing Opinions in Online Polls. In Proceedings of the 9th ACM Conference on Electronic Commerce (EC'08).
6. Jurca, R., and Faltings, B. 2011. Incentives for Answering Hypothetical Questions. In Proceedings of the 1st Workshop on Social Computing and User Generated Content (SC'11).
7. Lambert, N., and Shoham, Y. 2008. Truthful Surveys. In Proceedings of the 4th International Workshop on Internet and Network Economics (WINE '08), 154-165.
8. Miller, N.; Resnick, P.; and Zeckhauser, R. 2005. Eliciting Informative Feedback: The Peer-Prediction Method. Management Science 51(9):1359-1373.
9. Prelec, D., and Seung, S. 2006. An algorithm that finds truth even if most people are wrong. Working Paper.
10. Prelec, D. 2004. A Bayesian Truth Serum for Subjective Data. Science 306(5695):462-466.
11. Raykar, V. C.; Yu, S.; Zhao, L. H.; Valadez, G. H.; Florin, C.; Bogoni, L.; and Moy, L. 2010. Learning From Crowds. Journal of Machine Learning Research (JMLR) 11:1297-1322.
12. Selten, R. 1998. Axiomatic Characterization of the Quadratic Scoring Rule. Experimental Economics 1:43-61.
13. Shaw, A. D.; Horton, J. J.; and Chen, D. L. 2011. Designing Incentives for Inexpert Human Raters. In Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (CSCW '11), 275-284.
14. Witkowski, J., and Parkes, D. 2012. Peer Prediction Without a Common Prior. In Proceedings of the 13th ACM Conference on Electronic Commerce (EC'12).