Dwelling on the Negative: Incentivizing Effort in Peer Prediction

Proceedings of the 1st AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2013

Volumn , Issue , 2013, Pages 190-197

  Witkowski, Jens ^a   Key, Peter ^b   Bachrach, Yoram ^b   Parkes, David C ^c  

^a UNIVERSITY OF FREIBURG   (Germany)

^b MICROSOFT RESEARCH   (United Kingdom)

^c HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

EXPECTED COSTS; GROUND TRUTH; PAYMENT SCHEMES; SELECTION MECHANISM; SIMPLE++;

COSTS;

EID: 85080012966     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (12)

1. Dasgupta, A., and Ghosh, A. 2013. Crowdsourced Judgement Elicitation with Endogenous Proficiency. In Proceedings of the 22nd ACM International World Wide Web Conference (WWW’13).
2. Jurca, R., and Faltings, B. 2006. Minimum Payments that Reward Honest Reputation Feedback. In Proceedings of the 7th ACM Conference on Electronic Commerce (EC’06).
3. Jurca, R., and Faltings, B. 2007. Robust Incentive-Compatible Feedback Payments. In Trust, Reputation and Security: Theories and Practice, volume 4452 of LNAI. Springer-Verlag. 204–218.
4. Jurca, R., and Faltings, B. 2009. Mechanisms for Making Crowds Truthful. Journal of Artificial Intelligence Research (JAIR) 34:209–253.
5. Miller, N.; Resnick, P.; and Zeckhauser, R. 2005. Eliciting Informative Feedback: The Peer-Prediction Method. Management Science 51(9):1359–1373.
6. Piech, C.; Huang, J.; Chen, Z.; Do, C.; Ng, A.; and Koller, D. 2013. Tuned Models of Peer Assessment in MOOCs. In Proceedings of the 6th International Conference on Educational Data Mining (EDM’13), 153–160. International Educational Data Mining Society.
7. Prelec, D. 2004. A Bayesian Truth Serum for Subjective Data. Science 306(5695):462–466.
8. Radanovic, G., and Faltings, B. 2013. A Robust Bayesian Truth Serum for Non-binary Signals. In Proceedings of the 27th AAAI Conference on Artificial Intelligence (AAAI’13).
9. Salganik, M. J., and Levy, K. E. C. 2012. Wiki surveys: Open and quantifiable social data collection. preprint, http://arxiv.org/abs/1202.0500.
10. Waggoner, B., and Chen, Y. 2013. Information Elicitation Sans Verification. In Proceedings of the 3rd Workshop on Social Computing and User Generated Content (SC’13).
11. Witkowski, J., and Parkes, D. 2012a. A Robust Bayesian Truth Serum for Small Populations. In Proceedings of the 26th AAAI Conference on Artificial Intelligence (AAAI’12).
12. Witkowski, J., and Parkes, D. 2012b. Peer Prediction Without a Common Prior. In Proceedings of the 13th ACM Conference on Electronic Commerce (EC’12).