Beat the machine: Challenging workers to find the unknown unknowns

AAAI Workshop - Technical Report

Volumn WS-11-11, Issue , 2011, Pages 2-7

  Attenberg, Josh ^a   Ipeirotis, Panagiotis G ^b   Provost, Foster ^b  

^a POLYTECHNIC UNIVERSITY   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC MODELS; DESIGN ITERATION; NORMAL OPERATIONS; PREDICTIVE MODELS; TRADITIONAL TECHNIQUES;

PREDICTIVE CONTROL SYSTEMS;

ERRORS;

EID: 80055053677     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (8)

1. Bennett, P. N., and Carvalho, V. R. 2010. Online stratified sampling: evaluating classifiers at web-scale. In CIKM'10.
2. Freund, Y., and Schapire, R. E. 1999. A short introduction to boosting.
3. Raykar, V.; Yu, S.; Zhao, L.; Jerebko, A.; Florin, C.; Valadez, G.; Bogoni, L.; and Moy, L. 2009. Supervised Learning from Multiple Experts: Whom to trust when everyone lies a bit. In Proceedings of the 26th Annual International Conference on Machine Learning, 889-896. ACM.
4. Sawade, Christoph; Bickel, Steffen; and Scheffer, Tobias. Active Risk Estimation. In ICML.
5. Settles, B. 2010. Active learning literature survey.
6. Sheng, V. S.; Provost, F.; and Ipeirotis, P. G. 2008. Get another label? improving data quality and data mining using multiple, noisy labelers. In KDD '08.
7. VanLehn, K. 1998. Analogy events: How examples are used during problem solving. Cognitive Science 22(3):347-388. (Pubitemid 128179875)
8. Winston, P. 1970. Learning structural descriptions from examples.