Crowdsourcing control: Moving beyond multiple choice

AAAI Workshop - Technical Report

Volumn WS-12-08, Issue , 2012, Pages 25-26

  Lin, Christopher H ^a   Mausam, ^a   Weld, Daniel S ^a  

^a University of Washington   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84875729985     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. Aldous, D. J. 1985. Exchangeability and related topics. In École d'Été de Probabilités de Saint-Flour XIII 1983, volume 1117 of Lecture Notes in Mathematics. Springer Berlin /Heidelberg. 1-198. 10.1007/BFb0099421.
2. Dai, P.; Mausam; and Weld, D. S. 2010. Decision-theoretic control of crowd-sourced workflows. In AAAI.
3. Dai, P.; Mausam; and Weld, D. S. 2011. Artificial intelligence for artificial intelligence. In AAAI.
4. Grier, D. A. 2011. Error identification and correction in human computation: Lessons from the WPA. In HCOMP.
5. Kamar, E.; Hacker, S.; and Horvitz, E. 2012. Combining human and machine intelligence in large-scale crowdsourcing. In AAMAS.
6. Karger, D. R.; Oh, S.;; and Shah, D. 2011. Budget-optimal crowdsourcing using low-rank matrix approximations. In Allerton.
7. Lin, C. H.; Mausam; and Weld, D. S. 2012. Dynamically switching between synergistic workflows for crowdsourcing. In AAAI.
8. Parameswaran, A.; Garcia-Molina, H.; Park, H.; Polyzotis, N.; Ramesh, A.; and Widom, J. 2010. Crowdscreen: Algorithms for filtering data with humans. In VLDB.
9. Raykar, V. C.; Yu, S.; Zhao, L. H.; and Valadez, G. 2010. Learning from crowds. Journal of Machine Learning Research 11:1297-1322.
10. Romney, A. K.; Weller, S. C.; and Batchelder, W. H. 1986. Culture as consensus: A theory of culture and informant accuracy. American Anthropologist 88(2):313-338.
11. Sheng, V. S.; Provost, F.; and Ipeirotis, P. G. 2008. Get another label? improving data quality and data mining using multiple, noisy labelers. In Proceedings of the Fourteenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
12. Snow, R.; O'Connor, B.; Jurafsky, D.; and Ng, A. Y. 2008. Cheap and fast - but is it good? evaluating non-expert annotations for natural language tasks. In EMNLP, 254-263.
13. Welinder, P.; Branson, S.; Belongie, S.; and Perona, P. 2010. The multidimensional wisdom of crowds. In NIPS.
14. Whitehill, J.; Ruvolo, P.; Bergsma, J.; Wu, T.; and Movellan, J. 2009. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In NIPS.