An online cost sensitive decision-making method in crowdsourcing systems

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2013, Pages 217-228

  Gao, Jinyang ^a   Liu, Xuan ^a   Ooi, Beng Chin ^a   Wang, Haixun ^b   Chen, Gang ^c  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b MICROSOFT RESEARCH ASIA   (China)

^c ZHEJIANG UNIVERSITY   (China)

Author keywords

Crowdsourcing; Decision making

Indexed keywords

COMPUTATIONAL ALGORITHM; CROWDSOURCING; DECISION-MAKING METHOD; DESIGN AND IMPLEMENTS; GENERALIZED NONLINEAR MODEL; NATURAL LANGUAGE PROCESSING; SEMANTIC-BASED INFORMATION RETRIEVAL; STATE-OF-ART METHODS;

COSTS; DECISION MAKING; NATURAL LANGUAGE PROCESSING SYSTEMS; ONLINE SYSTEMS; PROFITABILITY;

PROBLEM SOLVING;

EID: 84880542053     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2463676.2465307     Document Type: Conference Paper

References (19)

1. http://www.mturk.com.
2. O. Alonso, D. Rose, and B. Stewart. Crowdsourcing for relevance evaluation. In SIGIR Forum, Volume 42, pages 9-15. ACM, 2008.
3. A. Feng, M. Franklin, D. Kossmann, T. Kraska, S. Madden, S. Ramesh, A. Wang, and R. Xin. Crowddb: Query processing with the vldb crowd. VLDB, 4(12), 2011.
4. M. Franklin, D. Kossmann, T. Kraska, S. Ramesh, and R. Xin. Crowddb: answering queries with crowdsourcing. In SIGMOD, pages 61-72, 2011.
5. S. Guo, A. Parameswaran, and H. Garcia-Molina. So who won?: dynamic max discovery with the crowd. SIGMOD, pages 385-396. ACM, 2012.
6. P. Ipeirotis, F. Provost, and J. Wang. Quality management on amazon mechanical turk. SIGKDD workshop, pages 64-67. ACM, 2010.
7. G. Kazai, J. Kamps, M. Koolen, and N. Milic-Frayling. Crowdsourcing for book search evaluation: impact of hit design on comparative system ranking. SIGIR, 2011.
8. A. Kittur, E. Chi, and B. Suh. Crowdsourcing user studies with mechanical turk. SIGCHI, pages 453-456. ACM, 2008.
9. X. Liu, M. Lu, B. Ooi, Y. Shen, S. Wu, and M. Zhang. Cdas: a crowdsourcing data analytics system. VLDB, 5(10):1040-1051, 2012.
10. A. Marcus, E. Wu, D. Karger, S. Madden, and R. Miller. Crowdsourced databases: Query processing with people. CIDR, 2011.
11. A. Marcus, E. Wu, D. Karger, S. Madden, and R. Miller Demonstration of Qurk: a query processor for humanoperators. SIGMOD, pages 1315-1318. ACM, 2011.
12. A. Parameswaran, H. Garcia-Molina, H. Park, N. Polyzotis, A. Ramesh, and J. Widom. Crowdscreen: Algorithms for filtering data with humans. SIGMOD, pages 361-372. ACM, 2012.
13. A. Parameswaran and N. Polyzotis. Answering queries using humans, algorithms and databases. CIDR, 2011.
14. A. Parameswaran, A. Sarma, H. Garcia-Molina, N. Polyzotis, and J. Widom. Human-assisted graph search: it's okay to ask questions. VLDB, 4(5):267-278, 2011.
15. V. Raykar, S. Yu, L. Zhao, G. Valadez, C. Florin, L. Bogoni, and L. Moy. Learning from crowds. JMLR, 11:1297-1322, 2010.
16. J. Selke, C. Lofi, and W. Balke. Pushing the boundaries of crowd-enabled databases with query-driven schema expansion. VLDB, 5(6):538-549, 2012.
17. J. Wang, T. Kraska, M. Franklin, and J. Feng. Crowder: crowdsourcing entity resolution. VLDB, 5(11):1483-1494, 2012.
18. P. Welinder and P. Perona. Online crowdsourcing: rating annotators and obtaining cost-effective labels. CVPR workshop, pages 25-32. IEEE, 2010.
19. T. Yan, V. Kumar, and D. Ganesan. Crowdsearch: exploiting crowds for accurate real-time image search on mobile phones. MobiSys, pages 77-90, 2010. Singapore NRF