Detecting Non-Adversarial Collusion in Crowdsourcing

Proceedings of the 2nd AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2014

Volumn , Issue , 2014, Pages 104-111

  KhudaBukhsh, Ashiqur R ^a   Carbonell, Jaime G ^a   Jansen, Peter J ^a  

^a Carnegie Mellon University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

BIAS REDUCTION; COLLUSION DETECTION; CROWD SOURCING; DETECTION ALGORITHM; HIGH-ACCURACY; JOINT DECISIONS; PRODUCT RATINGS; SOCIAL RULES; SYNTHETIC AND REAL DATA;

CROWDSOURCING;

EID: 85040706728     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. Allahbakhsh, M.; Ignjatovic, A.; Benatallah, B.; Bertino, E.; Foo, N.; et al. 2013. Collusion detection in online rating systems. In Web Technologies and Applications. Springer. 196-207.
2. Argenal, R. N.; Cruz, E.; and Patungan, W. R. 2004. A new index for detecting collusion and its statistical properties.
3. Donmez, P.; Carbonell, J. G.; and Bennett, P. N. 2007. Dual strategy active learning. In Machine Learning: ECML 2007. Springer. 116-127.
4. Ercole, A.; Whittlestone, K.; Melvin, D.; and Rashbass, J. 2002. Collusion detection in multiple choice examinations. Medical education 36(2):166-172.
5. Hastie, T.; Tibshirani, R.; and Friedman, J. 2009. The elements of statistical learning: Data mining, inference, and prediction, (springer series in statistics).
6. Irving, R.W. 2004. Plagiarism and collusion detection using the smith-waterman algorithm. University of Glasgow.
7. Lam, S. K., and Riedl, J. 2004. Shilling recommender systems for fun and profit. In Proceedings of the 13th international conference on World Wide Web (WWW), 393-402. ACM.
8. Lasecki, W. S.; Teevan, J.; and Kamar, E. Information extraction and manipulation threats in crowd-powered systems. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW), 248-256.
9. Liu, Y.; Yang, Y.; and Sun, Y. L. 2008. Detection of collusion behaviors in online reputation systems. In Signals, Systems and Computers, 2008 42nd Asilomar Conference on, 1368-1372. IEEE.
10. Marcus, A.; Karger, D.; Madden, S.; Miller, R.; and Oh, S. 2012. Counting with the crowd. Proceedings of the VLDB Endowment 6(2):109-120.
11. Mazrooei, P.; Archibald, C.; and Bowling, M. 2013. Automating collusion detection in sequential games. In Proceedings of the Twenty-Seventh Conference on Artificial Intelligence (AAAI), 675-682.
12. Mehta, B.; Hofmann, T.; and Nejdl, W. 2007. Robust collaborative filtering. In Proceedings of the 2007 ACM conference on Recommender systems, 49-56. ACM.
13. Mitchell, T. M. 1997. Machine learning. McGraw-Hill Boston, MA:.
14. Roy, N., and Mccallum, A. 2001. Toward optimal active learning through monte carlo estimation of error reduction. In Proceedings of the International Conference on Machine Learning (ICML), 441-448.
15. Smed, J.; Knuutila, T.; and Hakonen, H. 2007. Towards swift and accurate collusion detection. In GAMEON, 103-107.
16. Vallve-Guionnet, C. 2005. Finding colluders in card games. In Information Technology: Coding and Computing, 2005. ITCC 2005. International Conference on, volume 2, 774-775. IEEE.
17. Wollack, J. A. 2003. Comparison of answer copying indices with real data. Journal of Educational Measurement 40(3):189-205.