Inferring missing relevance judgments from crowd workers via probabilistic matrix factorization

SIGIR'12 - Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2012, Pages 1095-1096

  Jung, Hyun Joon ^a   Lease, Matthew ^b  

^a The University of Texas at Austin   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

crowdsourcing; label aggregation; matrix factorization

Indexed keywords

COLLABORATIVE FILTERING; CONSENSUS METHODS; CROWDSOURCING; LABEL AGGREGATION; MAJORITY VOTING; MATRIX FACTORIZATIONS; RELEVANCE FEEDBACK; RELEVANCE JUDGMENT; WEIGHTED VOTING;

INFORMATION RETRIEVAL;

EID: 84866631974     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2348283.2348486     Document Type: Conference Paper

References (6)

1. O. Alonso, D. Rose, and B. Stewart. Crowdsourcing for relevance evaluation. SIGIR Forum, 42(2):9-15, 2008.
2. C. Buckley, M. Lease, and M. D. Smucker. Overview of the TREC 2010 Relevance Feedback Track (Notebook). In Proc. of the 19th Text Retrieval Conference, 2010.
3. S. Chen, J. Zhang, G. Chen, and C. Zhang. What if the irresponsible teachers are dominating? a method of training on samples and clustering on teachers. In 24th AAAI Conference, pages 419-424, 2010.
4. P. Ipeirotis, F. Provost, and J. Wang. Quality management on amazon mechanical turk. In Proceedings of the ACM SIGKDD workshop on human computation, pages 64-67. ACM, 2010.
5. H. J. Jung and M. Lease. Improving Consensus Accuracy via Z-score and Weighted Voting. In AAAI Workshop on Human Computation (HComp), 2011.
6. R. Salakhutdinov and et al. Probabilistic matrix factorization. In NIPS 2008, volume 20, January 2008.