Convex formulations of learning from crowds

Transactions of the Japanese Society for Artificial Intelligence

Volumn 27, Issue 3, 2012, Pages 133-142

  Kajino, Hiroshi ^a   Kashima, Hisashi ^b  

^a UNIVERSITY OF TOKYO   (Japan)

^b NONE

Author keywords

Convex optimization; Crowdsourcing; Multi task learning

Indexed keywords

ARTIFICIAL INTELLIGENCE; ITERATIVE METHODS; LEARNING SYSTEMS; OPTIMIZATION;

CONDITIONAL INDEPENDENCES; CONVEX OPTIMIZATION PROBLEMS; CROWDSOURCING; MULTIPLE CLASSIFIERS; MULTITASK LEARNING; NONCONVEX OPTIMIZATION PROBLEM; OPTIMIZATION FORMULATIONS; QUALITY PROBLEMS;

CONVEX OPTIMIZATION;

EID: 84867415955     PISSN: 13460714     EISSN: 13468030     Source Type: Journal    
DOI: 10.1527/tjsai.27.133     Document Type: Article

References (16)

1. Caruana, R.: Multitask Learning, in Machine Learning, Vol. 28, pp. 41-75 (1997)
2. Cortez, P., Cerdeira, A., Almeida, F., Matos, T., and Reis, J.: Modeling Wine Preferences by Data Mining from Physicochemical Properties, Decision Support Systems, Vol. 47, pp. 547-553 (2009)
3. Dawid, A. P. and Skene, A.M.: Maximum Likelihood Estimation of Observer Error-Rates Using the EM Algorithm, Applied Statistics, Vol. 28, No. 1, pp. 20-28 (1979)
4. Dekel, O. and Shamir, O.: Vox Populi: Collecting High-Quality Labels from a Crowd, in Proceedings of the 22nd Annual Conference on Learning Theory (2009)
5. Donmez, P., Carbonell, J. G., and Schneider, J.: Efficiently Learning the Accuracy of Labeling Sources for Selective Sampling, in Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 259-268 (2009)
6. Evgeniou, T. and Pontil, M.: Regularized Multi-Task Learning, in Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 109-117 (2004)
7. Frank, A. and Asuncion, A.: UCI Machine Learning Repository (2010)
8. Raykar, V. C., Yu, S., Zhao, L. H., Valadez, G. H., Florin, C., Bogoni, L., and Moy, L.: Learning from Crowds, Journal of Machine Learning Research, Vol. 11, pp. 1297-1322 (2010)
9. Sheng, V. S., Provost, F., and Ipeirotis, P. G.: Get Another Label? Improving Data Quality and Data Mining Using Multiple, Noisy Labelers, in Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 614-622 (2008)
10. Smyth, P., Fayyad, U., Burl, M., Perona, P., and Baldi, P.: Inferring Ground Truth from Subjective Labelling of Venus Images, in Advances in Neural Information Processing Systems 7, pp. 1085-1092 (1994)
11. Snow, R., O'Connor, B., Jurafsky, D., and Ng, A. Y.: Cheap and Fast-But is it Good?: Evaluating Non-Expert Annotations for Natural Language Tasks, in Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 254-263 (2008)
12. Welinder, P., Branson, S., Belongie, S., and Perona, P.: The Multidimensional Wisdom of Crowds, in Advances in Neural Information Processing Systems 23, pp. 2424-2432 (2010)
13. Welinder, P. and Perona, P.: Online crowdsourcing: rating annotators and obtaining cost-effective labels, in Computer Vision and Pattern Recognition Workshops, pp. 25-32 (2010)
14. Whitehill, J., Ruvolo, P., Wu, fan T., Bergsma, J., and Movellan, J.: Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise, in Advances in Neural Information Processing Systems 22, pp. 2035-2043 (2009)
15. Yan, Y., Rosales, R., Fung, G., and Dy, J.: Modeling Multiple Annotator Expertise in the Semi-Supervised Learning Scenario, in Proceedings of the 26th Conference Annual Conference on Uncertainty in Artificial Intelligence, pp. 674-682 (2010)
16. Yan, Y., Rosales, R., Fung, G., and Dy, J.: Active Learning from Crowds, in Proceedings of the 28th International Conference on Machine Learning, pp. 1161-1168 (2011)