-
1
-
-
84875749706
-
Quality control in crowdsourcing systems: issues and directions
-
Allahbakhsh M, Benatallah B, Ignjatovic A, Motahari-Nezhad HR, Bertino E, Dustdar S (2013) Quality control in crowdsourcing systems: issues and directions. IEEE Internet Comput 2:76–81
-
(2013)
IEEE Internet Comput
, vol.2
, pp. 76-81
-
-
Allahbakhsh, M.1
Benatallah, B.2
Ignjatovic, A.3
Motahari-Nezhad, H.R.4
Bertino, E.5
Dustdar, S.6
-
2
-
-
67349095304
-
Handbook of numerical analysis
-
Bernardi C, Maday Y (1997) Handbook of numerical analysis. Spectr Methods 5:209–485
-
(1997)
Spectr Methods
, vol.5
, pp. 209-485
-
-
Bernardi, C.1
Maday, Y.2
-
3
-
-
78649604206
-
Soylent: a word processor with a crowd inside
-
Bernstein MS, Little G, Miller RC, Hartmann B, Ackerman MS, Karger DR, Crowell D, Panovich K (2010) Soylent: a word processor with a crowd inside. In: Proceedings of the 23nd annual ACM symposium on user interface software and technology, ACM, pp 313–322
-
(2010)
Proceedings of the 23nd annual ACM symposium on user interface software and technology, ACM
-
-
Bernstein, M.S.1
Little, G.2
Miller, R.C.3
Hartmann, B.4
Ackerman, M.S.5
Karger, D.R.6
Crowell, D.7
Panovich, K.8
-
4
-
-
84993167633
-
-
Bragg J, Weld DS, et al (2013) Crowdsourcing multi-label classification for taxonomy creation. In: First AAAI conference on human computation and crowdsourcing, pp 25–33
-
-
-
-
5
-
-
0035478854
-
Random forests
-
Breiman L (2001) Random forests. Mach Learn 45(1):5–32
-
(2001)
Mach Learn
, vol.45
, Issue.1
, pp. 5-32
-
-
Breiman, L.1
-
8
-
-
84993151982
-
-
Buckley C, Lease M, Smucker MD, Jung HJ, Grady C, Buckley C, Lease M, Smucker MD, Grady C, Lease M, et al (2010) Overview of the trec 2010 relevance feedback track (notebook). In: The nineteenth text retrieval conference (TREC) notebook
-
-
-
-
10
-
-
78650293844
-
Towards crowdsourcing translation tasks in library cataloguing, a pilot study
-
Corney J, Lynn A, Torres C, Di Maio P, Regli W, Forbes G, Tobin L (2010) Towards crowdsourcing translation tasks in library cataloguing, a pilot study. In: The 4th IEEE international conference on digital ecosystems and technologies(DEST), IEEE, pp 572–577
-
(2010)
The 4th IEEE international conference on digital ecosystems and technologies(DEST), IEEE
-
-
Corney, J.1
Lynn, A.2
Torres, C.3
Di Maio, P.4
Regli, W.5
Forbes, G.6
Tobin, L.7
-
11
-
-
33745838229
-
The pascal recognising textual entailment challenge
-
Machine learning challenges. evaluating predictive uncertainty, visual object classification, and recognising tectual entailment, Springer
-
Dagan I, Glickman O, Magnini B (2006) The pascal recognising textual entailment challenge. In: Quiñonero-Candela J, Dagan I, Magnini B, d’Alché-Buc F (eds) Machine learning challenges. evaluating predictive uncertainty, visual object classification, and recognising tectual entailment, Springer, pp 177–190
-
(2006)
Quiñonero-Candela J
, pp. 177-190
-
-
Dagan, I.1
Glickman, O.2
Magnini, B.3
Dagan, I.4
Magnini, B.5
d’Alché-Buc, F.6
-
12
-
-
84893096721
-
Aggregating crowdsourced binary ratings
-
Dalvi N, Dasgupta A, Kumar R, Rastogi V (2013) Aggregating crowdsourced binary ratings. In: Proceedings of the 22nd international conference on world wide web, International World Wide Web conferences steering committee, pp 285–294
-
(2013)
Proceedings of the 22nd international conference on world wide web, International World Wide Web conferences steering committee
-
-
Dalvi, N.1
Dasgupta, A.2
Kumar, R.3
Rastogi, V.4
-
13
-
-
0003102944
-
Maximum likelihood estimation of observer error-rates using the em algorithm
-
Dawid AP, Skene AM (1979) Maximum likelihood estimation of observer error-rates using the em algorithm. Appl Stat 28(1):20–28
-
(1979)
Appl Stat
, vol.28
, Issue.1
, pp. 20-28
-
-
Dawid, A.P.1
Skene, A.M.2
-
15
-
-
79953645302
-
Crowdsourcing systems on the world-wide web
-
Doan A, Ramakrishnan R, Halevy AY (2011) Crowdsourcing systems on the world-wide web. Commun ACM 54(4):86–96
-
(2011)
Commun ACM
, vol.54
, Issue.4
, pp. 86-96
-
-
Doan, A.1
Ramakrishnan, R.2
Halevy, A.Y.3
-
18
-
-
84858213232
-
Shepherding the crowd yields better work
-
Dow S, Kulkarni A, Klemmer S, Hartmann B (2012) Shepherding the crowd yields better work. In: Proceedings of the ACM 2012 conference on computer supported cooperative work, ACM, pp 1013–1022
-
(2012)
Proceedings of the ACM 2012 conference on computer supported cooperative work, ACM
-
-
Dow, S.1
Kulkarni, A.2
Klemmer, S.3
Hartmann, B.4
-
19
-
-
77954009273
-
Are your participants gaming the system? Screening mechanical turk workers
-
Downs JS, Holbrook MB, Sheng S, Cranor LF (2010) Are your participants gaming the system? Screening mechanical turk workers. In: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, pp 2399–2402
-
(2010)
Proceedings of the SIGCHI conference on human factors in computing systems, ACM
-
-
Downs, J.S.1
Holbrook, M.B.2
Sheng, S.3
Cranor, L.F.4
-
20
-
-
76649132306
-
-
Eagle N (2009) txteagle: mobile crowdsourcing. In: Aykin N (ed) Internationalization, design and global development, Springer, pp 447–456
-
Eagle N (2009) txteagle: mobile crowdsourcing. In: Aykin N (ed) Internationalization, design and global development, Springer, pp 447–456
-
-
-
-
24
-
-
84874049835
-
Self-taught active learning from crowds
-
Fang M, Zhu X, Li B, Ding W, Wu X (2012) Self-taught active learning from crowds. In: Data mining (2012 IEEE 12th international conference on ICDM), IEEE, pp 858–863
-
(2012)
Data mining (2012 IEEE 12th international conference on ICDM), IEEE
-
-
Fang, M.1
Zhu, X.2
Li, B.3
Ding, W.4
Wu, X.5
-
25
-
-
84899651693
-
Classification in the presence of label noise: a survey
-
Frénay B, Verleysen M (2014) Classification in the presence of label noise: a survey. IEEE Trans Neural Netw Learn Syst 25(5):845–869
-
(2014)
IEEE Trans Neural Netw Learn Syst
, vol.25
, Issue.5
, pp. 845-869
-
-
Frénay, B.1
Verleysen, M.2
-
26
-
-
0035371148
-
An adaptive version of the boost by majority algorithm
-
Freund Y (2001) An adaptive version of the boost by majority algorithm. Mach Learn 43(3):293–318
-
(2001)
Mach Learn
, vol.43
, Issue.3
, pp. 293-318
-
-
Freund, Y.1
-
27
-
-
84876057388
-
A survey on instance selection for active learning
-
Fu Y, Zhu X, Li B (2013) A survey on instance selection for active learning. Knowl Inf Syst 35(2):249–283
-
(2013)
Knowl Inf Syst
, vol.35
, Issue.2
, pp. 249-283
-
-
Fu, Y.1
Zhu, X.2
Li, B.3
-
28
-
-
0004012196
-
-
2, Taylor & Francis, London
-
Gelman A, Carlin JB, Stern HS, Rubin DB (2014) Bayesian data analysis, vol 2. Taylor & Francis, London
-
(2014)
Bayesian data analysis
-
-
Gelman, A.1
Carlin, J.B.2
Stern, H.S.3
Rubin, D.B.4
-
31
-
-
85028203782
-
Incremental support vector learning for ordinal regression
-
Gu B, Sheng VS, Tay KY, Romano W, Li S (2014) Incremental support vector learning for ordinal regression. IEEE Trans Neural Netw Learn Syst 26(7):1403–1416
-
(2014)
IEEE Trans Neural Netw Learn Syst
, vol.26
, Issue.7
, pp. 1403-1416
-
-
Gu, B.1
Sheng, V.S.2
Tay, K.Y.3
Romano, W.4
Li, S.5
-
32
-
-
84929471718
-
Incremental learning for ν -support vector regression
-
Gu B, Sheng VS, Wang Z, Ho D, Osman S, Li S (2015) Incremental learning for ν -support vector regression. Neural Netw 67:140–150
-
(2015)
Neural Netw
, vol.67
, pp. 140-150
-
-
Gu, B.1
Sheng, V.S.2
Wang, Z.3
Ho, D.4
Osman, S.5
Li, S.6
-
34
-
-
76749092270
-
The weka data mining software: an update
-
Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The weka data mining software: an update. ACM SIGKDD Explor Newslett 11(1):10–18
-
(2009)
ACM SIGKDD Explor Newslett
, vol.11
, Issue.1
, pp. 10-18
-
-
Hall, M.1
Frank, E.2
Holmes, G.3
Pfahringer, B.4
Reutemann, P.5
Witten, I.H.6
-
35
-
-
84929208117
-
Demographic estimation from face images: human vs. machine performance
-
Han H, Otto C, Liu X, Jain A (2014) Demographic estimation from face images: human vs. machine performance. IEEE Trans Pattern Anal Mach Intell 37(6):1148–1161
-
(2014)
IEEE Trans Pattern Anal Mach Intell
, vol.37
, Issue.6
, pp. 1148-1161
-
-
Han, H.1
Otto, C.2
Liu, X.3
Jain, A.4
-
36
-
-
33847246935
-
The rise of crowdsourcing
-
Howe J (2006) The rise of crowdsourcing. Wired Mag 14(6):1–4
-
(2006)
Wired Mag
, vol.14
, Issue.6
, pp. 1-4
-
-
Howe, J.1
-
38
-
-
84893707563
-
Repeated labeling using multiple noisy labelers
-
Ipeirotis PG, Provost F, Sheng VS, Wang J (2014) Repeated labeling using multiple noisy labelers. Data Min Knowl Discov 28(2):402–441
-
(2014)
Data Min Knowl Discov
, vol.28
, Issue.2
, pp. 402-441
-
-
Ipeirotis, P.G.1
Provost, F.2
Sheng, V.S.3
Wang, J.4
-
40
-
-
84867415955
-
Convex formulations of learning from crowds
-
Kajino H, Kashima H (2012) Convex formulations of learning from crowds. Trans Jan Soc Artif Intell 27:133–142
-
(2012)
Trans Jan Soc Artif Intell
, vol.27
, pp. 133-142
-
-
Kajino, H.1
Kashima, H.2
-
41
-
-
84856118112
-
Budget-optimal crowdsourcing using low-rank matrix approximations
-
Karger DR, Oh S, Shah D (2011) Budget-optimal crowdsourcing using low-rank matrix approximations. In: Communication, control, and computing (Allerton), 2011 49th annual allerton conference on, IEEE, pp 284–291
-
(2011)
Communication, control, and computing (Allerton), 2011 49th annual allerton conference on, IEEE
-
-
Karger, D.R.1
Oh, S.2
Shah, D.3
-
42
-
-
84896842331
-
Budget-optimal task allocation for reliable crowdsourcing systems
-
Karger DR, Oh S, Shah D (2014) Budget-optimal task allocation for reliable crowdsourcing systems. Oper Res 62(1):1–24
-
(2014)
Oper Res
, vol.62
, Issue.1
, pp. 1-24
-
-
Karger, D.R.1
Oh, S.2
Shah, D.3
-
45
-
-
80755168388
-
Crowdforge: crowdsourcing complex work
-
Kittur A, Smus B, Khamkar S, Kraut RE (2011) Crowdforge: crowdsourcing complex work. In: Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM, pp 43–52
-
(2011)
Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM
-
-
Kittur, A.1
Smus, B.2
Khamkar, S.3
Kraut, R.E.4
-
48
-
-
84922928478
-
Multicategory crowdsourcing accounting for variable task difficulty, worker skill, and worker intention
-
Kurve A, Miller DJ, Kesidis G (2015) Multicategory crowdsourcing accounting for variable task difficulty, worker skill, and worker intention. IEEE Trans Knowl Data Eng 27(3):794–809
-
(2015)
IEEE Trans Knowl Data Eng
, vol.27
, Issue.3
, pp. 794-809
-
-
Kurve, A.1
Miller, D.J.2
Kesidis, G.3
-
50
-
-
84993118608
-
-
Li H, Yu B (2014) Error rate bounds and iterative weighted majority voting for crowdsourcing
-
Li H, Yu B (2014) Error rate bounds and iterative weighted majority voting for crowdsourcing. arXiv:1411.4086
-
-
-
-
51
-
-
84906932246
-
Towards a general rule for identifying deceptive opinion spam. In: Proceedings of the 52nd annual meeting of the association for computational linguistics
-
Li J, Ott M, Cardie C, Hovy E (2014) Towards a general rule for identifying deceptive opinion spam. In: Proceedings of the 52nd annual meeting of the association for computational linguistics, ACL
-
(2014)
ACL
-
-
Li, J.1
Ott, M.2
Cardie, C.3
Hovy, E.4
-
52
-
-
84922280902
-
Segmentation-based image copy-move forgery detection scheme
-
Li J, Li X, Yang B, Sun X (2015) Segmentation-based image copy-move forgery detection scheme. IEEE Trans Inf Forensics Secur 10(3):507–518
-
(2015)
IEEE Trans Inf Forensics Secur
, vol.10
, Issue.3
, pp. 507-518
-
-
Li, J.1
Li, X.2
Yang, B.3
Sun, X.4
-
54
-
-
77949543086
-
Cost-sensitive learning
-
Ling CX, Sheng VS (2010) Cost-sensitive learning. In: Sammut C, Webb GI (eds) Encyclopedia of machine learning, Springer, pp 231–235
-
(2010)
Encyclopedia of machine learning, Springer
, pp. 231-235
-
-
Ling, C.X.1
Sheng, V.S.2
Sammut, C.3
Webb, G.I.4
-
55
-
-
70449657736
-
Turkit: tools for iterative tasks on mechanical turk
-
Little G, Chilton LB, Goldman M, Miller RC (2009) Turkit: tools for iterative tasks on mechanical turk. In: Proceedings of the ACM SIGKDD workshop on human computation, ACM, pp 29–30
-
(2009)
Proceedings of the ACM SIGKDD workshop on human computation, ACM
-
-
Little, G.1
Chilton, L.B.2
Goldman, M.3
Miller, R.C.4
-
56
-
-
84957964666
-
Detecting multiple stochastic network motifs in network data
-
Liu K, Cheung WK, Liu J (2015) Detecting multiple stochastic network motifs in network data. Knowl Inf Syst 42(1):49–74
-
(2015)
Knowl Inf Syst
, vol.42
, Issue.1
, pp. 49-74
-
-
Liu, K.1
Cheung, W.K.2
Liu, J.3
-
60
-
-
84931059008
-
Contextual correlates of semantic similarity
-
Miller GA, Charles WG (1991) Contextual correlates of semantic similarity. Lang Cognit Process 6(1):1–28
-
(1991)
Lang Cognit Process
, vol.6
, Issue.1
, pp. 1-28
-
-
Miller, G.A.1
Charles, W.G.2
-
62
-
-
84942293165
-
A unified statistical framework for crowd labeling
-
Muhammadi J, Rabiee HR, Hosseini A (2015) A unified statistical framework for crowd labeling. Knowl Inf Syst 45(2):271–294
-
(2015)
Knowl Inf Syst
, vol.45
, Issue.2
, pp. 271-294
-
-
Muhammadi, J.1
Rabiee, H.R.2
Hosseini, A.3
-
63
-
-
84898932626
-
Learning with noisy labels
-
Natarajan N, Dhillon IS, Ravikumar PK, Tewari A (2013) Learning with noisy labels. In: Advances in neural information processing systems, vol 26. pp 1196–1204
-
(2013)
Advances in neural information processing systems
, vol.26
, pp. 1196-1204
-
-
Natarajan, N.1
Dhillon, I.S.2
Ravikumar, P.K.3
Tewari, A.4
-
64
-
-
84883094853
-
Batc: a benchmark for aggregation techniques in crowdsourcing
-
Nguyen QVH, Nguyen TT, Lam NT, Aberer K (2013) Batc: a benchmark for aggregation techniques in crowdsourcing. In: Proceedings of the 36th international ACM SIGIR conference on research and development in information retrieval, ACM, pp 1079–1080
-
(2013)
Proceedings of the 36th international ACM SIGIR conference on research and development in information retrieval, ACM
-
-
Nguyen, Q.V.H.1
Nguyen, T.T.2
Lam, N.T.3
Aberer, K.4
-
65
-
-
84962869219
-
Label noise correction methods
-
Nicholson B, Zhang J, Sheng VS, Wang Z (2015) Label noise correction methods. In: IEEE International Conference on, IEEE, data science and advanced analytics (DSAA), 2015. 36678 2015, pp 1–9
-
(2015)
IEEE International Conference on, IEEE, data science and advanced analytics (DSAA), 2015
, vol.36678
, Issue.2015
, pp. 1-9
-
-
Nicholson, B.1
Zhang, J.2
Sheng, V.S.3
Wang, Z.4
-
67
-
-
84939876669
-
Transfer learning for Bayesian discovery of multiple Bayesian networks
-
Oyen D, Lane T (2015) Transfer learning for Bayesian discovery of multiple Bayesian networks. Knowl Inf Syst 43(1):1–28
-
(2015)
Knowl Inf Syst
, vol.43
, Issue.1
, pp. 1-28
-
-
Oyen, D.1
Lane, T.2
-
68
-
-
77956031473
-
A survey on transfer learning
-
Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359
-
(2010)
IEEE Trans Knowl Data Eng
, vol.22
, Issue.10
, pp. 1345-1359
-
-
Pan, S.J.1
Yang, Q.2
-
69
-
-
0028741835
-
Voting algorithms
-
Parhami B (1994) Voting algorithms. IEEE Trans Reliab 43(4):617–629
-
(1994)
IEEE Trans Reliab
, vol.43
, Issue.4
, pp. 617-629
-
-
Parhami, B.1
-
70
-
-
85021642385
-
Semeval-2007 task 17: english lexical sample, srl and all words
-
Pradhan SS, Loper E, Dligach D, Palmer M (2007) Semeval-2007 task 17: english lexical sample, srl and all words. In: Proceedings of the 4th international workshop on semantic evaluations, association for computational linguistics, pp 87–92
-
(2007)
Proceedings of the 4th international workshop on semantic evaluations, association for computational linguistics
-
-
Pradhan, S.S.1
Loper, E.2
Dligach, D.3
Palmer, M.4
-
71
-
-
84942249246
-
Class imbalance revisited: a new experimental setup to assess the performance of treatment methods
-
Prati RC, Batista GEAPA, Silva DF (2015) Class imbalance revisited: a new experimental setup to assess the performance of treatment methods. Knowl Inf Syst 45(1):247–270
-
(2015)
Knowl Inf Syst
, vol.45
, Issue.1
, pp. 247-270
-
-
Prati, R.C.1
Batista, G.E.A.P.A.2
Silva, D.F.3
-
74
-
-
84869096933
-
Robust ensemble learning for data mining
-
Springer, Berlin
-
Rätsch G, Schölkopf B, Smola AJ, Mika S, Onoda T, Müller KR (2000) Robust ensemble learning for data mining. Knowledge discovery and data mining. Current issues and new applications. Springer, Berlin, pp 341–344
-
(2000)
Knowledge discovery and data mining. Current issues and new applications
, pp. 341-344
-
-
Rätsch, G.1
Schölkopf, B.2
Smola, A.J.3
Mika, S.4
Onoda, T.5
Müller, K.R.6
-
75
-
-
84857856268
-
Eliminating spammers and ranking annotators for crowdsourced labeling tasks
-
Raykar VC, Yu S (2012) Eliminating spammers and ranking annotators for crowdsourced labeling tasks. J Mach Learn Res 13:491–518
-
(2012)
J Mach Learn Res
, vol.13
, pp. 491-518
-
-
Raykar, V.C.1
Yu, S.2
-
76
-
-
71149084080
-
Supervised learning from multiple experts: whom to trust when everyone lies a bit
-
Raykar VC, Yu S, Zhao LH, Jerebko A, Florin C, Valadez GH, Bogoni L, Moy L (2009) Supervised learning from multiple experts: whom to trust when everyone lies a bit. In: Proceedings of the 26th annual international conference on machine learning, ACM, pp 889–896
-
(2009)
Proceedings of the 26th annual international conference on machine learning, ACM
-
-
Raykar, V.C.1
Yu, S.2
Zhao, L.H.3
Jerebko, A.4
Florin, C.5
Valadez, G.H.6
Bogoni, L.7
Moy, L.8
-
77
-
-
77951954464
-
Learning from crowds
-
Raykar VC, Yu S, Zhao LH, Valadez GH, Florin C, Bogoni L, Moy L (2010) Learning from crowds. J Mach Learn Res 11:1297–1322
-
(2010)
J Mach Learn Res
, vol.11
, pp. 1297-1322
-
-
Raykar, V.C.1
Yu, S.2
Zhao, L.H.3
Valadez, G.H.4
Florin, C.5
Bogoni, L.6
Moy, L.7
-
78
-
-
84878784643
-
Learning from multiple annotators: distinguishing good from random labelers
-
Rodrigues F, Pereira F, Ribeiro B (2013) Learning from multiple annotators: distinguishing good from random labelers. Pattern Recogn Lett 34(12):1428–1436
-
(2013)
Pattern Recogn Lett
, vol.34
, Issue.12
, pp. 1428-1436
-
-
Rodrigues, F.1
Pereira, F.2
Ribeiro, B.3
-
80
-
-
77953088193
-
Who are the crowdworkers? Shifting demographics in mechanical turk
-
Ross J, Irani L, Silberman M, Zaldivar A, Tomlinson B (2010) Who are the crowdworkers? Shifting demographics in mechanical turk. In: CHI’10 extended abstracts on human factors in computing systems, ACM, pp 2863–2872
-
(2010)
CHI’10 extended abstracts on human factors in computing systems, ACM
-
-
Ross, J.1
Irani, L.2
Silberman, M.3
Zaldivar, A.4
Tomlinson, B.5
-
81
-
-
84870522605
-
Active learning literature survey
-
Settles B (2010) Active learning literature survey. Univ Wis Madison 52(55–66):11
-
(2010)
Univ Wis Madison
, vol.52
, Issue.55-66
, pp. 11
-
-
Settles, B.1
-
83
-
-
84965134289
-
Double or nothing: multiplicative incentive mechanisms for crowdsourcing
-
Shah NB, Zhou D (2015) Double or nothing: multiplicative incentive mechanisms for crowdsourcing. In: Advances in neural information processing systems, vol 28. pp 1–9
-
(2015)
Advances in neural information processing systems
, vol.28
, pp. 1-9
-
-
Shah, N.B.1
Zhou, D.2
-
85
-
-
65449144451
-
Get another label? improving data quality and data mining using multiple, noisy labelers
-
Sheng VS, Provost F, Ipeirotis PG (2008) Get another label? improving data quality and data mining using multiple, noisy labelers. In: Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 614–622
-
(2008)
Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM
-
-
Sheng, V.S.1
Provost, F.2
Ipeirotis, P.G.3
-
88
-
-
65449137414
-
Knowledge discovery in large image databases: dealing with uncertainties in ground truth
-
Smyth P, Burl MC, Fayyad UM, Perona P (1994) Knowledge discovery in large image databases: dealing with uncertainties in ground truth. In: KDD workshop, pp 109–120
-
(1994)
KDD workshop
-
-
Smyth, P.1
Burl, M.C.2
Fayyad, U.M.3
Perona, P.4
-
89
-
-
85153964878
-
Inferring ground truth from subjective labelling of venus images
-
Smyth P, Fayyad U, Burl M, Perona P, Baldi P (1995) Inferring ground truth from subjective labelling of venus images. In: Advances in Neural Information Processing Systems, vol 7. pp 1085–1092
-
(1995)
Advances in Neural Information Processing Systems
, vol.7
, pp. 1085-1092
-
-
Smyth, P.1
Fayyad, U.2
Burl, M.3
Perona, P.4
Baldi, P.5
-
90
-
-
80053360508
-
Cheap and fast—but is it good? Evaluating non-expert annotations for natural language tasks
-
Snow R, O’Connor B, Jurafsky D, Ng AY (2008) Cheap and fast—but is it good? Evaluating non-expert annotations for natural language tasks. In: Proceedings of the conference on empirical methods in natural language processing, association for computational linguistics, pp 254–263
-
(2008)
Proceedings of the conference on empirical methods in natural language processing, association for computational linguistics
-
-
Snow, R.1
O’Connor, B.2
Jurafsky, D.3
Ng, A.Y.4
-
94
-
-
85055620180
-
-
Sukhbaatar S, Bruna J, Paluri M, Bourdev L, Fergus R (2014) Training convolutional networks with noisy labels. arXiv:1406.2080
-
(2014)
Training convolutional networks with noisy labels. arXiv
, vol.1406
, pp. 2080
-
-
Sukhbaatar, S.1
Bruna, J.2
Paluri, M.3
Bourdev, L.4
Fergus, R.5
-
95
-
-
35348823168
-
Internet-scale collection of human-reviewed data
-
Su Q, Pavlov D, Chow JH, Baker WC (2007) Internet-scale collection of human-reviewed data. In: Proceedings of the 16th international conference on world wide web, ACM, pp 231–240
-
(2007)
Proceedings of the 16th international conference on world wide web, ACM
-
-
Su, Q.1
Pavlov, D.2
Chow, J.H.3
Baker, W.C.4
-
98
-
-
0036565589
-
An instance-weighting method to induce cost-sensitive trees
-
Ting KM (2002) An instance-weighting method to induce cost-sensitive trees. IEEE Trans Knowl Data Eng 14(3):659–665
-
(2002)
IEEE Trans Knowl Data Eng
, vol.14
, Issue.3
, pp. 659-665
-
-
Ting, K.M.1
-
99
-
-
84901749646
-
Chen L (2014) Crowdcleaner: data cleaning for multi-version data on the web via crowdsourcing
-
ICDE: IEEE
-
Tong Y, Cao CC, Zhang CJ, Li Y, Chen L (2014) Crowdcleaner: data cleaning for multi-version data on the web via crowdsourcing. In: 2014 IEEE 30th international conference on data engineering (ICDE), IEEE, pp 1182–1185
-
2014 IEEE 30th international conference on data engineering
, pp. 1182-1185
-
-
Tong, Y.1
Cao, C.C.2
Zhang, C.J.3
Li, Y.4
-
104
-
-
51749107030
-
recaptcha: Human-based character recognition via web security measures
-
Von Ahn L, Maurer B, McMillen C, Abraham D, Blum M (2008) recaptcha: Human-based character recognition via web security measures. Science 321(5895):1465–1468
-
(2008)
Science
, vol.321
, Issue.5895
, pp. 1465-1468
-
-
Von Ahn, L.1
Maurer, B.2
McMillen, C.3
Abraham, D.4
Blum, M.5
-
105
-
-
84873165828
-
Efficiently scaling up crowdsourced video annotation
-
Vondrick C, Patterson D, Ramanan D (2013) Efficiently scaling up crowdsourced video annotation. Int J Comput Vis 101(1):184–204
-
(2013)
Int J Comput Vis
, vol.101
, Issue.1
, pp. 184-204
-
-
Vondrick, C.1
Patterson, D.2
Ramanan, D.3
-
106
-
-
65749118363
-
Graphical models, exponential families, and variational inference
-
Wainwright MJ, Jordan MI (2008) Graphical models, exponential families, and variational inference. Found Trends Mach Learn 1(1–2):1–305
-
(2008)
Found Trends Mach Learn
, vol.1
, Issue.1-2
, pp. 1-305
-
-
Wainwright, M.J.1
Jordan, M.I.2
-
107
-
-
85006266573
-
Man vs. machine: practical adversarial detection of malicious crowdsourcing workers
-
USENIX Association, CA
-
Wang G, Wang T, Zheng H, Zhao BY (2014) Man vs. machine: practical adversarial detection of malicious crowdsourcing workers. In: 23rd USENIX security symposium, USENIX Association, CA
-
(2014)
In: 23rd USENIX security symposium
-
-
Wang, G.1
Wang, T.2
Zheng, H.3
Zhao, B.Y.4
-
110
-
-
0002949285
-
The problem with noise and small disjuncts
-
Weiss GM, Hirsh H (1998) The problem with noise and small disjuncts. In: ICML, pp 574–578
-
(1998)
ICML
-
-
Weiss, G.M.1
Hirsh, H.2
-
111
-
-
77956536129
-
Online crowdsourcing: rating annotators and obtaining cost-effective labels
-
IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW): IEEE
-
Welinder P, Perona P (2010) Online crowdsourcing: rating annotators and obtaining cost-effective labels. In: The 2010 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), IEEE, pp 25–32
-
(2010)
The
, vol.2010
, pp. 25-32
-
-
Welinder, P.1
Perona, P.2
-
112
-
-
85162055266
-
The multidimensional wisdom of crowds
-
Welinder P, Branson S, Perona P, Belongie SJ (2010) The multidimensional wisdom of crowds. In: Advances in neural information processing systems (NIPS), vol 23. pp 2424–2432
-
(2010)
Advances in neural information processing systems (NIPS)
, vol.23
, pp. 2424-2432
-
-
Welinder, P.1
Branson, S.2
Perona, P.3
Belongie, S.J.4
-
113
-
-
84961291654
-
A rapid learning algorithm for vehicle classification
-
Wen X, Shao L, Xue Y, Fang W (2015) A rapid learning algorithm for vehicle classification. Inf Sci 295:395–406
-
(2015)
Inf Sci
, vol.295
, pp. 395-406
-
-
Wen, X.1
Shao, L.2
Xue, Y.3
Fang, W.4
-
114
-
-
77951951247
-
Whose vote should count more: Optimal integration of labels from labelers of unknown expertise
-
Whitehill J, Wu Tf, Bergsma J, Movellan JR, Ruvolo PL (2009) Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In: Advances in neural information processing systems (NIPS), pp 2035–2043
-
(2009)
Advances in neural information processing systems (NIPS)
-
-
Whitehill, J.1
Tf, W.2
Bergsma, J.3
Movellan, J.R.4
Ruvolo, P.L.5
-
116
-
-
84881234522
-
A probabilistic model of active learning with multiple noisy oracles
-
Wu W, Liu Y, Guo M, Wang C, Liu X (2013) A probabilistic model of active learning with multiple noisy oracles. Neurocomputing 118:253–262
-
(2013)
Neurocomputing
, vol.118
, pp. 253-262
-
-
Wu, W.1
Liu, Y.2
Guo, M.3
Wang, C.4
Liu, X.5
-
118
-
-
77955004851
-
Crowdsearch: exploiting crowds for accurate real-time image search on mobile phones
-
Yan T, Kumar V, Ganesan D (2010a) Crowdsearch: exploiting crowds for accurate real-time image search on mobile phones. In: Proceedings of the 8th international conference on mobile systems, applications, and services, ACM, pp 77–90
-
(2010)
Proceedings of the 8th international conference on mobile systems, applications, and services, ACM
-
-
Yan, T.1
Kumar, V.2
Ganesan, D.3
-
120
-
-
80052400610
-
Modeling annotator expertise: learning when everybody knows a bit of something
-
Yan Y, Rosales R, Fung G, Schmidt MW, Valadez GH, Bogoni L, Moy L, Dy JG (2010c) Modeling annotator expertise: learning when everybody knows a bit of something. In: International conference on artificial intelligence and statistics, pp 932–939
-
(2010)
International conference on artificial intelligence and statistics
-
-
Yan, Y.1
Rosales, R.2
Fung, G.3
Schmidt, M.W.4
Valadez, G.H.5
Bogoni, L.6
Moy, L.7
Dy, J.G.8
-
122
-
-
0003585730
-
An introduction to Bayesian inference in econometrics
-
Wiley, New York
-
Zellner A (1996) An introduction to Bayesian inference in econometrics. Wiley, New York
-
(1996)
-
-
Zellner, A.1
-
123
-
-
84882759297
-
Research on crowdsourcing quality control strategies and evaluation algorithm
-
Zhang Z, Pang J, Xie X (2013) Research on crowdsourcing quality control strategies and evaluation algorithm. Chin J Comput 8:1636–1649
-
(2013)
Chin J Comput
, vol.8
, pp. 1636-1649
-
-
Zhang, Z.1
Pang, J.2
Xie, X.3
-
124
-
-
84937883035
-
Spectral methods meet em: a provably optimal algorithm for crowdsourcing
-
Zhang Y, Chen X, Zhou D, Jordan MI (2014) Spectral methods meet em: a provably optimal algorithm for crowdsourcing. In: Advances in neural information processing systems, vol 27. pp 1260–1268
-
(2014)
Advances in neural information processing systems
, vol.27
, pp. 1260-1268
-
-
Zhang, Y.1
Chen, X.2
Zhou, D.3
Jordan, M.I.4
-
126
-
-
84958244338
-
Improving label quality in crowdsourcing using noise correction
-
Zhang J, Sheng VS, Wu J, Fu X, Wu X (2015b) Improving label quality in crowdsourcing using noise correction. In: Proceedings of the 24th ACM international on conference on information and knowledge management, ACM, pp 1931–1934
-
(2015)
Proceedings of the 24th ACM international on conference on information and knowledge management, ACM
-
-
Zhang, J.1
Sheng, V.S.2
Wu, J.3
Fu, X.4
Wu, X.5
-
128
-
-
85027958625
-
Active learning with imbalanced multiple noisy labeling
-
Zhang J, Wu X, Shengs VS (2015d) Active learning with imbalanced multiple noisy labeling. IEEE Trans Cybern 45(5):1081–1093
-
(2015)
IEEE Trans Cybern
, vol.45
, Issue.5
, pp. 1081-1093
-
-
Zhang, J.1
Wu, X.2
Shengs, V.S.3
-
129
-
-
84963731561
-
Multi-class ground truth inference in crowdsourcing with clustering
-
Zhang J, Sheng V, Wu J, Wu X (2016) Multi-class ground truth inference in crowdsourcing with clustering. IEEE Trans Knowl Data Eng 28(4):1080–1085
-
(2016)
IEEE Trans Knowl Data Eng
, vol.28
, Issue.4
, pp. 1080-1085
-
-
Zhang, J.1
Sheng, V.2
Wu, J.3
Wu, X.4
|