Debiasing crowdsourced quantitative characteristics in local businesses and services

IPSN 2015 - Proceedings of the 14th International Symposium on Information Processing in Sensor Networks (Part of CPS Week)

Volumn , Issue , 2015, Pages 190-201

  Ouyang, Robin Wentao ^a   Kaplan, Lance ^b   Martin, Paul ^a   Toniolo, Alice ^c   Srivastava, Mani ^a   Norman, Timothy J ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b U S ARMY RESEARCH LABORATORY   (United States)

^c UNIVERSITY OF ABERDEEN   (United Kingdom)

Author keywords

Crowdsourcing; Humans as sensors; Probabilistic graphical models; Truth discovery

Indexed keywords

INFERENCE ENGINES; INFORMATION SCIENCE; RECREATIONAL FACILITIES; SENSOR NETWORKS;

BIAS AND VARIANCE; CROWD MANAGEMENTS; CROWDSOURCING; NUMBER OF PEOPLES; PROBABILISTIC GRAPHICAL MODELS; PROBABILISTIC MODELING; QUANTITATIVE CHARACTERISTICS; TRUTH DISCOVERY;

DATA HANDLING;

EID: 84954100230     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2737095.2737116     Document Type: Conference Paper

References (31)

1. M. S. Bernstein, G. Little, R. C. Miller, B. Hartmann, M. S. Ackerman, D. R. Karger, D. Crowell, and K. Panovich. Soylent: a word processor with a crowd inside. In UIST, pages 313-322. ACM, 2010.
2. C. M. Bishop and N. M. Nasrabadi. Pattern recognition and machine learning. Springer New York, 2006.
3. J. A. Burke et al. Participatory sensing. Center for Embedded Network Sensing, 2006.
4. A. T. Campbell, S. B. Eisenman, N. D. Lane, E. Miluzzo, and R. A. Peterson. People-centric urban sensing. In Proceedings of the 2nd annual international workshop on Wireless internet, page 18. ACM, 2006.
5. A. P. Dawid and A. M. Skene. Maximum likelihood estimation of observer error-rates using the em algorithm. Applied Statistics, pages 20-28, 1979.
6. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological), pages 1-38, 1977.
7. J. M. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5):604-632, 1999.
8. N. D. Lane et al. Urban sensing systems: opportunistic or participatory? In HotMobile, pages 11-16. ACM, 2008.
9. M. Marge, S. Banerjee, and A. I. Rudnicky. Using the amazon mechanical turk for transcription of spoken language. In ICASSP, pages 5270-5273. IEEE, 2010.
10. P. Mohan et al. Nericell: rich monitoring of road and traffic conditions using mobile smartphones. In SenSys, pages 323-336. ACM, 2008.
11. R. W. Ouyang et al. If you see something, swipe towards it: crowdsourced event localization using smartphones. In UbiComp, pages 23-32. ACM, 2013.
12. R. W. Ouyang et al. Truth discovery in crowdsourced detection of spatial events. In CIKM, pages 461-470. ACM, 2014.
13. R. W. Ouyang, A.-S. Wong, and C.-T. Lea. Received signal strength-based wireless localization via semidefinite programming: noncooperative and cooperative schemes. IEEE TVT, 59(3):1307-1318, 2010.
14. J.-g. Park et al. Growing an organic indoor location system. In MobiSys, pages 271-284. ACM, 2010.
15. J. Pasternack and D. Roth. Knowing what to believe (when you already know something). In COLING, pages 877-885. Association for Computational Linguistics, 2010.
16. A. J. Quinn and B. B. Bederson. Human computation: a survey and taxonomy of a growing field. In CHI, pages 1403-1412. ACM, 2011.
17. V. C. Raykar et al. Learning from crowds. The Journal of Machine Learning Research, 99:1297-1322, 2010.
18. S. Reddy et al. Recruitment framework for participatory sensing data collections. In Pervasive Computing, pages 138-155. Springer, 2010.
19. T. Sakaki, M. Okazaki, and Y. Matsuo. Earthquake shakes twitter users: real-time event detection by social sensors. In WWW, pages 851-860. ACM, 2010.
20. M. Srivastava, T. Abdelzaher, and B. Szymanski. Human-centric sensing. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 370(1958):176-197, 2012.
21. D. Wang et al. On truth discovery in social sensing: a maximum likelihood estimation approach. In IPSN, pages 233-244. ACM, 2012.
22. D. Wang et al. On credibility estimation tradeoffs in assured social sensing. IEEE JSAC, 31(6):1026-1037, 2013.
23. D. Wang et al. Using humans as sensors: An estimation-theoretic perspective. In IPSN, pages 35-46. IEEE, 2014.
24. H. Wang et al. No need to war-drive: unsupervised indoor localization. In MobiSys, pages 197-210. ACM, 2012.
25. H. Wang, D. Lymberopoulos, and J. Liu. Local business ambience characterization through mobile audio sensing. In WWW, pages 293-304. ACM, 2014.
26. Y. Wang et al. Tracking human queues using single-point signal monitoring. In MobiSys, pages 42-54. ACM, 2014.
27. P. Welinder et al. The multidimensional wisdom of crowds. In NIPS, pages 2424-2432, 2010.
28. J. Whitehill et al. Whose vote should count more: Optimal integration of labels from labelers of unknown expertise. In NIPS, pages 2035-2043, 2009.
29. J. Yick, B. Mukherjee, and D. Ghosal. Wireless sensor network survey. Computer networks, 52(12):2292-2330, 2008.
30. X. Yin, J. Han, and P. S. Yu. Truth discovery with multiple conflicting information providers on the web. IEEE TKDE, 20(6):796-808, 2008.
31. B. Zhao et al. A bayesian approach to discovering truth from conflicting sources for data integration. VLDB Endowment, 5(6):550-561, 2012.