From sensing to controlling: The state of the art in ubiquitous crowdsourcing

International Journal of Communication Networks and Distributed Systems

Volumn 11, Issue 1, 2013, Pages 11-25

  Vukovic, Maja ^a   Das, Rajarshi ^a   Kumara, Soundar ^b  

^a IBM T J WATSON RESEARCH CENTER   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Crowdsensing; Crowdsourcing; Mobile; Ubiquitous

Indexed keywords

COMPLEX NETWORKS; QUALITY CONTROL;

CROWDSENSING; HUMAN NETWORKS; INCENTIVE DESIGN; MOBILE; STATE OF THE ART; TASK COMPLEXITY; UBIQUITOUS; WIDE SPECTRUM;

CROWDSOURCING;

EID: 84880123328     PISSN: 17543916     EISSN: 17543924     Source Type: Journal    
DOI: 10.1504/IJCNDS.2013.054832     Document Type: Article

References (66)

1. Allan, S. (2007) 'Citizen journalism and the rise of 'mass self-communication': reporting the London bombings', Global Media Journal, Australian Edition.
2. Amazon Mechanical Turk (2012) available at http://www.mturk.com (accessed on 14 February 2012).
3. Banzi, M. (2008) Getting Started With Arduino, O'Reilly Media/Make.
4. Brabham, D. (2008) 'Crowdsourcing as a model for problem solving: an introduction and cases. Convergence', The International Journal of Research into New Media Technologies, Vol. 14, No. 1, pp.75-90.
5. Brabham, D.C. (in press) 'Crowdsourcing: a model for leveraging online communities', in Delwiche, A. and Henderson, J. (Eds.): The Routledge Handbook of Participatory Culture.
6. Bryant, S.L., Forte, A. and Bruckman, A. (2005) 'Becoming Wikipedian: transformation of participation in a collaborative online encyclopedia', in Proceedings of the International Conference on Supporting Group Work.
7. Burke, J., Estrin, D., Hansen, M., Parker, A., Ramanathan N., Reddy S. and Srivastava, M. (2006) 'Participatory sensing', in Proceedings of World Sensor Web.
8. Clery, D. (2011) 'Galaxy zoo volunteers share pain and glory of research', Science, Vol. 333, No. 6039, pp.173-175.
9. Danis, C., Ellis, J.B, Kellogg, W.A., van Beijma, H., Hoefman, B., Daniels, S.B. and Loggers, J-W. (2011) 'Mobile phones for health education in the developing world: SMS as a user interface', Proceedings of First Annual Symposium on Computing for Development.
10. Darpa Network Challenge (2010) available at http://archive.darpa.mil/ networkchallenge/ (accessed on 14 February 2012).
11. Das, R. and Vukovic, M. (2011) 'emerging theories and models for human computation: a brief survey', Workshop on Ubiquitous Crowdsourcing, International Conference on Ubiquitous Computing.
12. Eagle, N. (2009) 'txteagle: mobile crowdsourcing', Internationalization, Design and Global Development, LNCS 5623, pp.447-456.
13. Erickson, T. (2010) 'Geocentric crowdsourcing and smarter cities: enabling urban intelligence in cities and regions', Workshop on Ubiquitous Crowdourcing, International Conference on Ubiquitous Computing.
14. Farrell, R., Rajput, N., Das, R., Danis, C. and Danesha, K. (2010) 'Social Navigation for the spoken web', Proceedings of the Fourth ACM Conference on Recommender System.
15. Foursquare (2012) available at http://www.foursquare.com (accessed on 14 February 2012).
16. Ghosh, A. and Hummel, P. (2011) 'A game-theoretic analysis of rank-order mechanisms for usergenerated content', Proceedings of the Conference on Electronic Commerce.
17. Gigwalk (2012) available at http://gigwalk.com (accessed on 14 February 2012).
18. GoldCorp Challenge (2000) available at http://www.goldcorpchallenge.com/ (accessed on 14 February 2012).
19. Govindaraj, D., Naidu, K.V.M., Nandi, A., Narlikar, G. and Poosala, V. (2011) 'MoneyBee: towards enabling a ubiquitous, efficient, and easy-to-use mobile crowdsourcing service in the emerging market', Bell Laboratories Technical Journal, Vol. 15, No. 4, pp.79-92.
20. Heymann P. and Garcia-Molina, H. (2011) 'Turkalytics: analytics for human computation', in Proceedings of the International Conference on World Wide Web.
21. Ho, C. and Chen, K. (2009) 'On formal models of social verification', Human Computation Systems, Human Computation Workshop.
22. Ho, C., Chang, T. and Hsu J. (2007) 'PhotoSlap: a multi-player online game for semantic annotation', Proceedings of the 22nd AAAI Conference.
23. Horton, J. and Chilton, L. (2010) 'The labor economics of paid crowdsourcing', Proceedings of the Electronic Commerce Conference.
24. How's my street? (2010) 'Crowdsourcing app lets you know', IT World, available at http://www.cityzenmobile.com/howsmystreet/ (accessed on 14 February 2012).
25. Innocentive (2012) available at http://www.innocentive.com (accessed on 14 February 2012).
26. Ipeirotis, P.G. (2010a) 'Analyzing the Amazon mechanical Turk marketplace', XRDS, Vol. 17, No. 2.
27. Ipeirotis, P.G. (2010b) 'Demographics of mechanical Turk', NYU Working Paper No. CEDER-10-01.
28. Jain, S. and Parkes, D. (2009) 'The role of game theory in human computation systems', Human Computation Workshop.
29. Kaji, K., Yano., M. and Kawaguchi., N. (2011) 'App.Locky: users' context collecting platform for context-aware application recommendation', Workshop on Ubiquitous Crowdsourcing, International Conference on Ubiquitous Computing.
30. Kencl, L. (2010) 'Dilemmas facing mobile applications', Invited talk, Workshop on Ubiquitous Crowdourcing, International Conference on Ubiquitous Computing.
31. Kern, R., Thies, H., Bauer, C. and Satzger, G. (2010) 'Quality assurance for human-based electronic services: a decision matrix for choosing the right approach', in Proceedings of First Enterprise Crowdsourcing Workshop at International Conference on Web Engineering.
32. Kim, S., Robson, C., Zimmerman, T., Pierce, J. and Haber, E.M. (2011) 'Creek watch: pairing usefulness and usability for successful citizen science', in Proceedings of the Computer Human Interaction Conference.
33. Kittur, A., Chi, E. and Suh, B. (2008) 'Crowdsourcing user studies with mechanical Turk', Computer Human Interaction, pp.453-456.
34. Konomi S. (2011) 'Beyond mobile collaboration: toward metropolitan-scale geocentric crowdsourcing', Workshop on Ubiquitous Crowdsourcing, International Conference on Ubiquitous Computing, Beijing.
35. Lamont, I. (2010) 'A plane lands on the Hudson River, and Twitter documents it all', available at http://www.computerworld.com/s/article/9126181/ Plane-lands-on-the-Hudson-and-Twitter-documents-it-all (accessed on 14 February 2012).
36. Laredo J., Vukovic M. and Rajagopal, S. (2011) 'Service for crowd-driven gathering of nondiscoverable knowledge', in Proceedings of International Conference on Service Oriented Computing.
37. Liu, Y., Lehdonvirta, V., Kleppe, M., Alexandrova, T., Kimura, H. and Nakajima, T. (2010) 'A crowdsourcing based mobile image translation and knowledge sharing service', in Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia.
38. LiYing, C., Kumara, S. and Albert, R. (2010) 'Complex networks: an engineering view', Circuits and Systems Magazine, IEEE, pp.10-25.
39. Madireddy, M., Medeiros, D.J. and Kumara, S. (2011) 'An agent based model for evacuation traffic management', Winter Simulation Conference, Arizona, USA.
40. Malone, T., Laubacher R. and Dellarocas C. (2009) 'Harnessing crowds: mapping the genome of collective intelligence', Working Paper No. 2009-001, MIT Center for Collective Intelligence.
41. Mashhadi, A. and Capra, L. (2011) 'Quality control for real-time ubiquitous crowdsourcing', Workshop on Ubiquitous Crowdsourcing, International Conference on Ubiquitous Computing.
42. Mason, W. and Watts, D. (2009) 'Financial incentives and the performance of crowds', Proceedings of Workshop on Human Computation.
43. Mooney P., Sun H. and Yan L. (2011) 'VGI as a dynamically updating data source in locationbased services in urban environments', Workshop on Ubiquitous Crowdsourcing, International Conference on Ubiquitous Computing.
44. Noveck, B.S. (2006) 'Peer to patent: collective intelligence, open review, and patent reform', Harvard Journal of Law and Technology, Vol. 20, pp.123-162.
45. Oakland County, MI (2009) Ideas, available at http://oakgov.ideascale. com/ (accessed on 14 February 2012).
46. OpenStreetMap (2012) available at http://www.openstreetmap.org/ (accessed on 14 February 2012).
47. Palatino, D. and Vojnovic, M. (2009) 'Crowdsourcing and all-pay auctions', Proceedings of the 10th Conference on Electronic Commerce.
48. Paxton, M. and Benford, S. (2009) 'Experiences of participatory sensing in the wild', in Proceedings of International Conference on Ubiquitous Crowdsourcing.
49. Pfleging B., Sahami Shirazi A., Steinbeg, M. and Schmidt, A. (2011) 'Towards an application platform that allows access to sensors in the car', in Proceedings of Computer Human Interaction Conference.
50. Quinn, A.J. and Bederson, B.B. (2011) 'Human computation: a survey and taxonomy of a growing field', in Proceedings Of Computer Human Interaction.
51. Reddy, S., Estrin, D., Hansen, M., Srivastava, M. (2010) 'Examining micro-payments for participatory sensing data collections', Proceedings of the International Conference on Ubiquitous Computing.
52. Reyes, A., Vukovic, M. and Laredo, J. (2010) 'Towards crowdsourcing for disaster management', Workshop on Ubiquitous Crowdsourcing, International Conference on Ubiquitous Computing.
53. Rogstadius, J., Kostakos, V., Kittur, A., Smus, B., Laredo, J. and Vukovic, M. (2011) 'An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets', in Proceedings of the Conference on Weblogs and Social Media, pp.321-328.
54. Stevens, M. and D'Hondt, E. (2010) 'Crowdsourcing of pollution data using smartphones', Workshop on Ubiquitous Crowdsourcing, International Conference on Ubiquitous Computing.
55. Sudit, D. and Kumara, S. (2012) 'Quantitative techniques for soft information fusion', Proceedings of the Industrial and Systems Engineering Research Conference, Orlando, Florida.
56. Threadless (2012) available at http://www.threadless.com (accessed on 14 February 2012).
57. Torrey, C., Burke, M., Lee, M., Dey, A., Fussler, S. and Kiesler, S. (2007) 'Connected giving: ordinary people coordinating disaster relief on the internet', Hawaii International Conference on System Sciences.
58. Ushahidi (2012) available at http://www.ushahidi.org (accessed on 15 February 2012).
59. Von Ahn, L., Blum, M., Hopper, N. and Langford, J. (2003) 'CAPTCHA: using hard AI problems for security', Proceedings of Eurocrypt.
60. Vukovic, M. and Naik, V. (2011) 'Managing enterprise IT systems using online communities', Proceedings of Services Computing Conference.
61. Whitia, P. (2009) 'Crowdsourcing and its application in marketing activities', Contemporary Management Research, Vol. 5, No. 1, pp.15-28.
62. Wicks, P., Massagli, M., Frost, J., Brownstein, C., Okun, S., Vaughan, T., Bradley, R. and Heywood, J. (2010) 'Sharing health data or better outcomes on patients like me', Journal of Medical Internet Research.
63. Wing, J. (2008) 'Five deep questions in computing', Communications of the ACM, Vol. 51, No. 1, pp.58-60.
64. Yan, T., Marzilli, M., Holmes, R., Ganesan, D. and Corner, M. (2009) 'mCrowd: a platform for mobile crowdsourcing', Proceedings of the Conference on Embedded Networked Sensor Systems.
65. Yan, Y., Rosales, R., Fung, G. and Dy. J. (2011) 'Active learning from crowds', Proceedings of the International Conference on Machine Learning.
66. Zimmerman, J., Tomasic, A., Garrod, C., Yoo, D., Hiruncharoenvate, C., Aziz, R., Thiruvengadam, N.R., Huang, Y. and Steinfeld, A. (2011) 'Field trial of Tiramisu: crowd-sourcing bus arrival times to spur co-design', Proceedings of Computer Human Interaction.