Combining crowdsourcing and learning to improve engagement and performance

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2014, Pages 3379-3388

  Dontcheva, Mira ^a   Morris, Robert ^b   Brandt, Joel ^a   Gerber, Elizabeth M ^c  

^a ADOBE RESEARCH   (United States)

^b MIT MEDIA LAB   (United States)

^c NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Crowdsourcing; Games; Training

Indexed keywords

HUMAN ENGINEERING; TEACHING;

ADOBE PHOTOSHOP; CROWDSOURCING; CROWDSOURCING PLATFORMS; GAMES; LEARNING EXPERIENCES; PRIOR EXPERIENCE; REAL-WORLD IMAGE; SKILLED WORKERS;

PERSONNEL TRAINING;

EID: 84900457719     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2556288.2557217     Document Type: Conference Paper

References (20)

1. Amabile, T. M. Creativity and innovation in organizations. Harvard Business School, 1996.
2. Bergman, L., Castelli, V., Lau, T., and Oblinger, D. Docwizards: A system for authoring follow-me documentation wizards. In Proceedings of UIST (2005), 191-200.
3. Bernstein, M. S., Brandt, J., Miller, R. C., and Karger, D. R. Crowds in two seconds: Enabling realtime crowd-powered interfaces. In Proceedings of UIST (2011), 33-42.
4. Bernstein, M. S., Little, G., Miller, R. C., Hartmann, B., Ackerman, M. S., Karger, D. R., Crowell, D., and Panovich, K. Soylent: A word processor with a crowd inside. In Proceedings of UIST (2010), 313-322.
5. Cohen, J. A coefficient of agreement for nominal scales. Educational and psychological measurement, 1 (1960), 37-46.
6. Cooper, S., Khatib, F., Treuille, A., Barbero, J., Lee, J., Beenen, M., Leaver-Fay, A., Baker, D., Popovic, Z., and players, F. Predicting protein structures with a multiplayer online game. Nature 446 (2010), 756-760.
7. Dong, T., Dontcheva, M., Joseph, D., Karahalios, K., Newman, M., and Ackerman, M. Discovery-based games for learning software. In Proceedings of SIGCHI (2012), 2083-2086.
8. Dow, S., Kulkarni, A., Klemmer, S., and Hartmann, B. Shepherding the crowd yields better work. In Proceedings of CSCW (2012), 1013-1022.
9. Guilford, J. P. The nature of human intelligence. McGraw-Hill, 1967.
10. Heer, J., and Bostock, M. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of SIGCHI (2010), 203-212.
11. Kaufman, J. C., Plucker, J. A., and Baer, J. Essentials of creativity assessment, vol. 53. Wiley, 2008.
12. Kittur, A., Smus, B., Khamkar, S., and Kraut, R. E. Crowdforge: Crowdsourcing complex work. In Proceedings of UIST (2011), 43-52.
13. Kulkarni, A., Can, M., and Hartmann, B. Collaboratively crowdsourcing workflows with turkomatic. In Proceedings of the CSCW (2012), 1003-1012.
14. Lewis, S., Dontcheva, M., and Gerber, E. Affective computational priming and creativity. In Proceedings of SIGCHI (2011), 735-744.
15. Li, W., Grossman, T., and Fitzmaurice, G. Gamicad: A gamified tutorial system for first time autocad users. In Proceedings of UIST (2012), 103-112.
16. Morris, R. R., Dontcheva, M., Finkelstein, A., and Gerber, E. Affect and creative performance on crowdsourcing platforms. In Proceedings of ACII (2013).
17. Pongnumkul, S., Dontcheva, M., Li, W., Wang, J., Bourdev, L., Avidan, S., and Cohen, M. F. Pause-and-play: Automatically linking screencast video tutorials with applications. In Proceedings of UIST (2011), 135-144.
18. Puccio, G., and Murdock, Mary, E. Creativity Assessment: Readings and Resources. Creative Education Foundation Press, Buffalo, NY, USA, 1999.
19. von Ahn, L., and Dabbish, L. Labeling images with a computer game. In Proceedings of the SIGCHI (2004), 319-326.
20. Zhang, H., Dow, S., Kraut, R., and Kittur, A. Reviewing versus doing: Learning and performance in crowd assessment. In Proceedings of CSCW (2014).