Cognitively inspired task design to improve user performance on crowdsourcing platforms

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2014, Pages 3665-3674

  Sampath, Harini Alagarai ^a   Rajeshuni, Rajeev ^a   Indurkhya, Bipin ^a  

^a INTERNATIONAL INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

Cognitive Psychology; Crowdsourcing; Eye Tracking; Mechanical Turk; Task Design; Visual Saliency; Working Memory

Indexed keywords

HUMAN ENGINEERING; VISUALIZATION;

COGNITIVE PSYCHOLOGY; CROWDSOURCING; EYE-TRACKING; MECHANICAL TURKS; TASK DESIGN; VISUAL SALIENCY; WORKING MEMORY;

DESIGN;

EID: 84900392478     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2556288.2557155     Document Type: Conference Paper

References (30)

1. Baddeley, A. Working memory: Looking back and looking forward. Nature Reviews Neuroscience 4, 10 (2003), 829-839
2. Ballard, D. H., Hayhoe, M. M., Pook, P. K., and Rao, R. P. Deictic codes for the embodiment of cognition. Behavioral and Brain Sciences 20, 04 (1997), 723-742
3. Bates, D., Maechler, M., and Bolker, B. lme4: Linear mixed-effects models using s4 classes
4. Biewald, L., and Van Pelt, C. Distributing a task to multiple workers over a network for completion while providing quality control, 2011. WO Patent 2,011,159,434
5. Chen, K., Kannan, A., Yano, Y., Hellerstein, J. M., and Parikh, T. S. Shreddr: Pipelined paper digitization for low-resource organizations. In Proceedings of the 2nd ACM Symposium on Computing for Development, ACM (2012), 3
6. Clark, A. Supersizing the Mind: Embodiment, Action, and Cognitive Extension: Embodiment, Action, and Cognitive Extension. Oxford University Press, USA, 2008
7. Deshpande, Y. Adaptivity and Interface Design: A Human-Computer Interaction Study in E-Learning Applications. PhD thesis, Indian Institute of Technology, Guwahati, January 2014
8. Fisher, D. L., and Tan, K. C. Visual displays: The highlighting paradox. Human Factors: The Journal of the Human Factors and Ergonomics Society 31, 1 (1989), 17-30
9. Gamow, G., and Stern, M. Puzzle-math. Macmillan, 1958
10. Gray, W. D., Sims, C. R., Fu, W.-T., and Schoelles, M. J. The soft constraints hypothesis: A rational analysis approach to resource allocation for interactive behavior. Psychological review 113, 3 (2006), 461
11. Green, S., Heer, J., and Manning, C. D. The efficacy of human post-editing for language translation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2013), 439-448
12. Heer, J., and Bostock, M. Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2010), 203-212
13. Huang, E., Zhang, H., Parkes, D. C., Gajos, K. Z., and Chen, Y. Toward automatic task design: A progress report. In Proceedings of the ACM SIGKDD workshop on human computation, ACM (2010), 77-85
14. Ipeirotis, P. G., Provost, F., and Wang, J. Quality management on amazon mechanical turk. In Proceedings of the ACM SIGKDD workshop on human computation, ACM (2010), 64-67
15. Kittur, A., Chi, E. H., and Suh, B. Crowdsourcing user studies with mechanical turk. In Proceedings of the SIGCHI conference on human factors in computing systems, ACM (2008), 453-456
16. Komarov, S., Reinecke, K., and Gajos, K. Z. Crowdsourcing performance evaluations of user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2013), 207-216
17. Korf, R. E. Toward a model of representation changes. Artificial intelligence 14, 1 (1980), 41-78
18. Landauer, T. K. Latent semantic analysis. Encyclopedia of Cognitive Science (2006)
19. Law, E., and Ahn, L. v. Human computation. Synthesis Lectures on Artificial Intelligence and Machine Learning 5, 3 (2011), 1-121
20. Little, G., Chilton, L. B., Goldman, M., and Miller, R. C. Exploring iterative and parallel human computation processes. In Proceedings of the ACM SIGKDD workshop on human computation, ACM (2010), 68-76
21. Mason, W., and Watts, D. J. Financial incentives and the performance of crowds. ACM SigKDD Explorations Newsletter 11, 2 (2010), 100-108
22. Miller, G. The magical number seven, plus or minus two: Some limits on our capacity for processing information. The psychological review 63 (1956), 81-97
23. Morris, R., Dontcheva, M., and Gerber, E. Priming for better performance in microtask crowdsourcing environments. Internet Computing, IEEE 16, 5 (2012), 13-19
24. Olesen, P. J., Westerberg, H., and Klingberg, T. Increased prefrontal and parietal activity after training of working memory. Nature neuroscience 7, 1 (2003), 75-79
25. Paolacci, G., Chandler, J., and Ipeirotis, P. Running experiments on amazon mechanical turk. Judgment and Decision Making 5, 5 (2010), 411-419
26. Parent, G., and Eskenazi, M. Speaking to the crowd: Looking at past achievements in using crowdsourcing for speech and predicting future challenges. In INTERSPEECH (2011), 3037-3040
27. Toomim, M. Economic utility of interaction in crowdsourcing. In Workshop on Crowdsourcing and Human Computation at CHI (2011)
28. Treisman, A. Perceptual grouping and attention in visual search for features and for objects. Journal of Experimental Psychology: Human Perception and Performance 8, 2 (1982), 194-214
29. Wickens, C. D., Ambinder, M. S., Alexander, A. L., and Martens, M. The role of highlighting in visual search through maps. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 48 (2004), 1895-1899
30. Wolfe, J. M. Guided search 2. 0 a revised model of visual search. Psychonomic bulletin and review 1, 2 (1994), 202-238.