Relationship between quality and payment in crowdsourced design

Proceedings of the 2014 IEEE 18th International Conference on Computer Supported Cooperative Work in Design, CSCWD 2014

Volumn , Issue , 2014, Pages 499-504

  Wu, Hao ^a   Corney, Jonathan ^a   Grant, Michael ^a  

^a UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

Amazon Mechanical Turk (MTurk); crowdsourcing; crowdsourcing demographics; design productivity; interior design; open innovation

Indexed keywords

ARCHITECTURAL DESIGN; INNOVATION; INTERACTIVE COMPUTER SYSTEMS; INTERNET; PRODUCT DESIGN;

AMAZON MECHANICAL TURKS; CROWDSOURCING; DESIGN PRODUCTIVITY; INTERIOR DESIGNS; OPEN INNOVATION;

INTERIORS (BUILDING);

EID: 84904609211     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CSCWD.2014.6846895     Document Type: Conference Paper

References (32)

1. R. Whitfield, A. Duffy, G. Coates, and W. Hills, "Distributed design coordination," Res. Eng. Des., vol. 13, pp. 243-252, 2002.
2. S.-w. Hsiao and J.-R. Chou, "A creativity-based design process for innovative product design," Int. J. Ind. Ergon., vol. 34, no. 5, pp. 421-443, Nov. 2004.
3. R. G. Cooper and E. J. Kleinschmidt, "An Investigation into the New Product Process: Steps, Deficiencies, and Impact," J. Prod. Innov. Manag., vol. 3, no. 2, pp. 71-85, Jun. 1986.
4. D. Dougherty, "Interpretive Barriers To Successful Product Innovation In Large Firms," Organ. Sci., vol. 3, 1992.
5. J. Howe, "The rise of crowdsourcing," Wired Mag., no. 14, pp. 1-5, 2006.
6. Yochai Benkler, "The wealth of networks: How social production transforms markets and freedom," Yale Univ. Press, 2006.
7. A. Kittur, E. H. Chi, and B. Suh, "Crowdsourcing user studies with Mechanical Turk," Proceeding twenty-sixth Annu. CHI Conf. Hum. Factors Comput. Syst. - CHI '08, P. 453, 2008.
8. D. Brabham, "Crowdsourced advertising: how we outperform Madison Avenue," Flow A Crit. Forum Telev. Media Cult., 2009.
9. L. B. Jeppesen and L. Frederiksen, "Why Do Users Contribute to Firm-Hosted User Communities? The Case of Computer-Controlled Music Instruments," Organ. Sci., vol. 17, no. 1, pp. 45-63, Jan. 2006.
10. R. V. Kozinets, A. Hemetsberger, and H. J. Schau, "The Wisdom of Consumer Crowds: Collective Innovation in the Age of Networked Marketing," J. Macromarketing, vol. 28, no. 4, pp. 339-354, Dec. 2008.
11. C. Hogue, "Crowdsourcing for science," Chem. Eng. News, 2011.
12. S. Chilton, "Crowdsourcing is radically changing the geodata landscape: Case study of OpenStreetMap," 24th Int. Cartogr. Conf., 2009.
13. M. Haklay and P. Weber, "Openstreetmap: User-generated street maps," Pervasive Comput. IEEE, pp. 12-18, 2008.
14. O. Stewart, J. Huerta, and M. Sader, "Designing crowdsourcing community for the enterprise," ACM SIGKDD Work. Hum. Comput., pp. 50-53, 2009.
15. L. Yu and J. Nickerson, "Cooks or cobblers?: crowd creativity through combination," CHI 2011, May 7-12, Vancouver, BC, Canada, 2011.
16. L. Yu and J. Nickerson, "Generating creative ideas through crowds: An experimental study of combination," in Thirty Second International Conference on Information Systems, Shanghai 2011.
17. L. Yu and Y. Sakamoto, "Feature selection in crowd creativity," Found. Augment. Cogn. Dir. ..., pp. 383-392, 2011.
18. A. F. Osborn, Applied imagination; principles and procedures of creative problem-solving. Published by Scribner's, 1957.
19. T. Amabile, Creativity in Context: Update to the Social Psychology of Creativity. Westview Press, June 7, 1996.
20. J. Bao, Y. Sakamoto, and J. Nickerson, "Evaluating Design Solutions Using Crowds," in Seventeenth Americas Conference on Information Systems, August 4th-7th, Detroit, Michigan, 2011.
21. G. Paolacci, J. Chandler, and P. Ipeirotis, "Running experiments on amazon mechanical turk," Judgm. Decis. Mak., vol. 5, no. 5, pp. 411-419, 2010.
22. M. Kosinski and Y. Bachrach, "Crowd IQ: Measuring the intelligence of crowdsourcing platforms," in WebSci '12 Proceedings of the 3rd Annual ACM Web Science Conference, NY, USA, 2012, pp. 151-160.
23. A. P. Jagadeesan, A. Lynn, J. R. Corney, X. T. Yan, J. Wenzel, A. Sherlock, and W. Regli, "Geometric reasoning via internet CrowdSourcing," 2009 SIAM/ACM Jt. Conf. Geom. Phys. Model. -SPM '09, P. 313, 2009.
24. J. R. Corney and C. Torres-Sanchez, "Putting the crowd to work in a knowledge-based factory," Adv. Eng. Informatics, vol. 24, no. 3, pp. 243-250, Aug. 2010.
25. J. Horton and L. Chilton, "The labor economics of paid crowdsourcing," in Proceedings of the 11th ACM conference on EC'10, June 7-11, 2010, no. 1, pp. 209-218.
26. G. Kazai, "In Search of Quality in Crowdsourcing for Search Engine Evaluation," pp. 165-176, 2011.
27. J. Nickerson, Y. Sakamoto, and L. Yu, "Structures for creativity: The crowdsourcing of design," in CHI 2011 Workshop on Crowdsourcing and Human Computation: Systems, Studies, and Platforms, May 8, 2011, Vancouver, BC, Canada.
28. J. Ross, L. Irani, and M. Silberman, "Who are the crowdworkers?: shifting demographics in mechanical turk," Proc. 28th ..., pp. 2863-2872, 2010.
29. S. Khanna, A. Ratan, J. Davis, and W. Thies, "Evaluating and improving the usability of Mechanical Turk for low-income workers in India," ACM DEV'10, December 17-18, 2010, London, United Kingdom, 2010.
30. L. Yu, "Crowd creativity through combination," Proc. 8th ACM Conf. Creat. Cogn. - C&C '11, P. 471, 2011.
31. M. Maher, "Design creativity research: From the individual to the crowd," Des. Creat. 2010, 2011.
32. "Amazon Mechanical Turk-Wikipedia," 2013. [Online]. Available: http://en.wikipedia.org/wiki/Amazon-Mechanical-Turk#cite-note-awsdevforum-6.