Generating creative ideas through crowds: An experimental study of combination

International Conference on Information Systems 2011, ICIS 2011

Volumn 4, Issue , 2011, Pages 3513-3528

  Yu, Lixiu ^a   Nickerson, Jeffrey V ^a  

^a STEVENS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Combination; Creativity; Crowdsourcing; Design; Idea generation; Innovation

Indexed keywords

COMBINATION; COMBINATION SYSTEMS; COMBINED DESIGN; CREATIVITY; CROWDSOURCING; DESIGN PROBLEMS; IDEA GENERATION; INITIAL DESIGN;

INFORMATION SYSTEMS; INNOVATION;

DESIGN;

EID: 84884647365     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (71)

1. von Ahn, L. and Dabbish, L. 2004. Labeling images with a computer game. Proc. CHI 2004, ACM Press, 319-326.
2. Amabile, T. 1996. Creativity in context. Colorado: Westview Press.
3. Amabile, T. 1998. How to kill creativity. Harvard Business Review, September-October, 77-87. Amazon Mechanical Turk. https://www.mturk.com/mturk/welcome.
4. Bederson, B. B., Hu, C., and Resnik, P. 2010. Translation by iterative collaboration between monolingual users. Proc. Graphics Interface (GI) conference.
5. Benkler, Y. 2006. The wealth of networks: How social production transforms markets and freedom, CT: Yale University Press.
6. Bernstein, M.S., Little, G., Miller, R.C., Hartmann, B., Ackerman, M.S., Karger, D.R., Crowell, D., and Panovich, K. 2010. Soylent: a word processor with a crowd inside. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). ACM, New York, NY, USA, 313-322.
7. Biewald L. and Allick M. 2011. Massive multiplayer Human Computation for fun, money, and survival. CHI 2011 Workshop on Crowdsourcing and Human Computation.
8. Bao, J., Sakamoto, Y., and Nickerson, J. V. 2011. Evaluating Design Solutions Using Crowds, AMCIS.
9. Boden, M. A. 1996. Dimensions of creativity. MA: The MIT Press.
10. Brabham, D. 2010. Moving the crowd at Threadless: Motivations for participation in a crowdsourcing application. Information, Communication and Society. 13:1122-1145.
11. Buckley P. and Carter M. 2004. A formal analysis of knowledge combination in multinational entrprises, Journal of international business studies, 35.
12. Chesbrough, H., Vanhaverbeke, W., West, J. 2006. Open Innovation: Researching a New Paradigm. UK: Oxford University Press
13. Crowston, K., Wei K., Howison J., Wiggins A. Free/Libre Open Source Software Development: What we know and what we do not know, ACM computing surveys, in press.
14. Davis, L. 1987. Genetic Algorithms and Simulated Annealing. Los Altos, CA: Morgan Kaufman.
15. Deb, K. 2001. Multi-objective optimization using evolutionary algorithms. UK: Wiley, Chichester.
16. Dennis, A.R., Valacich, J.S., Connolly, T., and Wynne, B.E. 1996. Process structuring in electronic brainstorming. Information Systems Research, 7 (2):268.
17. Diehl, M., and Stroebe, W. 1987. Productivity loss in brainstorming groups: Toward the solution of a riddle. Journal of personality and social psychology, 53(3), 497.
18. Ebel R.L. 1951. Estimation of the reliability of ratings. Psychometrika, 16:407-424.
19. Eveleens, C. 2010. Innovation management; a literature review of innovation process models and their implications. Lectoraat Innovatie Publieke Sector.
20. Finke R. 1990. Creative imagery: Discoveries and inventions in visualization, New York: Lawrence
21. Erlbaum Finke, R. A., Ward, T. B., and Smith, S. M. 1996. Creative cognition: Theory, research, and applications. MA: MIT press.
22. Fleming, L. 2001. Recombinant uncertainty in technological search, Management Science. 47 (1): 117-132.
23. George, J. 2007. Creativity in organizations. Academy of Management Annals, 1(1), 439-477.
24. Gero J. S., and Maher M. L. (eds) 1993. Modeling creativity and knowledge-based creative design. Hillside, NJ: Lawrence Erlbaum.
25. Goldschmidt, G., and Litan Sever A. 2009. From text to design solution: inspiring design ideas with texts. Paper presented at International Conference on Engineering design, ICED'09.
26. Goldberg, D. E. 1989. Genetic Algorithms in Search, Optimization and Machine Learning, MA: Kluwer Academic Publishers.
27. Gooding, D. C. 2010. Visualizing scientific inference. Topics in Cognitive Science, 2 (1):15-35.
28. Google Docs Drawing Application. http://docs0.google.com/demo/edit?id=scACRQaIm3t83kVISWPhWfrqx#drawing
29. Gulley, N. 2001. Patterns of innovation: a web-based MATLAB programming contest. CHI'01 extended abstracts on Human factors in computing systems.
30. Hargadon, A. and Bechky, B. 2006. When collections of creatives become creative collectives: A field study of problem solving at work. Organization Science, 17(4), 484-500.
31. Hayek, F. A. 1945. The use of knowledge in society, American Economic review, 35(4), 519-530.
32. Henderson, R. M. and Clark, K. B. 1990. Architectural innovation: the reconfiguration of existing product technologies and the failure of established firms. Administrative science Quarterly, 35 (1).
33. Hevner, A., March, S., Park, J., and Ram, S. 2004. Design Science in information systems research, MIS Quarterly, 28: 1, 75-105.
34. Holland. J. H. 1975. Adaptation in Natural and Artificial Systems. Ann Arbor: University of Michigan Press.
35. Howe, J. 2006. The Rise of Crowdsourcing, Wired, 14(6), URL (accessed 8 September 2011): http://www.wired.com/wired/archive/14.06/crowds.html
36. Kosorukoff, A. 2001. Human based genetic algorithm. Paper presented at IEEE Conference on Systems, Man, and Cybernetics.
37. Kittur, A., Chi, E.H., and Suh, B. 2008. Crowdsourcing user studies with Mechanical Turk. Proc. CHI 2008, ACM, 453-456.
38. Kohn, N. W., Paulus, P. B. and Choi, Y. 2011. Building on the ideas of others: An examination of the idea combination process. Journal of Experimental Social Psychology, 47, 554-561.
39. Leimeister, J. M., Huber, M., Bretschneider, U., and Krcmar, H. 2009. Leveraging crowdsourcing-Activation-Supporting components in IT-based idea competitions. Journal of Management Information Systems, 26(1), 197-224.
40. Litchfield, R. C. 2008. Brainstorming reconsidered: A goal-based view. The Academy of Management Review Archive, 33(3), 649-668.
41. Malone, T. W., Laubacher, R., and Dellarocas, C. N., 2009. Harnessing crowds: Mapping the genome of collective intelligence. MIT Sloan Research, Paper No. 4732-09. Available at SSRN: http://ssrn.com/abstract=1381502
42. Mullen, B., Johnson C., and Salas E. 1991. Productivity loss in brainstorming groups: A meta-analytic integration, Basic and Applied Social Psychology, 72(1), 3-23.
43. Mumford, M. D., Mobley, M. I., Uhlman, C. E., Reiter-Palmon, R, and Doares, L. 1991. Process analytic models of creative thought. Creativity Research Journal, 4, 91-122.
44. Nelson, R. R. and Winter S. G. 1982. An evolutionary theory of economic change. Cambridge: Belknap Press/Harvard University Press.
45. Nickerson, J.V. and Sakamoto, Y. Crowdsourcing Creativity: Combining Ideas in Networks, Workshops on Information in Networks, 2010
46. Nickerson, J.V., Sakamoto, Y. and Yu, L., Structures for Creativity: The Crowdsourcing of Design, Workshop at CHI, 2011.
47. Nunamaker, J.F., Dennis, A.R., Valacich, J.S., Vogel, D., and George, J.F. 1991. Electronic meeting systems. Communications of the ACM, 34 (7), 40-61.
48. Olsson, O. and Frey B. 2002. Entrepreneurship as recombinant growth, Small business Economics, 19: 69-80.
49. Osborn, A.F. 1957. Applied imagination: Principles and procedures of creative problem solving (Third Revised Edition). New York: Charles Scribner's Sons.
50. Paulus, P. B., Larey, T. S., and Ortega, A. H. 1995. Performance and perceptions of brainstormers in an organizational setting. Basic and Applied Social Psychology, 17, 249-265.
51. Putman, V. L., and Paulus, P. B. 2009. Brainstorming, brainstorming rules and decision making. Journal of Creative Behavior, 43, 23-39.
52. Piller, F. T. 2010. Open innovation with customers: Crowdsourcing and co-creation at threadless. Available at SSRN: http://ssrn.com/abstract=1688018
53. Quinn, A. J., Bederson, B. B. Human Computation: A Survey and Taxonomy of a Growing Field. Proc. CHI 2011.
54. Raykar, V. C., Yu, S., Zhao, L. H., Valadez, G. H., Florin, C., Bogoni, L., and Moy, L. 2010. Learning from crowds. Journal of Machine Learning Research. 11, 7, 1297-1322.
55. Rietzschel, E. F., Nijstad, B. A., and Stroebe, W. 2006. Productivity is not enough: A comparison of interactive and nominal brainstorming groups on idea generation and selection. Journal of Experimental Social Psychology, 42, 244-251.
56. Ross, J., Irani, L., Silberman, M.S., Zaldivar, A., and Tomlinson, B. 2010. Who are the crowdworkers? Shifting demographics in Mechanical Turk. In: alt.CHI session of CHI 2010 Extended Abstracts on Human Factors in Computing Systems.
57. Sakamoto Y. and Bao, J. Testing Tournament Selection in Creative Problem Solving with Crowds, ICIS 2011.
58. Simonton, D. K. 2003. Scientific creativity as constrained stochastic behavior: The integration of product, person, and process perspectives. Psychological Bulletin, 129, 475-494.
59. Simonton, D. K. 2004. Creativity in science: Chance, Logic, Genius and Zeitgeist, New York: Cambridge University Press.
60. Smith, S. M., Ward, T. B., and Schumacher, J. S. 1993. Constraining effects of examples in a creative generation task. Memory and Cognition, 21(6), 837-845.
61. Solomon, D. J. 2004. The rating reliability calculator. BMC Medical Research Methodology 4: 11.
62. Spears, W. M. 1993. Crossover or mutation? In Foundations of Genetic Algorithms 2, edited by L.D. Whitley. CA: Morgan Kaufmann.
63. Stevens, G. A. and Burley, J. 1997. 3000 Raw ideas=1 Commercial success!, Research-Technology Management, 16-27.
64. Taylor, A., and Greve, H. R. 2006. Superman or the fantastic four? Knowledge combination and experience in innovative teams. Academy of Management Journal, 49(4), 693-706.
65. Thagard, P. 1992. Conceptual revolutions. New Jersey: Princeton University Press.
66. Tolstoy D. 2009. Knowledge combination and knowledge creation in a foreign-market network. Journal of small business management, 47(2), 202-220
67. Tversky, B. and Chou, J. 2010. Creativity: depth and breadth. Paper presented at the First International Conference on Design Creativity.
68. Yu, L. and Nickerson, J.V. Cooks or Cobblers? Crowd Creativity through Combination. Proceedings of the CHI'11 Conference on Human Factors in Computing Systems, ACM Press, 2011.
69. Yu L. and Sakamoto, Y. 2011. Feature Selection in Crowd Creativity. HCII, Springer.
70. Yu L., Sakamoto, Y., and Nickerson, J.V. 2011. Feature Propagation in Idea Networks. Workshop on Information in Networks.
71. Wasko, M. M. L., and Faraj, S. 2005. Why should I share? Examining social capital and knowledge contribution in electronic networks of practice. MIS Quarterly, 29(1), 35-57.