Evaluating design solutions using crowds

17th Americas Conference on Information Systems 2011, AMCIS 2011

Volumn 5, Issue , 2011, Pages 3923-3931

  Bao, Jin ^a   Sakamoto, Yasuaki ^a   Nickerson, Jeffrey V ^a  

^a STEVENS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Creativity; Crowdsourcing; Evaluation; Human based genetic algorithms; Mechanical turk

Indexed keywords

CROWDSOURCING; GENETIC ALGORITHMS; INFORMATION SYSTEMS; INFORMATION USE;

ALL SOLUTIONS; CREATIVITY; DESIGN SOLUTIONS; EVALUATION; EVALUATION METHODS; MECHANICAL TURKS;

QUALITY CONTROL;

EID: 84870319587     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.2139/ssrn.2201651     Document Type: Conference Paper

References (34)

1. von Ahn, L., and Dabbish, L. (2008). Designing games with a purpose. Communications of the ACM, 51(8), 58-67.
2. Amabile, T: (1996). Creativity in context. Westview Pr.
3. Asch, S. E. (1951). Effects of group pressure upon the modification and distortion of judgments. In H. Guetzkow (Ed.), Groups, leadership and men. Pittsburgh, PA; Carnegie Press.
4. Banerjee, A.J. C. Quiroz, and S. J. Louis. A model of creative design using collaborative interactive genetic algorithms. In Proceedings of the Third International Conference on Design Computing and Cognition, DCC08, 2008,
5. Bentley, P. J. and Come, D. W (eds) Creative Evolutionary Systems. SF: Morgan Kaufmann, 2002.
6. Crowston, K. (1997). A coordination theory approach to organizational process design. Organization-Science, 8(2) 157-175.
7. Deb, K., Multi-Objective Optimization Using Evolutionary Algorithms, Wiley, 2009
8. Dennis, A, and Williams, M. (2003). Electronic Brainstorming. Group creativity: Innovation through collaboration, 160-178.
9. Finke, R. A., Ward, T. B., and Smith, S. M. (1992). Creative Cognition: Theory, Research, and Application. Cambridge, MA: MIT Press.
10. Fogel, D. B. (2006). Evolutionary Computation: Toward a Hew Philosophy of Machine Intelligence, IEEE Press, Piscataway, NJ, Third Edition.
11. Gallupe, R. B., Dennis, A. R., Cooper, W. H., Valacich, J. S., Bastianutti, L. M. and Nunamaker, J, F. (1992), "Electronic Brainstorming and Group Size, " Academy of Management Journal, Vol. 35, No. 2, pp. 350-369.
12. Goldberg, D. E. (1989). Genetic Algorithms in Search, Optimization and Machine Learning. Kluwer Academic Publishers, Boston, MA.
13. Guilford, J. P. (1967). The nature of human intelligence. McGraw-Hill, New York.
14. Howe, J. (2006). The rise of crowdsourcing. Wired Magazine, (14), 1-4.
15. Kittur, A., Chi. L. H., and Suh, B. (2008), Crowdsourcing user studies with Mechanical Turk. In Proc. CHI 2008, ACM Press, (2008), 453-456.
16. Kosorukoff, A. (2001). Human based genetic algorithm. In Proc. IEEE Conference on Systems, Man, and Cybernetics, 3464-3469.
17. Little, G., Chilton, L. B., Goldman, M., and Miller, R. C. (2010). Exploring iterative and parallel human computation processes. In Proc. of the ACM SIGKDD Workshop on Human Computation, 68-76.
18. Love, B. C. (2005). Environment and goals jointly direct category acquisition. Current Directions in Psychological Science, 14, 195-199.
19. Malone, T. W., Laubacher, R, and Dellarocas, C. (2010). Harnessing crowds: Mapping the genome of collective intelligence, CCI Working Paper 2009-001.
20. McKnight, D. H., Choudhury, V. and Kacmar, C. (2002) Developing and Validating Trust Measures for e-Commerce: An Integrative Typology Information Systems Research, 13, 3, 334-359.
21. Malon, T.W., Laubacher, R., and Dellarocas, C.: Harnessing crowds: Mapping the genome of collective intelligence. MIT Sloand School Working Paper 4732-09, (2010)
22. Montoya-Weiss, M.M., Massey, A. P. and Song, M. (2001). Getting it together: temporal coordination and conflicts management in global virtual teams. Academy of Management Journal, 44, 6, 1251-1262.
23. Mumford, M. D. (2003). Where have we been, where are we going? Taking stock in creativity research. Creativity Research Journal, 15, 107-120.
24. Nickerson, J. V., and Sakamoto, Y. (2010). Crowdsourcing creativity: Combining ideas in networks. Workshop on Information in Networks. New York, NY.
25. Nickerson, J. V., Sakamoto, Y., and Yu, L. (2011). Structures for creativity: The crowdsourcing of design. CHI Workshop on Crowdsourcing and Human Computation
26. Osborn, A. F. (1957). Applied Imagination. New York: Scribner.
27. Paul, S., Haseman, W. D. and Ramamurthy;, K. (2004) Collective memory and cognitive-conflict group decision-making: An experimental investigation. Decision Support Systems, 36, 3, 261-281.
28. Quinn, A. J., and Bederson, B. B. (2011). Human Computation: A Survey and Taxonomy of a Growing Field. CHI.
29. Runco, M A., and Pritzker, S. R. (1999). Encyclopedia of Creativity. San Diego: Academic Press.
30. Surowiecki, J. (2004). The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies; and nations. New York: Random House.
31. Takagi, H. (1998), Interactive Evolutionary Computation: System Optimization Based on Human Subjective Evaluation, IEEE International Conference on Intelligent Engineering Systems
32. Wagner, C., and Back, A. (2008). Group wisdom support systems: Aggregating the insights of many through information technology, Issues in Information Systems, 9, 343-350.
33. Ward, T. B., Smith, S. M., and Vaid, J. (1997). Creative Thought: An Investigation of Conceptual Structures and Processes. Washington, DC: APA Books.
34. Yu, L., and Nickerson, J. V. (2011). Cooks or cobblers? Crowd creativity through combination, CHI 2011, ACM Press.