A pilot study of using crowds in the classroom

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2013, Pages 227-236

  Dow, Steven ^a   Gerber, Elizabeth ^b   Wong, Audris ^c  

^a Carnegie Mellon University ^*  (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Crowdsourcing; Education; Feedback; Innovation

Indexed keywords

CLASSROOM SETTINGS; CROWDSOURCING; FACE-TO-FACE INTERACTION; HIGHER EDUCATION; INNOVATION PROCESS; INNOVATION WORKS; SOCIOTECHNICAL; STUDENT LEARNING;

EDUCATION; FEEDBACK; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; INNOVATION;

STUDENTS;

EID: 84877950437     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2470654.2470686     Document Type: Conference Paper

References (60)

1. Bao, P., Gerber, E., Gergle, D., and Hoffman, D. Momentum: getting and staying on topic during a brainstorm. Proc of conf on Human factors in computing systems, ACM (2010), 1233-1236.
2. Bernstein, M.S., Brandt, J., Miller, R.C., and Karger, D.R. Crowds in two seconds: enabling realtime crowd-powered interfaces. Proc ACM symposium on User interface software and technology, ACM (2011), 33-42.
3. Beyer, H. Contextual Design: Defining Customer-Centered Systems. Morgan Kaufmann, 1997.
4. Blumenfeld, P., Soloway, E., Marx, R., Krajcik, J., Guzdial, M., and Palincsar, A. Motivating Project-Based Learning: Sustaining the Doing, Supporting the Learning. Educational Psychologist 26, 3 (1991), 369-398.
5. Chandler, D. and Kapelner, A. Breaking monotony with meaning: Motivation in crowdsourcing markets. University of Chicago mimeo, (2010).
6. Collins, A., Brown, J., & Holum, A. Cognitive Apprenticeship: Making Thinking Visible. American Educator, 6-46.
7. Cynthia J Atman, D.K. Characterizing design learning: A mixed-methods study of engineering designers' use of language. (2008).
8. Davidoff, S., Lee, M.K., Dey, A.K., and Zimmerman, J. Rapidly Exploring Application Design Through Speed Dating. Proceedings of Ubicomp, (2007).
9. Dow, S.P., Kulkarni, A., Klemmer, S.R., and Hartmann, B. Shepherding the Crowd Yields Better Work. In Proc of Computer Supported Cooperative Work, (2012).
10. Dym, C.L., Agogino, A.M., Frey, D.D., and Leifer, L.J. Engineering Design Thinking, Teaching, and Learning. Journal of Engineering Education 94, (2005), 103-120.
11. Fixson, S.K. Teaching Innovation through Interdisciplinary Courses and Programmes in Product Design and Development: An Analysis at 16 US Schools. Creativity and Innovation Management 18, 3 (2009), 199-208.
12. George, J.M. 9 Creativity in Organizations. The Academy of Management Annals 1, 1 (2007), 439-477.
13. Gerber, E., Olson, J.M., and Komarek, R. Extracurricular Design-Based Learning. International Journal of Engineering Education 28, 2 (2012).
14. Heer, J. and Bostock, M. Crowdsourcing graphical perception: using mechanical turk to assess visualization design. Proceedings of the intl conference on Human Factors in Computing Systems, ACM (2010), 203-212.
15. Howe, J. Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business. Crown Business, 2008.
16. Ipeirotis, P.G. Analyzing the Amazon Mechanical Turk marketplace. XRDS: Crossroads, The ACM Magazine for Students 17, 2010, 16-21.
17. Kittur, A., Chi, E.H., and Suh, B. Crowdsourcing user studies with Mechanical Turk. Proc of conference on Human factors in computing systems, (2008), 453.
18. Kohavi, R., Henne, R.M., and Sommerfield, D. Practical guide to controlled experiments on the web: listen to your customers not to the hippo. Proc of ACM intl conf on Knowledge discovery and data mining (2007), 959-967.
19. Kolko, J. Abductive Thinking and Sensemaking: The Drivers of Design Synthesis. Design Issues 26, 1 (2011), 15-28.
20. Kolodner, J., Hmelo, C.E., and Narayanan, N.H. Learning by Design™ from Theory to Practice. In Proc of Intl Conference of the Learning Sciences, (1998), 16-22.
21. Kuratko, D.F. The Emergence of Entrepreneurship Education: Development, Trends, and Challenges. Entrepreneurship Theory and Practice 29, 5 (2005), 577-598.
22. Lewis, S., Dontcheva, M., and Gerber, E. Affective computational priming and creativity. Proc of the conf on Human factors in computing systems, ACM (2011), 735-744.
23. Lewitt, T. Creativity Is Not Enough. Harvard Business Review, 2002.
24. Mckenna, A.F., Colgate, J.E., Carr, S.H., and Olson, G.B. IDEA: Formalizing the Foundation for an Engineering Design Education. International Journal of Engineering Education 22, 3 (2006), 671-678.
25. Miron, E., Erez, M., and Naveh, E. Do personal characteristics and cultural values that promote innovation, quality, and efficiency compete or complement each other? Journal of Organizational Behavior 25, 2 (2004), 175-199.
26. Osborn, A.F. Applied Imagination: Principles and Procedures of Creative Problem Solving. Charles Scribner's Sons, 1963.
27. Peterman, N.E. and Kennedy, J. Enterprise Education: Influencing Students' Perceptions of Entrepreneurship. Entrepreneurship Theory and Practice 28, 2 (2003), 129-144.
28. Plaschka, G. and Welsch, H. Emerging Structures in Entrepreneurship Education: Curricular Designs and Strategies. SSRN eLibrary, (1990).
29. Ross, J., Irani, L., Silberman, M.S., Zaldivar, A., and Tomlinson, B. Who are the crowdworkers? In extended abstracts on Human Factors in Computing Systems, (2010).
30. Shaffer, D.W. and Resnick, M. "Thick" authenticity: new media and authentic learning. J. Interact. Learn. Res. 10, 2 (1999), 195-215.
31. Siroker, D. How Obama Raised $60 Million by Running a Simple Experiment. 2010. http://blog.optimizely.com/howobama-raised-60-million-by- running-an-exp.
32. Sternberg, R.J. Handbook of Creativity. Cambridge University Press, 1998.
33. Strauss, A.C. and Corbin, J.M. Grounded Theory in Practice. Sage Publications, Inc, 1997.
34. Terwiesch, C. and Ulrich, K. Innovation Tournaments: Creating and Selecting Exceptional Opportunities. Harvard Business Press, 2009.
35. Thomke, S.H. Experimentation Matters: Unlocking the Potential of New Technologies for Innovation. Harvard Business Press, 2003.
36. Tidbell, B., Mulder, I., and Stappers, P.J. Online Design Contests: A Network of Inspiration for Designers. (2011).
37. Wang, H.-C., Cosley, D., and Fussell, S.R. Idea expander: supporting group brainstorming with conversationally triggered visual thinking stimuli. Proc of ACM conf on Computer Supported Cooperative Work, (2010), 103-106.
38. Westerberg, C. and Wickersham, C. Internships Have Value, Whether or Not Students Are Paid. The Chronicle of Higher Education, 2011.
39. Xu, A. and Bailey, B.P. A crowdsourcing model for receiving design critique. In extended abstracts on Human Factors in Computing Systems, ACM (2011), 1183-1188.
40. Yu, L. and Nickerson, J.V. Cooks or cobblers?: crowd creativity through combination. Proc of ACM conf on Human Factors in Computing Systems, (2011), 1393-1402.
41. Innocentive. www.innocentive.com.
42. oDesk. https://www.odesk.com.
43. 99designs: http://99designs.com/.
44. Crowdspring. www.crowdspring.com.
45. Optimizely. www.optimizely.com.
46. Indiegogo. www.indiegogo.com.
47. Facebook. www.facebook.com.
48. Google Ad Words. https://adwords.google.com.
49. Coffee Joulies on Kickstarter. http://www.kickstarter.com/projects/ 705847536/coffeejoulies-your-coffee-just-right.
50. Open Innovation. www.openinnovation.net.
51. Case Study. http://en.wikipedia.org/wiki/Case-study.
52. Coursera. www.coursera.org.
53. Stanford Technology Ventures. http://stvp.stanford.edu/.
54. FIRST Robotics Competition. www.pittsburghfirst.org/.
55. Solar Car Teams. http://en.wikipedia.org/wiki/List-of-solar-car-teams.
56. Tartan Hacks. www.tartanhacks.com.
57. Newgrounds. http://www.newgrounds.com/.
58. MindSwarms. www.mindswarms.com.
59. Qualtrics. www.qualtrics.com.
60. IndieGoGo blog. http://www.indiegogo.com/blog/.