Idea Generation and the Role of Feedback: Evidence from Field Experiments with Innovation Tournaments

Production and Operations Management

Volumn 26, Issue 1, 2017, Pages 80-99

  Wooten, Joel O ^a   Ulrich, Karl T ^b  

^a UNIVERSITY OF SOUTH CAROLINA   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

contest; creativity; crowdsourcing; feedback; innovation

Indexed keywords

EID: 84988556575     PISSN: 10591478     EISSN: 19375956     Source Type: Journal    
DOI: 10.1111/poms.12613     Document Type: Article

References (34)

1. Adamczyk, S., J. Haller, A. C. Bullinger, K. M. Möslein. 2011. Knowing is silver, listening is gold: On the importance and impact of feedback in IT-based innovation contests. A. Bernstein, G. Schwabe, eds. Proceedings of the 10th International Conference on Wirthschaftsinformatik, vol. 1, Zurich, Switzerland, 221–230.
2. Archak, N. 2010. Money, glory and cheap talk: Analyzing strategic behavior of contestants in simultaneous innovation contests on TopCoder.com. Proceedings of the 19th International Conference on World Wide Web, WWW 2010, Raleigh, North Carolina, USA, April 26-30, 2010. ACM New York, NY, 21–30.
3. Barankay, I. 2011. Rankings and social tournaments: Evidence from a crowd-sourcing experiment. Working paper, Wharton School of Business, Philadelphia, PA.
4. Baum, C. F., A. Nichols, M. E. Schaffer. 2010. Evaluating one-way and two-way cluster-robust covariance matrix estimates. Presentation, 16th UK Stata User Group Meeting, September 17.
5. Bockstedt, J., A. Mishra, C. Druehl. 2016. Heterogeneous submission behavior and its implications for success in innovation contests with public submissions. Prod. Oper. Manag. 25(7): 1157–1176.
6. Boudreau, K. J., N. Lacetera, K. R. Lakhani. 2011. Incentives and problem uncertainty in innovation contests: An empirical analysis. Management Sci. 57(5): 843–863.
7. Bull, C., A. Schotter, K. Weigelt. 1987. Tournaments and piece rates: An experimental study. J. Polit. Econ. 95(1): 1–33.
8. Cameron, A. C., J. B. Gelbach, D. L. Miller. 2008. Bootstrap-based improvements for inference with clustered errors. Rev. Econ. Stat. 90(3): 414–427.
9. Che, Y. K., I. Gale. 2003. Optimal design of research contests. Am. Econ. Rev. 93(3): 646–671.
10. Dahan, E., H. Mendelson. 2001. An extreme value model of concept testing. Management Sci. 47(1): 102–116.
11. Eriksson, T., A. Poulsen, M. C. Villeval. 2009. Feedback and incentives: Experimental evidence. Labour Econ. 16(6): 679–688.
12. Evans, W. N. 2013. Outline of the Wild Bootstrap Procedure in Cameron et al. Supplemental Materials. University of Notre Dame, Notre Dame, IN.
13. Feng, Z., P. Diehr, A. Peterson, D. McLerran. 2001. Selected statistical issues in group randomized trials. Annu. Rev. Public Health 22(1): 167–187.
14. Freeman, R. B., A. M. Gelber. 2010. Prize structure and information in tournaments: Experimental evidence. Am. Econ. J. Appl. Econ. 2(1): 149–164.
15. Fullerton, R. L., R. P. McAfee. 1999. Auctioning entry into tournaments. J. Polit. Econ. 107(3): 573–605.
16. Girotra, K., C. Terwiesch, K. T. Ulrich. 2010. Idea generation and the quality of the best idea. Management Sci. 56(4): 591–605.
17. Highsmith, J. A. 1978. Solving design problems more effectively. MIS Quart. 2(4): 23–30.
18. Katz, R. 1982. The effects of group longevity on project communication and performance. Adm. Sci. Q. 27(1): 81–104.
19. Keller, R. T. 1986. Predictors of the performance of project groups in R & D organizations. Acad. Manag. J. 29(4): 715–726.
20. Kline, S. J., N. Rosenberg. 1986. An overview of innovation. R. Landau, N. Rosenberg, eds. The Positive Sum Strategy: Harnessing Technology for Economic Growth. National Academy Press, Washington, DC, 275–305.
21. Kluger, A. N., A. DeNisi. 1996. The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol. Bull. 119(2): 254–284.
22. Kornish, L. J., K. T. Ulrich. 2011. Opportunity spaces in innovation: Empirical analysis of large samples of ideas. Management Sci. 57(1): 107–128.
23. Lakhani, K. R., L. B. Jeppesen, P. A. Lohse, J. A. Panetta. 2007. The value of openness in scientific problem solving. Working paper 07-050, Harvard Business School, Boston, MA.
24. Locke, E. A., G. P. Latham. 1990. A Theory of Goal Setting and Task Performance. Prentice Hall, Englewood Cliffs, NJ.
25. March, J. G. 1991. Exploration and exploitation in organizational learning. Organ. Sci. 2(1): 71–87.
26. Moulton, B. R. 1990. An illustration of a pitfall in estimating the effects of aggregate variables on micro units. Rev. Econ. Stat. 72(2): 334–338.
27. Seshadri, S., Z. Shapira. 2003. The flow of ideas and timing of evaluation as determinants of knowledge creation. Ind. Corp. Change 12(5): 1099–1124.
28. Skinner, B. F. 1948. Superstition in the pigeon. J. Exp. Psychol. 38(2): 168–172.
29. Taylor, C. R. 1995. Digging for golden carrots: An analysis of research tournaments. Am. Econ. Rev. 85(4): 872–890.
30. Terwiesch, C., K. T. Ulrich. 2009. Innovation Tournaments: Creating and Selecting Exceptional Opportunities. Harvard Business School Press, Boston, MA.
31. Terwiesch, C., Y. Xu. 2008. Innovation contests, open innovation, and multiagent problem solving. Management Sci. 54(9): 1529–1543.
32. Vosniadou, S. 1994. Capturing and modeling the process of conceptual change. Learn. Instr. 4(1): 45–69.
33. Wooten, J. O., K. T. Ulrich. 2015. The impact of visibility in innovation tournaments: Evidence from field experiments. Working paper, Moore School of Business and The Wharton School, Columbia, SC and Philadelphia, PA.
34. Yang, Y., P. Y. Chen, P. Pavlou. 2010. Managing open innovation contests in online market. Working paper, Temple University, Philadelphia, PA.