Idea evaluation mechanisms for collective intelligence in open innovation communities: Do traders outperform

International Conference on Information Systems 2011, ICIS 2011

Volumn 4, Issue , 2011, Pages 3059-3082

  Blohm, Ivo ^a   Riedl, Christoph ^b   Leimeister, Jan Marco ^c   Krcmar, Helmut ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b HARVARD UNIVERSITY   (United States)

^c UNIVERSITY OF KASSEL   (Germany)

Author keywords

Cognitive load theory; Collective intelligence; Communities; Crowdsourcing; Idea evaluation; Information aggregation; Open innovation; Prediction markets; Rating scales; Web 2.0

Indexed keywords

COGNITIVE LOAD THEORY; COLLECTIVE INTELLIGENCES; CROWDSOURCING; IDEA EVALUATIONS; INFORMATION AGGREGATION; OPEN INNOVATION; PREDICTION MARKETS; RATING SCALE; WEB 2.0;

COMMERCE; ECOSYSTEMS; FORECASTING; INFORMATION SYSTEMS; RATING; SURVEYS;

INNOVATION;

EID: 84884653196     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (151)

1. Amabile, T.M. 1996. Creativity in Context. Update to Social Psychology of Creativity, (1 ed.). Oxford: Westview Press.
2. Armstrong, J.S., and Collopy, F. 1992. "Error Measures for Generalizing About Forecasting Methods: Empirical Comparisons " International Journal of Forecasting (8:1), pp. 69-80.
3. Arrow, K.J., Forsythe, R., Gorham, M., Hahn, R., Ledyard, J.O., Levmore, S., Litan, R., Milgrom, P., Nelson, F.D., Neumann, G.R., Ottaviani, M., Schelling, T.C., Shiller, R.J., Smith, V.L., Snowberg, E., Sunstein, C.R., Tetlock, P.C., Tetlock, P.E., Varian, H.R, Wolfers, J., and Zitzewitz, E. 2008. "The Promise of Prediction Markets," Science (320:5878), pp. 877-878.
4. Baddeley, A. 1986. Working Memory, (1 ed.). Oxford, UK: Oxford University Press.
5. Bagozzi, R.P., and Yi, Y. 1988. "On the Evaluation of Structural Equatation Models," Journal of the Academy of Marketing Sciences (16:1), pp. 74-94.
6. Bajaj, A., and Nidumolu, S.R. 1998. "A Feedback Model to Understand Information System Usage," Information & Management (33:4), pp. 213-224.
7. Benbasat, I., and Zmud, R. 2003. "The Identity Crisis within the Is Discipline: Defining and Communicating the Discipline's Core Properties," MIS Quarterly (27:2), pp. 183-194.
8. Berg-Jensen, M., Hienerth, C, and Lettl, C. 2010. "Forecasting the Attractiveness of User-Generating Designs Via Online-Data," in: 2010 Acadamey of Management Annual Meeting. Montreal, Canada.
9. Berg, H., and Proebsting, T.A. 2009. "Hanson's Automated Market Maker," The Journal of Prediction Markets (3:1), pp. 45-59.
10. Berg, J.E., and Rietz, TA. 2003. "Prediction Markets as Decision Support Systems," Information Systems Frontiers (5:1), pp. 79-93.
11. Berthold, A., and Jameson, A. 1999. "Interpreting Symptoms of Cognitive Load in Speech Input," in: Proceedings of the seventh international conference on User modeling. Banff, Canada: Springer-Verlag New York, Inc.
12. Blohm, I., Bretschneider, U, Leimeister, J.M., and Krcmar, H. 2011a. "Does Collaboration among Participants Lead to Better Ideas in It-Based Idea Competitions? An Empirical Investigation," International Journal of Networking and Virtual Organizations (9:2), pp. 106-122.
13. Blohm, I., Koroglu, O., Leimeister, J.M., and Krcmar, H. 2011b. "Absorptive Capacity for Open Innovation Communities-Learnings from Theory and Practice," in: 2011 Academy of Management Annual Meeting. San Antonio, Texas/USA.,
14. M. Luckner S., and Weinhardt, C. 2010. "Fraud Detection in Play-Money Prediction Markets," Information Systems and E-Business Management (8:4), pp. 395-413.
15. Boer, K., Kaymak, U., and Spiering, J. 2007. "From Descrete-Time Models to Continuous-Time Asynchronous Modeling of Financial Markets," Computational Intelligence (23:2), pp. 142-161.
16. Bogers, M., Afuah, A., and Bastian, B. 2010. "Users as Innovators: A Review, Critique, and Future Research Directions," Journal of Management (36:4), pp. 857-875.
17. Bonabeau, E. 2009. "Decision 2.0: The Power of Collective Intelligence," MIT Sloan Management Review (50:2), pp. 44-52.
18. Bothos, E., Apostolou, D., and Mentzas, G. 2009. "Collective Intelligence for Idea Management with Internet-Based Information Aggregation Markets," Internet Research (19:1), pp. 26-41.
19. Botti, S., and Iyengar, S.S. 2006. "The Dark Side of Choice: When Choice Impairs Social Welfare," Journal of Public Policy & Marketing (25:1), pp. 24-38.
20. Boudreau, M.-C, Gefen, D., and Straub, D.W. 2001. "Validation in Information Systems Research: A State-of-the-Art Assessment," MIS Quarterly (25:1), pp. 1-16
21. Bretschneider, U. 2011. "Die Ideen Community Zur Integration Von Kunden in Die Frühen Phasen Des Innovationsprozesses. Empirische Analysen Und Implikationen Für Forschung Und Praxis," in: Chair of Informations Systems (117). Garching b. München: Technische Universität München.
22. Browne, M.W., and Cudeck, R. 1993. "Alternative Ways of Assessing Model Fit," in Testing Structural Equation Models, K.A. Bollen and J.S. Long (eds.). Newbury Park, CA, USA: Sage.
23. Brünken, R., Plass, J.L., and Leutner, D. 2003. "Direct Measurement of Cognitive Load in Multimedia Learning," Educational Psychologist (28:1), pp. 53-61.
24. Buhner, M. 2008. Einjuhrung in Die Test-Und Fragebogenkonstruktion, (2 ed.). München, Germany: Pearson Studium.
25. Bullinger, A., Neyer, A.K., Rass, M., and Moslein, K. 2010. "Community-Based Innovation Contests: Where Competition Meets Cooperation," Creativity & Innovation Management (19:3), pp. 290-303.
26. Cady, S.H., and Valentine, J. 1999. "Team Innovation and Perceptions of Consideration. What Difference Does Diversity Make?," Small Group Research (30:6), pp. 730-750.
27. Caroff, X., and Besançon, M. 2008. "Variability of Creativity Judgments," Learning and Individual Differences (18:4), pp. 367-371.
28. Chalmers, P.A. 2003. "The Role of Cognitive Theory in Human-Computer Interface," Computers in Human Behavior (19:5), pp. 593-607.
29. Chen, L., Goes, P., Marsden, J.R., and Zhang, Z. 2009-10. "Design and Use of Preference Markets for Evaluation of Early Stage Technologies," Journal of Management Information Systems (26:3), pp. 45-70.
30. Chen, Y., Chu, C.-H., Mullen, T., and Pennock, D.M. 2005. "Information Markets Vs. Opinion Pools: An Empirical Comparison," in: 6th ACM Conference on Electronic Commerce. Vancouver, BC, Canada: ACM.
31. Chen, Y., Dimitrov, S., Sami, R., Reeves, D.M., Pennock, D.M., Hanson, R.D., Fortnow, L., and Gonen, R. 2010. "Gaming Prediction Markets: Equilibrium Strategies with a Market Maker," Algorithmica (58:4), pp. 930-969.
32. Chesbrough, H.W. 2006. Open Innovation. The New Imperative for Creating and Profiting from Technology, (1 ed.).
33. Boston MA: Christian, L. M., Dillman, DA., and Smyth, J.D. 2007. "Helping Respondents Get It Right the First Time: The Influence of Words, Symbols, and Graphics in Web Surveys," Public Opinion Quarterly (71:1), pp. 113-125.
34. Christiansen, J.D. 2007. "Prediction Markets: Practical, Experiments in Small Markets and Behaviors Observed," The Journal of Prediction Markets (1:1), pp. 17-41.
35. Cohen, J., Cohen, P., West, S.G., and Aiken, L.S. 2003. Applied Multiple Regression/Correlation Analysis for the Behavorial Sciences, (3 ed.). Hillsdale, NJ, USA: Erlbaum.
36. Cohen, W. M., and Levinthal, D. A. 1990. "Absorptive Capacity: A New Perspective on Learning and Innovation " Administrative Science Quarterly (35:1), pp. 128-152.
37. Cosley, D., Lam, S.K., Albert, I., Konstan, J.A., and Riedl, J. 2003. "Is Seeing Believing?: How Recommender System Interfaces Affect Users' Opinions," SIGCHI conference on Human factors in computing systems, Ft. Lauderdale, Florida, USA: ACM.
38. Couper, M.P., Conrad, F.G., and Tourangeau, R. 2007. "Visual Context Effects in Web Surveys," Public Opinion Quarterly (71:4), pp. 623-634.
39. Cowan, N. 2005. Working Memory Capacity, Essays in Cognitive Psychology. New York, NY, USA: Psychology Press.
40. Cyr, D., Head, M., Larios, H., and Pan, B. 2009. "Exploring Human Images in Website Designs: A Multi-Method Approach," MIS Quarterly (33:3), pp. 530-566.
41. Daft, R.L., and Macintosh, N.B. 1981. "A Tentative Exploration into the Amount and Equivocality of Information Processing in Organizational Work Units," Administrative Science Quarterly (26:2), pp. 207-224.
42. Dahan, E., Soukhoroukova, A., and Spann, M. 2010. "New Product Developement 2.0: Preference Markets How Scalable Securities Markets Identify Winning Product Concepts & Attributes," Journal of Product Innovation Management (27:2), pp. 937-954.
43. Das, S. 2005. "A Learning Market-Maker in the Glosten-Milgrom Model," Quantitative Finance (5:2), pp. 169-180.
44. Dean, D.L., Hender, J.M., Rodgers, T.L., and Santanen, E.L. 2006. "Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation," Journal of the Association for Information Systems (7:10), pp. 646-698.
45. DeStefano, D., and LeFevre, J.-A. 2007. "Cognitive Load in Hypertext Reading: A Review," Computers in Human Behavior (23), pp. 1616-1641.
46. Di Gangi, P.M., and Wasko, M.M. 2009. "Steal My Idea! Organizational Adoption of User Innovations from a User Innovation Community: A Case Study of Dell Ideastorm," Decision Support Systems (48:1), pp. 303-312.
47. Easley, D., and Kleinberg, J. 2010. Networks, Crowds, and Markets: Reasoning About a Highly Connected World, (1 ed.). Cambridge, Mass., USA: Cambridge University Press.
48. Ebner, W., Leimeister, J.M., and Krcmar, H. 2009. "Community Engineering for Innovations: The Ideas Competition as a Method to Nurture a Virtual Community for Innovations," R&D Management (39:4) PP- 42-356.
49. Enkel, E., Perez-Freije, J., and Gassmann, O. 2005. "Minimizing Market Risks through Customer Integration in New Product Development: Learning from Bad Practice," Creativity and Innovation Management (14:4), pp. 425-437.
50. Eppler, M.J., and Mengis, J. 2004. "The Concept of Information Overload: A Review of Literature from Organization Science, Accounting, Marketing, Mis, and Related Disciplines," The Information Society: An International Journal (20:5), pp. 325-344.
51. Ericsson, K.A., and Lehmann, A.C. 1996. "Experts an Exceptional Performance: Evidence of Maximal Adaption to Task Constraints," Annual Review of Psychology (47:1), pp. 273-305.
52. Fama, E.F. 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," The Journal of Finance (25:2), pp. 383-417.
53. Fama, E.F. 1991. "Efficient Capital Markets: Ii," The Journal of Finance (46:5), pp. 1575-1617.
54. Farhoomand, A.F., and Drury, D.H. 2002. "Managerial Information Overload," Communications of the ACM (45:10), pp. 127-131.
55. Ferioli, M., Dekoninck, E., Culley, S., Roussel, B., and Renaud, J. 2010. "Understanding the Rapid Evaluation of Innovative Ideas in the Early Stages of Design," International Journal of Product Development (12:1), pp. 67-83
56. Fishbein, M. 1966. "The Relationships between Beliefs, Attitudes, and Behavior," in Cognitive Consistencey: Motivational Antecedents and Behavorial Consequents S. Feldmann (ed.). New York: Academic Press.
57. Fornell, C, and Larcker, D.F. 1981. "Evaluating Structural Equation Models with Unobservable Variables and Measurement Error," Journal of Marketing Research (18:2), pp. 39-50.
58. Forsythe, R., Rietz, T.A., and Ross, T.W. 1999. "Wishes, Expectations and Actions: A Survey on Price Formation in Election Stock Markets," Journal of Economic Behavior & Organization (39:1), pp. 83-110.
59. Franke, N, and Hienerth, C. 2006. "Pràdikatoren Der Qualitat Von Geschàftsideen: Eine Empirische Analyse Eines Online-Ideen-Forums," Zeitschrift fur Betriebswirtschaft Special Issue (6:4), pp. 47-68.
60. Franke, N., and Shah, S. 2003. "How Communities Support Innovative Activities: An Exploration of Assistance and Sharing among End-Users," Research Policy (32:1), pp. 157-178.
61. Frazier, PA., Tix, A.P., and Barron, K.E. 2004. "Testing Moderator and Mediator Effects in Counseling Psychology Research," Journal of Counseling Psychology (51), pp. 115-134.
62. st Hawaii International Conference on System Science (HICCS 41), Waikoloa, Big Island, Hawaii, USA.
63. Gassmann, O. 2006. "Opening up the Innovation Process: Towards an Agenda," R&D Management (36:3), pp. 223-228.
64. Goleman, D. 1996. Emotional Intelligence. Why It Can Matter More Than Iq, (1 ed.). London: Bloomsbury.
65. Graefe, A. 2009. "Prediction Markets Versus Alternative Methods. Empirical Tests of Accuracy and Acceptability," in: Fakultat fur Wirtschaftswissenschaften. Karlsruhe: Universitat Karlsruhe (TH).
66. Grise, M.-L., and Gallupe, RB. 2000. "Information Overload: Addressing the Productivity Paradox in Face-to-Face Electronic Meetings," Journal of Management Information Systems (16:3), pp. 157-185.
67. Gwizdka, J. 2010. "Distribution of Cognitive Load in Web Search," J. Am. Soc. Inf. Sci. Technol. (61:11), pp. 2167-2187.
68. Haerem, T., and Rau, D. 2007. "The Influence of Degree of Expertise and Objective Task Complexity on Perceived Task Complexity and Performance," Journal of Applied Psychology (92:5), pp. 1320-1331.
69. Hanson, R. 2003. "Combinatorial Information Market Design," Information Systems Frontiers (5:1), pp. 107-119.
70. Hanson, R. 2007. "Logarithmic Market Scoring Rules for Modular Combinatorial Information Aggregation," Journal of Prediction Markets (1:1), pp. 3-15.
71. Hayek, FA. 1945. "The Use of Knowledge in Society," American Economic Review (35:4), pp. 519-530.
72. Healy, P.J., Linardi, S., Lowery, J.R., and Ledyard, J.O. 2010. "Prediction Markets: Alternative Mechanisms for Complex Environments with Few Traders," Management Science (56:11), pp. 1977-1996.
73. Hwang, M.I., and Lin, J.W. 1999. "Information Dimension, Information Overload and Decision Quality," Journal of Information Science (25:3), June 1,1999, pp. 213-218.
74. Janis, I.L., and Mann, L. 1977. Decision Making. A Psychological Analysis of Conflct, Choice, and Commitment, (1 ed.). New York: The Free Press.
75. Janis, I.L., and Mann, L. 1982. "A Theoretic Framework for Decision Counseling," in Counseling on Personal Decisions: Theory and Helping on Short-Term Helping Relationships., I.L. Janis (ed.). New Heaven: Yale University Press.
76. Jeppesen, L.B., and Frederiksen, L. 2006. "Why Do Users Contribute to Firm-Hosted User Communities? The Case of Computer-Controlled Music Instruments," Organization Science (17:1), pp. 45-63.
77. Jian, L., and Sami, R. 2010. "Aggregation and Manipulation in Prediction Markets: Effects of Trading Mechanism and Information Distribution," in: 11th ACM conference on Electronic commerce. Cambridge, Massachusetts, USA: ACM.
78. Jokisch, M. 2007. Active Integration of Users into the Innovation Process of a Manufacturer The Bmw Customer Innovation Lab, (1 ed.). München
79. Kamp, G., and Koen, P.A. 2009. "Improving the Idea Screening Process within Organizations Using Prediction Markets: A Theoretical Perspective," The Journal of Prediction Markets (3:2), pp. 39-64.
80. Karimi, J., Somers, T.M., and Gupta, Y.P. 2004. "Impact of Environmental Uncertainty and Task Characteristics on User Satisfaction with Data," Information Systems Research (15:2), pp. 175-193.
81. Keeney, R.L. 1992. Value-Focused Thinking: A Path to Creative Decision-Making, (1 ed.). Cambrige, Mass., USA: Harvards University Press.
82. Kim, S.S., and Malhotra, N.K. 2005. "A Longitudinal Model of Continued Is Use: An Integrative View of Four Mechanisms Underlying Postadoption Phenomena," Management Science (51:5), pp. 741-755.
83. Kirsh, D. 2000. "A Few Thoughts on Cognitive Overload," Intellectica (30:1), pp. 19-51.
84. Knapp, H., and Kirk, S.A. 2003. "Using Pencil and Paper, Internet and Touch-Tone Phones for Self-Administered Surveys: Does Methodology Matter?," Computers in Human Behavior (19:1), pp. 117-134.
85. Kristensson, P., Gustafsson, A., and Archer, T. 2004. "Harnessing the Creative Potential among Users," The Journal of Product Innovation Management (21:1), pp. 4-14.
86. LaComb, A.C., Barnett, A., and Qimei, P. 2007. "The Imagination Market," Information Systems Frontiers (9:2-3), pp. 245-256.
87. Lane, P.J., Koka, B.R., and Pathak, S. 2006. "The Reification of Absorptive Capacity: A Critical Review and Rejuvenation of the Construct," Academy of Management Review (31:4), pp. 863-883.
88. LeDoux, J. 1998. The Emotional Brain. The Mysterious Underpinning of Emotional Life, (1 ed.). London: Weidenfeld & Nicolson.
89. Leimeister, J.M. 2010. "Collective Intelligence," Business & Information Systems Engineering (52:4), pp. 239-242.
90. Leung, R., MacLean, K., Bertelsen, M.B., and Saubhasik, M. 2007. "Evaluation of Haptically Augmented Touchscreen Gui Elements under Cognitive Load," in: Proceedings of the gth international conference on Multimodal interfaces. Nagoya, Aichi, Japan: ACM.
91. Lewin, AY., Massini, S., and Peeters, C. 2011. "Microfoundations of Internal and External Absorptive Capacity Routines," Organization Science (22:1), pp. 81-98.
92. Limayem, M., and DeSanctis, G. 2000. "Providing Decisional Guidance for Multicriteria Decision Making in Groups," Information Systems Research (11:4), pp. 386-401.
93. Luckner, S., and Weinhardt, C. 2007. "How to Pay Traders in Information Markets: Results from a Field Experiment," Journal of Prediction Markets (1:2), pp. 147-156.
94. Malhotra, N.K. 1982. "Reflections on the Information Overload Paradigm in Consumer Decision Making," The Journal of Consumer Research (10:4), pp. 436-440.
95. Malhotra, N.K. 2007. Marketing Research. An Applied Orientation, (5 ed.). Upper Saddle River: Pearson.
96. March, J.G. 1978. "Bounded Rationality, Ambiguity and the Engineering of Choice," The Bell Journal of Economics (9:2), pp. 587-608.
97. Matthing, J., Kristensson, P., Gustafsson, A., and Parasuraman, A. 2006. "Developping Succesful Technology-Based Services: The Issue of Identifying and Involving Innovative Users," Journal of Services Marketing (20:5), pp. 288-297.
98. Mayer, R.E., and Moreno, R. 2003. "Nine Ways to Reduce Cognitive Load in Multimedia Learning," Educational Psychologist (38:1), pp. 43-52.
99. Miller, GA. 1956. "The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information," Psychological Review (63:2), pp. 81-97.
100. Mizuyama, H., and Komatsu, T. 2010. "A Prediction Market Approach to Facilitating Consensus Building Amon Supply Chain Partners," E-Journal of Advanced Maintenance (2:1), pp. 149-159.
101. Nielsen, J. 1994. "Enhancing the Explanotory Power of Usability Heuristics," SIGCHI Conference on Human Factors in Computing Systems, Boston, Mass., USA, pp. 152-158
102. Nunnally, J.C., and Bernstein, I.H. 1994. Psychometric Theory. New York, USA: McGraw-Hill
103. O'Reilly, C.R., Parlette, G.N., and Bloom, J.R. 1980. "Perceptual Measures of Task Characteristics: The Biasing Effects of Differing Frames of Reference and Job Attitudes," Academy of Management Journal (23:1), pp. 118-131
104. Ogawa, S., and Piller, F. 2006. "Reducing the Risks of New Product Development," MIT Sloan Management Review (47:2), pp. 65-71.
105. Othman, A., and Sandholm, T. 2010. "Automated Market-Making in the Large: The Gates Hillman Prediction Market," in: 11th ACM conference on Electronic commerce. Cambridge, Mass., USA: ACM.
106. Ozer, M. 2005. "What Do We Know About New Product Idea Selection?."
107. Paas, F., Renkl, A., and Sweller, J. 2003. "Cognitive Load Theory and Instructional Design: Recent Developments," Educational Psychologist (38:1), pp. 1-4
108. Paivio, A. 1986. Mental Representations: A Dual Coding Approach, (1 ed.). Oxford, England: Oxford University Press.
109. Pennock, D.M., and Sami, R. 2008. "Computational Aspects of Prediction Markets," in Algorithmic Game Theory. Cambridge: Cambridge Univ. Press, pp. 651-678.
110. Perrow, C. 1967. "A Framework for the Comparative Analysis of Organizations," American Sociological Review (32:2), pp. 194-208.
111. Piller, F.T., and Walcher, D. 2006. "Toolkits for Idea Competitions: A Novel Method to Integrate Users in New Product Development," R&D Management (36:3), pp. 307-318.
112. Poston, R.S., and Speier, C. 2005. "Effective Use of Knowledge Management Systems: A Process Model of Content Ratings and Credibility Indicators," MIS Quarterly (29:2), pp. 221-244
113. Reinig, B.A., Briggs, R.O., and Nunamaker Jr, J.F. 2007. "On the Measurement of Ideation Quality," Journal of Management Information Systems (23:4), pp. 143-161.
114. Riedl, C, Blohm, I., Leimeister, J.M., and Krcmar, H. 2010. "Rating Scales for Collective Intelligence in Innovation Communities: Why Quick and Easy Decision Making Does Not Get It Right," 2010 International Conference on Information Systems, St. Louis, Mi, USA: AIS.
115. Riedl, C, May, N., Finzen, J., Stathel, S., Kaufman, V., and Krcmar, H. 2009. "An Idea Ontology for Innovation Management," International Journal on Semantic Web and Information Systems (5:4), pp. 1-18.
116. Rochford, L. 1991. "Generating and Screening New Product Ideas," Industrial Marketing Management (20:4), pp. 287-296.
117. Runco, M.A., and Basadur, M. 1993. "Assessing Ideational and Evaluative Skills and Creative Styles and Attitudes," Creativity and Innovation Management (2:3), pp. 166-173.
118. Runco, M.A., and Smith, W.R. 1992. "Interpersonal and Intrapersonal Evaluations of Creative Ideas," Personality and Individual Differences (13:3), pp. 295-302
119. Sainfort, F., and Booske, B. 2000. "Measuring Post-Decisions Satisfaction," Medical Decision Making (20:1), pp. 51-61.
120. Schmutz, P., Heinz, S., Métrailler, Y., and Opwis, K 2009. "Cognitive Load in Ecommerce Applications-Measurement and Effects on User Satisfaction," Advances in Human-Computer Interaction
121. Schulz, C, and Wagner, S. 2008. "Outlaw Community Innovations," International Journal of Innovation Management (12:3), pp. 399-418
122. Servan-Schreiber, E., Wolfers, J., Pennock, D.M., and Galebach, B. 2004. "Prediction Markets: Does Money Matter?," Electronic Markets (14:3), pp. 243-251
123. Shadish, W.R., Cook, T.D., and Campbell, D.T. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Interference, (1 ed.). Boston, Mass., USA: Houghton Mifflin Company.
124. Shannon, C.E. 1948. "A Mathematical Theory of Communication," The Bell System Technical Journal (27), pp. 379-423 & 623-656.
125. Sharma, R., Yetton, P., and Crawford, J. 2009. "Estimating the Effect of Common Method Variance: The Method-Method Pair Technique with an Illustration from Tam Research," MIS Quarterly (33:3), pp. 473-490.
126. Shneiderman, B., and Plaisant, C. 2004. Designing the User Interface Reading, Mass., USA: Addison-Wesley.
127. Slamka, C, Jank, W., and Skiera, B. 2011. "Second-Generation Prediction Markets for Information Aggregation: A Comparison of Payoff Mechanisms," Journal of Forecasting (forthcoming).
128. Soukhoroukova, A., Spann, M., and Skiera, B. 2011. "Sourcing, Filtering, and Evaluating New Product Ideas: An Empirical Exploration of the Performance of Idea Markets," Journal of Product Innovation Management (forthcoming).
129. Spann, M., and Skiera, B. 2003. "Internet-Based Virtual Stock Markets for Business Forecasting," Management Science (49:10), pp. 1310-1326
130. Speier, C, Vessey, I., and Valacich, J.S. 2003. "The Effects of Interruptions, Task Complexity, and Information Presentation on Computer-Supported Decision-Making Performance," Decision Sciences (34:4), pp. 771-797
131. Stathel, S., van Dinther, C, and Schonfeld, A. 2009. "Service Innovation with Information Markets," Wirtschaftsinformatik, Wien
132. Stewart, T., and Travis, D. 2003. "Guidelines, Standards, and Style Guides," in The Human-Computer Interaction Handbook, J. Jacko and A. Sears (eds.). London: Lawrence Erlbaum Associates
133. Sweller, J. 1988. "Cognitive Load During Problem Solving: Effects on Learning," Cognitive Science (12:2), pp. 257-285
134. Torodova, G., and Durisin, B. 2007. "Absorptive Capacity: Valuing a Reconceptualization," Academy of Management Review (32:3), pp. 774-786.
135. Toubia, O., and Flores, L. 2007. "Adaptive Idea Screening Using Consumers," Marketing Science (26:3), pp. 342-360
136. Triantaphyllou, E. 2000. Multi-Criteria Decision Making Methods: A Comparative Study, (1 ed.). Dordrecht, The Netherlands: Kluwer
137. Urban, G.L., and Hauser, J.R. 1993. Design and Marketing of New Products, (1 ed.). Englewood Cliffs, NJ/USA: Prentice Hall.
138. van Merrienboer, J.J.G., Kirschner, PA., and Kester, L. 2003. "Taking the Load Off a Learner's Mind: Instructional Design for Complex Learning," Educational Psychologist (38:1), pp. 5-13.
139. van Schaik, P., and Ling, J. 2007. "Design Parameters of Rating Scales for Web Sites," ACM Transactions on Computer-Human Interaction (14:1), p. 35.
140. Voich, D. 1995. Comparative Empirical Analysis of Cultural Values and Perceptions of Political Economy Issues, (1 ed.). Westport, Connecticut: Praeger
141. von Hippel, E. 2005. Democratizing Innovation, (1 ed.). Cambridge, Mass.: MIT Press.
142. Walcher, P.-D. 2007. Der Ideenwettbewerb Als Methode Der Aktiven Kundenintegration, (1 ed.). Wiesbaden: Gabler.
143. West, J., and Lakhani, K. 2008. "Getting Clear About Communities in Open Innovation," Industry and Innovation (15:2), pp. 223-231
144. West, S.G., Aiken, L.S., and Krull, J.L. 1996. "Experimental Personality Designs: Analyzing Categorical by Continuous Variable Interactions," Journal of Personality (64:1), pp. 1-49.
145. Wheaton, B., Muthén, B., Alwin, D.F., and Summers, G.F. 1977. "Assessing Reliability and Stability in Panel Models," in Sociological Methodology, D.R. Heise (ed.). San Francisco, CA, USA: Jossey-Bass
146. Winkelmann, A., Herwig, S., Poppelbu B J., Tiebe, D., and Becker, J. 2009. "Discussion of Functional Design Options for Online Rating Systems: A State-of-the-Art Analysis," 17th European Conference on Information Systems (ECIS 2009)
147. Verona. Withey M., Daft, R.L., and Cooper, W.H. 1983. "Measures of Perrow's Work Unit Technology: An Empirical Assessment and a New Scale," Academy ofManagement Journal (26:1), pp. 45-63.
148. Wolfers, J., and Zitzewitz, E. 2004. "Prediction Markets," Journal of Economic Perspective (18:2), pp. 107-126.
149. Zajonc, R. 1980. "Feeling and Thinking: Preferences Need No References," American Psychologist (35:2), pp. 151-175.
150. Zigurs, I., and Buckland, B.K. 1998. "A Theory of Task/Technology Fit and Group Support Systems Effectiveness," MIS Quarterly.
151. Zwass, V. 2010. "Co-Creation: Toward a Taxonomy and an Integrated Research Perspective," Inter nationalJournal of Electronic Commerce (15:1), pp. 11-48