Rating scales for collective intelligence in innovation communities: Why quick and easy decision making does not get IT right

ICIS 2010 Proceedings - Thirty First International Conference on Information Systems

Volumn , Issue , 2010, Pages

  Riedl, Christoph ^a   Blohm, Ivo ^a   Leimeister, Jan Marco ^b   Krcmar, Helmut ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF KASSEL   (Germany)

Author keywords

Absorptive capacity; Collecting intelligence; Decision making; Idea evaluation; Open innovation; Rating

Indexed keywords

ABSORPTIVE CAPACITY; COLLECTING INTELLIGENCE; COLLECTIVE INTELLIGENCES; DECISION MANAGEMENT; IDEA EVALUATION; INNOVATION PLATFORMS; MULTI-ATTRIBUTES; MULTI-METHOD APPROACH; ONLINE INNOVATIONS; OPEN INNOVATION; RATING SCALE; SELECTION MECHANISM;

DECISION MAKING; INFORMATION SYSTEMS; INNOVATION; SOCIAL NETWORKING (ONLINE); SURVEYS;

RATING;

EID: 84870974090     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (101)

1. Amabile, T.M. Creativity in Context. Update to Social Psychology of Creativity, (1 ed.) Westview Press, Oxford, UK, 1996.
2. Ang, S.H., and Low, S.Y.M. Exploring the Dimensions of Ad Creativity, Psychology & Marketing (17:10) 2000, pp 835-854.
3. Bagozzi, R.P., and Yi, Y. On the evaluation of Structural Equatation Models, Journal of the Academy of Marketing Sciences (16:1) 1988, pp 74-94.
4. Baron, R.M., and Kenny, D.A. The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations, Journal of Personality and Social Psychology (51:6) 1986, pp 1173-1182.
5. Benbasat, I., and Zmud, R. The Identity Crisis within the IS Discipline: Defining and Communicating the Discipline's Core Properties, MIS Quarterly (27:2) 2003, pp 183-194.
6. Besemer, S.P., and O'Quin, K. Analyzing creative products: Refinement and test of judging tool, Creativity Research Journal (20:2) 1986, pp 115-126.
7. Besemer, S.P., and O'Quin, K. Confirming the Three-Factor Creative Product Analysis Matrix Model in an American Sample, Creativity Research Journal (12:4) 1999, pp 287-296.
8. Biemer, P., and Lyberg, L.E. Introduction to Survey Quality, (1 ed.) John Wiley & Sons, Hoboken, NJ, USA, 2003.
9. Bloch, P., Ridgway, N., and Sherrell, D. Extending the Concept of Shopping: An Investigation of Browsing Activity, Journal of the Academy of Marketing Science (17:1) 1989, pp 13-21.
10. Blohm, I., Bretschneider, U., Leimeister, J.M., and Krcmar, H. Does Collaboration Among Participants Lead to Better Ideas in IT-Based Idea Competitions? An Ampirical Investigation, 43rd Hawaii International Conference on System Science (HICSS 43), Kauai, Hawai, 2010.
11. Boudreau, M.-C., Gefen, D., and Straub, D.W. Validation in Information Systems Research: A State-of-the-Art Assessment, MIS Quarterly (25:1) 2001, pp 1-16.
12. Browne, M.W., and Cudeck, R. Alternative Ways of Assessing Model Fit, in: Testing Structural Equation Models, K.A. Bollen and J.S. Long (eds.), Sage, Newbury Park, CA, USA, 1993.
13. Bühner, M. Einführung in die Test- und Fragebogenkonstruktion, (2 ed.) Pearson Studium, München, Germany, 2008.
14. Cady, S.H., and Valentine, J. Team Innovation and Perceptions of Consideration. What Difference does Diversity Make?, Small Group Research (30:6) 1999, pp 730-750.
15. Caroff, X., and Besançon, M. Variability of Creativity Judgments, Learning and Individual Differences (18:4) 2008, pp 367-371.
16. Chesbrough, H. Open Innovation: The New Imperative for Creating and Profiting from Technology Harvard Business School Press, Boston, MA, USA, 2006.
17. Chesbrough, H., and Crowther, A.K. Beyond High Tech: Early Adopters of Open Innovation in Other Industries, R&D Management (36:3) 2006, pp 229-236.
18. Christiaans, H.H.C.M. Creativity as Design Criterion, Creativity Research Journal (14:1) 2002, pp 41-54.
19. Christian, L.M., and Dillman, D.A. The Influence of Graphical and Symbolic Language Manipulations on Responses to Self-Administered Questions, Public Opinion Quarterly (68:1) 2004, pp 57-80.
20. Christian, L.M., Dillman, D.A., and Smyth, J.D. Helping Respondents Get it Right the First Time: The Influence of Words, Symbols, and Graphics in Web Surveys, Public Opinion Quarterly (71:1) 2007, pp 113-125.
21. Cohen, J., Cohen, P., West, S.G., and Aiken, L.S. Applied Multiple Regression / Correlation Analysis for the Behavorial Sciences, (3 ed.) Erlbaum, Hillsdale, NJ, USA, 2003.
22. Cohen, W. M., and Levinthal, D. A. Absorptive Capacity: A New Perspective On Learning And Innovation Administrative Science Quarterly (35:1) 1990, pp 128-152.
23. Collins, D. Pretesting Survey Instruments: An Overview of Cognitive Methods, Quality of Life Research (12:3) 2003, pp 229-238.
24. Conrad, F.G., Couper, M.P., Tourangeau, R., and Peytchev, A. Use and Non-use of Clarification Features in Web Surveys, Journal of Official Statistics (22:2) 2006, pp 245-269.
25. Cyr, D., Head, M., Larios, H., and Pan, B. Exploring Human Images in Website Design: A Multi-Method Approach, MIS Quarterly (33:3) 2009, pp 539-566.
26. Dahlander, L., and Gann, D.M. How Open is Open Innovation?, Research Policy (39:6) 2010, pp 699-709.
27. Dean, D.L., Hender, J.M., Rodgers, T.L., and Santanen, E.L. Identifying Quality, Novel, and Creative Ideas: Constructs and Scales for Idea Evaluation, Journal of the Association for Information Systems (7:10) 2006, pp 646-698.
28. Di Gangi, P.M., and Wasko, M. "Steal my Idea! Organizational Adoption of User Innovations from a User Innovation Community: A Case Study of Dell IdeaStorm," Decision Support Systems (48) 2009, pp 303-312.
29. Easley, D., and Kleinberg, J. Networks, Crowds, and Markets: Reasoning about a Highly Connected World Cambridge University Press, Cambridge, MA, USA, 2010.
30. Ebner, W., Leimeister, J.M., and Krcmar, H. Community Engineering for Innovations -The Ideas Competition as a method to nurture a Virtual Community for Innovations, R&D Management (39:4) 2009, pp 342-356.
31. Enkel, E., Perez-Freije, J., and Gassmann, O. Minimizing Market Risks Through Customer Integration in New Product Development: Learning from Bad Practice, Creativity and Innovation Management (14:4) 2005, pp 425--437.
32. Ferrando, P.J. Testing the Equivalence Among Different Item Response Formats in Personality Measurement: A Structural Equation Modeling Approach, Structural Equation Modeling, (7:2) 2000, pp 271-286.
33. Finke, R.A., Ward, T.B., and Smith, S.M. Creative Cognition. Theory, Research and Applications MIT Press, Cambrigde, MA, USA, 1996.
34. Fishbein, M. The Relationships Between Beliefs, Attitudes, and Behavior, in: Cognitive Consistencey: Motivational Antecedents and Behavorial Consequents S. Feldmann (ed.), Academic Press, New York, NY, USA, 1966.
35. Flynn, L.R., and Goldsmith, R.E. A Short, Reliable Measure of Subjective Knowledge, Journal of Business Research (46:1) 1999, pp 57-66.
36. Fornell, C., and Larcker, D.F. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error, Journal of Marketing Research, Vol. 18, (1981), S. 39-50. (18:2) 1981, pp 39-50.
37. Franke, N., and Hienerth, C. Prädikatoren der Qualität von Geschäftsideen: Eine empirische Analyse eines Online- Ideen-Forums, Zeitschrift für Betriebswirtschaft Special Issue (6:4) 2006, pp 47-68.
38. Franke, N., and Shah, S. How Communities Support Innovative Activities: An Exploration of Assistance and Sharing Among End-Users, Research Policy (32:1) 2003, pp 157-178.
39. Frazier, P.A., Tix, A.P., and Barron, K.E. Testing Moderator and Mediator Effects in Counseling Psychology Research, Journal of Counseling Psychology (51:1) 2004, pp 115-134.
40. Galletta, D.F., Henry, R., McCoy, S., and Polak, P. Web Site Delays: How Tolerant are Users?, Journal of the Association for Information Systems (5:1) 2004, pp 1-28.
41. Ganassali, S. The Influence of the Design of Web Survey Questionnaires on the Quality of Responses, Survey Research Methods (2:1) 2008, pp 21-32.
42. Gassmann, O. Opening up the Innovation Process: Towards an Agenda, R&D Management (36:3) 2006, pp 223-228.
43. Goleman, D. Emotional Intelligence. Why it can matter more than IQ, (1 ed.) Bloomsbury, London, UK, 1996.
44. Griffin, M., Babin, B., and Attaway, J. Anticipation of Injurious Consumption Outcomes and its Impact on Consumer Attributions of Blame, Journal of the Academy of Marketing Science (24:4) 1996, pp 314-327.
45. Janis, I.L., and Mann, L. Decision Making. A Psychological Analysis of Conflct, Choice, and Commitment, (1 ed.) The Free Press, New York, NY, USA, 1977.
46. Janis, I.L., and Mann, L. A Theoretic Framework for Decision Counseling, in: Counseling on personal decisions: Theory and helping on short-term helping relationships., I.L. Janis (ed.), Yale University Press, New Heaven, CT, USA, 1982.
47. Jeppesen, L.B., and Frederiksen, L. Why do Users Contribute to Firm-Hosted User Communities? The Case of Computer-Controlled Music Instruments, Organization Science (17:1) 2006, pp 45-63.
48. Johnson-Laird, P.N. Human and Machine Thinking, (1.Aufl. ed.) Lawrence Erlbaum, Hillsdale, NJ, USA, 1993.
49. Jokisch, M. Active Integration of Users into the Innovation Process of a Manufacturer. The BMW Customer Innovation Lab, (1 ed.), München, Germany, 2007.
50. Keller, J.M. Motivational Design of Instruction, in: Instructional Design Theories and Models, C.M. Reigeluth (ed.), Lawrence Erlbaum, Hillsdale, NJ, USA, 1983.
51. King, L.A., King, D.W., and Klockars, A.J. Dichotomous and Multipoint Scales Using Bipolar Adjectives, Applied Psychological Measurement (7:2), April 1, 1983 1983, pp 173-180.
52. Kristensson, P., Gustafsson, A., and Archer, T. Harnessing the Creative Potential Among Users, The Journal of Product Innovation Management (21:1) 2004, pp 4-14.
53. Lakhani, K., and Panetta, J. The Principles of Distributed Innovation, Innovations: Technology, Governance, Globalization (2:3) 2007, pp 97-112.
54. LeDoux, J. The Emotional Brain. The Mysterious Underpinning of Emotional Life, (1 ed.) Weidenfeld & Nicolson, London, UK, 1998.
55. Leimeister, J.M. Collective Intelligence, Business & Information Systems Engineering (2:4) 2010, pp 245-248.
56. Leimeister, J.M., Huber, M., Bretschneider, U., and Krcmar, H. Leveraging Crowdsourcing: Activation-Supporting Components for IT-Based Ideas Competition Journal of Management Information Systems (26:1) 2009, pp 197-224.
57. Lilien, G.L., Morrison, P.D., Searls, K., Sonnack, M., and von Hippel, E. Performance Assessment of the Lead Iser Idea-Generation Process for New Product Development, Management Science (48:8) 2002, pp 1042-1059.
58. Lindgaard, G., and Dudek, C. What is this Evasive Beast we Call User Satisfaction?, Interacting witch Computers (15:3) 2003, pp 429-452.
59. Lozano, L.M., García-Cueto, E., and Muñiz, J. Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales, Methodology: European Journal of Research Methods for the Behavioral and Social Sciences (4:2) 2008, pp 73-79.
60. Lüthje, C. Characteristics of Innovating Users in a Consumer Goods Field. An Empirical Study of Sport-Related Product Consumers, Technovation (24:9) 2004, pp 683-695.
61. MacCrimmon, K.R., and Wagner, C. Stimulating Ideas Through Creative Software, Management Science (40:11) 1994, pp 1514-1532.
62. Malhotra, N.K. Marketing Research. An Applied Orientation, (5.Aufl. ed.) Pearson, Upper Saddle River, NJ, USA, 2007.
63. Matthing, J., Kristensson, P., Gustafsson, A., and Parasuraman, A. Developping Succesful Technology-Based Services: The Issue of Identifying and Involving Innovative Users, Journal of Services Marketing (20:5) 2006, pp 288-297.
64. Mayer, R.E. Fifty Years of Creativity Research, in: Handbook of Creativity, R.J. Sternberg (ed.), Cambrige University Press, Cambrige, MA, USA, 1999, pp. 449-460.
65. Nagasundaram, M., and Bostrom, R.P. The Structuring of Creative Processes Using GSS: A Framework for Research, Journal of Management Information Systems (11:3) 1994, pp 87-114.
66. Niu, W., and Sternberg, R.J. Cultural Influences on Artistic Creativity and its Evaluation, International Journal of Psychology (36:1) 2001, pp 225-241.
67. Ogawa, S., and Piller, F. Reducing the Risks of New Product Development, MIT Sloan Management Review (47:2) 2006, pp 65-71.
68. Oliver, R.L., and Swan, J.E. Consumer Perceptions of Interpersonal Equity and Satisfaction in Transactions: A Field Survey Approach, Journal of Marketing (53:2) 1989, pp 21-35.
69. Palvia, P., Leary, D., Mao, E., Midha, V., Pinjani, P., and Salam, A.F. Research Methodologies in MIS: An Update, Communications of the Association for Information Systems (14) 2004, pp 526-542.
70. Piller, F.T., and Walcher, D. Toolkits for Idea Competitions: A Novel Method to Integrate Users in New Product Development, R&D Management (36:3) 2006, pp 307-318.
71. Plucker, J.A., Beghetto, R.A., and Dow, G.T. Why isn't Creativity More Important to Educational Psychologists? Potentials, Pitfalls, and Future Directions in Creativity Research, Educational Psychologist (39:2) 2004, pp 83-96.
72. Reinig, B.A., Briggs, R.O., and Nunamaker Jr, J.F. On the Measurement of Ideation Quality, Journal of Management Information Systems (23:4), Spring2007 2007, pp 143-161.
73. Riedl, C., May, N., Finzen, J., Stathel, S., Kaufman, V., and Krcmar, H. An Idea Ontology for Innovation Management, International Journal on Semantic Web and Information Systems (5:4) 2009, pp 1-18.
74. Rochford, L. Generating and Screening New Product Ideas, Industrial Marketing Management (20:4) 1991, pp 287-296.
75. Roman, D. Crowdsourcing and the Question of Expertise, Communications of the ACM (52:12) 2009, pp 12-12.
76. Runco, M.A., and Basadur, M. Assessing Ideational and Evaluative Skills and Creative Styles and Attitudes, Creativity and Innovation Management (2:3) 1993, pp 166-173.
77. Runco, M.A., and Sakomoto, S.O. Experimental Studies of Creativity, in: Handbook of Creativity, R.J. Sternberg (ed.), Cambridge University Press, Cambridge, MA, USA, 1999, pp. 62-92.
78. Runco, M.A., and Smith, W.R. Interpersonal and Intrapersonal Evaluations of Creative Ideas, Personality and Individual Differences (13:3) 1992, pp 295-302.
79. Sainfort, F., and Booske, B. Measuring Post-Decisions Satisfaction, Medical Decision Making (20:1) 2000, pp 51-61.
80. Schulz, C., and Wagner, S. Outlaw Community Innovations, International Journal of Innovation Management (12:3) 2008, pp 399-418.
81. Schwarz, N. Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation Lawrence Erlbaum, Hillsdale, NJ, USA, 1996.
82. Shankar, V., Smith, A.K., and Rangaswamy, A. Customer Satisfaction and Loyalty in Online and Offline Environments, International Journal of Research in Marketing (20:2) 2003, pp 153-175.
83. Sharma, R., Yetton, P., and Crawford, J. Estimating the Effect of Common Method Variance: The Method-Method Pair Technique with an Illustration from TAM Research, MIS Quarterly (33:3) 2009, pp 473-490.
84. Small, R.V., and Venkatesh, M. A Cognitive-Motivational Model of Decision Satisfaction, Instructional Science (28:1) 2000, pp 1-22.
85. Sniezek, J.A. Groups Under Uncertainty: An Examination of Confidence in Group Decision Making, Group Decision Making (52:1) 1992, pp 124-154.
86. Spann, M., Ernst, H., Skiera, B., and Soll, J.H. Identification of Lead Users for Consumer Products via Virtual Stock Markets, Journal of Product Innovation Management (26:3) 2009, pp 322-355.
87. Sudman, S., Bradburn, N.M., and Schwarz, N. Thinking about Answers. The Application of Cognitive Processes to Survey Methodology, (1 ed.) Jossey-Bass Publishers, San Francisco, CA, USA, 1996.
88. Tetlock, P.E. Expert Political Judgment: How Good Is It? How Can We Know? Princeton University Press., Princeton, NJ, USA, 2006.
89. Torodova, G., and Durisin, B. Absorptive Capacity: Valuing a Reconceptualization, Academy of Management Review (32:3) 2007, pp 774-786.
90. Toubia, O., and Flores, L. Adaptive Idea Screening Using Consumers, Marketing Science (26:3) 2007, pp 342-360.
91. Tourangeau, R., Rips, L.J., and Rasinski, K. The Psychology of Survey Response, (1 ed.) Cambridge University Press, Cambridge, MA, USA, 2000.
92. Utterback, J. Mastering the Dynamics of Innovation Harvard Business School Press, Boston, MA, USA, 1996.
93. Voich, D. Comparative Empirical Analysis of Cultural Values and Perceptions of Political Economy Issues Praeger, Westport, CT, USA, 1995.
94. von Hippel, E. The Sources of Innovation Oxford University Press, New York, NY, USA, 1988.
95. von Hippel, E. "Sticky Information" and the Locus of Problem Solving: Implications for Innovation, Management Science (40:4) 1994, pp 429-439.
96. von Hippel, E. Democratizing Innovation MIT Press, Cambridge, MA, USA, 2005.
97. Walcher, P.-D. Der Ideenwettbewerb als Methode der aktiven Kundenintegration, (1 ed.) Gabler, Wiesbaden, Germany, 2007.
98. West, J., and Lakhani, K. Getting Clear About Communities in Open Innovation, Industry and Innovation (15:2) 2008, pp 223-231.
99. West, S.G., Aiken, L.S., and Krull, J.L. Experimental personality designs: Analyzing categorical by continuous variable interactions, Journal of Personality (64:1) 1996, pp 1-49.
100. Wheaton, B., Muthén, B., Alwin, D.F., and Summers, G.F. Assessing Reliability and Stability in Panel Models, in: Sociological Methodology, D.R. Heise (ed.), Jossey-Bass, San Francisco, CA, USA, 1977.
101. Zajonc, R. Feeling and Thinking: Preferences Need no References, American Psychologist (35:2) 1980, pp 151-175