Assessing Innovation: A 360-degree appraisal study

International Journal of Selection and Assessment

Volumn 20, Issue 4, 2012, Pages 497-509

  Potočnik, Kristina ^a   Anderson, Neil ^b  

^a UNIVERSITY OF EDINBURGH BUSINESS SCHOOL   (United Kingdom)

^b BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84869846059     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/ijsa.12012     Document Type: Article

References (67)

1. Alge, B. J., Ballinger, G. A., Tangirala, S., & Oakley, J. L. (2006). Information privacy in organizations: Empowering creative and extra role performance. Journal of Applied Psychology, 91, 221-232. doi:10.1037/0021-9010.91.1.221.
2. Amabile, T. M., Mueller, J. S., Simpson, W. B., Hadley, C. N., Kramer, S. J., & Fleming, L. (2002). Time pressure and creativity in organizations: A longitudinal field study. HBS Working Paper 02-073). Cambridge, MA: Harvard University, Harvard Business School.
3. Anderson, N., De Dreu, C. K. W., & Nijstad, B. A. (2004). The routinization of innovation research: A constructively critical review of the state-of-the-science. Journal of Organizational Behavior, 25, 147-173. doi:10.1002/job.236.
4. Anderson, N., & Ones, D. S. (2003). The construct validity of three entry-level personality inventories: Cautionary findings from a multiple inventory investigation. European Journal of Personality, 17, 1-28. doi:10.1002/per.484.
5. Anderson, N., Potočnik, K., & Zhou, J. (2012). Innovation and creativity in organizations: A state-of-the-science review and prospective commentary. Unpublished manuscript.
6. Arthur, W. J., Bennett, W. J., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88, 234-245. doi:10.1037/0021-9010.88.2.234.
7. Atwater, L. E., & Brett, J. F. (2005). Antecedents and consequences of reactions to developmental 360° feedback. Journal of Vocational Behavior, 66, 532-548. doi:10.1016/j.jvb.2004.05.003.
8. Atwater, L. E., & Yammarino, F. J. (1997). Self-other rating agreement: A review and model. In G. R. Ferris & G. R. Ferris (Eds.), Research in personnel and human resources management, vol. 15 (pp. 121-174). Greenwich, CT: JAI Press.
9. Axtell, C., Holman, D., & Wall, T. (2006). Promoting innovation: A change study. Journal of Occupational and Organizational Psychology, 79, 509-516. doi:10.1348/096317905X68240.
10. Axtell, C. M., Holman, D. J., Unsworth, K. L., Wall, T. D., Waterson, P. E., & Harrington, E. (2000). Shopfloor innovation: Facilitating the suggestion and implementation of ideas. Journal of Occupational and Organizational Psychology, 73, 265-285. doi:10.1348/096317900167029.
11. Baer, M. (2010). The strength-of-weak-ties perspective on creativity: A comprehensive examination and extension. Journal of Applied Psychology, 95, 592-601. doi:10.1037/a0018761.
12. Baer, M., & Frese, M. (2003). Innovation is not enough: Climates for initiative and psychological safety, process innovations, and firm performance. Journal of Organizational Behavior, 24, 45-68. doi:10.1002/job.179.
13. Barrick, M. R., Mount, M. K., & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9-30. doi:10.1111/1468-2389.00160.
14. Bartram, D. (2005). The great eight competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 9, 1185-1203. doi:10.1037/0021-9010.90.6.1185.
15. Becker, G. A., & Miller, C. E. (2002). Examining contrast effects in performance appraisals: Using appropriate controls and assessing accuracy. Journal of Psychology, 136, 667-683. doi:10.1080/00223980209604827.
16. Beehr, T. A., Ivanitskaya, L., Hansen, C. P., Erofeev, D., & Gudanowski, D. M. (2001). Evaluation of 360 degree feedback ratings: Relationships with each other and with performance and selection predictors. Journal of Organizational Behavior, 22, 775-788. doi:10.1002/job.113.
17. Berson, Y., Oreg, S., & Dvir, T. (2008). CEO values, organizational culture and firm outcomes. Journal of Organizational Behavior, 29, 615-633. doi:10.1002/job.499.
18. Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analyses. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). San Francisco, CA: Jossey-Bass.
19. Burke, M. J., Finkelstein, L. M., & Dusig, M. S. (1999). On average deviation indices for estimating interrater agreement. Organizational Research Methods, 2, 49-68. doi:10.1177/109442819921004.
20. Campbell, J. P., McCloy, R. A., Oppler, S. H., & Sager, C. E. (1993). A theory of performance. In N. Schmitt & W. C. Borman (Eds.), Personnel selection in organizations (pp. 35-70). San Francisco, CA: Jossey-Bass.
21. Cardinal, L. B. (2001). Technological innovation in the pharmaceutical industry: The use of organizational control in managing research and development. Organization Science, 12, 19-36. doi:10.1287/orsc.12.1.19.10119.
22. Chi, N., Huang, Y., & Lin, S. (2009). A double-edged sword? Exploring the curvilinear relationship between organizational tenure diversity and team innovation: The moderating role of team-oriented HR practices. Group & Organization Management, 34, 698-726. doi:10.1177/1059601109350985.
23. Clegg, C., Unsworth, K., Epitropaki, O., & Parker, G. (2002). Implicating trust in the innovation process. Journal of Occupational & Organizational Psychology, 75, 409-422. doi:10.1348/096317902321119574.
24. Cohen, J. (1998). Standard power analysis for the behavioral sciences (2nd ed.) Hillsdale, NJ: Lawrence Elburn.
25. Dalessio, A. (1998). Using multisource feedback for employee development and personnel decisions. In J. W. Smither (Ed.), Performance appraisal: State of the art in practice (pp. 278-330). San Francisco, CA: Jossey-Bass.
26. Eckert, R., Ekelund, B. Z., Gentry, W. A., & Dawson, J. F. (2010). 'I don't see me like you see me, but is that a problem?' cultural influences on rating discrepancy in 360-degree feedback instruments. European Journal of Work and Organizational Psychology, 19, 259-278. doi:10.1080/13594320802678414.
27. Frese, M., Teng, E., & Wijnen, C. J. D. (1999). Helping to improve suggestion systems: Predictors of making suggestions in companies. Journal of Organizational Behavior, 2, 1139-1155. doi:10.1002/(SICI)1099-1379(199912)20:7<1139:AID-JOB946>3.0.CO;2-I.
28. Frese, M., & Zapf, D. (1994). Action as the core of work psychology: A German approach. In H. C. Triandis, M. D. Dunette, & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (Vol. 4, pp. 271-340). Palo Alto, CA: Consulting Psychologists Press.
29. George, J. M., & Zhou, J. (2001). When openness to experience and conscientiousness are related to creative behavior: An interactional approach. Journal of Applied Psychology, 86, 513-524. doi:10.1037/0021-9010.86.3.513.
30. Gilson, L. L., & Shalley, C. E. (2004). A little creativity goes a long way: An examination of teams' engagement in creative processes. Journal of Management, 3, 453-470. doi:10.1016/j.jm.2003.07.001.
31. Hensel, R., Meijers, F., Van der Leeden, R., & Kessels, J. (2010). 360 degree feedback: How many raters are needed for reliable ratings on the capacity to develop competences, with personal qualities as developmental goals? The International Journal of Human Resource Management, 21, 2813-2830. doi:10.1080/09585192.2010.528664.
32. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterization model misspecification. Psychological Methods, 3, 424-453. doi:10.1037/1082-989X.3.4.424.
33. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118.
34. Hülsheger, U. R., Anderson, N., & Salgado, J. F. (2009). Team-level predictors of innovation at work: A comprehensive meta-analysis spanning three decades of research. Journal of Applied Psychology, 94, 1128-1145. doi:10.1037/a0015978.
35. Hunt, S. T. (1996). Generic work behavior: An investigation into the dimensions of entry-level, hourly job performance. Personnel Psychology, 49, 51-83.
36. James, L. (1982). Aggregation bias in estimates of perceptual measures. Journal of Applied Psychology, 67, 219-229. doi:10.1037/0021-9010.67.2.219.
37. James, L. R., Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98. doi:10.1037/0021-9010.69.1.85.
38. Latham, S. F., & Braun, M. (2009). Managerial risk, innovation, and organizational decline. Journal of Management, 35, 258-281. doi:10.1177/0149206308321549.
39. Lindell, M. K., Brandt, C. J., & Whitney, D. J. (1999). A revised index of interrater agreement for multi-item ratings of a single target. Applied Psychological Measurement, 23, 127-135. doi:10.1177/01466219922031257.
40. Miron, E., Erez, M., & Naveh, E. (2004). Do personal characteristics and cultural values that promote innovation, quality, and efficiency compete or complement each other? Journal of Organizational Behavior, 25, 175-199. doi:10.1002/job.237.
41. Moneta, G. B., Amabile, T. M., Schatzel, E. A., & Kramer, S. J. (2010). Multirater assessment of creative contributions to team projects in organizations. European Journal of Work and Organizational Psychology, 19, 150-176. doi:10.1080/13594320902815312.
42. Morgeson, F. P., Mumford, T. V., & Campion, M. A. (2005). Coming full circle: Using research and practice to address 27 questions about 360-degree feedback programs. Consulting Psychology Journal: Practice and Research, 57, 196-209. doi:10.1037/1065-9293.57.3.196.
43. Ohly, S., Sonnentag, S., & Pluntke, F. (2006). Routinization, work characteristics and their relationships with creative and proactive behaviors. Journal of Organizational Behavior, 27, 257-279. doi:10.1002/job.376.
44. Oldham, G. R., & Cummings, A. (1996). Employee creativity: Personal and contextual factors at work. Academy of Management Journal, 39, 607-634. doi:10.2307/256657.
45. Ones, D. S., & Anderson, N. (2002). Gender and ethnic group differences on personality scales in selection: Some British data. Journal of Occupational and Organizational Psychology, 75, 255-276. doi:10.1348/096317902320369703.
46. Ostroff, C., Atwater, L. E., & Feinberg, B. J. (2004). Understanding self-other agreement: A look at rater and ratee characteristics, context, and outcomes. Personnel Psychology, 57, 333-375. doi:10.1111/j.1744-6570.2004.tb02494.x.
47. Pearce, C. L., & Ensley, M. D. (2004). A reciprocal and longitudinal investigation of the innovation process: The central role of shared vision in product and process innovation teams (PPITs). Journal of Organizational Behavior, 25, 259-278. doi:10.1002/job.235.
48. Pirola-Merlo, A., & Mann, L. (2004). The relationship between individual creativity and team creativity: Aggregating across people and time. Journal of Organizational Behavior, 25, 235-257. doi:10.1002/job.240.
49. Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903. doi:10.1037/0021-9010.88.5.879.
50. Potočnik, K., & Anderson, N. (2012a, April). Applying a 360-degree framework to innovative performance measurement. In N. Anderson (chair), International Advances in Innovation and Creativity in the Workplace. Invited symposium conducted at the Annual Conference of Society of Industrial and Organizational Psychology (SIOP), San Diego, USA.
51. Potočnik, K., & Anderson, N. (2012b, July). Assessment of innovative performance. In N. Anderson & K. Potočnik (Chairs), Advances in Testing and Measurement: Job Performance, Change and Innovation. Invited symposium conducted at the 8th Conference of the International Test Commission, Amsterdam, The Netherlands.
52. Rank, J., Pace, V. L., & Frese, M. (2004). Three avenues for future research on creativity, innovation, and initiative. Applied Psychology: An International Review, 53, 518-528. doi:10.1111/j.1464-0597.2004.00185.x.
53. Rothstein, H. (1990). Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe. Journal of Applied Psychology, 75, 322-327. doi:10.1037/0021-9010.75.3.322.
54. Salgado, J. F. (1997). The five factor model of personality and job performance in the European Community. Journal of Applied Psychology, 82, 30-43. doi:10.1037/0021-9010.82.1.30.
55. Scullen, S. E. (1997). When ratings from one source have been averaged, but ratings from another source have not: Problems and solutions. Journal of Applied Psychology, 82, 880-888. doi:10.1037/0021-9010.82.6.880.
56. Shalley, C. E. (1995). Effects of coaction, expected evaluation, and goal setting on creativity and productivity. Academy of Management Journal, 38, 483-503. doi:10.2307/256689.
57. Shalley, C. E., & Perry-Smith, J. E. (2001). Effects of social-psychological factors on creative performance: The role of informational and controlling expected evaluation and modeling experience. Organizational Behavior and Human Decision Processes, 84, 1-22. doi:10.1006/obhd.2000.2918.
58. Smither, J. W., Barry, S. R., & Reilly, R. R. (1989). An investigation of the validity of expert true score estimates in appraisal research. Journal of Applied Psychology, 74, 143-151. doi:10.1037/0021-9010.74.1.143.
59. Subramaniam, M., & Youndt, M. A. (2005). The influence of intellectual capital on the types of innovative capabilities. Academy of Management Journal, 48, 450-463. doi:10.5465/AMJ.2005.17407911.
60. Welbourne, T. M., Johnson, D. E., & Erez, A. (1998). The role-based performance scale: Validity analysis of a theory-based measure. Academy of Management Journal, 41, 540-555. doi:10.2307/256941.
61. West, M. A., & Anderson, N. (1992). Innovation, cultural values and the management of change in British hospitals. Work and Stress, 6, 293-310. doi:10.1080/02678379208259959.
62. West, M. A., & Anderson, N. R. (1996). Innovation in top management teams. Journal of Applied Psychology, 81, 680-693. doi:10.1037/0021-9010.81.6.680.
63. West, M. A., & Farr, J. L. (1990). Innovation at work. In M. A. West & J. L. Farr (Eds.), Innovation and creativity at work: Psychological and organizational strategies (pp. 3-13). Chichester: Wiley.
64. West, M. A., Smith, H., Feng, W. L., & Lawthom, R. (1998). Research excellence and departmental climate in British universities. Journal of Occupational and Organizational Psychology, 71, 261-281.
65. Yammarino, F. J., & Atwater, L. E. (1993). Understanding self-perception accuracy: Implications for human resource management. Human Resource Management, 32, 231-247.
66. Yuan, F., & Woodman, R. W. (2010). Innovative behavior in the workplace: The role of performance and image outcome expectations. Academy of Management Journal, 53, 323-342. doi:10.5465/AMJ.2010.49388995.
67. Zhang, Z., Hempel, P. S., Han, Y., & Tjosvold, D. (2007). Transactive memory system links work team characteristics and performance. Journal of Applied Psychology, 92, 1722-1730. doi:10.1037/0021-9010.92.6.1722.