Perceptual equivalence of psychological climates within groups: When agreement indices do not agree

Journal of Occupational and Organizational Psychology

Volumn 85, Issue 3, 2012, Pages 454-471

  Beus, Jeremy M ^a   Jarrett, Steven M ^a   Bergman, Mindy E ^a   Payne, Stephanie C ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84863496913     PISSN: 09631798     EISSN: 20448325     Source Type: Journal    
DOI: 10.1111/j.2044-8325.2011.02049.x     Document Type: Article

References (51)

1. Baker, J. A., III. (2007). The report of the BP U.S. refineries independent safety review panel. doi:
2. Bergman, M. E. (2011). Agreement, disagreement, and a person-centered psychology of working. Industrial and Organizational Psychology: Perspectives on Science and Practice, 4, 131-135.
3. Beus, J. M., Bergman, M. E., & Payne, S. C. (2010). The influence of organizational tenure on safety climate strength. Accident Analysis and Prevention, 42, 1431-1437. doi:
4. Beus, J. M., Payne, S. C., Bergman, M. E., & Arthur, W., Jr. (2010). Safety climate and injuries: An examination of theoretical and empirical relationships. Journal of Applied Psychology, 95, 713-727. doi:
5. Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). San Francisco, CA: Jossey-Bass.
6. Bliese, P. D., Chan, D., & Ployhart, R. E. (2007). Multilevel methods: Future directions in measurement, longitudinal analyses, and nonnormal outcomes. Organizational Research Methods, 10, 551-563. doi:
7. Bliese, P. D., & Halverson, R. R. (1998). Group size and measures of group-level properties: An examination of eta-squared and ICC values. Journal of Management, 24, 157-172.
8. Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185-216. doi:
9. Brislin, R. W. (1986). The wording and translation of research instruments. In W. J. Lonner & J. W. Berry (Eds.), Cross-cultural research methodology series: Vol. 8. Field methods in cross-cultural psychology (pp. 137-164). Beverly Hills, CA: Sage.
10. Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466. doi:
11. Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246. doi:
12. Cheyne, A., Tomas, J. M., Cox, S., & Oliver, A. (2003). Perceptions of safety climate at different employment levels. Work and Stress, 17, 21-37. doi:
13. Christian, M. S., Bradley, J. C., Wallace, J. C., & Burke, M. J. (2009). Workplace safety: A meta-analysis of the roles of person and situation factors. Journal of Applied Psychology, 94, 1103-1127. doi:
14. Cole, M. S., & Bruch, H. (2006). Organizational identity strength, identification, and commitment and their relationships to turnover intention: Does organizational hierarchy matter? Journal of Organizational Behavior, 27, 585-605. doi:
15. Dickson, M. W., Resick, C. J., & Hanges, P. J. (2006). When organizational climate is unambiguous, it is also strong. Journal of Applied Psychology, 91, 351-364. doi:
16. Drasgow, F., & Hulin, C. L. (1987). Cross-cultural measurement. Interamerican Journal of Psychology, 21, 1-24.
17. Fisher, C. D. (1986). Organizational socialization: An integrative review. In K. M. Rowland & G. R. Ferris (Eds.) Research in Personnel and Human Resource Management (pp. 101-145). Greenwich, CT: JAI Press.
18. French, J. R. P., & Raven, B. H. (1955). The bases of social power. In D. Cartwright (Ed.), Studies in social power (pp. 150-167). Ann Arbor, MI. : Institute of Social Research, University of Michigan.
19. Glick, W. H. (1985). Conceptualizing and measuring organizational and psychological climate: Pitfalls in multilevel research. Academy of Management Review, 10, 601-616. doi:
20. Hinkin, T. R. (1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1, 104-121. doi:
21. Hulin, C. L., Drasgow, F., & Komocar, J. (1982). Applications of item response theory to analysis of attitude scale translations. Journal of Applied Psychology, 67, 818-825. doi:
22. James, L. R. (1982). Aggregation bias in estimates of perceptual agreement. Journal of Applied Psychology, 67, 219-229. doi:
23. James, L. R., Choi, C. C., Ko, C. E., McNeil, P. K., Minton, M. K., Wright, M. A., & Kim, K. (2008). Organizational and psychological climate: A review of theory and research. European Journal of Work and Organizational Psychology, 17, 5-32. doi:
24. James, L. R., Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98. doi:
25. James, L. R., James, L. A., & Ashe, D. K. (1990). The meaning of organizations: The role of cognition and values. In B. Schneider (Ed.), Organizational climate and culture (pp. 40-84). San Francisco, CA: Jossey-Bass.
26. James, L. R., & Jones, A. P. (1974). Organizational climate: A review of theory and research. Psychological Bulletin, 81, 1096-1112. doi:
27. Joyce, W. F., & Slocum, J. W., Jr. (1979). Climates in organizations. In S. Kerr (Ed.), Organizational behavior (pp. 317-333). Columbus, OH: Grid.
28. Klein, K. J., Conn, A. B., Smith, D. B., & Sorra, J. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. Journal of Applied Psychology, 86, 3-16. doi:
29. Lau, D., & Murnighan, J. K. (1998). Demographic diversity and faultlines: The compositional dynamics of organizational groups. Academy of Management Review, 23, 325-340. doi:
30. Lau, D., & Murnighan, J. K. (2005). Interactions within groups and subgroups: Effects of demographic faultlines. Academy of Management Journal, 48, 645-659. doi:
31. Lindell, M. K., & Brandt, C. J. (2000). Climate quality and climate consensus as mediators of the relationship between organizational antecedents and outcomes. Journal of Applied Psychology, 85, 331-348. doi:
32. Louis, M. R. (1980). Surprise and sense making: What a newcomers experience in entering unfamiliar organizational settings. Administrative Science Quarterly, 25, 226-251.
33. Meriac, J. P., Poling, T. L., & Woehr, D. J. (2009). Are there gender differences in work ethic? An examination of the measurement equivalence of the multidimensional work ethic profile. Personality and Individual Differences, 47, 209-213. doi:
34. Muthén, L. K., & Muthén, B. O. (2010). Mplus 6.0 user's guide. Los Angeles, CA: Muthén & Muthén.
35. O'Reilly, C. A., Caldwell, D. F., & Barnett, W. P. (1989). Work group demography, social integration, and turnover. Administrative Science Quarterly, 34, 21-37.
36. Ostroff, C., & Kinicki, A. J., & Tamkins, M. M. (2003). Organizational culture and climate. In W. C. Borman, D. R. Ilgen, & R. J. Klimoski (Eds.), Handbook of psychology: Industrial and organizational psychology (pp. 565-593). Hoboken, NJ: John Wiley & Sons, Inc.
37. Podsakoff, P. M., & Organ, D. W. (1986). Self-reports in organizational research: Problems and prospects. Journal of Management, 12, 531-544. doi:
38. Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5-39). San Francisco, CA: Jossey-Bass.
39. Schneider, B., Ehrhart, M. G., & Macey, W. H. (2011). Perspectives on organizational climate and culture. In S. Zedeck (Ed.) APA handbook of industrial and organizational psychology, Vol 1: Building and developing the organization (pp. 373-414). Washington, DC: American Psychological Association.
40. Schneider, B., & Reichers, A. E. (1983). On the etiology of climates. Personnel Psychology, 36, 19-39. doi:
41. Schneider, B., Salvaggio, A. N., & Subirats, M. (2002). Climate strength: A new direction for climate research. Journal of Applied Psychology, 87, 220-229. doi:
42. Schneider, B., White, S. S., & Paul, M. C. (1998). Linking service climate and customer perceptions of service quality: Tests of a causal model. Journal of Applied Psychology, 83, 150-163. doi:
43. Spector, P. E., & Jex, S. M. (1998). Development of four self-report measures of job stressors and strain: Interpersonal conflict at work scale, organizational constraints scale, quantitative workload inventory, and physical symptoms inventory. Journal of Occupational Health Psychology, 3, 356-367. doi:
44. Thatcher, S. M. B., & Patel, P. C. (2011). Demographic faultlines: A meta-analysis of the literature. Journal of Applied Psychology, 96, 1119-1139. doi:
45. Van Maanen, J., & Schein, E. H. (1979). Toward a theory of organizational socialization. Research in Organizational Behavior, 1, 209-264.
46. Weick, K. E. (1995). Sensemaking in organizations. Thousand Oaks, CA: Sage.
47. Woehr, D. J., Arciniega, L. M., & Lim, D. H. (2007). Examining work ethic across populations: A comparison of the multidimensional work ethic profile across three diverse cultures. Educational and Psychological Measurement, 67, 154-168.
48. Zohar, D. (2000). A group-level model of safety climate: Testing the effect of group climate on microinjuries in manufacturing jobs. Journal of Applied Psychology, 85, 587-596. doi:
49. Zohar, D. (2003). Safety climate: Conceptual and measurement issues. In J. C. Quick & L. E. Tetrick (Eds.), Handbook of occupational health psychology (pp. 123-142). Washington, DC: American Psychological Association.
50. Zohar, D., & Luria, G. (2005). A multilevel model of safety climate: Cross-level relationships between organization and group-level climates. Journal of Applied Psychology, 90, 616-628. doi:
51. Zohar, D., & Tenne-Gazit, O. (2008). Transformational leadership and group interaction as a climate antecedent: A social network analysis. Journal of Applied Psychology, 93, 744-757. doi: