Change the Referent? A Meta-Analytic Investigation of Direct and Referent-Shift Consensus Models for Organizational Climate

Journal of Management

Volumn 42, Issue 4, 2016, Pages 838-861

  Wallace, J Craig ^a   Edwards, Bryan D ^a   Paul, Jeff ^b   Burke, Michael ^c   Christian, Michael ^d   Eissa, Gabi ^a  

^a OKLAHOMA STATE UNIVERSITY   (United States)

^b ILLINOIS STATE UNIVERSITY   (United States)

^c TULANE UNIVERSITY   (United States)

^d UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

culture and climate; groups group processes dynamics; hierarchical linear modeling (HLM) multi level; teams

Indexed keywords

EID: 84962137601     PISSN: 01492063     EISSN: 15571211     Source Type: Journal    
DOI: 10.1177/0149206313484520     Document Type: Article

References (129)

1. A.AlexandrovE.BabakusU.Yavas2007. The effects of perceived management concern for frontline employees and customers on turnover intentions. Journal of Service Research, 9: 356-371.
2. D.R.AllenM.Wilburn2002. Linking customer and employee satisfaction to the bottom line. Milwaukee, WI: American Society for Quality.
3. C.M.AndersonM.M.Martin1999. The relationship of argumentativeness and verbal aggressiveness to cohesion, consensus, and satisfaction in small groups. Communication Reports, 12: 21-31.
4. W.ArthurJr.S.T.BellB.D.Edwards2007. A longitudinal examination of the comparative criterion-related validity of additive and referent-shift consensus operationalizations of team efficacy. Organizational Research Methods, 10: 35-58.
5. J.T.AustinT.R.Crespin2006. Problems of criteria in industrial and organizational psychology: Progress problems and prospects. In (Eds.), Performance measurement: Current perspectives and future challenges: 9-48. Mahwah, NJ: Lawrence Erlbaum.
6. J.T.AustinP.Villanova1992. The criterion problem: 1917–1992. Journal of Applied Psychology, 77: 836-874.
7. M.*BaerM.Frese2003. Innovation is not enough: Climates for initiative and psychological safety, process innovations, and firm performance. Journal of Organizational Behavior, 24: 45-68.
8. J.BarlingC.LoughlinE.K.Kelloway2002. Development and test of a model linking safety-specific transformational leadership and occupational safety. Journal of Applied Psychology, 87: 488-496.
9. J.J.Bartko1976. On various intraclass correlation reliability coefficients. Psychological Bulletin, 83: 762-765.
10. K.L.Bettenhuasen1991. Five years of group research: What have we learned and what needs to be addressed. Journal of Management, 17: 345-381.
11. C.C.*BoruckiM.J.Burke1999. An examination of service-related antecedents to retail store performance. Journal of Organizational Behavior, 20: 943-962.
12. D.E.BowenC.Ostroff2004. Understanding HRM-firm performance linkages: The role of the “strength” of the system. Academy of Management Review, 29: 203-221.
13. M.J.BurkeC.C.BoruckiA.Hurley1992. Reconceptualizing psychological climate in a retail service environment: A multiple stakeholder perspective. Journal of Applied Psychology, 77: 717-729.
14. M.J.BurkeC.C.BoruckiJ.Kaufman2002. Contemporary perspectives on the study of psychological and organizational climate: A commentary. European Journal of Work and Organizational Psychology, 11: 325-340.
15. M.J.BurkeS.Chan-SerafinR.SalvadorA.SmithS.Sarpy2008. The role of national culture and organizational climate in safety training effectiveness. European Journal of Work and Organizational Psychology, 17: 133-154.
16. M.J.BurkeW.P.Dunlap2002. Estimating interrater agreement with the Average Deviation (AD)index: A user’s guide. Organizational Research Methods, 5: 159-172.
17. M.J.BurkeR.Landis2003. Methodological and conceptual issues in applications of meta-analysis. In (Ed.), Validity generalization: A critical review: 287-310. Hillsdale, NJ: Lawrence Erlbaum.
18. M.J.BurkeM.T.RupinskiW.P.DunlapH.K.Davison1996. Do situational variables act as substantive causes of relationships between individual difference variables? Two large-scale tests of “Common Cause” models. Personnel Psychology, 49: 573-598.
19. J.Z.CarrA.M.SchmidtJ.K.FordR.P.DeShon2003. Climate perceptions matter: A meta-analytic path analysis relating molar climate, cognitive and affective states, and individual level work outcomes. Journal of Applied Psychology, 88: 605-619.
20. D.Chan1998. Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83: 234-246.
21. G.*ChenB.KirkmanR.KanferD.AllenB.Rosen2007. A multilevel study of leadership, empowerment, and performance in teams. Journal of Applied Psychology, 92: 331-346.
22. Z.*ChenW.LamJ.A.Zhong2007. Leader-member exchange and member performance: A new look at individual-level negative feedback-seeking behavior and team-level empowerment climate. Journal of Applied Psychology, 92: 202-212.
23. M.S.ChristianJ.C.BradleyJ.C.WallaceM.J.Burke2009. Workplace safety: A meta-analysis of the roles of person and situation factors. Journal of Applied Psychology, 94: 1103-1127.
24. C.ChuangH.Liao2010. Strategic human resource management in service context: Taking care of business by taking care of employees and customers. Personnel Psychology, 63: 153-196.
25. C.J.*CollinsK.G.Smith2006. Knowledge exchange and combination: The role of human resource practices in the performance of high-technology firms. Academy of Management Journal, 49: 544-560.
26. J.A.*ColquittR.A.NoeC.L.Jackson2002. Justice in teams: Antecedents and consequences of procedural justice climate. Personnel Psychology, 55: 83-109.
27. L.J.CronbachG.C.Gleser1965. Psychological tests and personnel decisions. Urbana, IL: University of Illinois Press.
28. J.*CullenK.P.ParboteeahB.Victor2003. The effects of ethical climates on organizational commitment: A two-study analysis. Journal of Business Ethics, 46: 127-141.
29. J.F.*DawsonV.Gonzalez-RomaA.DavisM.A.West2008. Organisational climate and climate strength in UK hospitals. European Journal of Work and Organizational Psychology, 17: 89-111.
30. A.*de JongK.de RuyterJ.Lemmink2005. Service climate in self-managing teams: Mapping the linkage of team member perceptions and service performance outcomes in a business-to-business setting. Journal of Management Studies, 42: 1593-1620.
31. L.A.DeChurchJ.R.Mesmer-Magnus2010. The cognitive underpinnings of effective teamwork: A meta-analysis. Journal of Applied Psychology, 95: 32-53.
32. J.*DietzS.D.PughJ.Wiley2004. Service climate effects on customer attitudes: An examination of boundary conditions. Academy of Management Journal, 47: 81-92.
33. M.G.*Ehrhart2004. Leadership and procedural justice climate as antecedents of unit-level organizational citizenship behavior. Personnel Psychology, 57: 61-94.
34. A.ErezM.C.BloomM.T.Wells1996. Using random rather than fixed effects models in meta-analysis: Implications for situational specificity and validity generalization. Personnel Psychology, 49: 275-306.
35. D.*FayH.LuhrmannC.Kohl2004. Proactive climate in a post-reorganization setting: When staff compensate managers’ weakness. European Journal of Work and Organizational Psychology, 13: 241-267.
36. G.A.*GeladeM.Ivery2003. The impact of human resource management and work climate on organizational performance. Personnel Psychology, 56: 383-404.
37. G.A.*GeladeS.Young2005. Test of a service profit chain model in the retail banking sector. Journal of Occupational & Organizational Psychology, 78: 1-22.
38. C.B.GibsonA.E.RandelP.C.Earley2000. Understanding group efficacy: An empirical test of multiple assessment methods. Group and Organization Management, 25: 67-97.
39. F.*GilR.RicoC.M.AlcoverA.Barrasa2005. Change-oriented leadership, satisfaction and performance in work groups, Journal of Managerial Psychology, 20: 312-328.
40. W.H.Glick1985. Conceptualization and measuring organizational and psychological climate: Pitfalls of multilevel research. Academy of Management Review, 10: 601-610.
41. C.GlissonL.R.James2002. The cross-level effects of culture and climate in human service teams. Journal of Organizational Behavior, 23: 767-794.
42. V.*Gonzalez-RomaL.Fortes-FerreiraJ.Peiro2009. Team climate, climate strength and team performance. A longitudinal study. Journal of Occupational and Organizational Psychology, 82: 511-536.
43. J.R.Hackman1986. The psychology of self-management in organizations. In (Eds.), Psychology and work: Productivity, change, and employment: 89-136. Washington, DC: American Psychological Association.
44. D.A.HarrisonD.A.NewmanP.L.Roth2006. How important are job attitudes? Meta-analytic comparisons of integrative behavioral outcomes and time sequences. Academy of Management Journal, 49: 305-325.
45. D.A.*HofmannB.Mark2006. An investigation of the relationship between safety climate and medication errors as well as other nurse and patient outcomes. Personnel Psychology, 59: 847-869.
46. D.A.*HofmannA.Stetzer1996. A cross-level investigation of factors influencing unsafe behaviors and accidents. Personnel Psychology, 49: 307-339.
47. D.A.*HofmannA.Stetzer1998. The role of safety climate and communication in accident interpretation: Implications for learning from negative events. Academy of Management Journal, 41: 644-657.
48. C.H.*HuiW.C.K.ChiuP.L.H.YuK.ChengH.Tse2007. The effects of service climate and the effective leadership behaviour of supervisors on frontline employee service quality: A multi-level analysis. Journal of Occupational & Organizational Psychology, 80: 151-172.
49. J.E.HunterF.L.Schmidt2004. Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks, CA: Sage.
50. D.J.Isenberg1986. Group polarization: A critical review and meta-analysis. Journal of Personality and Social Psychology, 50: 1141-1151.
51. L.R.James1982. Aggregation bias in estimates of perceptual agreement. Journal of Applied Psychology, 67: 219-229.
52. L.R.JamesC.C.ChoiC.E.KoP.K.McNeilM.K.MintonM.A.WrightK.Kim2008. Organizational and psychological climate: A review of theory and research. European Journal of Work and Organizational Psychology, 17: 5-32.
53. L.R.JamesR.G.DemareeS.A.MulaikR.T.Ladd1992. Validity generalization in the context of situational models. Journal of Applied Psychology, 77: 3-14.
54. L.R.JamesR.G.DemareeG.Wolf1984. Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69: 85-98.
55. L.A.JamesL.R.James1989. Integrating work perceptions: Explorations into the measurement of meaning. Journal of Applied Psychology, 74: 739-751.
56. I.L.Janis1971. Groupthink. Psychology Today, 5: 43-46.
57. J.W.Johnson1996. Linking employee perceptions of service climate to customer satisfaction. Personnel Psychology, 49: 831-851.
58. T.*Katz-NavonE.NavehZ.Stern2005. Safety climate in healthcare organizations: A multidimensional approach. Academy of Management Journal, 48: 1075-1089.
59. C.A.KieslerS.B.Kiesler1969. Conformity. Reading, MA: Addison-Wesley.
60. E.B.*KingK.de ChermontM.WestJ.F.DawsonM.Hebl2007. How innovation can alleviate negative consequences of demanding work contexts: The influence of climate for innovation on organizational outcomes. Journal of Occupational and Organizational Psychology, 80: 631-645.
61. B.L.KirkmanP.E.TeslukB.Rosen2001. Assessing the incremental validity of consensus ratings over aggregation of individual-level data in predicting team effectiveness. Personnel Psychology, 54: 645-667.
62. K.J.*KleinA.B.ConnB.SmithJ.S.Sorra2001. Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. Journal of Applied Psychology, 86: 3-16.
63. K.J.KleinF.DansereauR.J.Hall1994. Levels issues in theory development, data collection, and analysis. Academy of Management Review, 19: 105-229.
64. R.E.KopelmanA.P.BriefR.A.Guzzo1990. The role of climate and culture in productivity. In (Ed.), Organizational climate and culture: 282-318. San Francisco: Jossey-Bass.
65. S.W.J.KozlowskiK.J.Klein2000. A multilevel approach to theory and research in organization: Contextual, temporal, and emergent properties. In (Eds.), Multilevel theory, research, and methods in organizations: 3-90. San Francisco: Jossey-Bass.
66. M.KuenziM.Schminke2009. Assembling fragments into a lens: A review, critique, and proposed research agenda for the organizational work climate literature. Journal of Management, 35: 634-717.
67. H.*LiaoA.Chuang2004. A multilevel investigation of factors influencing employee service performance and customer outcomes. Academy of Management Journal, 47: 41-58.
68. M.*LindellC.Brandt2000. Climate quality and climate consensus as mediators of the relationship between organizational antecedents and outcomes. Journal of Applied Psychology, 85: 331-348.
69. M.W.LipseyD.B.Wilson2001. Practical meta-analysis. Thousand Oaks, CA: Sage.
70. G.*Luria2008. Controlling for quality: Climate, leadership, and behavior. Quality Management Journal, 15: 27-42.
71. G.*LuriaD.Yagil2008. Procedural justice, ethical climate and service outcomes in restaurants. International Journal of Hospitality Management, 27: 276-283.
72. J.S.*MacCormickS.K.Parker2010. A multiple climates approach to understanding business unit effectiveness. Human Relations, 63: 1171-1806.
73. A.*Martin2008. Service climate and employee well-being in higher education. Journal of Management & Organization, 14: 155-167.
74. C.M.MasonM.A.Griffin2003. Identifying group task satisfaction at work. Small Group Research, 34: 413-442.
75. J.E.MathieuG.Chen2011. The etiology of the multilevel paradigm in management research. Journal of Management, 37: 610-641.
76. G.E.*MathisenT.TorsheimS.Einarsen2006. The team-level model of climate for innovation: A two-level confirmatory factor analysis. Journal of Occupational and Organizational Psychology, 79: 23-35.
77. D.M.*MayerM.KuenziR.L.Greenbaum2010. Examining the link between ethical leadership and employee misconduct: The mediating role of ethical climate. Journal of Business Ethics, 95: 7-16.
78. M.T.*MaynardJ.E.MathieuW.M.MarshT.M.Ruddy2007. A multilevel investigation of the influences of employees’ resistance to empowerment. Human Performance, 20: 147-171.
79. P.F.*McKayD.R.AveryM.A.Morris2008. Mean racial-ethnic differences in employee sales performance: The moderating role of diversity climate. Personnel Psychology, 61: 349-374.
80. P.F.*McKayD.R.AveryM.A.Morris2009. A tale of two climates: Diversity climate from subordinates’ and managers’ perspectives and their role in store unit sales performance. Personnel Psychology, 62: 767-791.
81. S.*NaumannN.Bennett2002. The effects of procedural justice climate on work group performance. Small Group Research, 33: 361-377.
82. E.*NavehT.Katz-NavonZ.Stern2005. Treatment errors in healthcare: A safety climate approach. Management Science, 51: 948-960.
83. A.*NealM.A.Griffin2006. A longitudinal study of the relationships among safety climate, safety behavior, and accidents at the individual and group levels. Journal of Applied Psychology, 91: 946-953.
84. A.OrtonyG.L.CloreA.Collins1988. The cognitive structure of emotions. New York: Cambridge University Press.
85. C.*OstroffD.E.Bowen2000. Moving HR to a higher level: HR practices and organizational effectiveness. In (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions: 211-266. San Francisco: Jossey-Bass.
86. C.OstroffA.KinickiM.Clark2002. Substantive and operational issues of response bias across levels of analysis: An example of climate-satisfaction relationships. Journal of Applied Psychology, 87: 355-368.
87. C.OstroffA.J.KinickiM.M.Tamkins2003. Organizational culture and climate. In (Eds.), Comprehensive handbook of psychology: Vol. 12. Industrial and organizational psychology: 565-594. New York: Wiley.
88. R.C.Overton1998. A comparison of fixed-effects and mixed (random-effects) models for meta-analysis tests of moderator variable effects. Psychological Methods, 3: 354-379.
89. M.PattersonP.WarrM.West2004. Organizational climate and company productivity: The role of employee affect and employee level. Journal of Occupational and Organizational Psychology, 77: 193-216.
90. A.*Pirola-MerloC.HärtelL.MannG.Hirst2002. How leaders influence the impact of affective events on team climate and performance in R&D teams. Leadership Quarterly, 13: 561-581.
91. T.*Probst2004. Safety and insecurity: Exploring the moderating effect of organizational safety climate. Journal of Occupational Health Psychology, 9: 3-40.
92. N.R.QuigleyA.G.TekleabP.E.Tesluk2007. Comparing consensus- and aggregation-based methods of measuring team-level variables: The role of relationship conflict and conflict management processes. Organizational Research Methods, 10: 589-608.
93. N.S.RajuP.A.Brand2003. Determining the significance of correlations corrected for unreliability and range restriction. Applied Psychological Measurement, 27: 52-71.
94. N.S.RajuM.J.BurkeJ.NormandG.Langlois1991. A new meta-analytic approach. Journal of Applied Psychology, 76: 432-446.
95. H.A.*RichardsonR.J.Vandenberg2005. Integrating managerial perceptions and transformational leadership into a work-unit level model of employee involvement. Journal of Organizational Behavior, 26: 561-589.
96. D.M.Rousseau1985. Issues of level in organizational research: Multi-level and cross-level perspectives. Research in Organizational Behavior, 7: 1-37.
97. M.*SalanovaS.AgutJ.M.Peiro2005. Linking organizational resources and work engagement to employee performance and customer loyalty: The mediation of service climate. Journal of Applied Psychology, 90: 1217-1227.
98. M.J.*SchmitS.P.Allscheid1995. Employee attitudes and customer satisfaction: Making theoretical and empirical connections. Personnel Psychology, 48: 521-536.
99. B.SchneiderD.Bowen1993. The service organization: Human resources management is crucial. Organizational Dynamics, 21: 39-52.
100. B.SchneiderD.BowenM.E.EhrhartK.M.Holcombe2000. The climate for service: Evolution of a construct. In (Eds.), Handbook of organizational culture and climate: 21-36. Thousand Oaks, CA: Sage.
101. B.*SchneiderM.G.EhrhartD.M.MayerJ.L.SaltzK.Niles-Jolly2005. Understanding organization-customer links in service settings. Academy of Management Journal, 48: 1017-1032.
102. B.SchneiderW.H.MaceyW.LeeS.A.Young2009. Organizational service climate drivers of the American Customer Satisfaction Index (ACSI) and financial and market value performance. Journal of Service Research, 32: 3-14.
103. B.*SchneiderS.S.WhiteM.C.Paul1998. Linking service climate and customer perceptions of service quality: Test of a causal model. Journal of Applied Psychology, 83: 150-163.
104. M.*SchulteC.OstroffS.ShmulyianA.Kinicki2009. Organizational climate configurations: Relationships to collective attitudes, customer satisfaction, and financial performance. Journal of Applied Psychology, 3: 618-634.
105. S.E.*SeibertS.R.SilverW.A.Randolph2004. Taking empowerment to the next level: A multiple-level model of empowerment, performance, and satisfaction. Academy of Management Journal, 47: 332–349.
106. P.E.ShroutJ.L.Fleiss1979. Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86: 420-428.
107. T.*SimonsQ.Roberson2005. Why managers should care about fairness: The effects of aggregate justice perceptions on organizational outcomes. Journal of Applied Psychology, 88: 432-443.
108. K.G.*SmithC.J.CollinsK.D.Clark2005. Existing knowledge, knowledge creation capability, and the rate of new product introduction in high-technology firms. Academy of Management Journal, 48: 346-357.
109. D.R.*SowinskiK.A.FortmannD.V.Lezotte2008. Climate for service and the moderating effects of climate strength on customer satisfaction, voluntary turnover, and profitability. European Journal of Work and Organizational Psychology, 17: 73-88.
110. A.*StetzerF.MorgesonE.Anderson1997. Organizational climate and ineffectiveness: Evidence from 25 outdoor workcrew divisions. Journal of Quality Management, 2: 251.
111. R.TakeuchiG.ChenD.P.Lepak2009. Through the looking glass of a social system: Cross-level effects of high-performance work systems on employees’ attitudes. Personnel Psychology, 62: 1-30.
112. P.*TeslukJ.FarrJ.MathieuR.Vance1995. Generalization of employee involvement training to the job setting: Individual and situational effects. Personnel Psychology, 48: 607-632.
113. C.J.ThoresenS.A.KaplanA.P.BarskyC.R.WarrenK.de Chermont2003. The affective underpinnings of job perceptions and attitudes: A meta-analytic review and integration. Psychological Bulletin, 129: 914-945.
114. A.*TowlerD.V.LezotteM.J.Burke2011. An examination of the service climate-firm performance chain: The role of customer retention. Human Resource Management, 50: 391-406.
115. H.van MierloJ.K.VermuntC.G.Rutte2009. Composing group-level constructs from individual-level survey data. Organizational Research Methods, 12: 368-392.
116. J.Vaslow1999. The multiple stakeholder model of psychological climate: Beyond employees and customers. Unpublished doctoral dissertation, Tulane University, New Orleans, LA.
117. M.*VeldJ.PaauweP.Boselie2011. HRM and strategic climates in hospitals: Does the message come across at the ward level. Human Resource Management, 20: 339-356.
118. S.H.*WagnerC.P.ParkerN.D.Christiansen2003. Employees that think and act like owners: Effects of ownerships beliefs and behaviors on organizational effectiveness. Personnel Psychology, 56: 847-871.
119. C.*WallaceG.Chen2006. A multilevel integration of personality, climate, self-regulation, and performance. Personnel Psychology, 59: 529-557.
120. J.C.*WallaceE.PoppS.Mondore2006. Safety climate as a mediator between foundation climates and occupational accidents. A group level study. Journal of Applied Psychology, 91: 681-688.
121. B.*WalshR.MatthewsM.TullerK.ParksD.McDonald2010. A multilevel model of the effects of equal opportunity climate on job satisfaction in the military. Journal of Occupational Health Psychology, 15: 191-207.
122. F.O.*WalumbwaC.WuB.Orwa2008. Contingent reward transactional leadership, work attitudes, and organizational citizenship behavior: The role of procedural justice climate perceptions and strength. Leadership Quarterly, 19: 251-265.
123. J.W.WhiteoakL.ChalipL.K.Hort2004. Assessing group efficacy: Comparing three measurement models. Small Group Research, 35: 158-173.
124. D.*YagilG.Luria2010. Friends in need: The protective effect of social relationships under low-safety climate. Group & Organization Management, 35: 727-745.
125. M.H.YoonS.E.BeattyJ.Suh2001. The effect of work climate on critical employee and customer outcomes. International Journal of Service Industry Management, 12: 500-521.
126. D.*Zohar1980. Safety climate in industrial organizations: Theoretical and applied implications. Journal of Applied Psychology, 65: 96-102.
127. D.Zohar2000. A group-level model of safety climate: Testing the effect of group climate on micro-accidents in manufacturing jobs. Journal of Applied Psychology, 85: 587-596.
128. D.Zohar2002. Modifying supervisory practices to improve subunit safety: A leadership-based intervention model. Journal of Applied Psychology, 87: 156-163.
129. D.*ZoharG.Luria2005. A multilevel model of safety climate: Cross level relationships between organization and group-level climates. Journal of Applied Psychology, 90: 616-628.