Degrees of Freedom in SEM: Are We Testing the Models That We Claim to Test?

Organizational Research Methods

Volumn 20, Issue 3, 2017, Pages 350-378

  Cortina, Jose M ^a   Green, Jennifer P ^a   Keeler, Kathleen R ^a   Vandenberg, Robert J ^b  

^a GEORGE MASON UNIVERSITY   (United States)

^b UNIVERSITY OF GEORGIA   (United States)

Author keywords

degrees of freedom; questionable research practices; reporting standards; structural equation modeling

Indexed keywords

EID: 85019738695     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428116676345     Document Type: Article

References (89)

1. Indicate that the paper was included in our review
2. *Aryee S., Walumbwa F. O., Seidu E. Y. M., Otaye L. E., (2012). Impact of high-performance work systems on individual- and branch-level performance: Test of a multilevel model of intermediate linkages. Journal of Applied Psychology, 97, 287–300.
3. Bandalos D. L., Finney S. J., (2001). Item parceling issues in structural equation modeling. In Marcoulides G. A., Schumacker R. E., (Eds.), New developments and techniques in structural equation modeling (pp. 269–296). Hillsdale, NJ: Erlbaum.
4. *Barrick M. R., Mount M. K., Strauss J. P., (1993). Conscientiousness and performance of sales representatives: Test of the mediating effects of goal setting. Journal of Applied Psychology, 78, 715.
5. *Bauer T. N., Green S. G., (1994). Effect of newcomer involvement in work-related activities: A longitudinal study of socialization. Journal of Applied Psychology, 79, 211–223.
6. *Borman W. C., Hanson M. A., Oppler S. H., Pulakos E. D., White L. A., (1993). Role of early supervisory experience in supervisor performance. Journal of Applied Psychology, 78, 443–449.
7. *Borman W. C., White L. A., Dorsey D. W., (1995). Effects of ratee task performance and interpersonal factors on supervisor and peer performance ratings. Journal of Applied Psychology, 80, 168–177.
8. *Butts M. M., Casper W. J., Yang T. S., (2013). How important are work-family support policies? A meta-analytic investigation of their effects on employee outcomes. Journal of Applied Psychology, 98, 1–25.
9. *Cable D. M., Kay V. S., (2012). Striving for self-verification during organizational entry. Academy of Management Journal, 55, 360–380.
10. *Carlson D. S., Grzywacz J. G., Ferguson M., Hunter E. M., Clinch C. R., Arcury T. A., (2011). Health and turnover of working mothers after childbirth via the work-family interface: An analysis across time. Journal of Applied Psychology, 96, 1045–1054.
11. Carlson K. D., Wu J., (2011). The illusion of statistical control: Control variable practice in management research. Organizational Research Methods, 15, 413–435.
12. *Carney M., Gedajlovic E. R., Heugens P. P., Van Essen M., Van Oosterhout J. H., (2011). Business group affiliation, performance, context, and strategy: A meta-analysis. Academy of Management Journal, 54, 437–460.
13. *Colquitt J. A., LePine J. A., Piccolo R. F., Zapata C. P., Rich B. L., (2012). Explaining the justice-performance relationship: Trust as exchange deepener or trust as uncertainty reducer? Journal of Applied Psychology, 97, 1–15.
14. *Colquitt J. A., Rodell J. B., (2011). Justice, trust, and trustworthiness: A longitudinal analysis integrating three theoretical perspectives. Academy of Management Journal, 54, 1183–1206.
15. *De Stobbeleir K. E., Ashford S. J., Buyens D., (2011). Self-regulation of creativity at work: The role of feedback-seeking behavior in creative performance. Academy of Management Journal, 54, 811–831.
16. *de Wit F. R. C., Greer L. L., Jehn K. A., (2012). The paradox of intragroup conflict: A meta-analysis. Journal of Applied Psychology, 97, 360–390.
17. *Detert J. R., Edmondson A. C., (2011). Implicit voice theories: Taken-for-granted rules of self-censorship at work. Academy of Management Journal, 54, 461–488.
18. *Diestel S., Schmidt K. H., (2011). Costs of simultaneous coping with emotional dissonance and self-control demands at work: results from two German samples. Journal of Applied Psychology, 96, 643.
19. *Ferris D. L., Johnson R. E., Rosen C. C., Djurdjevic E., Chang C.-H. (Daisy), Tan J. A., (2013). When is success not satisfying? Integrating regulatory focus and approach/avoidance motivation theories to explain the relation between core self-evaluation and job satisfaction. Journal of Applied Psychology, 98, 342–353
20. *Fullagar C. J., Gallagher D. G., Gordon M. E., Clark P. F., (1995). Impact of early socialization on union commitment and participation: A longitudinal study. Journal of Applied Psychology, 80, 147–157.
21. *Geletkanycz M. A., Boyd B. K., (2011). CEO outside directorships and firm performance: A reconciliation of agency and embeddedness views. Academy of Management Journal, 54, 335–352.
22. *Gotlieb J. B., Grewal D., Brown S. W., (1994). Consumer satisfaction and perceived quality: complementary or divergent constructs? Journal of Applied Psychology, 79, 875–885.
23. *Grant A. M., (2013). Rocking the boat but keeping it steady: The role of emotion regulation in employee voice. Academy of Management Journal, 56, 1703–1723.
24. *Guzzo R. A., Noonan K. A., Elron E., (1994). Expatriate managers and the psychological contract. Journal of Applied Psychology, 79, 617–626.
25. *Hoch J. E., Kozlowski S. W. J., (2014). Leading virtual teams: Hierarchical leadership, structural supports, and shared team leadership. Journal of Applied Psychology, 99, 390–403.
26. *Hoffman B. J., Bynum B. H., Piccolo R. F., Sutton A. W., (2011). Person-organization value congruence: How transformational leaders influence work group effectiveness. Academy of Management Journal, 54, 779–796.
27. Holland S., Shore D., Cortina J.M., (in press). A review and best practice recommendations for models integrating mediation and moderation. Organizational Research Methods.
28. *Hu J., Liden R. C., (2011). Antecedents of team potency and team effectiveness: An examination of goal and process clarity and servant leadership. Journal of Applied Psychology, 96, 851–862.
29. *Huang G., Zhao H. H., Niu X., Ashford S. J., Lee C., (2013). Reducing job insecurity and increasing performance ratings: Does impression management matter? Journal of Applied Psychology, 98, 852–862.
30. *Hunt S. D., Morgan R. M., (1994). Organizational commitment: One of many commitments or key mediating construct? Academy of Management Journal, 37, 1568–1587.
31. *Janssens M., Brett J. M., Smith F. J., (1995). Confirmatory cross-cultural research: Testing the viability of a corporation-wide safety policy. Academy of Management Journal, 38, 364–382.
32. *Jaros S. J., Jermier J. M., Koehler J. W., Sincich T., (1993). Effects of continuance, affective, and moral commitment on the withdrawal process: An evaluation of eight structural equation models. Academy of Management Journal, 36, 951–995.
33. *Jiang K., Lepak D. P., Hu J., Baer J. C., (2012). how does human resource management influence organizational outcomes? A meta-analytic investigation of mediating mechanisms. Academy of Management Journal, 55, 1264–1294.
34. *Johnson R. E., Rosen C. C., Djurdjevic E., (2011). Assessing the impact of common method variance on higher order multidimensional constructs. Journal of Applied Psychology, 96, 744–761.
35. *Judge T. A., Boudreau J. W., Bretz R. D., (1994). Job and life attitudes of male executives. Journal of Applied Psychology, 79, 767–782.
36. *Judge T. A., Ferris G. R., (1993). Social context of performance evaluation decisions. Academy of Management Journal, 36, 80–105.
37. *Judge T. A., Kammeyer-Mueller J. D., (2012). On the value of aiming high: The causes and consequences of ambition. Journal of Applied Psychology, 97, 758–775.
38. *Judge T. A., Locke E. A., (1993). Effect of dysfunctional thought processes on subjective well-being and job satisfaction. Journal of Applied Psychology, 78, 475–490.
39. *Judge T. A., Watanabe S., (1993). Another look at the job satisfaction-life satisfaction relationship. Journal of Applied Psychology, 78, 939–948.
40. *Kelloway E. K., Barling J., (1993). Members’ participation in local union activities: Measurement, prediction, and replication. Journal of Applied Psychology, 78(2), 262.
41. *Kirca A. H., Hult G. T. M., Roth K., Cavusgil S. T., Perryy M. Z., Akdeniz M. B., …White R. C., (2011). Firm-specific assets, multinationality, and financial performance: A meta-analytic review and theoretical integration. Academy of Management Journal, 54, 47–72.
42. Kline R. B., (2011). Principles and practice of structural equation modeling. New York, NY: Guilford Press.
43. *Krasikova D. V., LeBreton J. M., (2012). Just the two of us: Misalignment of theory and methods in examining dyadic phenomena. Journal of Applied Psychology, 97, 739–757.
44. *Kumar N., Stern L. W., Anderson J. C., (1993). Conducting interorganizational research using key informants. Academy of Management Journal, 36, 1633–1651.
45. *Lanaj K., Hollenbeck J. R., Ilgen D. R., Barnes C. M., Harmon S. J., (2013). The double-edged sword of decentralized planning in multiteam systems. Academy of Management Journal, 56, 735–757.
46. Landis R. S., Beal D. J., Tesluk P. E., (2000). A comparison of approaches to forming composite measures in structural equation models. Organizational Research Methods, 3, 186–207.
47. Landis R. S., Edwards B. D., Cortina J. M., (2008). On the practice of allowing correlated residuals among indicators in structural equation models. In Lance C. E., Vandenberg R. J., (Eds.), Statistical and methodological myths and urban legends: received doctrine, verity, and fable in the organizational and social sciences (pp. 193–218). Mahwah, NJ: Lawrence Erlbaum
48. *Lang J. W. B., Zettler I., Ewen C., Hülsheger U. R., (2012). Implicit motives, explicit traits, and task and contextual performance at work. Journal of Applied Psychology, 97, 1201–1217.
49. *Leroy H., Dierynck B., Anseel F., Simons T., Halbesleben J. R. B., McCaughey D., …Sels L., (2012). Behavioral integrity for safety, priority of safety, psychological safety, and patient safety: A team-level study. Journal of Applied Psychology, 97, 1273–1281.
50. *Leslie L. M., Manchester C. F., Park T.-Y., Mehng S. A., (2012). Flexible work practices: A source of career premiums or penalties? Academy of Management Journal, 55, 1407–1428.
51. *Lievens F., Patterson F., (2011). The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection. Journal of Applied Psychology, 96, 927–940.
52. *Little T. D., Cunningham W. A., Shahar G., Widaman K. F., (2002). To parcel or not to parcel: Exploring the question, weighing the merits. Structural Equation Modeling, 9, 151–173.
53. Little T. D., Rhemtulla M., Gibson K., Schoemann A. M., (2013). Why the items versus parcels controversy needn’t be one. Psychological Methods, 18, 285–300.
54. *Mayer D. M., Aquino K., Greenbaum R. L., Kuenzi M., (2012). Who displays ethical leadership, and why does it matter? An examination of antecedents and consequences of ethical leadership. Academy of Management Journal, 55, 151–171.
55. *Maynes T. D., Podsakoff P. M., (2014). Speaking more broadly: An examination of the nature, antecedents, and consequences of an expanded set of employee voice behaviors. Journal of Applied Psychology, 99, 87–112.
56. *McAllister D. J., (1995). Affect-and cognition-based trust as foundations for interpersonal cooperation in organizations. Academy of Management Journal, 38, 24–59.
57. *McCloy R. A., Campbell J. P., Cudeck R., (1994). A confirmatory test of a model of performance determinants. Journal of Applied Psychology, 79, 493.
58. *McDonald M. L., Westphal J. D., (2011). My brother’s keeper? CEO identification with the corporate elite, social support among CEOs, and leader effectiveness. Academy of Management Journal, 54, 661–693.
59. *McDonald M. L., Westphal J. D., (2013). Access denied: Low mentoring of women and minority first-time directors and its negative effects on appointments to additional boards. Academy of Management Journal, 56, 1169–1198.
60. Meade A. W., Behrend T. S., Lance C. E., (2009). Dr. StrangeLOVE, or: How I learned to stop worrying and love omitted variables. In Lance C. E., Vandenberg R. J., (Eds.), Statistical and methodological myths and urban legends (pp. 89–105). New York, NY: Taylor & Francis Group, LLC.
61. *Morrison E. W., (1993). Newcomer information seeking: Exploring types, modes, sources, and outcomes. Academy of Management Journal, 36, 557–589.
62. *Niehoff B. P., Moorman R. H., (1993). Justice as a mediator of the relationship between methods of monitoring and organizational citizenship behavior. Academy of Management Journal, 36, 527–556.
63. *Nifadkar S., Tsui A. S., Ashforth B. E., (2012). The way you make me feel and behave: Supervisor-triggered newcomer affect and approach-avoidance behavior. Academy of Management Journal, 55, 1146–1168.
64. *Patel P. C., Messersmith J. G., Lepak D. P., (2013). Walking the tightrope: An assessment of the relationship between high-performance work systems and organizational ambidexterity. Academy of Management Journal, 56, 1420–1442.
65. *Prussia G. E., Kinicki A. J., Bracker J. S., (1993). Psychological and behavioral consequences of job loss: a covariance structure analysis using Weiner’s (1985) attribution model. Journal of Applied Psychology, 78, 382–394.
66. *Rahim M. A., Magner N. R., (1995). Confirmatory factor analysis of the styles of handling interpersonal conflict: First-order factor model and its invariance across groups. Journal of Applied Psychology, 80, 122–132.
67. *Ree M. J., Carretta T. R., Teachout M. S., (1995). Role of ability and prior knowledge in complex training performance. Journal of Applied Psychology, 80, 721.
68. *Restubog S. L. D., Scott K. L., Zagenczyk T. J., (2011). When distress hits home: The role of contextual factors and psychological distress in predicting employees’ responses to abusive supervision. Journal of Applied Psychology, 96, 713–729.
69. Rigdon E. E., (1994). Calculating degrees of freedom for a structural equation model. Structural Equation Modeling: A Multidisciplinary Journal, 1, 274–278.
70. *Riggs M. L., Knight P. A., (1994). The impact of perceived group success-failure on motivational beliefs and attitudes: a causal model. Journal of Applied Psychology, 79, 755–766.
71. *Rodell J. B., (2013). Finding meaning through volunteering: Why do employees volunteer and what does it mean for their jobs? Academy of Management Journal, 56, 1274–1294.
72. *Schaubroeck J., Lam S. S. K., Peng A. C., (2011). Cognition-based and affect-based trust as mediators of leader behavior influences on team performance. Journal of Applied Psychology, 96, 863–871.
73. *Scott S. G., Bruce R. A., (1994). Determinants of innovative behavior: A path model of individual innovation in the workplace. Academy of Management Journal, 37, 580–607.
74. *Sluss D. M., Ployhart R. E., Cobb M. G., Ashforth B. E., (2012). Generalizing newcomers’ relational and organizational identifications: Processes and prototypicality. Academy of Management Journal, 55, 949–975.
75. *Spector P. E., Brannick M. T., (2011). Methodological urban legends: The misuse of statistical control variables. Organizational Research Methods, 14, 287–305.
76. *Spreitzer G. M., (1995). Psychological empowerment in the workplace: Dimensions, measurement, and validation. Academy of Management Journal, 38, 1442–1465.
77. *Stacy A. W., MacKinnon D. P., Pentz M. A., (1993). Generality and specificity in health behavior: Application to warning-label and social influence expectancies. Journal of Applied Psychology, 78, 611–627.
78. *Stein J. A., Smith G. M., Guy S. M., Bentler P. M., (1993). Consequences of adolescent drug use on young adult job behavior and job satisfaction. Journal of Applied Psychology, 78, 463–474.
79. Sutton R. I., Staw B. M., (1995). What theory is not. Administrative Science Quarterly, 40, 371–384.
80. *Thatcher S. M. B., Patel P. C., (2011). Demographic faultlines: A meta-analysis of the literature. Journal of Applied Psychology, 96, 1119–1139.
81. *Toker S., Biron M., (2012). Job burnout and depression: Unraveling their temporal relationship and considering the role of physical activity. Journal of Applied Psychology, 97, 699–710.
82. *Tracey J. B., Tannenbaum S. I., Kavanagh M. J., (1995). Applying trained skills on the job: The importance of the work environment. Journal of Applied Psychology, 80, 239–252.
83. *Turban D. B., Dougherty T. W., (1994). Role of protégé personality in receipt of mentoring and career success. Academy of Management journal, 37, 688–702.
84. *Wally S., Baum J. R., (1994). Personal and structural determinants of the pace of strategic decision making. Academy of Management Journal, 37, 932–956.
85. *Wayne J. H., Casper W. J., Matthews R. A., Allen T. D., (2013). Family-supportive organization perceptions and organizational commitment: The mediating role of work-family conflict and enrichment and partner attitudes. Journal of Applied Psychology, 98, 606–622.
86. Whetten D. A., (1989). What constitutes a theoretical contribution?. Academy of Management Review, 14, 490–495.
87. *Woehr D. J., Feldman J., (1993). Processing objective and question order effects on the causal relation between memory and judgment in performance appraisal: The tip of the iceberg. Journal of Applied Psychology, 78, 232–241.
88. *Wu C. H., Griffin M. A., (2012). Longitudinal relationships between core self-evaluations and job satisfaction. Journal of Applied Psychology, 97, 331–342.
89. *Zhang Z., Wang M., Shi J., (2012). Leader-follower congruence in proactive personality And work outcomes: The mediating role of leader-member exchange. Academy of Management Journal, 55, 111–130.