Assessing the Impact of Common Method Variance on Higher Order Multidimensional Constructs

Journal of Applied Psychology

Volumn 96, Issue 4, 2011, Pages 744-761

  Johnson, Russell E ^a   Rosen, Christopher C ^b   Djurdjevic, Emilija ^b  

^a MICHIGAN STATE UNIVERSITY   (United States)

^b UNIVERSITY OF ARKANSAS   (United States)

Author keywords

Common method variance; Construct validity; Core self evaluation; Measurement bias; Multidimensional constructs

Indexed keywords

ADULT; ARTICLE; CONTROL; FEMALE; HUMAN; JOB SATISFACTION; MALE; MIDDLE AGED; PERSONAL CONSTRUCT THEORY; PERSONALITY; PSYCHOLOGICAL MODEL; SELF CONCEPT; SELF EVALUATION;

ADULT; FEMALE; HUMANS; INTERNAL-EXTERNAL CONTROL; JOB SATISFACTION; MALE; MIDDLE AGED; MODELS, PSYCHOLOGICAL; PERSONAL CONSTRUCT THEORY; PERSONALITY; SELF CONCEPT; SELF EFFICACY; SELF-ASSESSMENT;

EID: 79960524174     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0021504     Document Type: Article

References (57)

1. Bagozzi R.P., Edwards J.R. A general approach to representing constructs in organizational research. Organizational Research Methods 1998, 1:45-87.
2. Bagozzi R.P., Yi Y. Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. Journal of Applied Psychology 1990, 75:547-560.
3. Becker G. How important is transient error in estimating reliability? Going beyond simulation studies. Psychological Methods 2000, 5:370-379.
4. Bollen K.A., Lennox R. Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin 1991, 110:305-314.
5. Bono J.E., Judge T.A. Core self-evaluations: A review of the trait and its role in job satisfaction and performance. European Journal of Personality 2003, 17:5-18.
6. Buckley M.R., Cote J.A., Comstock S.M. Measurement errors in the behavioral sciences: The case of personality/attitude research. Educational and Psychological Measurement 1990, 50:447-474.
7. Chan D. So why ask me? Are self-report data really that bad?. Statistical and methodological myths and urban legends: Doctrine, verity, and fable in the organizational and social sciences 2009, 309-336. Routledge, New York, NY. C.E. Lance, R.J. Vandenberg (Eds.).
8. Chen P.Y., Dai T., Spector P.E., Jex S.M. Relationship between negative affectivity and positive affectivity: Effects of judged desirability of scale items and respondent's social desirability. Journal of Personality Assessment 1997, 69:183-198.
9. Chen P.Y., Spector P.E. Negative affectivity as the underlying cause of correlations between stressors and strains. Journal of Applied Psychology 1991, 76:398-407.
10. Cohen-Charash Y., Spector P.E. The role of justice in organizations: A meta-analysis. Organizational Behavior and Human Decision Processes 2001, 86:278-321.
11. Cote J.A., Buckley M.R. Estimating trait, method, and error variance: Generalizing across 70 construct validation studies. Journal of Marketing Research 1987, 24:315-318.
12. Crampton S.M., Wagner J.A. Percept-percept inflation in microorganizational research: An investigation of prevalence and effect. Journal of Applied Psychology 1994, 79:67-76.
13. Crowne D.P., Marlowe D. A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology 1960, 24:349-354.
14. Digman J.M. Higher order factors of the Big Five. Journal of Personality and Social Psychology 1997, 73:1246-1256.
15. Dormann C., Fay D., Zapf D., Frese M. A state-trait analysis of job satisfaction: On the effect of core self-evaluations. Applied Psychology: An International Review 2006, 55:27-51.
16. Doty W.H., Glick W.H. Common methods bias: Does common methods variance really bias results?. Organizational Research Methods 1998, 1:374-406.
17. Edwards J.R. Multidimensional constructs in organizational behavior research: An integrative analytical framework. Organizational Research Methods 2001, 4:144-192.
18. Ferris, D. L., Rosen, C. C., Johnson, R. E., Brown, D. J., Risavy, S., & Heller, D. (in press). Approach or avoidance (or both?): Integrating core self-evaluations within an approach/avoidance framework. Personnel Psychology.
19. Gable S.L., Reis H.T., Elliot A.J. Evidence for bivariate systems: An empirical test of appetition and aversion across domains. Journal of Research in Personality 2003, 37:349-372.
20. Goldberg L.R. A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. Personality psychology in Europe 1999, 7:7-28. Tilburg University Press, Tilburg, the Netherlands. I. Mervielde, I. Deary, F. De Fruyt, F. Ostendorf (Eds.).
21. Hall R.J., Snell A.F., Foust M.S. Item parceling strategies in SEM: Investigating the subtle effects of unmodeled secondary constructs. Organizational Research Methods 1999, 2:233-256.
22. Harris K.J., Harvey P., Kacmar K.M. Do social stressors impact everyone equally? An examination of the moderating impact of core self-evaluations. Journal of Business and Psychology 2009, 24:153-164.
23. Harrison D.A., McLaughlin M.E., Coalter T.M. Context, cognition, and common method variance: Psychometric and verbal protocol evidence. Organizational Behavior and Human Decision Processes 1996, 68:246-261.
24. Hu L.-T., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6:1-55.
25. Johnson, R. E., Rosen, C. C., Chang, C.-H., Djurdjevic, E., & Taing, M. U. (in press). Recommendations for improving the construct clarity of higher-order multidimensional constructs. Human Resource Management Review.
26. Johnson R.E., Rosen C.C., Levy P.E. Getting to the core of core self-evaluations: A review and recommendations. Journal of Organizational Behavior 2008, 29:391-413.
27. Judge T.A., Bono J.E., Erez A., Locke E.A. Core self-evaluations and job and life satisfaction: The role of self-concordance and goal attainment. Journal of Applied Psychology 2005, 90:257-268.
28. Judge T.A., Bretz R.D. Report on an alternative measure of affective disposition. Educational and Psychological Measurement 1993, 53:1095-1104.
29. Judge T.A., Erez A., Bono J.E., Thoresen C.J. The Core Self-Evaluations Scale: Development of a measure. Personnel Psychology 2003, 56:303-331.
30. Judge T.A., Hurst C., Simon L.S. Does it pay to be smart, attractive, or confident (or all three)? Relationships among general mental ability, physical attractiveness, core self-evaluations, and income. Journal of Applied Psychology 2009, 94:742-755.
31. Judge T.A., Locke E.A., Durham C.C. The dispositional causes of job satisfaction: A core evaluations approach. Research in Organizational Behavior 1997, 19:151-188.
32. Judge T.A., Locke E.A., Durham C.C., Kluger A.N. Dispositional effects on job and life satisfaction: The role of core evaluations. Journal of Applied Psychology 1998, 83:17-34.
33. Kammeyer-Mueller J.D., Judge T.A., Scott B.A. The role of core self-evaluations in the coping process. Journal of Applied Psychology 2009, 94:177-195.
34. Kline R.B. Principles and practice of structural equation modeling 2004, Guilford, New York, NY. 2nd ed.
35. Kline T.J.B., Sulsky L.M., Rever-Moriyama S.D. Common method variance and specification errors: A practical approach to detection. Journal of Psychology 2002, 134:401-421.
36. Lance C.E., Dawson B., Birkbach D., Hoffman B.J. Method effects, measurement error, and substantive conclusions. Organizational Research Methods 2010, 13:435-455.
37. Lawrence C.A., Evans K.R., Cowles D. Relationship quality in services selling: An interpersonal influence perspective. Journal of Marketing 1990, 54:68-81.
38. Levenson H. Differentiating among internality, powerful others, and chance. Research with the locus of control construct 1981, 1:15-63. Academic Press, New York, NY. H.M. Lefcourt (Ed.).
39. Lindell M.K., Whitney D.J. Accounting for common method variance in cross-sectional designs. Journal of Applied Psychology 2001, 86:114-121.
40. Little T.D., Cunningham W.A., Shahar G., Widaman K.F. To parcel or not to parcel: Exploring the question, weighting the merits. Structural Equation Modeling 2002, 9:151-173.
41. Luthans F., Avolio B.J., Avey J.B., Norman S.N. Positive psychological capital: Measurement and relationship with performance and satisfaction. Personnel Psychology 2007, 60:541-572.
42. MacKenzie S.B., Podsakoff P.M., Jarvis C.B. The problem of measurement model misspecification in behavioral and organizational research and some recommended solutions. Journal of Applied Psychology 2005, 90:710-730.
43. Moorman R.H., Podsakoff P.M. A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behaviour research. Journal of Occupational and Organizational Psychology 1992, 65:131-149.
44. Muthén L., Muthén B. Mplus user's guide 2006, Author, Los Angeles, CA.
45. Podsakoff P.M., MacKenzie S.B., Lee J.-Y., Podsakoff N.P. Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology 2003, 88:879-903.
46. Richardson H.A., Simmering M.J., Sturman M.C. A tale of three perspectives: Examining post hoc statistical techniques for detection and correction of common method variance. Organizational Research Methods 2009, 12:762-800.
47. Rosen C.C., Chang C.-H., Johnson R.E., Levy P.E. Perceptions of the organizational context and psychological contract breach: Assessing competing perspectives. Organizational Behavior and Human Decision Processes 2009, 108:202-217.
48. Rosenberg M. Society and the adolescent self-image 1989, Wesleyan University Press, Middletown, CT. Rev. ed.
49. Schmidt F.L., Le H., Ilies R. Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods 2003, 8:206-224.
50. Seashore S.E., Lawler E.E., Mirvis P., Cammann C. Observing and measuring organizational change: A guide to field practice 1982, Wiley, New York, NY.
51. Spector P.E. Method variance in organizational research. Organizational Research Methods 2006, 9:221-232.
52. Spector P.E., Chen P.Y., O'Connell B.J. A longitudinal study of relations between job stressors and job strains while controlling for prior negative affectivity and strains. Journal of Applied Psychology 2000, 85:211-218.
53. Stajkovic A.D. Development of a core confidence-higher order construct. Journal of Applied Psychology 2006, 91:1208-1224.
54. Stanton J.M., Weiss E.M. Online panels for social science research: An introduction to the StudyResponse project (Report No. 12001) 2002, Syracuse University, School of Information Studies, Syracuse, NY.
55. Tourangeau R., Rips L.J., Rasinski K. The psychology of survey response 2000, Cambridge University Press, Cambridge, England.
56. Weitz J. A neglected concept in the study of job satisfaction. Personnel Psychology 1952, 5:201-205.
57. Williams L.J., Cote J.A., Buckley M.R. Lack of method variance in self-reported affect and perceptions at work: Reality or artifact?. Journal of Applied Psychology 1989, 74:462-468.