The ubiquity of common method variance: The case of the big five

Journal of Research in Personality

Volumn 45, Issue 5, 2011, Pages 417-429

  Biderman, Michael D ^a   Nguyen, Nhung T ^b   Cunningham, Christopher J L ^a   Ghorbani, Nima ^c  

^a UNIVERSITY OF TENNESSEE AT CHATTANOOGA   (United States)

^b TOWSON UNIVERSITY   (United States)

^c UNIVERSITY OF TEHRAN   (Iran)

Author keywords

Bifactor models; Big Five structure; Common method variance; Confirmatory factor analysis; Method bias; Multitrait multimethod; Personality

Indexed keywords

EID: 80052298395     PISSN: 00926566     EISSN: 10957251     Source Type: Journal    
DOI: 10.1016/j.jrp.2011.05.001     Document Type: Article

References (74)

1. Bäckström M. Higher-order factors in a five-factor personality inventory and its relation to social desirability. European Journal of Psychological Assessment 2007, 23:63-70.
2. Bäckström M., Björklund F., Larsson M. Five-factor inventories have a major general factor related to social desirability which can be reduced by framing items neutrally. Journal of Research in Personality 2009, 43:335-344.
3. Biderman, M. D., & Nguyen, N. T. (2004). Structural equation models of faking ability in repeated measures designs. In Paper presented at the 19th Annual Society for Industrial and Organizational Psychology Conference, Chicago, IL.
4. Biderman, M. D., & Nguyen, N. T. (2009). Measuring faking propensity. In Paper presented at the 24rd annual conference of the society for industrial and organizational psychology, New Orleans, LA.
5. Biderman, M. D., Nguyen, N. T., Mullins, B., & Luna, J. (2008). A method factor predictor of performance ratings. In Paper presented at the 23rd annual conference of the society for industrial & organizational psychology.
6. Biderman, M. D., Nguyen, N. T., & Cunningham, C. L. (2009). Common method variance in NEO-FFI and IPIP personality measurement. In Paper presented at the 24th annual conference of the society for industrial & organizational psychology.
7. Biderman, M. D., Nguyen, N. T., & Cunningham, C. L. (2011). A method factor measure of self-concept. In Paper accepted for presentation at the 26th annual conference of the society for industrial & organizational psychology.
8. Biderman M.D., Nguyen N.T., Sebren J. Time-on-task mediates the conscientiousness-performance relationship. Personality and Individual Differences 2008, 44:887-897.
9. Bollen K.A., Paxton P. Detection and determinants of bias in subjective measures. American Sociological Review 1998, 63:465-478.
10. Cellar D.F., Miller M.L., Doverspike D.D., Klawsky J.D. Comparison of factor structures and criterion-related validity coefficients for two measures of personality based on the five factor model. Journal of Applied Psychology 1996, 81:694-704.
11. Chen F.F., West S.G., Sousa K.H. A comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research 2006, 41:189-225.
12. Cordery J.L., Sevastos P.P. Responses to the original and revised Job Diagnostic Survey: Is education a factor in responses to negatively worded items?. Journal of Applied Psychology 1993, 78:141-143.
13. Costa P.T., McCrae R.R. The NEO PI/FFI manual supplement 1989, Psychological Assessment Resources, Odessa, FL.
14. Costello C.G., Comrey A.L. Scales for measuring depression and anxiety. The Journal of Psychology 1967, 66:303-313.
15. Cote J.A., Buckley R. Estimating trait, method, and error variance. Generalizing across 70 construct validation studies. Journal of Marketing Research 1987, 24:315-318.
16. Cunningham C.J.L. Need for recovery and ineffective self-management. Dissertation Abstracts International: Section B: The Sciences and Engineering 2007, 68(4-B):2695.
17. Damron, J. (2004). An examination of the fakeability of personality questionnaires: Faking for specific jobs. Unpublished master's thesis. University of Tennessee at Chattanooga, Chattanooga, TN.
18. DeVellis R.F. Scale development: Theory and applications 1991, Sage, Thousand Oaks, CA.
19. DeYoung C.G., Peterson J.B., Higgins D.M. Higher-order factors of the big five predict conformity: Are there neuroses of health?. Personality and Individual Differences 2001, 33:533-552.
20. Digman J.M. Higher order factors of the Big Five. Journal of Personality and Social Psychology 1997, 73:1246-1256.
21. DiStefano C., Motl R.W. Further investigating method effects associated with negatively worded items on self-report surveys. Structural Equation Modeling 2006, 13:440-464.
22. Doty D.H., Glick W.H. Common methods bias: Does common methods variance really bias results?. Organizational Research Methods 1998, 1:374-406.
23. Goldberg L.R. A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. Personality psychology in Europe 1999, Vol. 7:1-28. Tilburg University Press, Tilburg, The Netherlands.
24. Goldberg L.R., Somer O. The hierarchical structure of common Turkish person-descriptive adjectives. European Journal of Personality 2000, 14:497-531.
25. Grice J. Computing and evaluating factor scores. Psychological Methods 2001, 6:430-450.
26. Hackman J.R., Oldham G.R. Development of the job diagnostic survey. Journal of Applied Psychology 1975, 60:159-170.
27. Hall R.J., Snell A.F., Foust M.S. Item parceling strategies in SEM: Investigating the subtle effects of unmodeled secondary constructs. Organizational Research Methods 1999, 2:233-256.
28. Harvey R.J., Billings R.S., Nilan K.J. Confirmatory factor analysis of the Job Diagnostic Survey: Good news and bad news. Journal of Applied Psychology 1985, 70:461-468.
29. Hensley W.E., Roberts M.K. Dimensions of Rosenberg's self-esteem scale. Psychological Reports 1976, 78:1071-1074.
30. Hu L., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6:1-55.
31. Idaszak J.R., Drasgow F. A revision of the Job Diagnostic Survey: Elimination of a measurement artifact. Journal of Applied Psychology 1987, 72:69-74.
32. Kenny D.A., McCoach D.B. Effect of number of variables on measures of fit in structural equation modeling. Structural Equation Modeling 2003, 10:333-351.
33. Klehe, U. -C. et al. (2011). Responding to personality tests in a selection context: The role of the ability to identify criteria and the ideal-employee factor. Manuscript under review.
34. Lim B., Ployhart R.E. Assessing the convergent and discriminant validity of Goldberg's international personality item pool: A multitrait-multimethod examination. Organizational Research Methods 2006, 9:29-54.
35. Loehlin J.C., Martin N.G. The general factor of personality: Questions and elaborations. Journal of Research in Personality 2011, 45:44-49.
36. Magazine S.L., Williams L.J., Williams W.L. A confirmatory factor analysis examination of reverse coding effects in Meyer and Allen's affective and continuance commitment scales. Educational and Psychological Measurement 1996, 56:241-250.
37. Marsh H.W. Positive and negative self-esteem: A substantively meaningful distinction or artifacts?. Journal of Personality and Social Psychology 1996, 70:810-819.
38. Marsh H.W., Lüdtke O., Muthén B., Asparouhov T., Morin A.J.S., Trautwein U., et al. A new look at the Big Five factor structure through exploratory structural equation modeling. Psychological Assessment 2010, 22:471-491.
39. Marsh H.W., Scalas L.F., Nagengast B. Longitudinal tests of competing factor structures for the Rosenberg Self-Esteem Scale: Traits, ephemeral artifacts, and stable response styles. Psychological Assessment 2010, 22:366-381.
40. McFarland L.A., Ryan A.M. Variance in faking across noncognitive measures. Journal of Applied Psychology 2000, 85:812-821.
41. McFarland L.A., Ryan A.M. Toward an integrated model of applicant faking behavior. Journal of Applied Social Psychology 2006, 36:979-1016.
42. McGee G.W., Ferguson C.E.Jr., Seers A. Role conflict and role ambiguity: Do the scales measure these two constructs?. Journal of Applied Psychology 1989, 74:815-818.
43. Meyer J., Allen N. Testing the "Side-bet theory" of organizational commitment: Some methodological considerations. Journal of Applied Psychology 1984, 69:372-378.
44. Motl R.W., DeStefano C. Longitudinal invariance of self-esteem and method effects associated with negatively worded items. Structural Equation Modeling 2002, 9:562-578.
45. Mount M.K., Barrick M.R., Scullen S.M., Rounds J. Higher order dimensions of the big five personality traits and the big six vocational interest types. Personnel Psychology 2005, 58:447-478.
46. Musek J. A general factor of personality: Evidence for the Big One in the five-factor model. Journal of Research in Personality 2007, 41:1213-1233.
47. Muthén, B.O. (1998-2004). Mplus technical appendices. Los Angeles, CA: Muthén & Muthén.
48. Muthén, L. K., & Muthén, B. O. (1998-2006). Mplus user's guide (4th ed.). Los Angeles, CA: Muthén & Muthén.
49. Nunnally J.C. Psychometric theory 1978, McGraw-Hill, New York. 2nd ed.
50. Paglis, L. L., & William, L. J. (1996). Common method variance: When does it bias OB research results? In Paper presented at the meeting of the Society for Industrial and Organizational Psychology, San Diego, CA (April).
51. Paulhus D.L. Measurement and control of response bias. Measures of personality and social psychological attitudes 1991, 17-59. Academic, San Diego, CA. J.P. Robinson, P.R. Shaver, L.S. Wrightsman (Eds.).
52. Podsakoff P.M., MacKenzie S.B., Lee J., Podsakoff N.P. Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology 2003, 88:879-903.
53. Rizzo J.R., House R.J., Lirtzman S.I. Role conflict and ambiguity in complex organizations. Administrative Science Quarterly 1970, 15:150-163.
54. Rushton J.P., Bons T.A., Hur Y. The genetics and evolution of the general factor of personality. Journal of Research in Personality 2008, 42:1173-1185.
55. Saucier G. Effects of variable selection on the factor structure of person descriptors. Journal of Personality and Social Psychology 1997, 73:1296-1312.
56. Saucier G., Goldberg L.R. The structure of personality attributes. Personality and work: Reconsidering the role of personality in organizations 2003, 1-29. Jossey-Bass, San Francisco, CA. M.R. Barrick, A.M. Ryan (Eds.).
57. Schmit M.J., Ryan A.M. The Big Five in personnel selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology 1993, 78:966-974.
58. Schmitt N., Stults D.M. Factors defined by negatively worded items. The results of careless respondents?. Applied Psychological Assessment 1985, 9:367-373.
59. Schriesheim C.A., Eisenbach R.J. An exploratory and confirmatory factor analytic investigation of item wording effects on the obtained factor structures of survey questionnaire measures. Journal of Management 1995, 21:1177-1193.
60. Schriesheim C.A., Hill K.D. Controlling acquiescence response bias by item reversals: The effect of questionnaire validity. Educational and Psychological Measurement 1981, 41:1101-1114.
61. Sivo S.A., Fan X., Witta E.L., Willse J.T. The search for "optional" cutoff properties: Fit index criteria in structural equation modeling. Journal of Experimental Education 2006, 74:267-288.
62. Soto C.J., John O.P. Using the California Psychological Inventory to assess the Big Five personality domains: A hierarchical approach. Journal of Research in Personality 2009, 43:25-38.
63. Spector P.E. Development of the work locus of control scale. Journal of Occupational Psychology 1988, 61:335-340.
64. Spector P.E. Summated rating scale construction 1998, Sage, Thousand Oaks, CA.
65. Thompson, B., & Melancon, J. G. (1996). Using item 'testlets'/'parcels' in confirmatory factor analysis: An example using the PPSDQ-78. In Paper presented at the annual meeting of the Mid-South Educational Research Association, Tuscaloosa, AL (November).
66. Tomas J.M., Hontangas P.M., Oliver A. Linear confirmatory factor models to evaluate multitrait-multimethod matrices: The effects of number of indicators and correlation among methods. Multivariate Behavioral Research 2000, 35:469-499.
67. Tomás J.M., Oliver A. Rosenberg's self-esteem scale: Two factors or method effects. Structural Equation Modeling 1999, 6:84-98.
68. Van der Linden D., Nijenhuis J., Bakker A.B. The general factor of personality: A meta-analysis of Big Five intercorrelations and a criterion-related validity study. Journal of Research in Personality 2010, 44:315-327.
69. Watson D., Clar L., Tellegen A. Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology 1988, 54:1063-1070.
70. Williams L.J., Brown B.K. Method variance in organizational behavior and human resources research: effects on correlations, path coefficients, and hypothesis testing. Organizational Behavior and Human Decision Processes 1994, 57:185-209.
71. Williams L.J., Cote J.A., Buckley M.R. Lack of method variance in self-reported affect and perceptions at work: Reality or artifact?. Journal of Applied Psychology 1989, 74:462-468.
72. Williams L.J., Ford L.R., Nguyen N.T. Basic and advanced measurement models for confirmatory factor analysis. Handbook of research methods in industrial and organizational psychology 2002, 366-389. Blackwell, Oxford. S. Rogelberg (Ed.).
73. Wonderlic Inc. Wonderlic's personnel test manual and scoring guide 1999, Author, Chicago, IL.
74. Ziegler M., Buehner M. Modeling socially desirable responding and its effects. Educational and Psychological Measurement 2009, 69:548-565.