Investigating the nature of method factors through multiple informants: Evidence for a specific factor?

Multivariate Behavioral Research

Volumn 46, Issue 4, 2011, Pages 625-642

  Alessandri, Guido ^a   Vecchione, Michele ^a   Tisak, John ^b   Barbaranelli, Claudio ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b BOWLING GREEN STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79961241844     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171.2011.589272     Document Type: Article

References (59)

1. Alessandri, G., Vecchione, M., Fagnani, C., Bentler, P. M., Barbaranelli, C., Medda, E., Caprara, G. V. (2010). Much more than model fitting? Evidence for the heritability of method effect associated with positively worded items of the revised Life Orientation Test. Structural Equation Modeling, 17, 642-653.
2. Ashton, M. C., Lee, K., & Goldberg, L. R. (2004). A hierarchical analysis of 1,710 English personality-descriptive adjectives. Journal of Personality and Social Psychology, 87, 707-721.
3. Babakus, E., Ferguson, C. E., & Jöreskog, K. G. (1987). The sensitivity of confirmatory factor maximum likelihood factor analysis to violations of measurement scale and distributional assumptions. Journal of Marketing Research, 37, 72-141.
4. Bagozzi, R. P. (1993). An examination of the psychometric properties of measures of negative affect in the PANAS-X Scales. Journal of Personality and Social Psychology, 65, 836-851.
5. Bentler, P. M., & Chou, C. P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16, 78-117.
6. Biesanz, J. C., & West, S. G. (2004). Towards understanding assessments of the Big Five: Multitraitmultimethod analyses of convergent and discriminant validity across measurement occasion and type of observer. Journal of Personality, 72, 845-876.
7. Billiet, J. B., & McClendon, M. J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling, 7, 608-628.
8. Bollen, K. A., & Barb, K. H. (1981). Pearson's r and coarsely categorized measures. American Sociological Review, 46, 232-239.
9. Campbell, D. T., & Fiske, D. W (1959). Convergent and discriminant validation by the multitraitmultimethod matrix. Psychological Bulletin, 56, 81-105.
10. Caprara, G. V., Barbaranelli, C., Borgogni, L., & Vecchione, M. (2008). Big Five Questionnaire-2: Manual. Firenze, Italy: Organizzazioni Speciali.
11. Caprara, G. V., & Perugini, M. (1994). Personality described by adjectives: Generalizability of the "Big Five" to the Italian lexical context. European Journal of Personality, 8, 357-369.
12. Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills, CA: Sage.
13. Cronbach, L. J. (1946). Response sets and test validity. Educational and PsychologicalMeasurement, 6, 475-494.
14. DiStefano, C., & Motl, R. W. (2006). Further investigatingmethod effects associated with negatively worded items on self-report surveys. Structural Equation Modeling: A Multidisciplinary Journal, 13, 440-464.
15. DiStefano, C., & Motl, R. W. (2008). Personality correlates of method effects due to negatively worded items on the Rosenberg Self-Esteem scale. Personality and Individual Differences, 46, 309-313.
16. Fiske, D. W. (1987). Construct invalidity comes from method effects. Educational and Psychological Measurement, 47, 285-336.
17. Hazlett-Stevens, H., Ullman, J. B., & Craske, M. G. (2004). Factor structure of the Penn State Worry Questionnaire: Examination of a method factor. Assessment, 11, 361-370.
18. Herzberg, P. Y., Glaesmer, H., & Hoyer, J. (2006). Separating optimism and pessimism: A robust psychometric analysis of the Revised Life Orientation Test (LOT-r). Psychological Assessment, 18, 433-438.
19. Horan, P. M., DiStefano, C., & Motl, R. W. (2003). Wording effects in self-esteem scales: Methodological artifact or response style? Structural Equation Modeling, 10, 435-455.
20. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modelling: Sensitivity to underparameterized model misspecification. Psychological Methods, 4, 424-453.
21. John, O. P., & Robins, R. W. (1994). Accuracy and bias in self-perception: Individual differences in self-enhancement and the role of narcissism. Journal of Personality and Social Psychology, 66, 206-219.
22. Kenny, D. A., & Kashy, D. A. (1992). Analysis of the multitrait-multimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112, 165-172.
23. Kubzansky, L. D., Kubzansky, P. E., & Maselko, J. (2004). Optimism and pessimism in the context of health: Bipolar opposites or separate constructs? Personality and Social Psychology Bulletin, 30, 943-956.
24. Marsh, H. W. (1989). Confirmatory factor analyses of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 13, 335-361.
25. Marsh, H. W. (1993).Multitrait-multimethod analyses: Inferring each trait-method combination with multiple indicators. Applied Measurement in Education, 6, 49-81.
26. Marsh, H. W. (1996). Positive and negative self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810-819.
27. McCrae, R. R., & Costa, P. T., Jr. (1999). A five-factor theory of personality. In L. Pervin & O. P. John (Eds.), Handbook of personality (2nd ed., pp. 139-153). New York, NY: Guilford Press.
28. McPherson, J., & Mohr, P. (2005). The role of item extremity in the emergence of keying-related factors: An exploration with the Life Orientation Test. Psychological Methods, 10, 120-131.
29. Mehrabian, A., & Ljunggren, E. (1997).Dimensionality and content of optimism-pessimismanalyzed in terms of the PAD Temperament Model. Personality and Individual Differences, 23, 729-737.
30. Mehta, P. H., & Gosling, S. D. (2008). Bridging human and animal research: A comparative approach to studies of personality and health. Brain, Behavior, and Immunity, 22, 651-661.
31. Millham, J., & Kellogg, R. W. (1980). Need for social approval: Management or self-deception? Journal of Research in Personality, 14, 445-457.
32. Motl, R. W., & Conroy, D. E. (2000). Validity and factorial invariance of the Social Physique Anxiety Scale. Medicine and Science in Sports Exercise, 32, 1007-1017.
33. Motl, R. W., Conroy, D. E., & Horan, P. M. (2000). The Social Physique Anxiety Scale: An example of the potential consequences of negatively worded items in factorial validity studies. Journal of Applied Measurement, 1, 327-345.
34. Motl, R. W., & DiStefano, C. (2002). Longitudinal invariance of self-esteem and method effects associated with negatively worded items. Structural Equation Modeling, 9, 562-578.
35. Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38, 171-189.
36. Muthén, B., & Kaplan, D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. British Journal of Mathematical and Statistical Psychology, 45, 19-30.
37. Muthén, L. K., & Muthén, B. O. (2006). Mplus user's guide. Los Angeles, CA: Author.
38. Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.
39. Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17-59). San Diego, CA: Academic Press.
40. Paulhus, D. L. (1998). Manual for the Balanced Inventory of Desirable Responding (BIDR-7). Toronto, Canada, and Buffalo, NY: Multi-Health Systems.
41. Paulhus, D. L., & John, O. P. (1998). Egoistic and moralistic biases in self-perception: The interplay of self-deceptive styles with basic traits and motives. Journal of Personality, 66, 1025-1060.
42. Peabody, D., & DeRaad, B. (2002). The substantive nature of psycholexical personality factors: A comparison across languages. Journal of Personality and Social Psychology, 83, 983-997.
43. Pedhazur, E., & Schmelkin, L. (1991). Measurement, design and analysis. Hillsdale, NJ: Erlbaum.
44. Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method bias in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903.
45. Quilty, L. C., Oakman, J. M., & Risko, E. (2006). Correlates of the Rosenberg Self-Esteem scale method effects. Structural Equation Modeling, 13, 99-117.
46. Rauch, W. A., Schweizer, K., & Moosbrugger, H. (2007). Method effects due to social desirability as a parsimonious explanation of the deviation from unidimensionality in LOT-r scores. Personality and Individual Differences, 42, 1597-1607.
47. Satorra, A., & Bentler, P. M. (1988). Scaling corrections for chi-square statistics in covariance structure analysis. American Statistical Association 1988 Proceedings of the Business and Economics Sections, 308-313.
48. Satorra, A., & Bentler, P. M. (2001).A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514.
49. Scheier, M. F., Carver, C. S., & Bridges, M. W. (1994). Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): A reevaluation of the Life Orientation Test. Journal of Personality and Social Psychology, 67, 1063-1078.
50. Spector, P. E. (1992). A consideration of the validity and meaning of self report measures of job conditions, In C. L. Cooper & I. T. Robertson (Eds.), International review of industrial and organizational psychology (Vol. 7, pp. 123-151). Chichester, UK: Wiley.
51. Tabachnick, B. G., & Fidell, L. S. (1989). Using multivariate statistics. New York, NY: Harper & Row.
52. Taylor, S. E., Kemeny, M. E., Reed, G. M., Bower, J. E., & Gruenewald, T. L. (2000). Psychological resources, positive illusions, and health. American Psychologist, 55, 99-109.
53. Tomás, J. M., & Oliver, A. (1999). Rosenberg's Self-Esteem scale: Two factors or method effects. Structural Equation Modeling, 6, 84-98.
54. Vautier, S., Raufaste, E., & Cariou, M. (2003). Dimensionality of the Revised Life Orientation Test and the status of filler items. International Journal of Psychology, 38, 390-400.
55. Vecchione, M., Alessandri, G., & Barbaranelli, C. (2009). Egoistic and moralistic self-presentation styles: Measurement, validity and applications (Research Report). Sapienza University of Rome, Department of Psychology.
56. West, S. G., Finch, J. F., & Curran, P. J. (1995). Structural equation models with non-normal variables: Problems and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 57-75). Thousand Oaks, CA: Sage.
57. Widaman, K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9, 1-26.
58. Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? Journal of Applied Psychology, 74, 462-468.
59. Whiteside-Mansell, L., & Corwyn, R. F. (2003). Mean and covariance structures analyses: an examination of the Rosenberg Self-Esteem Scale among adolescent and adults. Educational and Psychological Measurement, 63, 163-173.