Method effects: The problem with negatively versus positively keyed items

Journal of Personality Assessment

Volumn 94, Issue 2, 2012, Pages 196-204

  Lindwall, Magnus ^a   Barkoukis, Vassilis ^b   Grano, Caterina ^c   Lucidi, Fabio ^c   Raudsepp, Lennart ^d   Liukkonen, Jarmo ^e   Thgersen Ntoumani, Cecilie ^f  

^a UNIVERSITY OF GOTHENBURG   (Sweden)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^c SAPIENZA UNIVERSITY OF ROME   (Italy)

^d UNIVERSITY OF TARTU   (Estonia)

^e UNIVERSITY OF JYVÄSKYLÄ   (Finland)

^f UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AGED; ARTICLE; DEPRESSION; FACTORIAL ANALYSIS; FEMALE; HUMAN; MALE; MIDDLE AGED; PSYCHOLOGICAL ASPECT; PSYCHOMETRY; SATISFACTION; SELF CONCEPT;

AGED; AGED, 80 AND OVER; DEPRESSION; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; MALE; MIDDLE AGED; PERSONAL SATISFACTION; PSYCHOMETRICS; SELF CONCEPT;

EID: 84859715247     PISSN: 00223891     EISSN: None     Source Type: Journal    
DOI: 10.1080/00223891.2011.645936     Document Type: Article

References (51)

1. American Educational Research Association. (1999). Standards for educational and psychological testing. Washington, DC: Author.
2. Arbuckle, J. L. (1995-2009). Amos 18 user's guide. Crawfordville, FL: Amos Development Corporation.
3. Bagozzi, R. P. (1993). Assessing construct validity in personality research: Applications to measures of self-esteem. Journal of Research in Personality, 27(1), 49-87.
4. Beekman, A. T. F., Deeg, D. J. H., Van Limbeek, J., Braam, A. W., de Vries, M. Z.,&Van Tilburg,W. (1997). Criterion validity of the Center for Epidemiologic Studies Depression scale (CES-D): Results from a community-based sample of older subjects in the Netherlands. PsychologicalMedicine: A Journal of Research in Psychiatry and the Allied Sciences, 27(1), 231-235.
5. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
6. Blascovich, J., & Tomaka, J. (1991). The Self-Esteem Scale. In J. P. Robinson, P. R. Shaver & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 115-160). San Diego, CA: Academic Press.
7. Blazer, D. G. (2003). Depression in late life: Review and commentary. The Journals ofGerontology: Series A: Biological Sciences and Medical Sciences, 58A, 249-265.
8. Brislin, R. W. (1986). The wording and translation of research instruments. In W. J. Lonner & J. W. Berry (Eds.), Field methods in cross-cultural research (pp. 137-164). Thousand Oaks, CA: Sage.
9. Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford.
10. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
11. Burke, M. J., Brief,A. P.,&George, J. M. (1993). The role of negative affectivity in understanding relations between self-reports of stressors and strains: A comment on the applied psychology literature. Journal of Applied Psychology, 78, 402-412.
12. Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2nd ed.). New York, NY: Routledge/Taylor & Francis Group.
13. Byrne, B. M., Shavelson, R. J.,&Muthen, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466.
14. Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills, CA: Sage.
15. Carstensen, L. L., Isaacowitz, D. M., & Charles, S. T. (1999). Taking time seriously: A theory of socioemotional selectivity. American Psychologist, 54, 165-181.
16. Carstensen, L. L.,&Mikels, J.A. (2005).At the intersection of emotion and cognition: Aging and the positivity effect. Current Directions in Psychological Science, 14, 117-121.
17. Cheung, G.W.,&Rensvold,R.B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
18. Classen, S., Velozo, C. A., & Mann, W. C. (2007). The Rosenberg Self-Esteem Scale as ameasure of self-esteem for the noninstitutionalized elderly. Clinical Gerontologist: The Journal of Aging and Mental Health, 31(1), 77-93.
19. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
20. Corwyn, R. F. (2000). The factor structure of global self-esteem among adolescents and adults. Journal of Research in Personality, 34, 357-379.
21. Cote, J. A., & Buckley, R. (1987). Estimating trait, method, and error variance: Generalizing across 70 construct validation studies. Journal of Marketing Research, 24, 315-318.
22. DeNeve, K. M., & Cooper, H. (1998). The happy personality: A meta-analysis of 137 personality traits and subjective well-being. Psychological Bulletin, 124, 197-229.
23. Diehl, M., Hastings, C. T., & Stanton, J. M. (2001). Self-concept differentiation across the adult life span. Psychology and Aging, 16, 643-654.
24. Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction With Life Scale. Journal of Personality Assessment, 49(1), 71-75.
25. DiStefano, C., & Motl, R. W. (2006). Further investigating method effects associated with negatively worded items on self-report surveys. Structural Equation Modeling, 13, 440-464.
26. DiStefano, C.,&Motl, R.W. 2009 Personality correlates of method effects due to negatively worded items on the rosenberg self-esteem scale Personality and Individual Differences 46 309-313.
27. Fiske, A.,Wetherell, J. L.,&Gatz, M. (2009).Depression in older adults. Annual Review of Clinical Psychology, 5, 363-389.
28. Goldsmith, R. E. (1986). Dimensionality of the Rosenberg Self-Esteem Scale. Journal of Social Behavior & Personality, 1, 253-264.
29. Horan, P. M., DiStefano, C., & Motl, R. W. (2003). Wording effects in selfesteem scales:Methodological artifact or response style? Structural Equation Modeling, 10, 435-455.
30. Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55.
31. Kling, K. C.,Hyde, J. S., Showers, C. J.,&Buswell, B. N. (1999).Gender differences in self-esteem: A meta-analysis. Psychological Bulletin, 125, 470-500.
32. Marsh, H. W. (1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810-819.
33. Marsh, H. W., & Grayson, D. (1995). Latent variable models of multitraitmultimethod data. In R. H. Hoyle (Ed.), Structural equation modeling (pp. 177-198). Thousand Oaks, CA: Sage.
34. Marsh, H. W., Scalas, L. F., & Nagengast, B. (2010). Longitudinal tests of competing factor structures for the Rosenberg Self-Esteem Scale: Traits, ephemeral artifacts, and stable response styles. Psychological Assessment, 22, 366-381.
35. Marsh, H.W., & Yeung, A. S. (1999). The lability of psychological ratings: The chameleon effect in global self-esteem. Personality and Social Psychology Bulletin, 25(1), 49-64.
36. McAuley, E., Elavsky, S., Motl, R. W., Konopack, J. F., Hu, L., & Marquez, D. X. (2005). Physical activity, self-efficacy, and self-esteem: Longitudinal relationships in older adults. The Journals of Gerontology: Series B: Psychological Sciences and Social Sciences, 60B, P268-P275.
37. Meredith, W., & Teresi, J. A. (2006). An essay on measurement and factorial invariance. Medical Care, 44(11 Suppl. 3), S69-S77.
38. Podsakoff, P. M.,MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903.
39. Quilty, L. C., Oakman, J. M., & Risko, E. (2006). Correlates of the Rosenberg Self-Esteem Scale method effects. Structural EquationModeling, 13(1), 99-117.
40. Radloff, L. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401.
41. Reitzes, D. C., & Mutran, E. J. (2006). Self and health: Factors that encourage self-esteem and functional health. The Journals of Gerontology: Series B: Psychological Sciences and Social Sciences, 61B(1), S44-S51.
42. Rosenberg, M. (1965). Society and adolescent self-image. Princeton, NJ: Princeton University.
43. Rosenberg,M. (1989). Society and the adolescent self-image. Middletown, CT: Wesleyan University Press.
44. Schmitt, D. P.,&Allik, J. (2005). Simultaneous administration of the Rosenberg Self-Esteem Scale in 53 nations: Exploring the universal and culture-specific features of global self-esteem. Journal of Personality and Social Psychology, 89, 623-642.
45. Schmitt, N., & Stults, D. M. (1986). Methodology review: Analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 10, 1-22.
46. Schriesheim, C. A., & Hill, K. D. (1981). Controlling acquiescence response bias by item reversals: The effect on questionnaire validity. Educational and Psychological Measurement, 41, 1101-1114.
47. Shiovitz-Ezra, S., Leitsch, S., Graber, J., & Karraker, A. (2009). Quality of life and psychological health indicators in the National Social Life, Health, and Aging Project. The Journals of Gerontology: Series B: Psychological Sciences and Social Sciences, 64B(Suppl. 1), I30-I37.
48. Tafarodi, R.W., & Swann,W. B., Jr. (1995). Self-liking and self-competence as dimensions of global self-esteem: Initial validation of a measure. Journal of Personality Assessment, 65, 322-342.
49. Tomas, J. M., & Oliver, A. (1999). Rosenberg's Self-Esteem Scale: Two factors or method effects. Structural Equation Modeling, 6(1), 84-98.
50. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4-69.
51. Wu, C.-H. (2008). An examination of the wording effect in the Rosenberg Self-Esteem Scale among culturally Chinese people. The Journal of Social Psychology, 148, 535-551.