Longitudinal factorial invariance of the Rosenberg Self-Esteem Scale: Determining the nature of method effects due to item wording

Journal of Research in Personality

Volumn 47, Issue 4, 2013, Pages 406-416

  Gana, Kamel ^a   Saada, Yaël ^a   Bailly, Nathalie ^b   Joulain, Michèle ^b   Hervé, Catherine ^b   Alaphilippe, Daniel ^b  

^a UNIVERSITÉ DE BORDEAUX   (France)

^b UNIVERSITÉ DE TOURS   (France)

Author keywords

Confirmatory factor analysis; Longitudinal approach; Method effects; Rosenberg Self Esteem Scale; Self esteem

Indexed keywords

EID: 84877041410     PISSN: 00926566     EISSN: 10957251     Source Type: Journal    
DOI: 10.1016/j.jrp.2013.03.011     Document Type: Article

References (76)

1. Alessandri G., Vecchione M., Fagnani C., Bentler P.M., Barbaranelli C., Medda E., et al. Much more than model fitting? Evidence for the heritability of method effect associated with positively worded items of the Life Orientation Test Revised. Structural Equation Modeling 2010, 17:642-653.
2. Alessandri G., Vecchione M., Tisak J., Barbaranelli C. Investigating the nature of method factors through multiple informants: Evidence for a specific factor?. Multivariate Behavioral Research 2011, 46:625-642.
3. Allison P.D. Missing data techniques for structural equation modeling. Journal of Abnormal Psychology 2003, 112(4):545-557. 10.1037/0021-843X.112.4.545.
4. Ang R.P., Neubronner M., Oh S., Leong V. Dimensionality of Rosenberg's Self-Esteem Scale among normal-technical stream students in Singapore. Current Psychology: A Journal for Diverse Perspectives on Diverse Psychological Issues 2006, 25(2):120-131. 10.1007/s12144-006-1007-3.
5. Arbuckle, J. L. (1996). Full information estimation in the presence of incomplete data. In Marcoulides, G. A., Schumacker, R. E. (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 243-277). Mahwah, NJ: Lawrence Erlbaum.
6. Arbuckle, J. L. (2009). AMOS 18.0 User's Guide. Crawfordville, FL: Amos Development Corporation.
7. Bentler P.M., Jackson D.N., Messick S. Identification of content and style: A two-dimensional interpretation of acquiescence. Psychological Bulletin 1971, 76(3):186-204. 10.1037/h0031474.
8. Boduszek D., Shevlin M., Mallett J., Hyland P., O'Kane D. Dimensionality and construct validity of the Rosenberg self-esteem scale within a sample of recidivistic prisoners. Journal of Criminal Psychology 2012, 2:19-25. 10.1108/20093821211210468.
9. Campbell D.T., Fiske D.W. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 1959, 56(2):81-105. 10.1037/h0046016.
10. Carmines E.G., Zeller R.A. Reliability and validity assessment 1979, Sage, Beverly Hills, CA.
11. Caspi A., Roberts B.W., Shiner R.L. Personality development: Stability and change. Annual Review of Psychology 2005, 56453-484. 10.1146/annurev.psych.55.090902.141913.
12. Chen F., Curran P.J., Bollen K.A., Kirby J., Paxton P. An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research 2008, 36:462-494. 10.1177/0049124108314720.
13. Corey D.M., Dunlap W.P., Burke M.J. Averaging correlations: Expected values and bias in combined Pearson rs and Fisher's z transformations. Journal of General Psychology 1998, 125(3):245-262. 10.1080/00221309809595548.
14. Corwyn R.F. The factor structure of global self-esteem among adolescents and adults. Journal of Research in Personality 2000, 34:357-379.
15. Cronbach L.J. Response sets and test validity. Educational and Psychological Measurement 1946, 6:475-494.
16. DiStefano C., Motl R.W. Further investigating method effects associated with negatively worded items on self-report surveys. Structural Equation Modeling 2006, 13:440-464.
17. DiStefano C., Motl R.W. Self-esteem and method effects associated with negatively worded items: Investigating factorial invariance by sex. Structural Equation Modeling 2009, 16:134-146.
18. DiStefano C., Motl R.W. Personality correlates of method effects due to negatively worded items on the Rosenberg Self-Esteem scale. Personality and Individual Differences 2009, 46:309-313.
19. Donnellan, M., Trzesniewski, K. H., Robins, R. W. (2011). Self-esteem: Enduring issues and controversies. In Chamorro-Premuzicm, T., von Stumm, S., Furnham, A. (Eds.), The Wiley-Blackwell handbook of individual differences (pp. 718-746). Wiley-Blackwell.
20. Enders C.K. Applied missing data analysis 2010, Guilford Press, New York.
21. Enders C.K., Bandalos D.L. The relative performance of full information maximum-likelihood estimation for missing data in structural equation models. Structural Equation Modeling 2001, 8:430-457.
22. Ferguson C.J. A meta-analysis of normal and disordered personality across the life span. Journal of Personality and Social Psychology 2010, 98(4):659-667. 10.1037/a0018770.
23. Gana K., Alaphilippe D., Bailly N. Factorial structure of the French version of the Rosenberg Self-Esteem Scale among the elderly. International Journal of Testing 2005, 5:169-176.
24. Geiser, C., Eid, M., West, S. G., Lischetzke, T., Nussbeck, F. W. (2012). A Comparison of method effects in two confirmatory factor models for structurally different methods. Structural Equation Modeling, 19, 409-436. 10.1080/10705511.2012.687658.
25. Graham J.W. Missing data analysis: Making it work in the real world. Annual Review of Psychology 2009, 60549-576. 10.1146/annurev.psych.58.110405.085530.
26. Gray J.A. Neural systems, emotion and psychopathology. Neurobiology of learning, emotion, and affect 1991, 276-306. Raven Press, New York. J. Madden (Ed.).
27. Hayduk L.A. Structural equation modeling with LISREL: Essentials and advances 1987, Johns Hopkins University Press, Baltimore, MD US.
28. Horan P.M., DiStefano C., Motl R.W. Wording effects in self-esteem scales: Methodological artifact or response style?. Structural Equation Modeling 2003, 10:435-455.
29. Hu L., Bentler P.M. Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods 1999, 3:424-453. 10.1037/1082-989X.3.4.424.
30. Huang C., Dong N. Factor structures of the Rosenberg Self-Esteem Scale: A meta-analysis of pattern matrices. European Journal of Psychological Assessment 2012, 28(2):132-138. 10.1027/1015-5759/a000101.
31. Hunter J.E., Gerbing D.W. Unidimensional measurement, second order factor analysis, and causal models. Research in Organizational Behavior 1982, 4:267-320.
32. Jahoda M. Current concepts of positive mental health 1958, Basic Books, New York.
33. Jeličić H., Phelps E., Lerner R.M. Use of missing data methods in longitudinal studies: The persistence of bad practices in developmental psychology. Developmental Psychology 2009, 45(4):1195-1199. 10.1037/a0015665.
34. Kling K.C., Hyde J.S., Showers C.J., Buswell B.N. Gender differences in self-esteem: A meta-analysis. Psychological Bulletin 1999, 125:470-500.
35. Lindwall M., Barkoukis V., Grano C., Lucidi F., Raudsepp L., Liukkonen J., et al. Method effects: The problem with negatively versus positively keyed items. Journal of Personality Assessment 2012, 94(2):196-204. 10.1080/00223891.2011.645936.
36. Little R.L., Rubin D.B. Statistical analysis with missing data 2002, Wiley, New York.
37. MacCallum R.C., Browne M.W., Cai L. Testing differences between nested covariance structure models: Power analysis and null hypotheses. Psychological Methods 2006, 11:19-35.
38. Marsh H.W. Positive and negative self-esteem: A substantively meaningful distinction or artifactors?. Journal of Personality and Social Psychology 1996, 70:810-819.
39. Marsh H.W., Grayson D. Longitudinal stability of latent means and individual differences: A unified approach. Structural Equation Modeling 1994, 2:317-359.
40. Marsh H.W., Hocevar D. Confirmatory factor analysis of multitrait-multimethod matrices. Journal of Educational Measurement 1983, 20(3):231-248. 10.1111/j.1745-3984.1983.tb00202.x.
41. Marsh H.W., Scalas L.F., Nagengast B. Longitudinal tests of competing factor structures for the Rosenberg Self-Esteem Scale: Traits, ephemeral artifacts, and table response styles. Psychological Assessment 2010, 22:366-388.
42. Motl R.W., DiStefano C. Longitudinal invariance of self-esteem and method effects associated with negatively worded items. Structural Equation Modeling 2002, 9:562-578.
43. Munafò M.R., Flint J. Dissecting the genetic architecture of human personality. Trends in Cognitive Sciences 2011, 15(9):395-400.
44. Muthén B.O. Latent variable modeling in heterogeneous populations. Psychometrika 1989, 54:557-585.
45. Nunnally J.C., Bernstein I.H. Psychometric theory 1994, McGraw-Hill, New York. 3rd ed.
46. Orth, U., Robins, R. W., Widaman, K. F. (2011, September 26). Life-span development of self-esteem and its effects on important life outcomes. Journal of Personality and Social Psychology. Advance online publication. doi: doi:10.1037/a0025558.
47. Orth U., Trzesniewski K.H., Robins R.W. Self-esteem development from young adulthood to old age: A cohort-sequential longitudinal study. Journal of Personality and Social Psychology 2010, 98:645-658.
48. Owens T.J. Acccentuate the positive-and the negative: Rethinking the use of self-esteem, self-deprecation, and self-confidence. Social Psychology Quarterly 2013, 56(4):288-299. http://dx.doi.org/10.2307/2786665.
49. Owens T.J. Two dimensions of self-esteem: Reciprocal effects of positive self-worth and self-deprecation on adolescent problems. American Sociological Review 1994, 59(3):391-407. 10.2307/2095940.
50. Pinquart M., Sörensen S. Gender differences in self-concept and psychological well-being in old age: A meta-analysis. The Journals of Gerontology: Series B: Psychological Sciences and Social Sciences 2001, 56B(4):P195-P213. 10.1093/geronb/56.4.P195.
51. Podsakoff P.M., MacKenzie S.B., Lee J.-Y., Podsakoff N.P. Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology 2003, 88:879-903.
52. Podsakoff P.M., MacKenzie S.B., Podsakoff N.P. Sources of method bias in social science research and recommendations on how to control it. Annual Review Of Psychology 2012, 63:539-569.
53. Quilty L.C., Oakman J.M., Risko E. Correlates of the Rosenberg Self-Esteem Scale method effects. Structural Equation Modeling 2006, 13:99-117.
54. Robins R.W., Hendin H.M., Trzesniewski K.H. Measuring global self-esteem: Construct validation of a single-item-measure and the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin 2001, 27:151-161.
55. Rosenberg M. Society and the adolescent self-image 1965, Princeton University Press, Princeton, NJ.
56. Rubio D., Berg-Weger M., Tebb S.S. Using structural equation modeling to test for multidimensionality. Structural Equation Modeling 2001, 8(4):613-626. 10.1207/S15328007SEM0804_06.
57. Ryff C.D., Singer B. Psychological well-being: Meaning, measurement, and implications for psychotherapy research. Psychotherapy and Psychosomatics 1996, 65:14-23.
58. Scheier M.F., Carver C.S., Bridges M.W. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): A reevaluation of the Life Orientation Test. Journal of Personality and Social Psychology 1994, 67:1063-1078.
59. Schlomer G.L., Bauman S., Card N.A. Best practices for missing data management in counseling psychology. Journal of Counseling Psychology 2010, 57(1):1-10. 10.1037/a0018082.
60. Schmitt D.P., Allik J. Simultaneous administration of the Rosenberg Self-Esteem Scale in 53 nations: Exploring the universal and culture-specific features of global self-esteem. Journal of Personality and Social Psychology 2005, 89:623-642.
61. Schmitt N., Kuljanin G. Measurement invariance: Review of practice and implications. Human Resource Management Review 2008, 18:210-222.
62. Schmitt N., Stults D.M. Methodology review: Analysis of multitrait-multimethod matrices. Applied Psychological Measurement 1986, 10(1):1-22. 10.1177/014662168601000101.
63. Shahani C., Dipboye R.L., Phillips A. Self-esteem as a correlate of work-related attitudes: A question of dimensionality. Journal of Personality Assessment 1990, 54:276-288.
64. Tomás J.M., Oliver A. Rosenberg's Self-Esteem Scale: Two factors or method effects. Structural Equation Modeling 1999, 6:84-98.
65. Vallières F., Vallerand J. Traduction et validation canadienne-française de l'échelle de l'estime de soi de Rosenberg. International Journal of Psychology 1990, 25:305-316.
66. Vandenberg R.J., Lance C.E. A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods 2000, 3:4-69.
67. Wang J., Siegal H.A., Falck R.S., Carlson R.G. Factorial structure of Rosenberg's self-esteem scale among crack-cocaine drug users. Structural Equation Modeling 2001, 8:275-286.
68. Weems G.H., Onwuegbuzie A.J., Schreiber J.B., Eggers S.J. Characteristics of respondents who respond differently to positively and negatively worded items on rating scales. Assessment & Evaluation in Higher Education 2003, 28:587-607.
69. Widaman K.F. Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement 1985, 9(1):1-26. 10.1177/014662168500900101.
70. Widaman, K. F. (2012). Exploratory factor analysis and confirmatory factor analysis. In Cooper, H., Camic, P. M., Long, D. L., Panter, A. T., Rindskopf, D., Sher, K. J. (Eds.), APA handbook of research methods in psychology, Vol 3: Data analysis and research publication (pp. 361-389). Washington, DC US: American Psychological Association. doi:. doi:10.1037/13621-018.
71. Widaman, K. F., Reise, S. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In Bryant, K. J., Windle, M., West, S. G. (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281-324). Washington, DC US: American Psychological Association. doi:. doi:10.1037/10222-009.
72. Widaman K.F., Ferrer E., Conger R.D. Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives 2010, 4(1):10-18. 10.1111/j.1750-8606.2009.00110.x.
73. Wothke, W. (2000). Longitudinal and multigroup modeling with missing data. In Little, T. D., Schnabel, K. U., Baumert, J. (Eds.), Modeling longitudinal and multilevel data: Practical issues, applied approaches, and specific examples (pp. 219-240, 269-281). Mahwah, NJ US: Lawrence Erlbaum Associates Publishers.
74. Wu C. An examination of the wording effect in the Rosenberg Self-Esteem Scale among culturally Chinese people. The Journal Of Social Psychology 2006, 148(5):535-552. http://dx.doi,.org/10.3200/SOCP.148.5.535-552.
75. Xie J., Roy J.P., Chen Z. Cultural and individual differences in self-rating behavior: An extension and refinement of the cultural relativity hypothesis. Journal of Organizational Behavior 2006, 27:341-364.
76. Yuan K., Zhang Z. Robust structural equation modeling with missing data and auxiliary variables. Psychometrika 2012, 77(4):803-826. 10.1007/s11336-012-9282-4.