Construct validity of the multidimensional structure of bullying and victimization: An application of exploratory structural equation modeling

Journal of Educational Psychology

Volumn 103, Issue 3, 2011, Pages 701-732

  Marsh, Herbert W ^a,b,c   Nagengast, Benjamin ^a   Morin, Alexandre J S ^b,d   Parada, Roberto H ^b,e   Craven, Rhonda G ^b   Hamilton, Linda R ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY OF WESTERN SYDNEY   (Australia)

^c KING SAUD UNIVERSITY   (Saudi Arabia)

^d UNIVERSITÉ DE SHERBROOKE   (Canada)

^e UNIVERSITY OF NOTRE DAME   (Australia)

Author keywords

Coping; Depression; Exploratory structural equation modeling (ESEM) and measurement invariance; Locus of control; Multiple dimensions of self concept

Indexed keywords

EID: 80051825706     PISSN: 00220663     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0024122     Document Type: Article

References (103)

1. Amirkhan J.H. A factor analytically derived measure of coping: The coping strategy indicator. Journal of Personality and Social Psychology 1990, 59:1066-1074. 10.1037/0022-3514.59.5.1066.
2. Angold A., Costello E.J., Erkanli A. Comorbidity. Journal of Child Psychology and Psychiatry 1999, 40:57-87. 10.1111/1469-7610.00424.
3. Archer J. Sex differences in aggression in real world settings: A meta-analytic review. Review of General Psychology 2004, 8:291-322. 10.1037/1089-2680.8.4.291.
4. Asparouhov T., Muthén B. Exploratory structural equation modeling. Structural Equation Modeling 2009, 16:397-438. 10.1080/10705510903008204.
5. Björkqvist K., Lagerspetz K.M.J., Kaukiainen A. Do girls manipulate and boys fight? Developmental trends in regard to direct and indirect aggression. Aggressive Behavior 1992, 18:117-127. 10.1002/1098-2337(1992)18:2<117::AID-AB2480180205>3.0.CO;2-3.
6. Bosworth K., Espelage D.L., Simon T.R. Factors associated with bullying behavior in middle school students. Journal of Early Adolescence 1999, 19:341-362. 10.1177/0272431699019003003.
7. Boulton M.J., Smith P.K. Bully/victim problems in middle-school children: Stability, self-perceived competence, peer perceptions and peer acceptance. British Journal of Developmental Psychology 1994, 12:315-329.
8. Boulton M.J., Underwood K. Bully/victim problems among middle school children. British Journal of Educational Psychology 1992, 62:73-87.
9. Boyle G.J. Self-Description Questionnaire II: A review. Test critiques 1994, Vol. 10:632-643. Test Corp. of America, Kansas City, MO. D.J. Keyser, R.C. Sweetland (Eds.).
10. Byrne B. Measuring self-concept across the life span: Issues and instrumentation 1996, American Psychological Association, Washington, DC. 10.1037/10197-000.
11. Campbell D.T., Fiske D.W. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 1959, 56:81-105. 10.1037/h0046016.
12. Campbell D.T., O'Connell E.J. Method factors in multitrait-multimethod matrices: Multiplicative rather than additive?. Multivariate Behavioral Research 1967, 2:409-426. 10.1207/s15327906mbr0204_1.
13. Card N.A., Hodges E.V.E. Peer victimization among school children: Correlations, causes, consequences, and considerations in assessment and intervention. School Psychology Quarterly 2008, 23:451-461. 10.1037/a0012769.
14. Card N.A., Little T.D. Studying aggression with structural equation modeling. The Cambridge Handbook of Violent Behavior 2007, 727-739. Cambridge University Press, New York. D. Flannery, A. Vazsonyi, I. Waldman (Eds.).
15. Card N.A., Stucky B.D., Sawalani G.M., Little T.D. Direct and indirect aggression during childhood and adolescence: A meta-analytic review of intercorrelations, gender differences, and relations to maladjustment. Child Development 2008, 79:1185-1229. 10.1111/j.1467-8624.2008.01184.x.
16. Chen F.F. Sensitivity of goodness of fit indices to lack of measurement invariance. Structural Equation Modeling 2007, 14:464-504.
17. Cheung G.W., Rensvold R.B. The effects of model parsimony and sampling error on the fit of structural equation models. Organizational Research Methods 2001, 4:236-264. 10.1177/109442810143004.
18. Cliff N. Orthogonal rotation to congruence. Psychometrika 1966, 31:33-42. 10.1007/BF02289455.
19. Cohen J. Multiple regression as a general data analytic system. Psychological Bulletin 1968, 70(6):426-443.
20. Cohen J., Cohen P. Applied multiple regression/correlation analysis for the behavioral sciences 1983, Lawrence Erlbaum, Hillsdale, NJ.
21. Crick N.R., Bigbee M.A., Howes C. Gender differences in children's normative beliefs about aggression: How do I hurt thee? Let me count the ways. Child Development 1996, 67:1003-1014. 10.2307/1131876.
22. Crick N.R., Grotpeter J.K. Relational aggression, gender, and social-psychological adjustment. Child Development 1995, 66:710-722. 10.2307/1131945.
23. Crick N.R., Nelson D.A., Morales J.R., Cullerton-Sen C., Casas J.F., Hickman S.E. Relational victimization in childhood and adolescence: I hurt you through the grapevine. Peer harassment in school: The plight of the vulnerable and victimized 2001, 196-214. Guilford, New York. J. Juvonen, A. Nishina, S. Graham (Eds.).
24. Dolan C.V., Oort F.J., Stoel R.D., Wicherts J.M. Testing measurement invariance in the target rotated multigroup exploratory factor model. Structural Equation Modeling 2009, 16:295-314. 10.1080/10705510902751416.
25. Due P., Holstein B.E., Lynch J., Diderichsen F., Gabnain S.N., Scheidt P., Currie C. Bullying and symptoms among school-aged children: International comparative cross sectional study in 28 countries. European Journal of Public Health 2005, 15:128-132. The Health Behaviour in School-Aged Children Bullying Working Group. 10.1093/eurpub/cki105.
26. Enders C. A primer on maximum likelihood algorithms for use with missing data. Structural Equation Modeling 2001, 8:128-141. 10.1207/S15328007SEM0801_7.
27. Feshbach S., Zagrodzka J. Aggression: Biological, developmental, and social perspectives 1997, Plenum Pr, New York.
28. Finkelhor D., Ormrod R.K., Turner H.A. Polyvictimization and trauma in a national longitudinal cohort. Development and Psychopathology 2007, 19:149-166. 10.1017/S0954579407070083.
29. Graham J.W. Missing data analysis: Making it work in the real world. Annual Review of Psychology 2009, 60:549-576. 10.1146/annurev.psych.58.110405.085530.
30. Gumpel T.P. Behavioral disorders in the school participant roles and sub-roles in three types of school violence. Journal of Emotional and Behavioral Disorders 2008, 16:145-162. 10.1177/1063426607310846.
31. Harachi T.W., Catalano R.F., Hawkins D.J. United States. The nature of school bullying: A cross-national perspective 1999, 279-295. Routledge, London, England. P.K. Smith, Y. Morita, J. Junger-Tas, D. Olweus, R.F. Catalano, P.T. Slee (Eds.).
32. Hattie J. Self-concept 1992, Lawrence Erlbaum, Hillsdale, NJ.
33. Hawker D.S.J., Boulton M.J. Twenty years' research on peer victimization and psychosocial maladjustment: A meta-analytic review of cross-sectional studies. Journal of Child Psychology and Psychiatry 2000, 41:441-455. 10.1111/1469-7610.00629.
34. Healey J. Bullying and youth violence. Issues in Society 2001, Vol. 154. Spinney, Rozelle, New South Wales, Australia.
35. Hussein M.H. The Peer Interaction in Primary School Questionnaire: Testing for measurement equivalence and latent mean differences in bullying between gender in Egypt, Saudi Arabia, and the USA. Social Psychology of Education 2010, 13:57-76. 10.1007/s11218-009-9098-y.
36. Jöreskog K.G. Statistical estimation of structural models in longitudinal investigations. Longitudinal research in the study of behavior and development 1979, 303-351. Academic Pr, New York, NY. J.R. Nesselroade, B. Baltes (Eds.).
37. Jöreskog K.G., Sörbom D. Advances in factor analysis and structural equation models 1979, Abt, Cambridge, MA.
38. Kovacs M. Children's Depression Inventory (CDI) manual 1992, Multi Health Systems, New York, NY.
39. Kovacs M., Devlin B. Internalizing disorders in childhood. Journal of Child Psychology and Psychiatry 1998, 39:47-63. 10.1017/S0021963097001765.
40. Lagerspetz K.M.J., Björkqvist K., Berts M., King E. Group aggression among school children in three schools. Scandinavian Journal of Psychology 1982, 23:45-52. 10.1111/j.1467-9450.1982.tb00412.x.
41. Little T.D., Jones S.M., Henrich C.C., Hawley P.H. Disentangling the " whys" from the " whats" of aggressive behavior. International Journal of Behavioral Development 2003, 27:122-133. 10.1080/01650250244000128.
42. Little T.D., Preacher K.J., Selig J.P., Card N.A. New developments in latent variable panel analyses of longitudinal data. International Journal of Behavioral Development 2007, 31:357-365. 10.1177/0165025407077757.
43. MacCallum R.C., Zhang S., Preacher K.J., Rucker D.D. On the practice of dichotomization of quantitative variables. Psychological Methods 2002, 7:19-40. 10.1037/1082-989X.7.1.19.
44. Marsh H.W. Multitrait-multimethod analyses. Educational research methodology, measurement, and evaluation: An international handbook 1988, 570-580. Pergamon Pr, Oxford, England. J.P. Keeves (Ed.).
45. Marsh H.W. Self-Description Questionnaire (SDQ) II: A theoretical and empirical basis for the measurement of multiple dimensions of adolescent self-concept: An interim test manual and a research monograph 1990, Psychological Corp, San Antonio, TX.
46. Marsh H.W. Multitrait-multimethod analyses: Inferring each trait/method combination with multiple indicators. Applied Measurement in Education 1993, 6:49-81. 10.1207/s15324818ame0601_4.
47. Marsh H.W. Stability of individual differences in multiwave panel studies: Comparison of simplex models and one-factor models. Journal of Educational Measurement 1993, 30:157-183. 10.1111/j.1745-3984.1993.tb01072.x.
48. Marsh H.W. Application of confirmatory factor analysis and structural equation modeling in sport/exercise psychology. Handbook of sport psychology 2007, 774-798. Wiley, New York, NY. 3rd ed. G. Tenenbaum, R.C. Eklund (Eds.).
49. Marsh H.W. Self-concept theory, measurement and research into practice: The role of self-concept in educational psychology 2007, British Psychological Society, Leicester, UK.
50. Marsh H.W., Balla J.R., Hau K.T. An evaluation of incremental fit indices: A clarification of mathematical and empirical processes. Advanced structural equation modeling techniques 1996, 315-353. Erlbaum, Hillsdale, NJ. G.A. Marcoulides, R.E. Schumacker (Eds.).
51. Marsh H.W., Balla J.R., McDonald R.P. Goodness-of-fit indices in confirmatory factor analysis: The effect of sample size. Psychological Bulletin 1988, 103:391-410. 10.1037/0033-2909.103.3.391.
52. Marsh H.W., Byrne B.M., Yeung A.S. Causal ordering of academic self-concept and achievement: Reanalysis of a pioneering study and revised recommendations. Educational Psychologist 1999, 34:155-167. 10.1207/s15326985ep3403_2.
53. Marsh H.W., Craven R.G. Reciprocal effects of self-concept and performance from a multidimensional perspective: Beyond seductive pleasure and unidimensional perspectives. Perspectives on Psychological Science 2006, 1:133-163. 10.1111/j.1745-6916.2006.00010.x.
54. Marsh H.W., Ellis L., Parada L., Richards G., Heubeck B.G. A short version of the Self-Description Questionnaire II: Operationalizing criteria for short-form evaluation with new applications of confirmatory factor analyses. Psychological Assessment 2005, 17:81-102. 10.1037/1040-3590.17.1.81.
55. Marsh H.W., Grayson D. Longitudinal stability of latent means and individual differences: A unified approach. Structural Equation Modeling 1994, 1:317-359. 10.1080/10705519409539984.
56. Marsh H.W., Grayson D. Latent-variable models of multitrait-multimethod data. Structural equation modeling: Issues and applications 1995, 177-198. Sage, Thousand Oaks, CA. R.H. Hoyle (Ed.).
57. Marsh H.W., Hattie J. Theoretical perspectives on the structure of self-concept. Handbook of self-concept 1996, 38-90. Wiley, Oxford, UK. B.A. Bracken (Ed.).
58. Marsh H.W., Hau K.-T. Assessing goodness of fit: Is parsimony always desirable?. Journal of Experimental Education 1996, 64:364-390.
59. Marsh H.W., Hau K.-T. Applications of latent-variable models in educational psychology: The need for methodological-substantive synergies. Contemporary Educational Psychology 2007, 32:151-170. 10.1016/j.cedpsych.2006.10.008.
60. Marsh H.W., Hau K.-T., Grayson D. Goodness-of-fit evaluation in structural equation modeling. Psychometrics. A festschrift to Roderick P. McDonald 2005, 275-340. Erlbaum, Hillsdale, NJ. A. Maydeu-Olivares, J. McArdle (Eds.).
61. Marsh H.W., Hau K.T., Wen Z. In search of golden rules: Comment on hypothesis testing approaches to setting cutoff values for fit indices and dangers in overgeneralizing Hu and Bentler's (1999) findings. Structural Equation Modeling 2004, 11:320-341. 10.1207/s15328007sem1103_2.
62. Marsh H.W., Hocevar D. A new procedure for analysis of multitrait-multimethod data: An application of second order confirmatory factor analysis. Journal of Applied Psychology 1988, 73:107-117. 10.1037/0021-9010.73.1.107.
63. Marsh H.W., Lüdtke O., Muthén B., Asparouhov T., Morin A.J.S., Trautwein U., Nagengast B. A new look at the big-five factor structure through exploratory structural equation modeling. Psychological Assessment 2010, 22:471-491. 10.1037/a0019227.
64. Marsh, H. W., Lüdtke, O., Robitzsch, A., Nagengast, B., Morin, A. J. S., & Trautwein, U. (2011). Two wrongs do not make a right: Camouflaging misfit with item-parcels in CFA models. Manuscript submitted for publication.
65. Marsh H.W., Martin A.J., Jackson S. Introducing a short version of the Physical Self-Description Questionnaire: New strategies, short-form evaluative criteria, and applications of factor analyses. Journal of Sport & Exercise Psychology 2010, 32:438-482.
66. Marsh H.W., Muthén B., Asparouhov T., Lüdtke O., Robitzsch A., Morin A.J.S., Trautwein U. Exploratory structural equation modeling, integrating CFA and EFA: Application to students' evaluations of university teaching. Structural Equation Modeling 2009, 16:439-476. 10.1080/10705510903008220.
67. Marsh H.W., O'Mara A. Long-term total negative effects of school-average ability on diverse educational outcomes: Direct and indirect effects of the big-fish-little-pond effect. Zeitschrift für Pädagogische Psychologie/German Journal of Educational Psychology 2010, 24:51-72.
68. Marsh H.W., Parada R.H., Craven R.G., Finger L. In the looking glass: A reciprocal effect model elucidating the complex nature of bullying, psychological determinants, and the central role of self-concept. Bullying: Implications for the classroom 2004, 63-109. Elsevier, San Diego, CA. C.E. Sanders, G.D. Phye (Eds.).
69. Marsh H.W., Parada R.H., Yeung A.S., Healey J. Aggressive school troublemakers and victims: A longitudinal model examining the pivotal role of self-concept. Journal of Educational Psychology 2001, 93:411-419. 10.1037/0022-0663.93.2.411.
70. Mayer M.J., Cornell D.G. New perspectives on school safety and violence prevention. Educational Researcher 2010, 39:5-6. 10.3102/0013189X09356778.
71. Meredith W. Rotation to achieve factorial invariance. Psychometrika 1964, 29:187-206. 10.1007/BF02289700.
72. Meredith W. Measurement invariance, factor analysis, and factorial invariance. Psychometrika 1993, 58:525-543. 10.1007/BF02294825.
73. Meredith W., Teresi J. An essay on measurement and factorial invariance. Medical Care 2006, 44(Suppl. 3):S69-S77. 10.1097/01.mlr.0000245438.73837.89.
74. Muthén L.K., Muthén B. Mplus user's guide 2008, Muthén & Muthén, Los Angeles CA.
75. Mynard H., Joseph S. Development of the multidimensional peer-victimization scale. Aggressive Behavior 2000, 26:169-178. 10.1002/(SICI)1098-2337(2000)26:2<169::AID-AB3>3.0.CO;2-A.
76. Nansel T.R., Overpeck M., Pilla R.S., Ruan J.W., Simons-Morton B., Scheidt P. Bullying behaviors among US youth: Prevalence and association with psychosocial adjustment. Journal of the American Medical Association 2001, 285:2094-2100. 10.1001/jama.285.16.2094.
77. Olweus D. Bully/victim problems among schoolchildren: Basic facts and effects of a school based intervention program. The development and treatment of childhood aggression 1991, 411-448. Erlbaum, Hillsdale, NJ. D.J. Pepler, K.H. Rubin (Eds.).
78. Olweus D. Bully/victim problems among schoolchildren: Long-term consequences and an effective intervention program. Mental disorder and crime 1993, 317-349. Sage, Newbury Park, CA. S. Hodgins (Ed.).
79. Olweus D. Bully/victim problems in school: Facts and intervention. European Journal of Psychology of Education 1997, 12:495-510. 10.1007/BF03172807.
80. Ostrov, J. M. (in press). Prospective associations between peer victimization and aggression. Child Development.
81. Ostrov J.M., Godleski S.A. Toward an integrated gender-linked model of aggression subtypes in early and middle childhood. Psychological Review 2010, 117:233-242. 10.1037/a0018070.
82. Parada R.H. Adolescent Peer Relations Instrument: A theoretical and empirical basis for the measurement of participant roles in bullying and victimization of adolescence. An interim test manual and a research monograph: A test manual 2000, University of Western Sydney, Self-Concept Enhancement and Learning Facilitation (SELF) Research Centre, Publication Unit, Penrith, New South Wales, Australia.
83. Parada R.H. Beyond bullying secondary schools program: Consultant's handbook 2002, University of Western Sydney, Self-Concept Enhancement and Learning Facilitation (SELF) Research Centre, Publication Unit, Penrith, New South Wales, Australia.
84. Parada, R. H. (2006). School bullying: Psychosocial determinants and effective intervention. Unpublished doctoral dissertation, University of Western Sydney, Penrith, New South Wales, Australia.
85. Parada R.H., Craven R.G., Marsh H.W. The beyond bullying secondary program: An innovative program empowering teachers to counteract bullying in schools. Self-processes, learning, and enabling human potential: Dynamic new approaches 2008, Vol. 3:373-426. Information Age, Charlotte, NC.
86. Parada, R. H., Marsh, H. W., & Craven, G. R. (2005, November). There and back again from bully to victim and victim to bully: A reciprocal effects model of bullying behaviours in schools. Paper presented at the Australian Association for Research in Education International, Parramatta, New South Wales, Australia.
87. Rigby K. Bullying in schools-and what to do about it 1996, ACER, Melbourne, Australia.
88. Rigby K., Slee P.T. Suicidal ideation among adolescent school children, involvement in bully-victim problems, and perceived social support. Suicide and Life-Threatening Behavior 1999, 29:119-130.
89. Rivers I., Smith P.K. Types of bullying behavior and their correlates. Aggressive Behavior 1994, 20:359-368. 10.1002/1098-2337(1994)20:5<359::AID-AB2480200503>3.0.CO;2-J.
90. Roland E., Idsøe T. Aggression and bullying. Aggressive Behavior 2001, 27:446-462. 10.1002/ab.1029.
91. Salmivalli C., Kaukiainen A., Lagerspetz K.M.J. Aggression and sociometric status among peers: Do gender and type of aggression matter?. Scandinavian Journal of Psychology 2000, 41:17-24. 10.1111/1467-9450.00166.
92. Sass D.A., Schmitt T.A. A comparative investigation of rotation criteria within exploratory factor analysis. Multivariate Behavioral Research 2010, 45:73-103. 10.1080/00273170903504810.
93. Selig J.P., Card N.A., Little T.D. Latent variable structural equation modeling in cross-cultural research: Multigroup and multilevel approaches. Multilevel analysis of individuals and cultures 2008, 93-119. Taylor & Francis, New York, NY. F.J.R. van de Vijver, D.A. van Hemert, Y.H. Poortinga (Eds.).
94. Shavelson R.J., Hubner J.J., Stanton G.C. Validation of construct interpretations. Review of Educational Research 1976, 46:407-441.
95. Smith P.K., Morita Y., Junger-Tas J., Olweus D., Catalano R.F., Slee P. The nature of school bullying: A cross-national perspective 1999, Routledge, London, England.
96. Smith P.K., Sharp S. School bullying: Insights and perspectives 1994, Routledge, London, England. 10.4324/9780203425497.
97. Sullivan K. The anti-bullying handbook 2000, New Zealand: Oxford University Pr, Auckland.
98. Sutton J., Smith P.K., Swettenham J. Bullying and " theory of mind": A critique of the " social skills deficit" view of anti-social behavior. Social Development 1999, 8:117-127. 10.1111/1467-9507.00083.
99. Swearer S.M., Espelage D.L., Vaillancourt T., Hymel S. What can be done about school bullying? Linking research to educational practice. Educational Researcher 2010, 39:38-47. 10.3102/0013189X09357622.
100. Underwood M.K. Social aggression among girls 2003, Guilford, New York, NY.
101. Vaillancourt T., Brendgen M., Boivin M., Tremblay R.E. A longitudinal confirmatory factor analysis of indirect and physical aggression: Evidence of two factors over time?. Child Development 2003, 74:1628-1638. 10.1046/j.1467-8624.2003.00628.x.
102. Wolke D., Woods S., Bloomfield L., Karstadt L. The association between direct and relational bullying and behavior problems among primary school children. Journal of Child Psychology and Psychiatry 2000, 41:989-1002. 10.1111/1469-7610.00687.
103. Wylie R.C. Measures of self-concept 1989, University of Nebraska, Lincoln.