What do teachers think about their students' inclusion? Consistency of students' self-reports and teacher ratings

Frontiers in Psychology

Volumn 10, Issue JULY, 2019, Pages

  Venetz, Martin ^a   Zurbriggen, Carmen L A ^b   Schwab, Susanne ^c,d  

^a University of Applied Sciences of Special Needs Education Zurich   (Switzerland)

^b BIELEFELD UNIVERSITY   (Germany)

^c UNIVERSITY OF VIENNA   (Austria)

^d NORTH WEST UNIVERSITY   (South Africa)

Author keywords

Academic self concept; Assessment accuracy; Inclusion; Self report; Teacher rating

Indexed keywords

EID: 85069461511     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2019.01637     Document Type: Article

References (71)

1. Armstrong, D., Amstrong, A. C., and Spandagou, I. (2011). Inclusion: by choice or by chance? Int. J. Inclusive Educ. 15, 29-39. doi: 10.1080/13603116.2010.496192
2. Artelt, C., and Rausch, T. (2014). "Accuracy of teacher judgments. When and for what reasons?, " in Teachers' Professional Development: Assessment, Training, and Learning, eds S. Krolak-Schwerdt, S. Glock, and M. Böhmer (Rotterdam: Sense Publishers), 27-43. doi: 10.1007/978-94-6209-536-6_3
3. Bear, G. G., Minke, K. M., and Manning, M. A. (2002). Self-concept of students with learning disabilities: a meta-analysis. Sch. Psychol. Rev. 31, 405-427
4. Bossaert, G., Colpin, H., Pijl, S. J., and Petry, K. (2013). Truly included? A literature study focusing on the social dimension of inclusion in education. Int. J. Inclusive Educ. 17, 60-79. doi: 10.1080/13603116.2011.580464
5. Campell, D. T., and Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol. Bull. 56, 81-105. doi: 10.1037/h0046016
6. Chapman, J. W. (1988). Learning disabled children's self-concepts. Rev. Educ. Res. 58, 347-371. doi: 10.3102/00346543058003347
7. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Modeling 14, 464-504. doi: 10.1080/10705510701301834
8. de Boer, A., and Pijl, S. J. (2016). The acceptance and rejection of peers with ADHD and ASD in general secondary education. J. Educ. Res. 109, 325-332. doi: 10.1080/00220671.2014.958812
9. de Monchy, M., Pijl, S. J., and Zandberg, T. (2004). Discrepancies in judging social inclusion and bullying of pupils with behaviour problems. Eur. J. Spec. Needs Educ. 19, 317-330. doi: 10.1080/0885625042000262488
10. DeVries, J. M., Voß, S., and Gebhardt, M. (2018). Do learners with special education needs really feel included? Evidence from the perception inclusion questionnaire and strengths and Difficulties questionnaire. Res. Dev. Disabil. 83, 28-36. doi: 10.1016/j.ridd.2018.07.007
11. Dunn, L. M. (1968). Special education for the mildly retarded-Is much of it justifiable? Except. Children 35, 5-22. doi: 10.1177/001440296803500101
12. Dunn, T. J., Baguley, T., and Brunsden, V. (2014). From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. Br. J. Psychol. 105, 399-412. doi: 10.1111/bjop.12046
13. Eid, M. (2000). A multitrait-multimethod model with minimal assumptions. Psychometrika 65, 241-261. doi: 10.1007/bf02294377
14. Eid, M. (2018). "Statistical approaches to analyzing well-being data, " in Handbook of Well-Being, eds E. Diener, S. Oishi, and L. Tay (Salt Lake City, UT: DEF Publishers)
15. Eid, M., Geiser, C., and Koch, T. (2016). Measuring method effects: from traditional to design-oriented approaches. Curr. Dir. Psychol. Sci. 25, 275-280. doi: 10.1177/0963721416649624
16. Eid, M., Lischetzke, T., Nussbeck, F. W., and Trierweiler, L. I. (2003). Separating trait from trait-specific method effects in multitrait-multimethod models: a multiple-indicator CT-C(M-1) model. Psychol. Methods 8, 38-60. doi: 10.1037/1082-989X.8.1.38
17. Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M., and Lischetzke, T. (2008). Structural equation modeling of multitrait-multimethod data: different models for different types of methods. Psychol. Methods 13, 230-253. doi: 10.1037/a0013219
18. Funder, D. C. (1995). On the accuracy of personality judgment: a realistic approach. Psychol. Rev. 102, 652-670. doi: 10.1037//0033-295x.102.4.652
19. Funder, D. C. (2012). Accurate personality judgment. Curr. Dir. Psychol. Sci. 21, 177-182. doi: 10.1177/0963721412445309
20. Gebhardt, M., Krammer, M., Schwab, S., Rossmann, P., and Gasteiger-Klicpera, B. (2013). What is behind the diagnosis of learning disabilities in Austrian schools? An empirical evaluation of the diagnostic process. Int. J. Spec. Educ. 28, 160-166
21. Geiser, C., Eid, M., Nussbeck, F. W., Courviosier, D. S., and Cole, D. A. (2010). Analyzing true change in longitudinal multitrait-multimethod studies: application of a multimethod change model to depression and anxiety in children. Dev. Psychol. 46, 29-45. doi: 10.1037/a0017888
22. Geiser, C., Eid, M., West, S. G., Lischetzke, T., and Nussbeck, F. W. (2012). A comparison of method effects in two confirmatory factor models for structurally different methods. Struct. Equ. Modeling 19, 409-436. doi: 10.1080/10705511.2012.687658
23. Geiser, C., Bums, G. L., and Servera, M. (2014). Testing for measurement invariance and latent mean differences across methods: interesting incremental information from multitrait-multimethod studies. Front. Psychol. 5:1216. doi: 10.3389/fpsyg.2014.01216
24. Givvin, K. B., Stipek, D. J., Salmon, J. M., and MacGyvers, V. L. (2001). In the eyes of the beholder: students' and teachers' judgments of students' motivation. Teach. Teach. Educ. 17, 321-331. doi: 10.1016/s0742-051x(00)00060-3
25. Gomez, R. (2014). Correlated trait-correlated method minus one analysis of the convergent and discriminant validities of the strengths and difficulties questionnaire. Assessment 21, 372-382. doi: 10.1177/1073191112457588
26. Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire (SDQ). J. Am. Acad. Child Adolesc. Psychiatry 40, 1337-1345
27. Haeberlin, U., Moser, U., Bless, G., and Klaghofer, R. (1989). Integration in die Schulklasse. Fragebogen zur Erfassung von Dimensionen der Integration von Schu"ulern FDI 4-6 [Integration in the Classroom. Questionnaire for Assessing Dimensions of Integration of Students]. Bern, Switzerland: Haupt
28. Hoge, R. D., and Coladarci, T. (1989). Teacher-based judgments of academic achievement: a review of literature. Rev. Educ. Res. 59, 297-313. doi: 10.3102/00346543059003297
29. Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1-55. doi: 10.1080/10705519909540118
30. Hurwitz, J. T., Elliott, S. N., and Braden, J. P. (2007). The influence of test familiarity and student disability status upon teachers' judgments of students' test performance. Sch. Psychol. Q. 22, 115-144. doi: 10.1037/1045-3830.22.2.115
31. Karing, C., Dörfler, T., and Artelt, C. (2015). How accurate are teacher and parent judgments of lower secondary school children's test anxiety? Educ. Psychol. 35, 909-925. doi: 10.1080/01443410.2013.814200
32. Koch, T., Kelava, A., and Eid, M. (2017). Analyzing different types of moderated method effects in confirmatory factor models for structurally different methods. Struct. Equ. Modeling 25, 179-200. doi: 10.1080/10705511.2017.1373595
33. Koster, M., Pijl, S. J., van Houten, E., and Nakken, H. (2007). The social position and development of pupils with SEN in mainstream Dutch schools. Eur. J. Spec. Needs Educ. 22, 31-46. doi: 10.1080/08856250601082265
34. Koster, M., Pijl, S. J., Nakken, H., and Van Houten, E. J. (2010). Social participation of students with special needs in regular primary education in the Netherlands. Int. J. Disabil. Dev. Educ. 57, 59-75. doi: 10.1080/10349120903537905
35. Krull, J., Wilbert, J., and Hennemann, T. (2014). The social and emotional situation of first graders with classroom behavior problems and classroom learning difficulties in inclusive classes. Learn. Disabil. 12, 169-190
36. Kwon, K., Kim, E. M., and Sheridan, S. M. (2012). A contextual approach to social skills assessment in the peer group: who is the best judge? Sch. Psychol. Q. 27, 121-133. doi: 10.1037/a0028696
37. Larson, R. W., Moneta, G., Richards, M. H., and Wilson, S. (2002). Continuity, stability, and change in daily emotional experience across adolescence. Child Dev. 73, 1151-1185
38. Machts, N., Kaiser, J., Schmidt, F. T. C., and Möller, J. (2016). Accuracy of teachers' judgments of students' cognitive abilities: a meta-analysis. Educ. Res. Rev. 19, 85-103. doi: 10.1016/j.edurev.2016.06.003
39. Marsh, H. W., Balla, J. R., and McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: the effect of sample size. Psychol. Bull. 103, 391-410. doi: 10.1037//0033-2909.103.3.391
40. Marsh, H. W., and Hocevar, D. (1988). A new, more powerful approach to multitrait-multimethod analyses: application of second-order confirmatory factor analysis. J. Appl. Psychol. 73, 107-117. doi: 10.1037/0021-9010.73.1.107
41. Marsh, H. W., Tracey, D. K., and Craven, R. G. (2006). Multidimensional self-concept structure for preadolescents with mild intellectual disabilities: a hybrid multigroup-mimic approach to factorial invariance and latent mean differences. Educ. Psychol. Meas. 66, 795-818. doi: 10.1177/0013164405285910
42. McCoy, S., and Banks, J. (2012). Simply academic? Why children with special educational needs don't like school. Eur. J. Spec. Needs Educ. 27, 81-97. doi: 10.1080/08856257.2011.640487
43. McDonald, R. P. (1999). Test Theory: A Unified Treatment. Mahwah, NJ: Erlbaum
44. Meissel, K., Meyer, F., Yao, E. S., and Rubie-Davies, C. M. (2017). Subjectivity of teacher judgments: exploring student characteristics that influence teacher judgments of student ability. Teach. Teach. Educ. 65, 48-60. doi: 10.1016/j.tate.2017.02.021
45. Muthén, B. (2002). Beyond SEM: general latent variable modeling. Behaviormetrika 29, 81-117. doi: 10.2333/bhmk.29.81
46. Muthén, L. K., and Muthén, B. (1998-2017). Mplus User's Guide 8th Edn. Los Angeles, CA: Muthén & Muthén. doi: 10.2333/bhmk.29.81
47. Nussbeck, F. W., Eid, M., and Lischetzke, T. (2006). Analysing multitrait-multimethod data with structural equation models for ordinal variables applying the WLSMV estimator: what sample size is needed for valid results? Br. J. Math. Stat. Psychol. 59, 195-213. doi: 10.1348/000711005X67490
48. Oh-Young, C., and Filler, J. (2015). A meta-analysis of the effects of placement on academic and social skill outcome measures of students with disabilities. Res. Dev. Disabil. 47, 80-92. doi: 10.1016/j.ridd.2015.08.014
49. Pohl, S., Steyer, R., and Kraus, K. (2008). Modelling method effects as individual causal effects. J R. Stat. Soc. 171, 41-63
50. Praetorius, A.-K., Berner, V.-D., Zeinz, H., Scheunpflug, A., and Dresel, M. (2013). Judgment confidence and judgment accuracy of teachers in judging self-concepts of students. J. Educ. Res. 106, 64-76. doi: 10.1080/00220671.2012.667010
51. Praetorius, A.-K., Koch, T., Scheunpflug, A., Zeinz, H., and Dresel, M. (2017). Identifying determinants of teachers' judgment (in)accuracy regarding students' school-related motivations using a Bayesian cross-classified multi-level model. Learn. Instr. 52, 148-160. doi: 10.1016/j.learninstruc.2017.06.003
52. Prince, E. J., and Hadwin, J. (2013). The role of a sense of school belonging in understanding the effectiveness of inclusion of children with special educational needs. Int. J. Inclusive Educ. 17, 238-262. doi: 10.1080/13603116.2012.676081
53. Rhemtulla, M., Brosseau-Liard, P. é., and Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychol. Methods 17, 354-373. doi: 10.1037/a0029315
54. Ruijs, N. M., and Peetsma, T. T. D. (2009). Effects of inclusion on students with and without special educational needs reviewed. Educ. Res. Rev. 4, 67-79. doi: 10.1016/j.edurev.2009.02.002
55. Ruijs, N. M., Van der Veen, I., and Peetsma, T. T. D. (2010). Inclusive education and students without special educational needs. Educ. Res. 52, 351-390. doi: 10.1080/00131881.2010.524749
56. Schwab, S. (2015). Social dimensions of inclusion in education of 4th and 7th grade pupils in inclusive and regular classes: outcomes from Austria. Res. Dev. Disabil. 4, 72-79. doi: 10.1016/j.ridd.2015.06.005
57. Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach's alpha. Psychometrika 74, 107-120. doi: 10.1007/S11336-008-9101-0
58. Skrzypiec, G., Askell-Williams, H., Slee, P., and Rudzinski, A. (2016). Students with self-identified special educational needs and disabilities (si-SEND): flourishing or languishing! Int. J. Disabil. Dev. Educ. 63, 7-26. doi: 10.1080/1034912x.2015.1111301
59. Sommer, U., Fink, A., and Neubauer, A. C. (2008). Detection of high ability children by teachers and parents: psychometric quality of new rating checklists for the assessment of intellectual, creative and social ability. Psychol. Sci. Q. 50, 189-205
60. Südkamp, A., Kaiser, J., and Möller, J. (2012). Accuracy of teachers' judgments of students' academic achievement: a meta-analysis. J. Educ. Psychol. 104, 743-762. doi: 10.1037/a0027627
61. Südkamp, A., Kaiser, J., and Möller, J. (2014). "Teachers' judgments of students' academic achievement: results from field and experimental studies, " in Teachers' Professional Development. Assessment, Training, and Learning, eds S. Krolak-Schwerdt, S. Glock, and M. Böhmer (Rotterdam: Sense Publishers). doi: 10.1037/a0027627
62. Urhahne, D., Chao, S.-H., Florineth, M. L., Luttenberger, S., and Paechter, M. (2011). Academic self-concept, learning motivation, and test anxiety of the underestimated student. Br. J. Educ. Psychol. 81, 161-177. doi: 10.1348/000709910X504500
63. Urhahne, D., and Zhu, M. (2015). Accuracy of teachers' judgments of students' subjective well-being. Learn. Individ. Differ. 43, 226-232. doi: 10.1016/j.lindif.2015.08.007
64. van Ophuysen, S. (2009). Die einschätzung sozialer beziehungen der schüler nach dem grundschulübergang durch den klassenlehrer. [Class teachers' assessment of children's social relationships after primary school transition.]. Unterrichtswissenschaft 37, 330-346
65. Venetz, M., and Zurbriggen, C. (2016). Intensity bias oder rosy view? Empirische Pädagogik 30, 27-42
66. Venetz, M., Zurbriggen, C., and Eckhart, M. (2014). Entwicklung und erste validierung einer kurzversion des "fragebogens zur erfassung von dimensionen der integration von schülern (fdi 4-6)" von haeberlin, moser, bless und klaghofer. Empirische Sonderpädagogik 6, 99-113
67. Venetz, M., Zurbriggen, C. L. A., Eckhart, M., Schwab, S., and Hessels, M. G. P. (2015). The Perceptions of Inclusion Questionnaire (PIQ). Available at: http://www.piqinfo.ch (accessed August 7, 2019)
68. Yu, J., Sun, S., and Cheah, C. S. L. (2016). Multitrait-multimethod analysis of the strengths and difficulties questionnaire in young asian american children. Assessment 23, 603-613. doi: 10.1177/1073191115586459
69. Zhu, M., and Urhahne, D. (2014). Assessing teachers' judgements of students' academic motivation and emotions across two rating methods. Educ. Res. Eval. 20, 411-427. doi: 10.1080/13803611.2014.964261
70. Zurbriggen, C. L. A., Venetz, M., and Hinni, C. (2018). The quality of experience of students with and without special educational needs in everyday life and when relating to peers. Eur. J. Spec. Needs Educ. 33, 205-220. doi: 10.1080/08856257.2018.1424777
71. Zurbriggen, C. L. A., Venetz, M., Schwab, S., and Hessels, M. G. P. (2017). A psychometric analysis of the student version of the perceptions of inclusion questionnaire (PIQ). Eur. J. Psychol. Assess. 2017, 1-9. doi: 10.1027/1015-5759/a000443