Evidence of convergent and discriminant validity of child, teacher, and peer reports of teacher-student support

Psychological Assessment

Volumn 24, Issue 1, 2012, Pages 54-65

  Li, Yan ^a   Hughes, Jan N ^a   Kwok, Oi Man ^a   Hsu, Hsien Yuan ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b NATIONAL TAIWAN NORMAL UNIVERSITY   (Taiwan)

Author keywords

Convergent validity; Discriminant validity; Elementary students; Multitrait multimethod measurement; Teacher student relationship

Indexed keywords

ACADEMIC ACHIEVEMENT; ADULT; ARTICLE; CHILD; CHILD BEHAVIOR; CLINICAL PRACTICE; CLINICAL RESEARCH; CONDUCT DISORDER; CONTROLLED STUDY; CONVERGENT VALIDITY; CORRELATION ANALYSIS; DISCRIMINANT VALIDITY; ELEMENTARY STUDENT; ETHNIC DIFFERENCE; FEMALE; HUMAN; HUMAN RELATION; MALE; NAMED INVENTORIES, QUESTIONNAIRES AND RATING SCALES; POLICY; PSYCHOLOGIC ASSESSMENT; QUESTIONNAIRE; SCHOOL CHILD; SCORING SYSTEM; SEX DIFFERENCE; STATISTICAL MODEL; STUDENT; TEACHER; TEACHER NETWORK OF RELATIONSHIPS INVENTORY; TEACHER STUDENT RELATIONSHIP; TEACHER-STUDENT SUPPORT; UNITED STATES; ADOLESCENT; DISCRIMINANT ANALYSIS; FACTORIAL ANALYSIS; LONGITUDINAL STUDY; PEER GROUP; PSYCHOLOGICAL ASPECT; REPRODUCIBILITY; TEACHING; UNIVERSITY; VALIDATION STUDY;

ADOLESCENT; CHILD; CONDUCT DISORDER; DISCRIMINANT ANALYSIS; FACTOR ANALYSIS, STATISTICAL; FACULTY; FEMALE; HUMANS; INTERPERSONAL RELATIONS; LONGITUDINAL STUDIES; MALE; MODELS, STATISTICAL; PEER GROUP; REPRODUCIBILITY OF RESULTS; STUDENTS; TEACHING;

EID: 84862488416     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0024481     Document Type: Article

References (73)

1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of crossinformant correlations for situational specificity. Psychological Bulletin, 101, 213-232. doi:10.1037/0033-2909.101.2.213
2. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-Age Forms and Profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.
3. Baker, J. A. (2006). Contributions of teacher-child relationships to positive school adjustment during elementary school. Journal of School Psychology, 44, 211-229. doi:10.1016/j.jsp.2006.02.002
4. Brock, D. M., Sarason, I. G., Sanghvi, H., & Gurung, R. A. R. (1998). The perceived acceptance scale: Development and validation. Journal of Social and Personal Relationships, 15, 5-21. doi:10.1177/0265407598151001
5. Burchinal, M. R., Peisner-Feinberg, E., Pianta, R., & Howes, C. (2002). Development of academic skills from preschool through second grade: Family and classroom predictors of developmental trajectories. Journal of School Psychology, 40, 415-436. doi:10.1016/S0022-4405(02)00107-3
6. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105. doi:10.1037/h0046016
7. Caplan, G. (1970). The theory and practice of mental health consultation. New York, NY: Basic Books.
8. Chen, Q., Hughes, J. N., Kwok, O., & Liew, J. (2010). Joint contributions of peer acceptance and peer academic reputation to achievement in academically at risk children: Mediating processes. Journal of Applied Developmental Psychology, 31, 448-459. doi:10.1016/j.appdev .2010.09.001
9. Cole, D. A. (1987). Utility of confirmatory factor analysis in test validation research. Journal of Consulting and Clinical Psychology, 55, 584-594. doi:10.1037/0022-006X.55.4.584
10. Conway, J. M. (1998). Estimation and uses of the proportion of method variance for multitrait-multimethod data. Organizational Research Methods, 1, 209-222. doi:10.1177/109442819812003
11. Corten, I. W., Saris, W. E., Coenders, G., Veld, W. V. D., Aalberts, C. E., & Kornelis, C. (2002). Fit of different models for multitrait-multimethod experiments. Structural Equation Modeling, 9, 213-232. doi:10.1207/S15328007SEM0902_4
12. Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and selfdetermination in human behavior. New York, NY: Plenum.
13. Deci, E. L., & Ryan, R. M. (1991). A motivational approach to self: Integration in personality. In R. A. Dienstbier (Ed.), Nebraska symposium on motivation, 1990 (pp. 237-288). Lincoln, NE: University of Nebraska Press.
14. Decker, D. M., Dona, D. P., & Christenson, S. L. (2007). Behaviorally at-risk African American students: The importance of student-teacher relationships for student outcomes. Journal of School Psychology, 45, 83-109. doi:10.1016/j.jsp.2006.09.004
15. Dodge, K. A., & Pettit, G. S. (2003). A biopsychosocial model of the development of chronic conduct problems in adolescence. Developmental Psychology, 39, 349-371. doi:10.1037/0012-1649.39.2.349
16. Doumen, S., Verschueren, K., Buyse, E., Germeijs, V., Luyckx, K., & Soenens, B. (2008). Reciprocal relations between teacher-child conflict and aggressive behavior in kindergarten: A three-wave longitudinal study. Journal of Clinical Child and Adolescent Psychology, 37, 588-599. doi:10.1080/15374410802148079
17. Doumen, S., Verschueren, K., Buyse, E., De Munter, S., Max, K., & Moens, L. (2009). Further examination of the convergent and discriminant validity of the Student-Teacher Relationship Scale. Infant and Child Development, 18, 502-520. doi:10.1002/icd.635
18. Eid, M., Lischetzke, T., Nussbeck, F. W., & Trierweiler, L. I. (2003). Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple-indicator CT-C (M-1) model. Psychological Methods, 8, 38-60. doi:10.1037/1082-989X.8.1.38
19. Enders, C. K. (2010). Applied missing data analysis. New York, NY: Guilford Press.
20. Flook, L., Repetti, R. L., & Ullman, J. B. (2005). Classroom social experiences as predictors of academic performance. Developmental Psychology, 41, 319-327. doi:10.1037/0012-1649.41.2.319
21. Furman, W., & Buhrmester, D. (1985). Children's perceptions of the personal relationships in their social networks. Developmental Psychology, 21, 1016-1024. doi:10.1037/0012-1649.21.6.1016
22. Furman, W., & Buhrmester, D. (1992). Age and sex differences in pereptions of networks of personal relationships. Child Development, 63, 103-115. doi:10.2307/1130905
23. Furrer, C., & Skinner, E. (2003). Sense of relatedness as a factor in children's academic engagement and performance. Journal of Educational Psychology, 95, 148-162. doi:10.1037/0022-0663.95.1.148
24. Gest, S. D., Welsh, J. A., & Domitrovich, C. E. (2005). Behavioral predictors of changes in social relatedness and liking school in elementary school. Journal of School Psychology, 43, 281-301. doi:10.1016/j.jsp.2005.06.002
25. Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581-586. doi:10.1111/j.1469-7610.1997.tb01545.x
26. Goodman, R. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire (SDQ). Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337-1345..
27. Guay, F., Boivin, M., & Hodges, E. V. E. (1999). Predicting change in academic achievement: A model of peer experiences and self-system processes. Journal of Educational Psychology, 91, 105-115. doi: 10.1037/0022-0663.91.1.105
28. Hamre, B. K., & Pianta, R. C. (2001). Early teacher-child relationships and the trajectory of children's school outcomes through eighth grade. Child Development, 72, 625-638. doi:10.1111/1467-8624.00301
29. Hamre, B. K., & Pianta, R. C. (2006). Student-teacher relationships. In G. C. Bear & K. M. Minke (Eds.), Children's needs III: Development, prevention, and intervention (pp. 59-71). Washington, DC: National Association of School Psychologists.
30. Harter, S. (1985). Manual for the Perceived Competence Scale for Children. Unpublished manuscript, University of Denver, Denver, CO.
31. Henricsson, L., & Rydell, A. (2004). Elementary school children with behavior problems: Teacher-child relations and self-perception. A prospective study. Merrill-Palmer Quarterly, 50, 111-138.
32. Hill, C. R., & Hughes, J. N. (2007). Further evidence of the convergent and discriminant validity of the Strengths and Difficulties Questionnaire. School Psychology Quarterly, 22, 380-406. doi:10.1037/10453830.22.3.380
33. Howes, C., Hamilton, C. E., & Matheson, C. C. (1994). Children's relationships with peers: Differential associations with aspects of the teacher-child relationship. Child Development, 65, 253-263. doi: 10.2307/1131379
34. Hughes, J. N. (in press). Longitudinal effects of teacher and student perceptions of teacher-student relationship qualities on academic adjustment. Elementary School Journal.
35. Hughes, J. N., Cavell, T. A., & Jackson, T. (1999). Influence of teacher-student relationships on aggressive children's development: A prospective study. Journal of Clinical Child Psychology, 28, 173-184. doi: 10.1207/s15374424jccp2802_5
36. Hughes, J. N., Cavell, T. A., & Willson, V. (2001). Further support for the developmental significance of the quality of the teacher-student relationship. Journal of School Psychology, 39, 289-301. doi:10.1016/S0022-4405(01)00074-7
37. Hughes, J. N., Gleason, K., & Zhang, D. (2005). Relationships as predictors of teachers' perceptions of academic competence in academically at-risk minority and majority first-grade students. Journal of School Psychology, 43, 303-320.
38. Hughes, J. N., & Kwok, O. (2007). The influence of student-teacher and parent-teacher relationships on lower achieving readers' engagement and achievement in the primary grades. Journal of Educational Psychology, 99, 39-51. doi:10.1037/0022-0663.99.1.39
39. Hughes, J. N., Luo, W., Kwok, O., & Loyd, L. (2008). Teacher-student support, behavior engagement, and achievement: A 3-year longitudinal study. Journal of Educational Psychology, 100, 1-14. doi:10.1037/0022-0663.100.1.1
40. Hughes, J. N., & Villarreal, V. (2008, July). Concurrent and longitudinal effects of multiple perceptions of teacher-student relationship on school adjustment. Paper presented at the meeting of the International Association of School Psychologists, Utrecht, the Netherlands.
41. Hughes, J. N., Yoon, J., & Cavell, T. A. (1999, April). Child, teacher, and peer reports of teacher-student relationship: Cross-informant agreement and relationship to school adjustment. Paper presented at the biennial meeting of the Society for Research in Child Development, Albuquerque, NM.
42. Kenny, D. A., & Kashy, D. A. (1992). Analysis of the multitrait-multimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112, 165-172. doi:10.1037/0033-2909.112.1.165
43. Ladd, G. W., Birch, S. H., & Buhs, E. S. (1999). Children's social and scholastic lives in kindergarten: Related spheres of influence? Child Development, 70, 1373-1400. doi:10.1111/1467-8624.00101
44. Lance, C. E., Noble, C. L., & Scullen, S. E. (2002). A critique of the correlated trait-correlated method and correlated uniqueness models for multitrait-multimethod data. Psychological Methods, 7, 228-244. doi: 10.1037/1082-989X.7.2.228
45. Liew, J., Chen, Q., & Hughes, J. N. (2010). Child effortful control, teacher-student relationships, and achievement in academically at-risk children: Additive and interactive effects. Early Childhood Research Quarterly, 25, 51-64. doi:10.1016/j.ecresq.2009.07.005
46. Little, M., & Kobak, R. (2003). Emotional security with teachers and children's stress reactivity: A comparison of special-education and regular-education classrooms. Journal of Clinical Child and Adolescent Psychology, 32, 127-138.
47. Mantzicopoulos, P., & Neuharth-Pritchett, S. (2003). Development and validation of a measure to assess head start children's appraisals of teacher support. Journal of School Psychology, 41, 431-451. doi: 10.1016/j.jsp.2003.08.002
48. Masten, A. S., Morison, P., & Pellegrini, D. S. (1985). A revised class play method of peer assessment. Developmental Psychology, 21, 523-533. doi:10.1037/0012-1649.21.3.523
49. Meehan, B. T., Hughes, J. N., & Cavell, T. A. (2003). Teacher-student relationships as compensatory resources for aggressive children. Child Development, 74, 1145-1157. doi:10.1111/1467-8624.00598
50. Muris, P., Meesters, C., & Fijen, P. (2003). The Self-Perception Profile for Children: Further evidence for its factor structure, reliability, and validity. Personality and Individual Differences, 35, 1791-1802. doi: 10.1016/S0191-8869(03)00004-7
51. Murray, C., Murray, K. M., & Waas, G. A. (2008). Child and teacher reports of teacher-student relationships: Concordance of perspectives and associations with school adjustment in urban kindergarten classrooms. Journal of Applied Developmental Psychology, 29, 49-61. doi: 10.1016/j.appdev.2007.10.006
52. Muthén, L. K., & Muthén, B. O. (2007). Mplus user's guide. Los Angeles, CA: Muthén & Muthén.
53. Palermo, F., Hanish, L. D., Martin, C. L., Fabes, R. A., & Reiser, M. (2007). Preschoolers' academic readiness: What role does the teacher-child relationship play? Early Childhood Research Quarterly, 22, 407-422. doi:10.1016/j.ecresq.2007.04.002
54. Pianta, R. C. (Ed.). (1992). Beyond the parent: The role of other adults in children's lives (pp. 121-129) San Francisco, CA: Jossey-Bass.
55. Pianta, R. C., Steinberg, M. S., & Rollins, K. B. (1995). The first two years of school: Teacher-child relationships and deflections in children's classroom adjustment. Development and Psychopathology, 7, 295-312. doi:10.1017/S0954579400006519
56. Pianta, R. C., & Stuhlman, M. W. (2004). Teacher-child relationships and children's success in the first years of school. School Psychology Review, 33, 444-458.
57. Realmuto, G. M., August, G. J., Sieler, J. D., & Pessoa-Brandao, L. (1997). Peer assessment of social reputation in community samples of disruptive and nondisruptive children: Utility of the revised class play method. Journal of Clinical Child Psychology, 26, 67-76. doi:10.1207/s15374424jccp2601_7
58. Renk, K., & Phares, V. (2004). Cross-informant ratings of social competence in children and adolescents. Clinical Psychology Review, 24, 239-254. doi:10.1016/j.cpr.2004.01.004
59. Resnick, M. D., Bearman, P. S., Blum, R. W., Bauman, K. E., Harris, K. M., Jones, J., Udry, J. R. (1997). Protecting adolescents from harm: Findings from the National Longitudinal Study on Adolescent Health. JAMA, 278, 823-832. doi:10.1001/jama.278.10.823
60. Rey, R. B., Smith, A. L., Yoon, J., Somers, C., & Barnett, D. (2007). Relationships between teachers and urban African American children: The role of informant. School Psychology International, 28, 346-364. doi:10.1177/0143034307078545
61. Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. New York, NY: Wiley.
62. Schafer, J. L. (2000). NORM: Multiple imputation of incomplete multivariate data under a normal model (Version 2.03) [Computer software]. Available from http://www.stat.psu.edu/~jls/misoftwa.html
63. Silver, R. B., Measelle, J. R., Armstrong, J. M., & Essex, M. J. (2005). Trajectories of classroom externalizing behavior: Contributions of child characteristics, family characteristics, and the teacher-child relationship during the school transition. Journal of School Psychology, 43, 39-60. doi:10.1016/j.jsp.2004.11.003
64. Skinner, E., & Belmont, M. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85, 571-581. doi: 10.1037/0022-0663.85.4.571
65. Terry, R. (2000). Recent advances in measurement theory and the use of sociometric techniques. In A. H. N. Cillessen & W. M. Bukowski (Eds.), Recent advances in the measurement of acceptance and rejection in the peer system: New directions for child and adolescent development, No. 88 (pp. 27-53). San Francisco, CA: Jossey-Bass.
66. Weinstein, R. S., Marshall, H. H., Sharp, L., & Botkin, M. (1987). Pygmalion and the student: Age and classroom differences in children's awareness of teacher expectations. Child Development, 58, 1079-1093. doi:10.2307/1130548
67. Weiss, R. S. (1974). The provisions of social relationships. In Z. Rubin (Ed.), Doing unto others (pp. 17-26). Englewood Cliffs, NJ: PrenticeHall.
68. West, S. G., Finch, J. F., & Curran, P. J. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 56-75). Thousand Oaks, CA: Sage.
69. Wigfield, A., Eccles, J. S., Yoon, K. S., Harold, R. D., Arbreton, A. J. A., Freedman-Doan, C., & Blumenfeld, P. C. (1997). Change in children's competence beliefs and subjective task values across the elementary school years: A 3-year study. Journal of Educational Psychology, 89, 451-469. doi:10.1037/0022-0663.89.3.451
70. Woodcock, R. W., & Johnson, M. B. (1989). Woodcock-Johnson PsychoEducational Battery-Revised. Allen, TX: DLM Teaching Resources.
71. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). WJ-III Tests of Achievement. Itasca, IL: Riverside.
72. Woodcock, R. W., & Muñoz-Sandoval, A. F. (1993). Woodcock-Muñoz Language Survey. Itasca, IL: Riverside.
73. Woodcock, R. W., Muñoz-Sandoval, A. F., McGrew, K., Mather, N., & Schrank, F. (2004). Batería III Woodcock-Muñoz. Riverside, CA: Riverside.