Diagnostic efficiency of several methods of identifying socially rejected children and effect of participation rate on classification accuracy

Journal of School Psychology

Volumn 49, Issue 5, 2011, Pages 573-595

  McKown, Clark ^a   Gumbiner, Laura M ^b   Johnson, Jason ^a  

^a RUSH UNIVERSITY MEDICAL CENTER   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Assessment methods; Diagnostic efficiency; Social acceptance; Social rejection; Sociometrics; Universal screening

Indexed keywords

ADOLESCENT; AGGRESSION; ARTICLE; CHILD; EDUCATIONAL STATUS; FEMALE; HUMAN; HUMAN RELATION; MALE; PEER GROUP; SENSITIVITY AND SPECIFICITY; SOCIAL DISTANCE; SOCIAL ENVIRONMENT; SOCIOMETRIC STATUS;

ADOLESCENT; AGGRESSION; CHILD; EDUCATIONAL STATUS; FEMALE; HUMANS; INTERPERSONAL RELATIONS; MALE; PEER GROUP; SENSITIVITY AND SPECIFICITY; SOCIAL DISTANCE; SOCIAL ENVIRONMENT; SOCIOMETRIC TECHNIQUES;

EID: 80052954205     PISSN: 00224405     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jsp.2011.06.002     Document Type: Article

References (124)

1. Andrade B.F., Waschbusch D.A., King S., Thurston C., McNutt L., Terrio B. Teacher-classified peer social status: Preliminary validation and associations with behavior ratings. Journal of Psychoeducational Assessment 2005, 23:279-290.
2. Asher S.R., Dodge K.A. Identifying children who are rejected by their peers. Developmental Psychology 1986, 22:444-449.
3. Asher S.R., Hymel S. Children's social competence in peer relations: Sociometric and behavioral assessment. Social competence 1981, 125-157. Guilford Press, New York, NY. J.D. Wine, M.D. Smye (Eds.).
4. Asher S.R., Renshaw P. Children without friends: Social knowledge and social skill training. The development of children's friendships 1981, 273-296. University Press, Cambridge, NY. S. Asher, J. Gottman (Eds.).
5. Bagwell C.L., Schmidt M.E., Newcomb A.F., Bukowski W.M. Friendship and peer rejection as predictors of adult adjustment. The role of friendship in psychological adjustment 2001, 25-49. Jossey-Bass, San Francisco, CA. C.A. Erdley (Ed.).
6. Beck S., Collins L., Overholser J., Terry K. A comparison of children who receive and who do not receive permission to participate in research. Journal of Abnormal Child Psychology 1984, 12:573-580.
7. Bell-Dolan D., Foster S.L., Christopher J.S. Children's reactions to participating in a peer relations study: An example of cost-effective assessment. Child Study Journal 1992, 22:137-156.
8. Bell-Dolan D., Foster S.L., Sikora D.M. Effects of sociometric testing on children's behavior and loneliness in school. Developmental Psychology 1989, 25:306-311.
9. Bell-Dolan D., Foster S.L., Tishelman A.C. An alternative to negative nomination sociometric measures. Journal of Clinical Child Psychology 1989, 18:153-157.
10. Bell-Dolan D., Wessler A.E. Ethical administration of sociometric measures: Procedures in use and suggestions for improvement. Professional Psychology: Research and Practice 1994, 25:23-32.
11. Bierman K.L. Peer rejection: Developmental processes and intervention strategies 2004, Guilford Press, New York, NY.
12. Boivin M., Hymel S., Hodges E.V.E. Toward a process view of peer rejection and harassment. Peer harassment in school: The plight of the vulnerable and victimized 2001, 265-289. Guilford Press, New York, NY. S. Graham (Ed.).
13. Campbell S. Behavior problems in preschool children: A review of recent research. Journal of Child Psychology and Psychiatry 1995, 36:113-149.
14. Carran D.T., Scott K.G. Risk assessment in preschool children: Research implications for the early detection of educational handicaps. Topics in Early Childhood Special Education 1992, 12:196-211.
15. Cassidy J., Asher S.R. Loneliness and peer relations in young children. Child Development 1992, 63:350-365.
16. Chan S., Mpofu E. Children's peer status in school settings: Current and prospective assessment procedures. School Psychology International 2001, 22:43-52.
17. Chung T., Asher S.R. Children's goals and strategies in peer conflict situations. Merrill-Palmer Quarterly: Journal of Developmental Psychology 1996, 42:125-147.
18. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960, 20:37-46.
19. Coie J.D., Dodge K.A. Continuities and changes in children's social status: A five-year longitudinal study. Merrill-Palmer Quarterly: Journal of Developmental Psychology 1983, 29:261-282.
20. Coie J.D., Dodge K.A. Multiple sources of data on social behavior and social status in the school: A cross-age comparison. Child Development 1988, 59:815-829.
21. Coie J.D., Dodge K.A., Coppotelli H. Dimensions and types of social status: A cross-age perspective. Developmental Psychology 1982, 18:557-570.
22. Coie J.D., Dodge K.A., Kupersmidt J.B. Peer group behavior and social status. Peer rejection in childhood 1990, 17-59. Cambridge University Press, New York, NY. J.D. Coie (Ed.).
23. Connolly J., Doyle A. Assessment of social competence in preschoolers: Teachers versus peers. Developmental Psychology 1981, 17:454-462.
24. Courser M.W., Shamblen S.R., Lavrakas P.J., Collins D., Ditterline P. The impact of active consent procedures on nonresponse and nonresponse error in youth survey data: Evidence from a new experiment. Evaluation Review 2009, 33:370-395.
25. Cowen E.L., Pederson A., Babigian H., Isso L.D., Trost M.A. Long-term follow-up of early detected vulnerable children. Journal of Consulting and Clinical Psychology 1973, 41(3):438-446.
26. Crick N.R., Ladd G.W. Nominator attrition: Does it affect the accuracy of children's sociometric classifications?. Merrill-Palmer Quarterly: Journal of Developmental Psychology 1989, 35:197-207.
27. de Guzman M., Carlo G., Ontai L., Koller S., Knight G. Gender and age differences in Brazilian children's friendship nominations and peer sociometric ratings. Sex Roles 2004, 51:217-222.
28. Dent C.W., Galaif J., Sussman S., Stacy A. Demographic, psychosocial and behavioral differences in samples of actively and passively consented adolescents. Addictive Behaviors 1993, 18:51-56.
29. Dishion T.J. The peer context of troublesome child and adolescent behavior. Understanding troubled and troubling youth 1990, Vol. 116:128-153. Sage, Thousand Oaks, CA.
30. Dishion T.J., Andrews D.W., Crosby L. Antisocial boys and their friends in early adolescence: Relationship characteristics, quality, and interactional process. Child Development 1995, 66:139-151.
31. Dodge K.A. Behavioral antecedents of peer social status. Child Development 1983, 54:1386-1399.
32. Dodge K.A., Feldman E. Issues in social cognition and sociometric status. Peer rejection in childhood 1990, 119-155. Cambridge University Press, New York, NY. J.D. Coie (Ed.).
33. Dodge K.A., Price J.M. On the relation between social information processing and socially competent behavior in early school-aged children. Child Development 1994, 65:1385-1897.
34. Dunnington M.J. Investigation of areas of disagreement in sociometric measurement of preschool children. Child Development 1957, 28:93-102.
35. Durlak J.A., Weissberg R.P., Dymnicki A.B., Taylor R.D., Schellinger K.B. The impact of enhancing students' social and emotional learning: A meta-analysis of school-based universal interventions. Child Development 2011, 82:405-432.
36. Durlak J.A., Weissberg R.P., Pachan M. A meta-analysis of after-school programs that seek to promote personal and social skills in children and adolescents. American Journal of Community Psychology 2010, 45:294-309.
37. Elledge L., Cavell T., Ogle N., Newgent R. School-based mentoring as selective prevention for bullied children: A preliminary test. Journal of Primary Prevention 2010, 31:171-187.
38. Ellickson P.L., Hawes J.A. An assessment of active versus passive methods for obtaining parental consent. Evaluation Review 1989, 13:45-55.
39. Erdley C.A., Asher S.R. A social goals perspective on children's social competence. Journal of Emotional and Behavioral Disorders 1999, 7:156-167.
40. Esbensen F., Miller M.H., Taylor T.J., He N., Freng A. Differential attrition rates and active parental consent. Evaluation Review 1999, 23:316-335.
41. Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters 2005, 27:861-874.
42. Feeny-Kettler K.A., Kratochwill T.R., Kettler R.J. Identification of preschool children at risk for emotional and behavioral disorders: Development and validation of a universal screening system. Journal of School Psychology 2011, 49:197-216.
43. Fendrich M., Johnson T.P. Examining prevalence differences in three national surveys of youth: impact of consent procedures, mode, and editing rules. Journal of Drug Issues 2001, 31:615-642.
44. Fox C.L., Boulton M.J. Evaluating the effectiveness of a social skills training (SST) programme for victims of bullying. Educational Research 2003, 45:231-247.
45. Frame C.L., Strauss C.C. Parental informed consent and sample bias in grade-school children. Journal of Social and Clinical Psychology 1987, 5:227-236.
46. French D.C. Heterogeneity of peer-rejected boys: Aggressive and nonaggressive subtypes. Child Development 1988, 59:976-985.
47. French D.C. Heterogeneity of peer-rejected girls. Child Development 1990, 61:2028-2031.
48. French D.C., Tyne T.F. The identification and treatment of peer relationship difficulties. Social skills training: A practical handbook for assessment and treatment 1982, 280-308. Guilford Press, New York, NY. J.P. Curran, P.M. Monti (Eds.).
49. French D.C., Waas G.A. Behavior problems of peer-neglected and peer-rejected elementary-age children: Parent and teacher perspectives. Child Development 1985, 56:246-252.
50. French D.C., Waas G.A. Teachers' ability to identify peer-rejected children: A comparison of sociometrics and teacher ratings. Journal of School Psychology 1985, 23:347-353.
51. Gifford-Smith M., Brownell C.A. Childhood peer relationships: Social acceptance, friendships, and peer networks. Journal of School Psychology 2003, 41:235-284.
52. Glover T.A., Albers C.A. Considerations for evaluating universal screening assessments. Journal of School Psychology 2007, 45:117-135.
53. Gredler G.R. Issues in early childhood screening and assessment. Psychology in the Schools 1997, 34:98-106.
54. Gredler G.R. Early childhood screening for developmental and educational problems. The psychoeducational assessment of preschool children 2000, 399-411. Allyn & Bacon, Needham Heights, MA. 3rd ed. B.A. Bracken (Ed.).
55. Green D., Swets J.A. Signal detection theory and psychophysics 1966, John Wiley, New York, NY.
56. Gresham F.M., Elliott S.N. Social skills rating system 1990, American Guidance Service, Circle Pines, MN.
57. Hamilton C., Fuchs D., Fuchs L.S., Roberts H. Rates of classroom participation and the validity of sociometry. School Psychology Review 2000, 29:251-266.
58. Hartup W.W., Glazer J.A., Charlesworth R. Peer reinforcement and sociometric status. Child Development 1967, 38:1017-1024.
59. Hayden-Thomson L., Rubin K., Hymel S. Sex preferences in sociometric choices. Developmental Psychology 1987, 23:558-562.
60. Hayvren M., Hymel S. Ethical issues in sociometric testing: Impact of sociometric measures on interaction behavior. Developmental Psychology 1984, 20:844-849.
61. Hinshaw S.P., Owens E.B., Sami N., Fargeon S. Prospective follow-up of girls with attention-deficit/hyperactivity disorder into adolescence: Evidence for cross-domain impairment. Journal of Consulting and Clinical Psychology 2006, 74:489-499.
62. Hollmann C.M., McNamara J.R. Considerations in the use of active and passive parental consent procedures. Journal of Psychology: Interdisciplinary and Applied 1999, 133:141-156.
63. Hymel S. Preschool children's peer relations: Issues in sociometric assessment. Merrill-Palmer Quarterly: Journal of Developmental Psychology 1983, 29:237-260.
64. Iverson A.M., Barton E.A., Iverson G.L. Analysis of risk to children participating in a sociometric task. Developmental Psychology 1997, 33:104-112.
65. Jenson J.M., Dieterich W.A., Brisson D., Bender K.A., Powell A. Preventing childhood bullying: Findings and lessons from the Denver Public Schools Trial. Research on Social Work Practice 2010, 20:509-517.
66. Ji P., Flay B.R., DuBois D.L., Brechling V., Day J., Cantillon D. Consent form return rates for third-grade urban elementary students. American Journal of Health Behavior 2006, 30:467-474.
67. Jiang X.L., Cillessen A.H.N. Stability of continuous measures of sociometric status: A meta-analysis. Developmental Review 2005, 25:1-25.
68. Kearney K., Hopkins A., Mauss A., Weisheit R. Sample bias resulting from a requirement for written parental consent. Public Opinion Quarterly 1983, 47:96-102.
69. Kemp C., Carter M. The social skills and social status of mainstreamed students with intellectual disabilities. Educational Psychology 2002, 22:391-411.
70. Kessel J.B., Zimmerman M. Reporting errors in studies of the diagnostic performance of self-administered questionnaires: Extent of the problem, recommendations for standardized presentation of results, and implications for the peer review process. Psychological Assessment 1993, 5:395-399.
71. Kupersmidt J.B. Predicting delinquency and academic problems from childhood peer status. J. D. Coie (Chair), Strategies for identifying children at social risk: Longitudinal correlates and consequences. Symposium conducted at the biennial meeting of the Society for Research in Child Development, Detroit, MI 1983, April.
72. Kupersmidt J.B., Coie J.D., Dodge K.A. The role of poor peer relationships in the development of disorder. Peer rejection in childhood 1990, 274-305. Cambridge University Press, New York, NY. J.D. Coie (Ed.).
73. Ladd G.W. Effectiveness of a social learning method for enhancing children's social interaction and peer acceptance. Child Development 1981, 52:171-178.
74. Ladd G.W. Social networks of popular, average, and rejected children in school settings. Merrill-Palmer Quarterly: Journal of Developmental Psychology 1983, 29:283-307.
75. Landau S., Boyle S.R. Reactive effects of sociometric testing: Implications for children's social behavior and affect. Paper presented at the annual meeting of the National Association of School Psychologists, San Francisco, CA 1990, April.
76. Landau S., Milich R., Whitten P. A comparison of teacher and peer assessment of social status. Journal of Clinical Child Psychology 1984, 13:44-49.
77. Landis J.R., Koch G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33:159-174.
78. Levitt J.M., Saka N., Romanelli L.H., Hoagwood K. Early identification of mental health problem in schools: The status of instrumentation. Journal of School Psychology 2007, 45:163-191.
79. Lueptow L., Mueller S., Hammes R., Master L. The impact of informed consent regulations on response rate and response bias. Sociological Methods and Research 1977, 6:183-204.
80. Maedgen J.W., Carlson C.L. Social functioning and emotional regulation in the attention deficit hyperactivity disorder subtypes. Journal of Clinical Child Psychology 2000, 29:30-42.
81. Mayeux L., Underwood M.K., Risser S.D. Perspectives on the ethics of sociometric research with children. Merrill-Palmer Quarterly: Journal of Developmental Psychology 2007, 53:53-78.
82. McDougall P., Hymel S., Vaillancourt T., Mercer L. The consequences of childhood peer rejection. Interpersonal rejection 2001, 213-247. Oxford University Press, New York, NY. M.R. Leary (Ed.).
83. McFadyen-Ketchum S., Dodge K.A. Problems in social relationships. Treatment of childhood disorders 1998, 338-365. Guilford Press, New York, NY. 2nd ed. R.A. Barkley (Ed.).
84. McKown C. Concurrent validity and clinical usefulness of several individually administered tests of children's social emotional cognition. Journal of Clinical Child and Adolescent Psychology 2007, 36:29-41.
85. McKown, C., Russo, N. M., Gumbiner, L. M., Warren, H. K., Alderson, D. B., & Lipton, M. (2011). Mediators of social acceptance in elementary-aged children. Manuscript under review.
86. Meisels S.J. Developmental screening in early childhood: A guide 1989, NAEYC, Washington, DC.
87. Merrell K.W. Assessment of social skills and peer relations. Best practices in assessment for school and clinical settings 1993, 307-340. Clinical Psychology Publishing, Brandon, VT. H.B. Vance (Ed.).
88. Metz C.E. Basic principles of ROC analysis. Seminars in Nuclear Medicine 1978, 8:283-298.
89. Moore S.G. Correlates of peer acceptance in nursery school children. The young child 1967, 229-247. National Association for the Education of Young Children, Washington, DC. W.W. Hartup, N.L. Smothergill (Eds.).
90. Moreno J.L. Psychological and social organization of groups in the community. Proceedings & Addresses. American Association on Mental Deficiency 1933, 38:224-242.
91. Nelson D.A., Crick N.R. Rose-colored glasses: Examining the social information-processing of prosocial young adolescents. The Journal of Early Adolescence 1999, 19:17-38.
92. Newcomb A.F., Bukowski W.M. Social impact and social preference as determinants of children's peer group status. Developmental Psychology 1983, 19:856-867.
93. Newcomb A.F., Bukowski W.M., Pattee L. Children's peer relations: A meta-analytic review of popular, rejected, neglected, controversial, and average sociometric status. Psychological Bulletin 1993, 113:99-128.
94. Noll R.B., Zeller M.H., Vannatta K., Bukowski W.M., Davies W.H. Potential bias in classroom research: Comparison of children with permission and those who do not receive permission to participate. Journal of Clinical Child Psychology 1997, 26:36-42.
95. Nowicki S., Duke M.P. Individual differences in the nonverbal communication of affect: The diagnostic analysis of nonverbal accuracy scale. Journal of Nonverbal Behavior 1994, 18:9-35.
96. Oden S., Asher S.R. Coaching children in social skills for friendship making. Child Development 1977, 48:495-506.
97. Olson S.L., Lifgren K. Concurrent and longitudinal correlates of preschool peer sociometrics: Comparing rating scale and nomination measures. Journal of Applied Developmental Psychology 1988, 9:409-420.
98. O'Neil R., Welsh M., Parke R.D., Wang S., Strand C. A longitudinal assessment of the academic correlates of early peer acceptance and rejection. Journal of Clinical Child Psychology 1997, 26:290-303.
99. Parker J.G., Asher S.R. Friendship and friendship quality in middle childhood: Links with peer group acceptance and feelings of loneliness and social dissatisfaction. Developmental Psychology 1993, 29:611-621.
100. Parker J.G., Rubin K.H., Price J.M., DeRosier M.E. Peer relationships, child development, and adjustment: A developmental psychopathology perspective. Developmental psychopathology 1995, Vol. 2:96-161. John Wiley & Sons, Oxford, England.
101. Parkhurst J.T., Asher S.R. Peer rejection in middle school: Subgroup differences in behavior, loneliness, and interpersonal concerns. Developmental Psychology 1992, 28:231-241.
102. Peery J.C. Popular, amiable, isolated, rejected: A reconceptualization of sociometric status in preschool children. Child Development 1979, 50:1231-1234.
103. Pekarik E.G., Prinz R.J., Neale J.M. The pupil evaluation inventory: A sociometric technique for assessing children's social behavior. Journal of Abnormal Child Psychology 1976, 4:83-97.
104. Pokorny S.B., Jason L.A., Schoeny M.E., Townsend S.M., Curie C.J. Do participation rates change when active consent procedures replace passive consent. Evaluation Review 2001, 25:567-580.
105. Putallaz M. Predicting children's sociometric status from their behavior. Child Development 1983, 54:1417-1426.
106. Putallaz M., Gottman J.M. An interactional model of children's entry into peer groups. Child Development 1981, 52:986-994.
107. Ratiner C., Weissberg R., Caplan M. Ethical considerations in sociometric testing: The reactions of preadolescent subject. Paper presented at the 94th annual meeting of the American Psychological Association, Washington, DC 1986, August.
108. Roff M., Sells S.B., Golden M.M. Social adjustment and personality development in children 1972, University of Minnesota Press, Oxford, England.
109. Sapouna M., Wolke D., Vannini N., Watson S., Woods S., Schneider W., et al. Virtual learning intervention to reduce bullying victimization in primary school: A controlled trial. Journal of Child Psychology and Psychiatry 2010, 51:104-112.
110. Schuster M., Bell R., Berry S., Kanouse D. Impact of a high school condom availability program on sexual attitudes and behaviors. Family Planning Perspectives 1998, 30(67-72):88.
111. Schwartz D., Dodge K.A., Pettit G.S., Bates J.E. Friendship as a moderating factor in the pathway between early harsh home environment and later victimization in the peer group. Developmental Psychology 2000, 36:646-662.
112. Severson H.H., Ary D.V. Sampling bias due to consent procedures with adolescents. Addictive Behaviors 1983, 8:433-437.
113. SPSS SPSS base 14.0 user's guide 2005, SPSS, Inc.
114. Stengel E. Suicide and attempted suicide 1971, Penguin, New York, NY.
115. Terry R. Recent advances in measurement theory and the use of sociometric techniques. New directions for child and adolescent development 2000, Vol. 88:27-53. Jossey-Bass, San Francisco. A.H.N. Cillessen, W.M. Bukowski (Eds.).
116. Terry R., Coie J.D. A comparison of methods for defining sociometric status among children. Developmental Psychology 1991, 27:867-880.
117. Underwood M.K., Kupersmidt J.B., Coie J.D. Childhood peer sociometric status and aggression as predictors of adolescent childbearing. Journal of Research on Adolescence 1996, 6:201-223.
118. Unger J.B., Gallaher P.G., Palmer P.H., Baezconde-Garbanati L., Trinidad D.R., Cen S., Johnson C.A. No news is bad news: Characteristics of adolescents who provide neither parental consent nor refusal for participation in school-based survey research. Evaluation Review 2004, 28:52-63.
119. Vandell D.L., Hembree S.E. Peer social status and friendship: Independent contributors to children's social and academic adjustment. Merrill-Palmer Quarterly: Journal of Developmental Psychology 1994, 40:461-477.
120. Waas G.A. Peer relationships. Children's needs III: development, prevention, and intervention 2006, 325-340. National Association of School Psychologists, Washington, DC. K.M. Minke (Ed.).
121. Wakschlag L.S., Briggs-Gowan M.J., Carter A.S., Hill C., Danis B., McCarthy K.J., et al. A developmental framework for distinguishing disruptive behavior from normative misbehavior in preschool children. Journal of Child Psychology and Psychiatry 2007, 48:976-987.
122. White V.M., Hill D.J., Effendi Y. How does active parental consent influence the findings of drug-use surveys in schools?. Evaluation Review 2004, 28:246-260.
123. Wickens T.D. Elementary signal detection theory 2002, Oxford University Press, New York.
124. Wu X., Hart C.H., Draper T.W., Olsen J.A. Peer and teacher sociometrics for preschool children: Cross-informant concordance, temporal stability, and reliability. Merrill-Palmer Quarterly: Journal of Developmental Psychology 2001, 47:416-443.