The Screening Accuracy of the Parent and Teacher-Reported Social Responsiveness Scale (SRS): Comparison with the 3Di and ADOS

Journal of Autism and Developmental Disorders

Volumn 45, Issue 6, 2015, Pages 1658-1672

  Duvekot, Jorieke ^a,b   van der Ende, Jan ^a   Verhulst, Frank C ^a   Greaves Lord, Kirstin ^a,b  

^a SOPHIA CHILDREN S HOSPITAL   (Netherlands)

^b Yulius Academie   (Netherlands)

Author keywords

Autism spectrum disorder (ASD); Multi informant; Screening; Social Responsiveness Scale (SRS)

Indexed keywords

ARTICLE; AUTISM DIAGNOSTIC OBSERVATION SCHEDULE; CHILD; CLINICAL ASSESSMENT; DEVELOPMENTAL DIMENSIONAL AND DIAGNOSTIC INTERVIEW; DISEASE CLASSIFICATION; FEMALE; GOLD STANDARD; HUMAN; MAJOR CLINICAL STUDY; MALE; MEDICAL INFORMATION; MENTAL DISEASE; MENTAL DISEASE ASSESSMENT; MENTAL HEALTH CENTER; PARENT; PATIENT REFERRAL; PRESCHOOL CHILD; PRIORITY JOURNAL; SCHOOL CHILD; SCREENING; SOCIAL ADAPTATION; TEACHER; AUTISM SPECTRUM DISORDER; COMPARATIVE STUDY; PREDICTIVE VALUE; PSYCHOLOGICAL RATING SCALE; PSYCHOMETRY; UNIVERSITY;

AUTISM SPECTRUM DISORDER; CHILD; CHILD, PRESCHOOL; FACULTY; FEMALE; HUMANS; MALE; PARENTS; PREDICTIVE VALUE OF TESTS; PSYCHIATRIC STATUS RATING SCALES; PSYCHOMETRICS;

EID: 84929949611     PISSN: 01623257     EISSN: 15733432     Source Type: Journal    
DOI: 10.1007/s10803-014-2323-3     Document Type: Article

References (75)

1. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin,101(2), 213–232. doi:10.1037//0033-2909.101.2.213.
2. Aldridge, F. J., Gibbs, V. M., Schmidhofer, K., & Williams, M. (2012). Investigating the clinical usefulness of the Social Responsiveness Scale (SRS) in a tertiary level, autism spectrum disorder specific assessment clinic. Journal of Autism and Developmental Disorders,42(2), 294–300. doi:10.1007/s10803-011-1242-9.
3. Axelrod, B. N. (2002). Validity of the Wechsler Abbreviated Scale of Intelligence and other very short forms of estimating intellectual functioning. Assessment,9(1), 17–23. doi:10.1177/1073191102009001003.
4. Begg, C. B., & Greenes, R. A. (1983). Assessment of diagnostic tests when disease verification is subject to selection bias. Biometrics,39(1), 207–215. doi:10.2307/2530820.
5. Bishop, D. V. M., & Baird, G. (2001). Parent and teacher report of pragmatic aspects of communication: Use of the children’s communication checklist in a clinical setting. Developmental Medicine and Child Neurology,43(12), 809–818. doi:10.1017/S0012162201001475.
6. Bölte, S., Westerwald, E., Holtmann, M., Freitag, C., & Poustka, F. (2011). Autistic traits and autism spectrum disorders: The clinical validity of two measures presuming a continuum of social communication skills. Journal of Autism and Developmental Disorders,41(1), 66–72. doi:10.1007/s10803-010-1024-9.
7. Charman, T., Baird, G., Simonoff, E., Loucas, T., Chandler, S., Meldrum, D., et al. (2007). Efficacy of three screening instruments in the identification of autistic-spectrum disorders. British Journal of Psychiatry,191, 554–559. doi:10.1192/bjp.bp.107.040196.
8. Charman, T., & Gotham, K. (2013). Measurement issues: Screening and diagnostic instruments for autism spectrum disorders—Lessons from research and practise. Child and Adolescent Mental Health,18(1), 52–63. doi:10.1111/j.1475-3588.2012.00664.x.
9. Chuthapisith, J., Taycharpipranai, P., Ruangdaraganon, N., Warrington, R., & Skuse, D. (2012). Translation and validation of the developmental, dimensional and diagnostic interview (3Di) for diagnosis of autism spectrum disorder in Thai children. Autism,16(4), 350–356. doi:10.1177/1362361311433770.
10. Cicchetti, D. V. (2001). Methodological commentary the precision of reliability and validity estimates re-visited: Distinguishing between clinical and statistical significance of sample size requirements. Journal of Clinical and Experimental Neuropsychology,23(5), 695–700. doi:10.1076/jcen.23.5.695.1249.
11. Cicchetti, D. V., Volkmar, F., Klin, A., & Showalter, D. (1995). Diagnosing autism using ICD-10 criteria: A comparison of neural networks and standard multivariate procedures. Child Neuropsychology,1(1), 26–37. doi:10.1080/09297049508401340.
12. Constantino, J. N., Davis, S. A., Todd, R. D., Schindler, M. K., Gross, M. M., Brophy, S. L., et al. (2003). Validation of a brief quantitative measure of autistic traits: Comparison of the social responsiveness scale with the autism diagnostic interview-revised. Journal of Autism and Developmental Disorders,33(4), 427–433. doi:10.1023/A:1025014929212.
13. Constantino, J. N., & Gruber, C. P. (2005). Social Responsiveness Scale (SRS). Los Angeles, CA: Western Psychological Services.
14. Constantino, J. N., & Gruber, C. P. (2012). Social Responsiveness Scale, second edition (SRS-2). Los Angeles, CA: Western Psychological Services.
15. Constantino, J. N., LaVesser, P. D., Zhang, Y., Abbacchi, A. M., Gray, T., & Todd, R. D. (2007). Rapid quantitative assessment of autistic social impairment by classroom teachers. Journal of the American Academy of Child and Adolescent Psychiatry,46(12), 1668–1676. doi:10.1097/chi.0b013e318157cb23.
16. Constantino, J. N., Przybeck, T., Friesen, D., & Todd, R. D. (2000). Reciprocal social behavior in children with and without pervasive developmental disorders. Journal of Developmental and Behavioral Pediatrics,21(1), 2–11. doi:10.1097/00004703-200002000-00001.
17. Corsello, C. M., Akshoomoff, N., & Stahmer, A. C. (2013). Diagnosis of autism spectrum disorders in 2-year-olds: a study of community practice. Journal of Child Psychology and Psychiatry,54(2), 178–185. doi:10.1111/j.1469-7610.2012.02607.x.
18. de Bildt, A., Greaves-Lord, K., & De Jonge, M. (2013). ADOS-2: Autisme diagnostisch observatieschema. Handleiding. Amsterdam: Hogrefe.
19. de Bildt, A., Mulder, E. J., Hoekstra, P. J., van Lang, N. D., Minderaa, R. B., & Hartman, C. A. (2009a). Validity of the Children’s Social Behavior Questionnaire (CSBQ) in children with intellectual disability: Comparing the CSBQ with ADI-R, ADOS, and clinical DSM-IV-TR classification. Journal of Autism and Developmental Disorders,39(10), 1464–1470. doi:10.1007/s10803-009-0764-x.
20. de Bildt, A., Sytema, S., Ketelaars, C., Kraijer, D., Mulder, E., Volkmar, F., et al. (2004). Interrelationship between autism diagnostic observation schedule-generic (ADOS-G), autism diagnostic interview-revised (ADI-R), and the diagnostic and statistical manual of mental disorders (DSM-IV-TR) classification in children and adolescents with mental retardation. Journal of Autism and Developmental Disorders,34(2), 129–137. doi:10.1023/B:JADD.0000022604.22374.5f.
21. de Bildt, A., Sytema, S., Ketelaars, C., Kraijer, D., Volkmar, F., & Minderaa, R. (2003). Measuring pervasive developmental disorders in children and adolescents with mental retardation: A comparison of two screening instruments used in a study of the total mentally retarded population from a designated area. Journal of Autism and Developmental Disorders,33(6), 595–605. doi:10.1023/B:JADD.0000005997.92287.a3.
22. de Bildt, A., Sytema, S., van Lang, N. D., Minderaa, R. B., van Engeland, H., & de Jonge, M. V. (2009b). Evaluation of the ADOS revised algorithm: The applicability in 558 Dutch children and adolescents. Journal of Autism and Developmental Disorders,39(9), 1350–1358. doi:10.1007/s10803-009-0749-9.
23. De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin,131(4), 483–509. doi:10.1037/0033-2909.131.4.483.
24. Dean, M., Kasari, C., Shih, W., Frankel, F., Whitney, R., Landa, R., et al. (2014). The peer relationships of girls with ASD at school: Comparison to boys and girls with and without ASD. Journal of Child Psychology and Psychiatry and Allied Disciplines,55(11), 1218–1225. doi:10.1111/jcpp.12242.
25. Dunn, G., Pickles, A., Tansella, M., & Vazquez-Barquero, J. L. (1999). Two-phase epidemiological surveys in psychiatric research. British Journal of Psychiatry,174, 95–100. doi:10.1192/Bjp.174.2.95.
26. Dworzynski, K., Ronald, A., Bolton, P., & Happe, F. (2012). How different are girls and boys above and below the diagnostic threshold for autism spectrum disorders? Journal of the American Academy of Child and Adolescent Psychiatry,51(8), 788–797. doi:10.1016/j.jaac.2012.05.018.
27. Falkmer, T., Anderson, K., Falkmer, M., & Horlin, C. (2013). Diagnostic procedures in autism spectrum disorders: A systematic literature review. European Child and Adolescent Psychiatry,22(6), 329–340. doi:10.1007/s00787-013-0375-0.
28. Ferdinand, R. F., Hoogerheide, K. N., van der Ende, J., Visser, J. H., Koot, H. M., Kasius, M. C., et al. (2003). The role of the clinician: Three-year predictive value of parents’, teachers’, and clinicians’ judgment of childhood psychopathology. Journal of Child Psychology and Psychiatry,44(6), 867–876. doi:10.1111/1469-7610.00171.
29. Filipek, P. A., Accardo, P. J., Baranek, G. T., Cook, E. H., Dawson, G., Gordon, B., et al. (1999). The screening and diagnosis of autistic spectrum disorders. Journal of Autism and Developmental Disorders,29(6), 439–484. doi:10.1023/A:1021943802493.
30. Fombonne, E., Marcin, C., Bruno, R., Tinoco, C. M., & Marquez, C. D. (2012). Screening for Autism in Mexico. Autism Research,5(3), 180–189. doi:10.1002/Aur.1235.
31. Gibson, J., Adams, C., Lockton, E., & Green, J. (2013). Social communication disorder outside autism? A diagnostic classification approach to delineating pragmatic language impairment, high functioning autism and specific language impairment. Journal of Child Psychology and Psychiatry and Allied Disciplines,54(11), 1186–1197. doi:10.1111/jcpp.12079.
32. Gotham, K., Risi, S., Dawson, G., Tager-Flusberg, H., Joseph, R., Carter, A., et al. (2008). A replication of the autism diagnostic observation schedule (ADOS) revised algorithms. Journal of the American Academy of Child and Adolescent Psychiatry,47(6), 642–651. doi:10.1097/Chi.0b013e31816bffb7.
33. Gotham, K., Risi, S., Pickles, A., & Lord, C. (2007). The autism diagnostic observation schedule: Revised algorithms for improved diagnostic validity. Journal of Autism and Developmental Disorders,37(4), 613–627. doi:10.1007/s10803-006-0280-1.
34. Hanley, J. A., & Mcneil, B. J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology,148(3), 839–843. doi:10.1148/radiology.148.3.6878708.
35. Hendriksen, J., & Hurks, P. (2009). Wechsler preschool and Primary Scale of intelligence—Third. Amsterdam: Pearson.
36. Hiller, R. M., Young, R. L., & Weber, N. (2014). Sex differences in autism spectrum disorder based on DSM-5 criteria: Evidence from clinician and teacher reporting. Journal of Abnormal Child Psychology,42(8), 1381–1393. doi:10.1007/s10802-014-9881-x.
37. Hunink, M. G., & Glasziou, P. (2001). Decision making in health and medicine. Cambridge: Cambridge University Press.
38. Hunink, M. G., Richardson, D. K., Doubilet, P. M., & Begg, C. B. (1990). Testing for fetal pulmonary maturity: ROC analysis involving covariates, verification bias, and combination testing. Medical Decision Making,10(3), 201–211. doi:10.1177/0272989x9001000307.
39. IBM Corporation (2011). IBM SPSS statistics for windows (20.0 ed.). Armonk, NY: IBM Corp.
40. Kamio, Y., Inada, N., Moriwaki, A., Kuroda, M., Koyama, T., Tsujii, H., et al. (2013a). Quantitative autistic traits ascertained in a national survey of 22 529 Japanese school children. Acta Psychiatrica Scandinavica,128(1), 45–53. doi:10.1111/acps.12034.
41. Kamio, Y., Moriwaki, A., & Inada, N. (2013b). Utility of teacher-report assessments of autistic severity in Japanese school children. Autism Research and Treatment,2013, 373240. doi:10.1155/2013/373240.
42. Kanne, S. M., Abbacchi, A. M., & Constantino, J. N. (2009). Multi-informant ratings of psychiatric symptom severity in children with autism spectrum disorders: the importance of environmental context. Journal of Autism and Developmental Disorders,39(6), 856–864. doi:10.1007/s10803-009-0694-7.
43. Kazdin, A. E. (2005). Evidence-based assessment for children and adolescents: Issues in measurement development and clinical application. Journal of Clinical Child and Adolescent Psychology,34(3), 548–558. doi:10.1207/s15374424jccp3403_10.
44. Kim, S. H., & Lord, C. (2012). Combining information from multiple sources for the diagnosis of autism spectrum disorders for toddlers and young preschoolers from 12 to 47 months of age. Journal of Child Psychology and Psychiatry,53(2), 143–151. doi:10.1111/j.1469-7610.2011.02458.x.
45. Koning, C., & Magill-Evans, J. (2001). Social and language skills in adolescent boys with Asperger syndrome. Autism,5(1), 23–36. doi:10.1177/1362361301005001003.
46. Kort, W., Schittekatte, M., Dekker, P. H., Verhaeghe, P., Compaan, E. L., Bosmans, M., & Vermeir, G. (2005). Wechsler intelligence scale for children-III. Nederlandstalige Uitgave. Amsterdam: Pearson.
47. Lai, M. C., Lombardo, M. V., & Baron-Cohen, S. (2014). Autism. Lancet,383(9920), 896–910. doi:10.1016/S0140-6736(13)61539-1.
48. Le Couteur, A., Haden, G., Hammal, D., & McConachie, H. (2008). Diagnosing autism spectrum disorders in pre-school children using two standardised assessment instruments: The ADI-R and the ADOS. Journal of Autism and Developmental Disorders,38(2), 362–372. doi:10.1007/s10803-007-0403-3.
49. Lord, C., Petkova, E., Hus, V., Gan, W., Lu, F., Martin, D. M., et al. (2012a). A multisite study of the clinical diagnosis of different autism spectrum disorders. Archives of General Psychiatry,69(3), 306–313. doi:10.1001/archgenpsychiatry.2011.148.
50. Lord, C., Rutter, M., DiLavore, P. C., & Risi, S. (1999). Autism diagnostic observation schedule (ADOS). Manual. Western Psychological Services: Los Angeles.
51. Lord, C., Rutter, M., DiLavore, P. C., Risi, S., Gotham, K., & Bishop, S. L. (2012). Autism diagnostic observation schedule, Second Edition (ADOS-2). Manual (Part I). Los Angeles: Western Psychological Services.
52. Lord, C., Rutter, M., & Lecouteur, A. (1994). Autism diagnostic interview-revised—A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders,24(5), 659–685. doi:10.1007/Bf02172145.
53. Mandy, W., Chilvers, R., Chowdhury, U., Salter, G., Seigal, A., & Skuse, D. (2012). Sex differences in autism spectrum disorder: Evidence from a large sample of children and adolescents. Journal of Autism and Developmental Disorders,42(7), 1304–1313. doi:10.1007/s10803-011-1356-0.
54. Noland, R. M., & Gabriels, R. L. (2004). Screening and identifying children with autism spectrum disorders in the public school system: The development of a model process. Journal of Autism and Developmental Disorders,34(3), 265–277. doi:10.1023/B:JADD.0000029549.84385.44.
55. Oosterling, I., Roos, S., de Bildt, A., Rommelse, N., de Jonge, M., Visser, J., et al. (2010). Improved diagnostic validity of the ADOS revised algorithms: A replication study in an independent sample. Journal of Autism and Developmental Disorders,40(6), 689–703. doi:10.1007/s10803-009-0915-0.
56. Ozonoff, S., Goodlin-Jones, B. L., & Solomon, M. (2005). Evidence-based assessment of autism spectrum disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology,34(3), 523–540. doi:10.1207/s15374424jccp3403_8.
57. Pelham, W. E., Fabiano, G. A., & Massetti, G. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology,34(3), 449–476. doi:10.1207/s15374424jccp3403_5.
58. Posserud, M. B., Lundervold, A. J., & Gillberg, C. (2006). Autistic features in a total population of 7–9-year-old children assessed by the ASSQ (Autism Spectrum Screening Questionnaire). Journal of Child Psychology and Psychiatry and Allied Disciplines,47(2), 167–175. doi:10.1111/j.1469-7610.2005.01462.x.
59. R Core Team. (2014). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.
60. Reed, P., & Osborne, L. A. (2013). The role of parenting stress in discrepancies between parent and teacher ratings of behavior problems in young children with autism spectrum disorder. Journal of Autism and Developmental Disorders,43(2), 471–477. doi:10.1007/s10803-012-1594-9.
61. Reitsma, J. B., Rutjes, A. W., Khan, K. S., Coomarasamy, A., & Bossuyt, P. M. (2009). A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. Journal of Clinical Epidemiology,62(8), 797–806. doi:10.1016/j.jclinepi.2009.02.005.
62. Reszka, S. S., Boyd, B. A., McBee, M., Hume, K. A., & Odom, S. L. (2014). Brief report: Concurrent validity of autism symptom severity measures. Journal of Autism and Developmental Disorders,44(2), 466–470. doi:10.1007/s10803-013-1879-7.
63. Richters, J. E. (1992). Depressed mothers as informants about their children: a critical review of the evidence for distortion. Psychological Bulletin,112(3), 485–499. doi:10.1037/0033-2909.112.3.485.
64. Risi, S., Lord, C., Gotham, K., Corsello, C., Chrysler, C., Szatmari, P., et al. (2006). Combining information from multiple sources in the diagnosis of autism spectrum disorders. Journal of the American Academy of Child and Adolescent Psychiatry,45(9), 1094–1103. doi:10.1097/01.chi.0000227880.42780.0e.
65. Roeyers, H., Thys, M., Druart, C., De Schryver, M., & Schittekate, M. (2011). SRS Screeningslijst voor autismespectrumstoornissen. Handleiding. Amsterdam: Hogrefe.
66. Santosh, P. J., Mandy, W. P. L., Puura, K., Kaartinen, M., Warrington, R., & Skuse, D. H. (2009). The construction and validation of a short form of the developmental, diagnostic and dimensional interview. European Child and Adolescent Psychiatry,18(8), 521–524. doi:10.1007/s00787-009-0004-0.
67. Schanding, G. T., Nowell, K. P., & Goin-Kochel, R. P. (2012). Utility of the Social Communication Questionnaire–Current and Social Responsiveness Scale as teacher-report screening tools for autism spectrum disorders. Journal of Autism and Developmental Disorders,42(8), 1705–1716. doi:10.1007/s10803-011-1412-9.
68. Seaman, S. R., & White, I. R. (2013). Review of inverse probability weighting for dealing with missing data. Statistical Methods in Medical Research,22(3), 278–295. doi:10.1177/0962280210395740.
69. Sikora, D. M., Hall, T. A., Hartley, S. L., Gerrard-Morris, A. E., & Cagle, S. (2008). Does parent report of behavior differ across ADOS-G classifications: Analysis of scores from the CBCL and GARS. Journal of Autism and Developmental Disorders,38(3), 440–448. doi:10.1007/s10803-007-0407-z.
70. Skuse, D., Warrington, R., Bishop, D., Chowdhury, U., Lau, J., Mandy, W., et al. (2004). The developmental, dimensional and diagnostic interview (3di): A novel computerized assessment for autism spectrum disorders. Journal of the American Academy of Child and Adolescent Psychiatry,43(5), 548–558. doi:10.1097/00004583-200405000-00008.
71. Szatmari, P., Archer, L., Fisman, S., & Streiner, D. L. (1994). Parent and teacher agreement in the assessment of pervasive developmental disorders. Journal of Autism and Developmental Disorders,24(6), 703–717. doi:10.1007/Bf02172281.
72. Tellegen, P. J., Winkel, M., Wijnberg-Williams, B. J., & Laros, J. A (1998). Snijders-Oomen Niet-verbale Intelligentietest. SON-R 2½-7 Handleiding and verantwoordig [Snijders-Oomen Nonverbal Intelligence Test. SON-R 2½-7 Manual and Research Report]. Lisse: Swets & Zeitlinger, B.V.
73. van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2012). Agreement of informants on emotional and behavioral problems from childhood to adulthood. Psychological Assessment,24(2), 293–300. doi:10.1037/a0025500.
74. Ventola, P. E., Kleinman, J., Pandey, J., Barton, M., Allen, S., Green, J., et al. (2006). Agreement among four diagnostic instruments for autism spectrum disorders in toddlers. Journal of Autism and Developmental Disorders,36(7), 839–847. doi:10.1007/s10803-006-0128-8.
75. Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., & Mallett, S. (2013). A systematic review classifies sources of bias and variation in diagnostic test accuracy studies. Journal of Clinical Epidemiology,66(10), 1093–1104. doi:10.1016/j.jclinepi.2013.05.014.