Do We Need Multiple Informants When Assessing Autistic Traits? The Degree of Report Bias on Offspring, Self, and Spouse Ratings

Journal of Autism and Developmental Disorders

Volumn 46, Issue 1, 2016, Pages 164-175

  Möricke, Esmé ^a   Buitelaar, Jan K ^b,c   Rommelse, Nanda N J ^a,c  

^a RADBOUD UNIVERSITY MEDICAL CENTER   (Netherlands)

^b RADBOUD UNIVERSITY   (Netherlands)

^c RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Autistic trait; General population; Parent offspring effect; Preschooler and parent; Report bias; Self and spouse report

Indexed keywords

ADULT; ARTICLE; AUTISM; CHILD; CONTROLLED STUDY; FEMALE; HUMAN; INTERPERSONAL COMMUNICATION; INTERRATER RELIABILITY; MAJOR CLINICAL STUDY; MALE; PHENOTYPE; PRIORITY JOURNAL; PROGENY; SELF CONCEPT; SELF REPORT; SOCIAL ADAPTATION; SOCIAL STATUS; AUTISM SPECTRUM DISORDER; MIDDLE AGED; OBSERVER VARIATION; PARENT; PRESCHOOL CHILD; PSYCHOLOGY; QUESTIONNAIRE; REPRODUCIBILITY; SPOUSE; STATISTICAL BIAS;

ADULT; AUTISM SPECTRUM DISORDER; BIAS (EPIDEMIOLOGY); CHILD, PRESCHOOL; FEMALE; HUMANS; MALE; MIDDLE AGED; OBSERVER VARIATION; PARENTS; REPRODUCIBILITY OF RESULTS; SELF REPORT; SPOUSES; SURVEYS AND QUESTIONNAIRES;

EID: 84953839837     PISSN: 01623257     EISSN: 15733432     Source Type: Journal    
DOI: 10.1007/s10803-015-2562-y     Document Type: Article

References (64)

1. Achenbach, T. M., Krukowski, R. A., Dumenci, L., & Ivanova, M. Y. (2005). Assessment of adult psychopathology: Meta-analyses and implications of cross-informant correlations. Psychological Bulletin,131, 361–382.
2. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioural and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin,101, 213–232.
3. Alexander, L., & Liljequist, L. (2013). Determining the accuracy of self-report versus informant-report using the Conners’ Adult ADHD Rating Scale. Journal of Attention Disorders. doi:10.1177/1087054713478652.
4. Allen, C. W., Silove, N., Williams, K., & Hutchins, P. (2007). Validity of the Social Communication Questionnaire in assessing risk of autism in preschool children with developmental problems. Journal of Autism and Developmental Disorders, 37, 1272–1278.
5. Austin, E. J. (2005). Personality correlates of the broader autism phenotype as assessed by the Autism Spectrum Quotient (AQ). Personality and Individual Differences,38, 451–460.
6. Auyeung, B., Baron-Cohen, S., Wheelwright, S., & Allison, C. (2008). The Autism Spectrum Quotient: Children’s Version (AQ-Child). Journal of Autism and Developmental Disorders,38, 1230–1240.
7. Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The Autism-Spectrum Quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. Journal of Autism and Developmental Disorders,31, 5–17.
8. Berry, K. J., & Mielke, P. W, Jr. (1988). A generalization of Cohen’s kappa agreement measure to interval measurement and multiple raters. Educational and Psychological Measurement,48, 921–933.
9. Berument, S. K., Rutter, M., Lord, C., Pickles, A., & Bailey, A. (1999). Autism Screening Questionnaire: Diagnostic validity. British Journal of Psychiatry,175, 444–451.
10. Bishop, D. V. M., Maybery, M., Maley, A., Wong, D., Hill, W., & Hallmayer, J. (2004). Using self-report to identify the broad phenotype in parents of children with autistic spectrum disorders: A study using the Autism-Spectrum Quotient. Journal of Child Psychology and Psychiatry,45, 1431–1436.
11. Bölte, S., Poustka, F., & Constantino, J. N. (2008). Assessing autistic traits: Cross-cultural validation of the Social Responsiveness Scale (SRS). Autism Research,1, 354–363.
12. Caye, A., Machado, J. D., & Rohde, L. A. (2013). Evaluating parental disagreement in ADHD diagnosis: Can we rely on a single report from home? Journal of Attention Disorders. doi:10.1177/1087054713504134.
13. Central Office for Statistics (Centraal Bureau voor Statistiek). (2003). Voorburg, The Netherlands.
14. Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment,6, 284–290.
15. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement,20, 37–46.
16. Cohen, J. (1992). A power primer. Psychological Bulletin,112, 155–159.
17. Constantino, J. N., & Gruber, C. P. (2005). Social Responsiveness Scale. Los Angeles, CA: Western Psychological Services.
18. Constantino, J. N., & Gruber, C. P. (2012). Social Responsiveness Scale (2nd ed.). Los Angeles, CA: Western Psychological Services.
19. Constantino, J. N., Lavesser, P. D., Zhang, Y., Abbacchi, A. M., Gray, T., & Todd, R. D. (2007). Rapid quantitative assessment of autistic social impairment by classroom teachers. Journal of the American Academy for Child and Adolescent Psychiatry,46, 1668–1676.
20. Corsello, C., Hus, V., Pickles, A., Risi, S., Cook, E. H. Jr., Leventhal, B. L., et al. (2007). Between a ROC and a hard place: Decision making and making decisions about using the SCQ. Journal of Child Psychology and Psychiatry, 48, 932–940.
21. De Los Reyes, A. (2013). Strategic objectives for improving understanding of informant discrepancies in developmental psychopathology research. Development and Psychopathology,25, 669–682.
22. De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin,131, 483–509.
23. De Vet, H. C., Terwee, C. B., Knol, D. L., & Bouter, L. M. (2006). When to use agreement versus reliability measures. Journal of Clinical Epidemiology,59, 1033–1039.
24. Dietz, C., Swinkels, S. H. N., Van Daalen, E., Van Engeland, H., & Buitelaar, J. K. (2006). Screening for autistic spectrum disorder in children aged 14–15 months. II: Population screening with the Early Screening of Autistic Traits Questionnaire (ESAT). Design and general findings. Journal of Autism and Developmental Disorders,36, 713–722.
25. Dirks, M. A., De Los Reyes, A., Briggs-Gowan, M., Cella, D., & Wakschlag, L. S. (2012). Annual research review: Embracing not erasing contextual variability in children’s behavior—theory and utility in the selection and use of methods and informants in developmental psychopathology. Journal of Child Psychology and Psychiatry,53, 558–574.
26. Duhig, A. M., Renk, K., Epstein, M. K., & Phares, V. (2000). Interparental agreement on internalizing, externalizing, and total behaviour problems: A meta-analysis. Clinical Psychology: Science and Practice,7, 435–453.
27. Eaves, L. C., Wingert, H. D., Ho, H. H., & Mickelson, E. C. R. (2006). Screening for autism spectrum disorders with the Social Communication Questionnaire. Developmental and Behavioral Pediatrics,27, S96–S103.
28. Ehlers, S., Gillberg, C., & Wing, L. (1999). A screening questionnaire for Asperger syndrome and other high-functioning autism spectrum disorders in school age children. Journal of Autism and Developmental Disorders,29, 129–141.
29. Fadnes, L. T., Taube, A., & Tylleskär, T. (2009). How to identify information bias due to self-reporting in epidemiological research. The Internet Journal of Epidemiology,7, 25.
30. Fernandopulle, N. (2011). Measurement of autism: A review of four screening measures. Indian Journal of Psychological Medicine,33, 5–10.
31. García-Primo, P., Hellendoorn, A., Charman, T., Roeyers, H., Dereu, M., Roge, B., et al. (2014). Screening for autism spectrum disorders: State of the art in Europe. European Child and Adolescent Psychiatry,23, 1005–1021.
32. Hoekstra, R. A., Bartels, M., Cath, D. C., & Boomsma, D. I. (2008). Factor structure, reliability and criterion validity of the Autism-Spectrum Quotient (AQ): A study in Dutch population and patient groups. Journal of Autism and Developmental Disorders,38, 1555–1566.
33. Hurley, R. S., Losh, M., Parlier, M., Reznick, J. S., & Piven, J. (2007). The Broad Autism Phenotype Questionnaire. Journal of Autism and Developmental Disorders,37, 1679–1690.
34. IBM Corp. (2011). IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp.
35. Jepsen, M. I., Gray, K. M., & Taffe, J. R. (2012). Agreement in multi-informant assessment of behaviour and emotional problems and social functioning in adolescents with autistic and Asperger’s disorder. Research in Autism Spectrum Disorders,6, 1091–1098.
36. Kalyva, E. (2010). Multirater congruence on the Social Skills Assessment of children with Asperger syndrome: Self, mother, father, and teacher ratings. Journal of Autism and Developmental Disorders,40, 1202–1208.
37. Katz, N., Petscher, Y., & Welles, T. (2009). Diagnosing attention-deficit hyperactivity disorder in college students: An investigation of the impact of informant ratings on diagnosis and subjective impairment. Journal of Attention Disorders,13, 277–283.
38. Kooij, J. J. S., Boonstra, A. M., Swinkels, S. H. N., Bekker, E. M., De Noord, I., & Buitelaar, J. K. (2008). Reliability, validity, and utility of instruments for self-report and informant report concerning symptoms of ADHD in adult patients. Journal of Attention Disorders,11, 445–458.
39. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics,33, 159–174.
40. Langberg, J., Epstein, J. N., Simon, J. O., Loren, R. E. A., Arnold, L. E., Hechtman, L., et al. (2010). Parent agreement on ratings of children’s attention deficit/hyperactivity disorder and broadband externalizing behaviors. Journal of Emotional and Behavioral Disorders,18, 41–50.
41. Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders,24, 659–685.
42. Mascendaro, P. M., Herman, K. C., & Webster-Stratton, C. (2012). Parent discrepancies in ratings of young children’s co-occuring internalizing symptoms. School Psychology Quarterly,27, 134–143.
43. Mattila, M. J., Jussila, K., Kuusikko, S., Kielinen, M., Linna, S. L., Ebeling, H., et al. (2009). When does the Autism Spectrum Screening Questionnaire (ASSQ) predict autism spectrum disorders in primary school-aged children? European Child and Adolescent Psychiatry,18, 499–509.
44. Maxwell, C. R., Parish-Morris, J., Hsin, O., Bush, J. C., & Schultz, R. T. (2013). The broad autism phenotype predicts child functioning in autism spectrum disorders. Journal of Neurodevelopmental Disorders,5, 25.
45. Moreno, J., Silverman, W. K., Saavedra, L. M., & Phares, V. (2008). Fathers’ ratings in the assessment of their child’s anxiety symptoms: A comparison to mothers’ ratings and their associations with parental symptomatology. Journal of Family Psychology,22, 915–919.
46. Multon, K. D. (2010). Interrater reliability. In N. J. Salkind (Ed.), Encyclopedia of research design (pp. 627–629). Thousand Oaks, CA: Sage.
47. Norris, M., & Lecavalier, L. (2010). Screening accuracy of level 2 autism spectrum disorder rating scales: A review of selected instruments. Autism,14, 263–284.
48. Ozonoff, S., Goodlin-Jones, B. L., & Solomon, M. (2005). Evidence-based assessment of autism spectrum disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology,34, 523–540.
49. Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioural research: A critical review of the literature and recommended remedies. Journal of Applied Psychology,88, 879–903.
50. Posserud, M. B., Lundervold, A. J., & Gillberg, C. (2006). Autistic features in a total population sample of 7–9 year-old children assessed by the ASSQ (Autism Spectrum Screening Questionnaire). Journal of Child Psychology and Psychiatry,47, 167–175.
51. Renk, K. (2005). Cross-informant ratings of the behavior of children and adolescents: The “gold standard”. Journal of Child and Family Studies,14, 457–468.
52. Ruzich, E., Allison, C., Smith, P., Watson, P., Auyeung, B., Ring, H., et al. (2015). Measuring autistic traits in the general population: A systematic review of the Autism-Spectrum Quotient (AQ) in a non-clinical population sample of 6,900 typical adult males and females. Molecular Autism,6, 2.
53. Sasson, N. J., Faso, D. J., Parlier, M., Daniels, J. L., & Piven, J. (2014). When father doesn’t know best: Selective disagreement between self-report and informant report of the broad autism phenotype in parents of a child with autism. Autism Research,7, 731–739.
54. Sasson, N. J., Lam, K. S. L., Parlier, M., Daniels, J. L., & Piven, J. (2013). Autism and the broad autism phenotype: Familial patterns and intergenerational transmission. Journal of Neurodevelopmental Disorders,5, 11.
55. Seidman, I., Yirmiya, N., Milshtein, S., Ebstein, R. P., & Levi, S. (2012). The Broad Autism Phenotype Questionnaire: Mothers versus fathers of children with an autism spectrum disorder. Journal of Autism and Developmental Disorders,42, 837–846.
56. Smith, S. R. (2007). Making sense of multiple informants in child and adolescent psychopathology: A guide for clinicians. Journal of Psychoeducational Assessment,25, 139–149.
57. Sollie, H., Larsson, B., & Mørch, W. T. (2013). Comparison of mother, father, and teacher reports of ADHD core symptoms in a sample of child psychiatric outpatients. Journal of Attention Disorders,17, 699–710.
58. Stratis, E. A., & Lecavalier, L. (2015). Informant agreement for youth with autism spectrum disorder or intellectual disability: A meta-analysis. Journal of Autism and Developmental Disorders,45, 1026–1041.
59. Sucksmith, E., Roth, I., & Hoekstra, R. A. (2011). Autistic traits below the clinical threshold: Re-examining the broader autism phenotype in the 21st century. Neuropsychology Review,21, 360–389.
60. Swinkels, S. H. N., Dietz, C., Van Daalen, E., Kerkhof, I. H. G. M., Van Engeland, H., & Buitelaar, J. K. (2006). Screening for autistic spectrum in children aged 14–15 months. I: The development of the Early Screening of Autistic Traits Questionnaire (ESAT). Journal of Autism and Developmental Disorders,36, 723–732.
61. Van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2012). Agreement of informants on emotional and behavioral problems from childhood to adulthood. Psychological Assessment,24, 293–300.
62. Van Wijngaarden-Cremers, P. J., Van Eeten, E., Groen, W. B., Van Deurzen, P. A., Oosterling, I. J., & Van der Gaag, R. J. (2014). Gender and age differences in the core triad of impairments in autism spectrum disorders: A systematic review and meta-analysis. Journal of Autism and Developmental Disorders,44, 627–635.
63. Wheelwright, S., Auyeung, B., Allison, C., & Baron-Cohen, S. (2010). Defining the broader, medium and narrow autism phenotype among parents using the Autism Spectrum Quotient (AQ). Molecular Autism,1, 10.
64. Zwaigenbaum, L., Bryson, S., Lord, C., Rogers, S., Carter, A., Carver, L., et al. (2009). Clinical assessment and management of toddlers with suspected autism spectrum disorder: Insights from studies of high-risk infants. Pediatrics,123, 1383–1391.