Systematic review of the measurement properties of tools used to measure behaviour problems in young children with autism

PLoS ONE

Volumn 10, Issue 12, 2015, Pages

  Hanratty, Jennifer ^a   Livingstone, Nuala ^a   Robalino, Shannon ^b   Terwee, Caroline B ^c   Glod, Magdalena ^b   Oono, Inalegwu P ^b   Rodgers, Jacqui ^b   Macdonald, Geraldine ^a   McConachie, Helen ^b  

^a QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

^c VU UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ABERRANT BEHAVIOR CHECKLIST; ASPERGER SYNDROME; AUTISM; BABY AND INFANT SCREEN FOR CHILDREN WITH AUTISMM TRAITS PART 3; BEHAVIOR ASSESSMENT SYSTEM FOR CHILDREN SECOND EDITION; CASE CONTROL STUDY; CHILD BEHAVIOR CHECKLIST; COHORT ANALYSIS; CROSS-SECTIONAL STUDY; HOME SITUATIONS QUESTIONNAIRE PERVASIVE DEVELOPMENTAL DISORDERS VERSION; HUMAN; INTERVENTION STUDY; NISONGER CHILD BEHAVIOR RATING FORM; OBSERVATIONAL STUDY; OUTCOME ASSESSMENT; PERVASIVE DEVELOPMENTAL DISORDER NOT OTHERWISE SPECIFIED; PROBLEM BEHAVIOR; PSYCHOLOGICAL RATING SCALE; QUESTIONNAIRE; RELIABILITY; REVIEW; SYSTEMATIC REVIEW; AUTISM SPECTRUM DISORDER; CHILD; FEMALE; MALE; PATHOPHYSIOLOGY; PERSONALITY ASSESSMENT; PERSONALITY TEST; PRESCHOOL CHILD; PSYCHOLOGY;

AUTISM SPECTRUM DISORDER; CHILD; CHILD, PRESCHOOL; FEMALE; HUMANS; MALE; PERSONALITY ASSESSMENT; PERSONALITY TESTS; PROBLEM BEHAVIOR; SURVEYS AND QUESTIONNAIRES;

EID: 84957110032     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0144649     Document Type: Review

References (84)

1. Ospina MB, Seida JK, Clark B, Karkhaneh M, Hartling L, Tjosvold L, et al. Behavioural and developmental interventions for autism spectrum disorder: A clinical systematic review. PloS one. 2008; 3(11): E3755. doi: 10.1371/journal.pone.0003755 PMID: 19015734
2. Howlin P, Magiati I, Charman T. Systematic review of early intensive behavioral interventions for children with autism. Journal Information. 2009; 114(1).
3. Oono IP, Honey E, McConachie H. Parent-mediated early intervention for young children with autism spectrum disorders (ASD). Cochrane Database of Systematic Reviews. 2013;(4: ). Epub April 20, 2013. doi: 10.1002/14651858.CD009774.pub2
4. Bolte EE, Diehl JJ. Measurement tools and target symptoms/skills used to assess treatment response for individuals with autism spectrum disorder. Journal of Autism & Developmental Disorders. 2013; 43 (11): 2491-501.
5. Achenbach T, Rescorla L. Manual for ASEBA Preschool Forms and Profiles. Burlington, Vermont: Research Center for Children, Youth and Families, University of Vermont; 2000.
6. Hartley S, Sikora D, McCoy R. Prevalence and risk factors of maladaptive behaviour in young children with autistic disorder. Journal of Intellectual Disability Research. 2008; 52(10): 819-29. doi: 10.1111/j. 1365-2788.2008.01065.x PMID: 18444989
7. Rivard M, Terroux A, Parent-Boursier C, Mercier C. Determinants of stress in parents of children with autism spectrum disorders. Journal of autism and developmental disorders. 2014; 44(7): 1609-20. doi: 10.1007/s10803-013-2028-z PMID: 24384673
8. McConachie H, Parr JR, Glod M, Hanratty J, Livingstone N, Oono IP, et al. Systematic review of tools to measure outcomes for young children with autism spectrum disorder. Health Technology Assessment. 2015; 19.
9. Scahill L, Aman M, Lecavalier L, Halladay A, Bishop S, Bodfish J, et al. Measuring repetitive behaviors as a treatment endpoint in youth with autism spectrum disorder. Autism. 2015; 19(1): 38-52. doi: 10.1177/1362361313510069 PMID: 24259748
10. Lecavalier L, Wood J, Halladay A, Jones N, Aman M, Cook E, et al. Measuring anxiety as a treatment endpoint in youth with autism spectrum disorder. Journal of Autism and Developmental Disorders. 2014; 44: 1128-43. doi: 10.1007/s10803-013-1974-9 PMID: 24158679
11. Anagnostou E, Jones N, Huerta M, Halladay A, Wang P, Scahill L, et al. Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder. Autism. 2015; 19 (5): 622-36. doi: 10.1177/1362361314542955 PMID: 25096930
12. APA. Diagnostic and statistical manual of mental disorders. Washington: American Psychiatric Association; 1994.
13. WHO. The ICD-10 classification of mental and behavioural disorders: Diagnostic criteria for research. Geneva: World Health Organisation; 1992.
14. WHO. International Classification of Functioning, Disability and Health (ICF). Geneva: World Health Organization; 2001.
15. Lord C, Rutter M, DiLavore P, Risi S. Autism diagnostic observation schedule: ADOS: Western Psychological Services Los Angeles, CA; 2002.
16. Le Couteur A, Rutter M, Lord C, Rios P, Robertson S, Holdgrafer M, et al. Autism diagnostic interview: A standardized investigator-based instrument. Journal of Autism & Developmental Disorders. 1989; 19 (3): 363-87.
17. Arick JR, Young HE, Falco RA, Loos LM, Krug DA, Gense MH, et al. Designing an outcome study to monitor the progress of students with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities. 2003; 18(2): 75-87. Peer Reviewed Journal: 2003-06153-002.
18. Baghdadli A, Assouline B, Sonie S, Pernon E, Darrou C, Michelon C, et al. Developmental trajectories of adaptive behaviors from early childhood to adolescence in a cohort of 152 children with autism spectrum disorders. Journal of Autism & Developmental Disorders. 2012; 42(7): 1314-25. PMID: 21928042.
19. Baker JK, Messinger DS, Lyons KK, Grantz CJ. A pilot study of maternal sensitivity in the context of emergent autism. Journal of Autism & Developmental Disorders. 2010; 40(8): 988-99. Peer Reviewed Journal: 2010-14722-008.
20. Bearss K, Johnson C, Handen B, Smith T, Scahill L. A pilot study of parent training in young children with autism spectrum disorders and disruptive behavior. Journal of Autism & Developmental Disorders. 2013; 43(4): 829-40. PMID: 22941342.
21. Bryce CI, Jahromi LB. Brief report: Compliance and noncompliance to parental control strategies in children with high-functioning autism and their typical peers. Journal of Autism & Developmental Disorders. 2013; 43(1): 236-43.
22. Chuang IC, Tseng MH, Lu L, Shieh JY. Sensory correlates of difficult temperament characteristics in preschool children with autism. Research in Autism Spectrum Disorders. 2012; 6(3): 988-95. doi: 10.1016/j.rasd.2012.01.002. WOS: 000305107400003.
23. Escalona A, Field T, Singer-Strunck R, Cullen C, Hartshorn K. Improvements in the behavior of children with autism following massage therapy. Brief report. Journal of Autism & Developmental Disorders. 2001; 31(5): 513-6. 194380.
24. Hartley SL, S D. M. Sex Differences in Autism Spectrum Disorder: An Examination of Developmental Functioning, Autistic Symptoms, and Coexisting Behavior Problems in Toddlers. Journal of Autism & Developmental Disorders. 2009; 39: 1715-22.
25. Herring S, Gray K, Taffe J, Tonge B, Sweeney D, Einfeld S. Behaviour and emotional problems in toddlers with pervasive developmental disorders and developmental delay: Associations with parental mental health and family functioning. Journal of Intellectual Disability Research. 2006; 50(12): 874-82. Peer Reviewed Journal: 2006-21220-003.
26. Hill-Chapman CR, Herzog TK, Maduro RS. Aligning over the child: Parenting alliance mediates the association of autism spectrum disorder atypicality with parenting stress. Research in Developmental Disabilities. 2013; 34(5): 1498-504. doi: 10.1016/j.ridd.2013.01.004. WOS: 000317876000014. PMID: 23475000
27. Jahromi LB, Bryce CI, Swanson J. The importance of self-regulation for the school and peer engagement of children with high-functioning autism. Research in Autism Spectrum Disorders. 2013; 7 (2): 235-46. doi: 10.1016/j.rasd.2012.08.012. WOS: 000318194700004.
28. Meek SE, Robinson LT, Jahromi LB. Parent-child predictors of social competence with peers in children with and without autism. Research in Autism Spectrum Disorders. 2012; 6(2): 815-23. WOS: 000301470100026.
29. Mooney EL, Gray KM, Tonge BJ. Early features of autism-Repetitive behaviours in young children. European Child & Adolescent Psychiatry. 2006; 15(1): 12-8. doi: 10.1007/s00787-006-0499-6. WOS: 000235748000002.
30. O'Donnell S, Deitz J, Kartin D, Nalty T, Dawson G. Sensory processing, problem behavior, adaptive behavior, and cognition in preschool children with autism spectrum disorders. American Journal of Occupational Therapy. 2012; 66(5): 586-94. PMID: 22917125. doi: 10.5014/ajot.2012.004168
31. Osborne LA, Reed P. The Relationship between Parenting Stress and Behavior Problems of Children with Autistic Spectrum Disorders. Exceptional Children. 2009; 76(1): 54-73. EJ855959.
32. Peters-Scheffer N, Didden R, Mulders M, Korzilius H. Low intensity behavioral treatment supplementing preschool services for young children with autism spectrum disorders and severe to mild intellectual disability. Research in Developmental Disabilities. 2010; 31(6): 1678-84. Peer Reviewed Journal: 2010-20891-062. doi: 10.1016/j.ridd.2010.04.008 PMID: 20627451
33. Reed P, Osborne LA. The role of parenting stress in discrepancies between parent and teacher ratings of behavior problems in young children with autism spectrum disorder. Journal of Autism & Developmental Disorders. 2013; 43(2): 471-7. Peer Reviewed Journal: 2013-02313-017.
34. Reed P, Osborne LA, Corness M. The Real-World Effectiveness of Early Teaching Interventions for Children with Autism Spectrum Disorder. Exceptional Children. 2007; 73(4): 417-33. EJ817513.
35. Reese RM, Richman DM, Belmont JM, Morse P. Functional characteristics of disruptive behavior in developmentally disabled children with and without autism. Journal of Autism & Developmental Disorders. 2005; 35(4): 419-28.
36. Remington B, Hastings RP, Kovshoff H, degli Espinosa F, Jahr E, Brown T, et al. Early intensive behavioral intervention: Outcomes for children with autism and their parents after two years. American Journal of Mental Retardation. 2007; 112(6): 418-38. PMID: 17963434.
37. Rickards AL, Walstab JE, Wright-Rossi RA, Simpson J, Reddihough DS. One-year follow-up of the outcome of a randomized controlled trial of a home-based intervention programme for children with autism and developmental delay and their families. Child: Care, Health & Development. 2009; 35(5): 593-602. PMID: 19508318.
38. Robbins FR, Dunlap G. Effects of task difficulty on parent teaching skills and behavior problems of young children with autism. American Journal on Mental Retardation. 1992; 96(6): 631-43.
39. Roberts J, Williams K, Carter M, Evans D, Parmenter T, Silove N, et al. A randomised controlled trial of two early intervention programs for young children with autism: Centre-based with parent program and home-based. Research in Autism Spectrum Disorders. 2011; 5(4): 1553-66.
40. Rojahn J, Matson JL, Mahan S, Fodstad JC, Knight C, Sevin JA, et al. Cutoffs, norms, and patterns of problem behaviors in children with an ASD on the Baby and Infant Screen for Children with aUtIsm Traits (BISCUIT-Part 3). Research in Autism Spectrum Disorders. 2009; 3(4): 989-98. Peer Reviewed Journal: 2010-06023-015.
41. Smith IM, Koegel RL, Koegel LK, Openden DA, Fossum KL, Bryson SE. Effectiveness of a Novel Community- Based Early Intervention Model for Children With Autistic Spectrum Disorder. Ajidd-American Journal on Intellectual and Developmental Disabilities. 2010; 115(6): 504-23. WOS: 000284440000007.
42. Smith T, Groen AD, Wynn JW. Randomized trial of intensive early intervention for children with pervasive developmental disorder.[Erratum appears in Am J Ment Retard 2001 May;106(3): 208], [Erratum appears in Am J Ment Retard 2000 Nov;105(6): 508]. American Journal of Mental Retardation. 2000; 105(4): 269-85. PMID: 10934569.
43. Taylor JL, Warren ZE. Maternal depressive symptoms following autism spectrum diagnosis. Journal of Autism & Developmental Disorders. 2012; 42(7): 1411-8. PMID: 21965086.
44. Tonge B, Brereton A, Kiomall M, Mackinnon A, R N.J.. A randomised group comparison controlled trial of 'preschoolers with autism': A parent education and skills training intervention for young children with autistic disorder. Autism. 2014; 18(2): 166-77. doi: 10.1177/1362361312458186 PMID: 22987897
45. Werner E, Dawson G, Munson J, Osterling J. Variation in early developmental course in autism and its relation with behavioral outcome at 3-4 years of age. Journal of Autism & Developmental Disorders. 2005; 35(3): 337-50. PMID: 16119475.
46. Rojahn J, Rowe E, Sharber A, Hastings R, Matson J, Didden R, et al. The Behavior Problems Inventory- Short Form for individuals with intellectual disabilities: Part I: Development and provisional clinical reference data. Journal of Intellectual Disability Research. 2012; 56(5): 527-45. doi: 10.1111/j.1365- 2788.2011.01507.x PMID: 22151184
47. Gwet K. Handbook of inter-rater reliability Advanced Analytics. LLC, Gaithersburg, MD. 2010.
48. Yoder PJ, Bottema-Beutel K, Woynaroski T, Chandrasekhar R, Sandbank M. Social communication intervention effects vary by dependent variable type in preschoolers with autism spectrum disorders. Evidence-based communication assessment and intervention. 2013; 7(4): 150-74. PMID: 25346776
49. Terwee CB, Jansma EP, Riphagen II, de Vet HC. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Quality of Life Research. 2009; 18(8): 1115-23. doi: 10.1007/s11136-009-9528-5 PMID: 19711195
50. Karabekiroglu K, Aman MG. Validity of the aberrant behavior checklist in a clinical sample of toddlers. Child Psychiatry & Human Development. 2009; 40(1): 99-110. PMID: 18600444.
51. Pandolfi V, Magyar CI, Dill CA. An Initial Psychometric Evaluation of the CBCL 6-18 in a Sample of Youth with Autism Spectrum Disorders. Research in Autism Spectrum Disorders. 2012; 6(1): 96-108. EJ947678.
52. M LB, T CB, P DL, A J, S PW, K DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: An international Delphi study. Quality of Life Research. 2010; 19: 539-49. doi: 10.1007/s11136-010-9606-8 PMID: 20169472
53. Terwee CB, Mokkink LB, Knol DL, Ostelo RWJG, Bouter LM, De Vet HCW. Rating themethodological qualtiy in systematic reviews of studies onmeasurment properties: A scoring system for the COSMIN checklist. Quality of Life Research. 2012; 21(4): 651-7. doi: 10.1007/s11136-011-9960-1 PMID: 21732199
54. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology. 2007; 60(1): 34-42. PMID: 17161752
55. Kamphaus R, Reynolds C. BASC-2 Behavioral and Emotional Screening System Manual. Circle Pines, MN: Pearson; 2007.
56. Achenbach TM, Rescorla LA. Manual for ASEBA School-Age Forms and Profiles. Burlington, VT: University of Vermont, Research Center for Chyildren, Youth and Families; 2001.
57. Aman M, Singh N. Aberrant Behavior Checklist Manual. East Aurora, New York: Slosson Educational Publications; 1986.
58. Matson JL, Wilkins J, Sevin JA, Knight C, Boisjoli JA, Sharp B. Reliability and item content of the baby and infant screen for children with aUtIsm traits (BISCUIT): Parts 1-3. Research in Autism Spectrum Disorders. 2009; 3(2): 336-44. 2010-06021-005.
59. Chowdhury M, Aman MG, Scahill L, Swiezy N, Arnold LE, Lecavalier L, et al. The Home Situations Questionnaire-PDD version: Factor structure and psychometric properties. Journal of Intellectual Disability Research. 2010; 54(3): 281-91. PMID: 20377705. doi: 10.1111/j.1365-2788.2010.01259.x
60. Bearss K, Johnson C, Smith T, Lecavalier L, Swiezy N, Aman M, et al. Effect of parent training vs parent education on behavioral problems in children with autism spectrum disorder: A randomized clinical trial. JAMA. 2015; 313(15): 1524-33. doi: 10.1001/jama.2015.3150 PMID: 25898050
61. Barkley RA, Edelbrock C. Assessing situational variation in children's behavior problems: The Home and School Situations Questionnaires. Advances in behavioral assessment of children and families. 1987; 3: 157-76.
62. Aman MG, Tasse MJ, Rojahn J, Hammer D. The Nisonger CBRF: A Child Behavior Rating Form for children with developmental disabilities. Research in Developmental Disabilities. 1996; 17: 41-57. PMID: 8750075
63. Arnold LE, Aman MG, Li X, Butter EJ, Humphries K, Scahill L, et al. RUPP Autism Network randomized clinical trial of parent training and medication: One year follow-up. Journal of the American Academy of Child & Adolescent Psychiatry. 2012; 51(11): 1173-84.
64. Brinkley J, Nations L, Abramson RK, Hall A, Wright HH, Gabriels R, et al. Factor analysis of the aberrant behavior checklist in individuals with autism spectrum disorders. Journal of Autism & Developmental Disorders. 2007; 37(10): 1949-59. PMID: 17186368.
65. Hass MR, Brown RS, Brady J, Johnson DB. Validating the BASC-TRS for Use With Children and Adolescents With an Educational Diagnosis of Autism. Remedial and Special Education. 2010; 33(3): 173- 83. http: //dx.doi.org/10.1177/0741932510383160. 16670084.
66. Kaat AJ, Lecavalier L, Aman MG. Validity of the aberrant behavior checklist in children with autism spectrum disorder. Journal of Autism & Developmental Disorders. 2014; 44(5): 1103-16.
67. Kuhlthau K, Kovacs E, Hall T, Clemmons T, Orlich F, Delahaye J, et al. Health-related quality of life for children with ASD: Associations with behavioral characteristics. Research in Autism Spectrum Disorders. 2013; 7(9): 1035-42.
68. Lecavalier L, Aman MG, Hammer D, Stoica W, Mathews GL. Factor Analysis of the Nisonger Child Behavior Rating Form in Children with Autism Spectrum Disorders. Journal of Autism & Developmental Disorders. 2004; 34(6): 709-21. EJ735533.
69. Lecavalier L, Leone S, Wiltz J. The Impact of Behaviour Problems on Caregiver Stress in Young People with Autism Spectrum Disorders. Journal of Intellectual Disability Research. 2006; 50(3): 172-83. EJ732942.
70. Mahan S, Matson JL. Children and Adolescents with Autism Spectrum Disorders Compared to Typically Developing Controls on the Behavioral Assessment System for Children, Second Edition (BASC- 2). Research in Autism Spectrum Disorders. 2011; 5(1): 119-25. EJ900369.
71. Matson JL, Boisjoli J, Rojahn J, Hess J. A factor analysis of challenging behaviors assessed with the baby and infant screen for children with autism traits (Biscuit-Part 3). Research in Autism Spectrum Disorders. 2009; 3(3): 714-22. 2010-06022-013.
72. Pandolfi V, Magyar CI, Dill CA. Confirmatory Factor Analysis of the Child Behavior Checklist 1.5-5 in a Sample of Children with Autism Spectrum Disorders. Journal of Autism & Developmental Disorders. 2009; 39(7): 986-95. http: //dx.doi.org/10.1007/s10803-009-0716-5. 10080586.
73. Sigafoos J, Pittendreigh N, Pennell D. Parent and teacher ratings of challenging behaviour in young children with developmental disabilities. British Journal of Learning Disabilities. 1997; 25(1): 13-7. Language: English. Entry Date: 19970801. Revision Date: 20091218. Publication Type: Journal article.
74. Bearss K, Lecavalier L, Minshawi N, Johnson C, Smith T, Handen B, et al. Toward an exportable parent training program for disruptive behaviors in autism spectrum disorder. Neuropsychiatry. 2013; 3 (2): 169-80. PMID: 23772233
75. Wigham S, McConachie H. Systematic review of the properties of tools used to measure outcomes in anxiety intervention studies for children with autism spectrum disorders. PloS one. 2014; 9(1): E85268. doi: 10.1371/journal.pone.0085268 PMID: 24465519
76. Hus V, Bishop S, Gotham K, Huerta M, Lord C. Factors influencing scores on the social responsiveness scale. Journal of Child Psychology and Psychiatry. 2013; 54(2): 216-24. doi: 10.1111/j.1469-7610. 2012.02589.x PMID: 22823182
77. Chowdhury M, Aman M, Lecavalier L, Smith T, Johnson C, Swiezy N, et al. Factor structure and psychometric properties of the revised Home Situations Questionnaire for autism spectrum disorder: The Home Situations Questionnaire-Autism Spectrum Disorder. Autism. 2015. Epub 17 July 2015. doi: 10.1177/1362361315593941
78. Arnold LE, Vitiello B, McDougle CJ, Scahill L, Shah B, Gonzalez NM, et al. Parent-defined target symptoms respond to risperidone in RUPP autism study: Customer approach to clinical trials. Journal of the American Academy of Child & Adolescent Psychiatry. 2003; 42(12): 1443-50.
79. Ruble L, McGrew JH, Toland MD. Goal Attainment Scaling as an Outcome Measure in Randomized Controlled Trials of Psychosocial Interventions in Autism. Journal of Autism & Developmental Disorders. 2012; 42(9): 1974-83.
80. Adrien J-L, Roux S, Couturier G, Malvy J, Guerin P, Debuly S, et al. Towards a New Functional Assessment of Autistic Dysfunction in Children with Developmental Disorders The Behaviour Function Inventory. Autism. 2001; 5(3): 249-64. PMID: 11708585
81. Rojahn J, Matson JL, Lott D, Esbensen AJ, Smalls Y. The Behavior Problems Inventory: An instrument for the assessment of self-injury, stereotyped behavior, and aggression/destruction in individuals with developmental disabilities. Journal of Autism & Developmental Disorders. 2001; 31(6): 577-88.
82. Farmer CA, Aman MG. Development of the children's scale of hostility and aggression: Reactive/proactive (C-SHARP). Research in Developmental Disabilities. 2009; 30(6): 1155-67. PMID: 19375274
83. Bourke-Taylor H, Law M, Howie L, Pallant J. Development of the Child's Challenging Behaviour Scale (CCBS) for mothers of school-aged children with disabilities. Child: Care, health and development. 2010; 36(4): 491-8.
84. Streiner D, Norman G, Cairney J. Health Measurement Scales: A practical guide to their development and use. 5th edition ed. Oxford: Oxford University Press; 2015.