Autism and epistemology III: Child development, behavioral stability, and reliability of measurement

American Journal of Medical Genetics, Part A

Volumn 158 A, Issue 5, 2012, Pages 969-979

  Fisch, Gene S ^a,b  

^a NEW YORK UNIVERSITY   (United States)

^b YESHIVA UNIVERSITY   (United States)

Author keywords

Autism; Diagnostic assessment; Intellectual disability; Kappa statistic; Pervasive developmental disability; Sensitivity; Specificity

Indexed keywords

ARTICLE; BEHAVIOR CHANGE; CHILD; CHILD BEHAVIOR; CHILD DEVELOPMENT; CLINICAL ASSESSMENT; CLINICAL EFFECTIVENESS; CLINICAL FEATURE; DEVELOPMENTAL SCREENING; DEVELOPMENTAL STABILITY; DIAGNOSTIC ACCURACY; DIAGNOSTIC ERROR; DIAGNOSTIC VALUE; DISEASE ASSOCIATION; DISEASE COURSE; DISEASE SEVERITY; EARLY DIAGNOSIS; EPISTEMOLOGY; GROWTH RATE; GROWTH RETARDATION; HUMAN; INFANTILE AUTISM; INTERRATER RELIABILITY; INTRARATER RELIABILITY; KAPPA STATISTICS; MENTAL DEVELOPMENT; PREDICTION; PREDICTIVE VALUE; PRIORITY JOURNAL; RATING SCALE; RISK ASSESSMENT; RISK FACTOR; SENSITIVITY AND SPECIFICITY; SYNDROME DELINEATION;

AUTISTIC DISORDER; CHILD; CHILD BEHAVIOR; CHILD DEVELOPMENT; CHILD DEVELOPMENT DISORDERS, PERVASIVE; EARLY DIAGNOSIS; HUMANS; REPRODUCIBILITY OF RESULTS;

EID: 84859946457     PISSN: 15524825     EISSN: 15524833     Source Type: Journal    
DOI: 10.1002/ajmg.a.35269     Document Type: Article

References (69)

1. American Psychiatric Association. 2000. Diagnostic and statistical manual of mental disorders, 4th edition. Text Revision. Arlington, VA: American Psychiatric Association.
2. Baird G, Charman T, Baron-Cohen S, Cox A, Swettenham J, Wheelwright S, Drew A. 2000. A screening instrument for autism at 18 months of age: A 6-year follow-up study. J Am Acad Chil Adolesc Psychiatry 39: 694-702.
3. Bayley N. 1993. Manual for the Bayley Scales of Infant Development, 2nd edition. San Antonio, TX: Psychological Corporation.
4. Brennan RL, Prediger DJ. 1981. Coefficient kappa: Some uses, misuses, and alternatives. Educ Psychol Meas 41: 687-699.
5. Brenner H, Gefeller O. 1997. Variation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence. Stat Med 16: 981-991.
6. Charman T, Baron-Cohen S, Baird G, Cox A, Wheelwright S, Swettenham J, Drew A. 2001. Commentary: The modified checklist for autism in toddlers. J Autism Dev Disord 31: 145-148.
7. Charman T, Taylor E, Drew A, Cockerill H, Brown JA, Baird G. 2005. Outcome at 7 years of children diagnosed at age 2: Predictive validity of assessments conducted at age 2 and 3 years of age and pattern of symptom change over time. J Child Psychol Psychiatry 46: 500-513.
8. Chawarska K, Klin A, Paul R, Volkmar F. 2007. Autism spectrum disorder in the second year: Stability and change in syndrome expression. J Child Psychol Psychiatry 48: 128-138.
9. Chawarska K, Klin A, Paul R, Macari S, Volkmar F. 2009. A prospective study of toddlers with ASD: Short term diagnostic and cognitive outcomes. J Child Psychol Psychiatry 50: 1235-1245.
10. Chlebowski C, Green JA, Barton ML, Fein D. 2010. Using the Child Autism Rating Scale to diagnose autism spectrum disorders. J Autism Dev Disord 40: 787-799.
11. Cicchetti DV. 1976. Assessing inter-rater reliability for rating scales: Resolving some basic issues. Br J Psychiatr 129: 452-456.
12. Cicchetti DV, Feinstein AR. 1990. High agreement but low kappa: II: Resolving the paradoxes. J Clin Epidemiol 43: 551-558.
13. Cohen J. 1960. A coefficient of agreement for nominal scales. Educ Psychol Meas 20: 37-46.
14. Cohen J. 1968. Weighted Kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70: 213-220.
15. Cohen J. 1972. Weighted chi square: And extension of the kappa method. Educ Psychol Meas 32: 61-74.
16. Cook NR. 2007. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115: 928-935.
17. Courchesne E, Webb SJ, Schumann CM. 2011. From toddlers to adults: The changing landscape of the brain in autism. In: Amaral DG, Dawson G, Geschwind DH, editors. Autism spectrum disorders. Oxford: Oxford University Press. pp 611-631.
18. Cox A, Charman T, Baron-Cohen S, Drew A, Klein K, Baird G, Swettenham J, Wheelwright S. 1999. Autism spectrum disorders at 20 and 42 months of age: Stability of Clinical and ADI-R diagnosis. J Child Psychol Psychiat 40: 719-732.
19. Daniels AM, Rosenberg RE, Law JK, Lord C, Kaufmann WE, Law PA. 2011. Stability of initial autism spectrum disorder diagnoses in community settings. J Autism Dev Disord 41: 110-121.
20. Darrou C, Pry R, Pernon E, Michelon C, Aussilloux C, Baghdadli A. 2010. Outcome of young children with autism. Autism 14: 663-677.
21. Dykens EM, Lense M. 2011. Intellectual: Disabilities and autism spectrum disorder: A cautionary note. In: Amaral DG, Dawson G, Geschwind DH, editors. Autism spectrum disorders. Oxford: Oxford University Press. pp 263-269.
22. Eaves LC, Ho HH. 2004. The very early identification of autism: Outcome to age 41/2-5. J Autism Dev Disord 34: 367-378.
23. Feinstein AR, Cicchetti DV. 1990. High agreement but low kappa: I: The problems of two paradoxes. J Clin Epidemiol 43: 543-549.
24. Fleiss JL, Cohen J, Everitt BS. 1969. Large sample standard errors of kappa and weighted kappa. Psychological Bulletin 72: 323-327.
25. Gaddis GM, Gaddis ML. 1990. Introduction to biostatistics: Part 3, sensitivity, specificity, predictive value, and hypothesis testing. Ann Emerg Med 19: 591-597.
26. Gesell A. 1940. The first five years of life: A guide to the study of the preschool child. New York: Harpers. pp 3-57.
27. Gesell A, Amatruda CS. 1941. Developmental diagnosis: Normal and abnormal child development. New York: Paul B. Hoeber, Inc. pp 3-25.
28. Gillberg C, Ehlers S, Schaumann H, Jakobsson G, Dahlgren SO, Lindblom R, Bågenholm A, Tjuus T, Blidner E. 1990. Autism under age 3 years: A clinical study of 28 cases referred for autistic symptoms in infancy. J Chil Psychol Psychiat 31: 921-934.
29. Gray KM, Tonge BJ, Sweeney DJ, Einfeld SL. 2008. Screening for autism in young children with developmental delay: An evaluation of the Developmental Behaviour Checklist: Early Screen. J Autism Dev Disord 38: 1003-1010.
30. Hageküll B, Bohlin G. 1981. Individual stability in dimensions of infant behavior. Infant Behav Dev 4: 97-108.
31. Kazdin AE. 1977. Artifact, bias, and complexity of assessment: The ABCs of reliability. J Appl Behav Anal 10: 141-150.
32. Kleinman JM, Ventola PE, Pandey J, Verbalis AD, Barton M, Hodgson S, Green J, Dumont-Mathieu T, Robins DL, Fein D. 2008. Diagnostic stability in very young children with autism spectrum disorders. J Autism Dev Disord 38: 606-615.
33. Kolling T, Goertz C, Frahsek S, Knopf M. 2010. Memory development throughout the second year: Overall developmental pattern, individual differences, and developmental trajectories. Infant Behav Dev 33: 159-167.
34. Kraemer HC, Bloch DA. 1988. Kappa coefficients in epidemiology: An appraisal of a reappraisal. J Clin Epidemiol 41: 959-968.
35. Landis JR, Koch GG. 1977. The measurement of observer agreement for categorical data. Biometrics 33: 159-174.
36. Linden A. 2004. Measuring diagnostic and predictive accuracy in disease management: An introduction to receiver operating characteristic (ROC) analysis. J Eval Clin Pract 12: 132-139.
37. Lord C. 1995. Follow-up of two-year-olds referred for possible autism. J Child Psychol Psychiatr 36: 1365-1382.
38. Lord C, Risi S, DiLavore PS, Shulman C, Thurm A, Pickles A. 2006. Autism from 2 to 9 years of age. Arch Gen Psychiatry 63: 694-701.
39. Lung FW, Shu BC, Chiang TL, Chen PF, Lin LL. 2009. Predictive validity of the Bayley scale of language development of children at 6-36 months. Pediatr Int 51: 666-669.
40. Maclure M, Willett WC. 1987. Misinterpretation and misuse of the kappa statistic. Am J Epidemiol 126: 161-169.
41. Matson JL, Wilkins J, Sharp B, Knight C, Sevin JA, Boisjoli JA. 2009a. Sensitivity and specificity of the Baby and Infant Screen for Children with aUtIsm Traits (BISCUIT): Validity and cutoff scores for autism and PDD-NOS in toddlers. Res Autism Spectr Disord 3: 924-930.
42. Matson JL, Fodstad JC, Dempsey T. 2009b. What symptoms predict the diagnosis of autism or PDD-NOS in infants and toddlers with developmental delays using the Baby and Infant Screen for Children with aUtIsm Traits. Dev Neurorehabil 12: 381-388.
43. Matson JL, Boisjoli JA, Hess JA, Wilkins J. 2010a. Factor structure and diagnostic fidelity of the Baby and Infant Screen for Children with aUtIsm Traits-Part 1 (BISCUIT-Part 1). Dev Rehabil 13: 72-79.
44. Matson JL, Wilkins J, Fodstad JC. 2010b. The validity of the Baby and Infant Screen for Children with aUtIsm Traits-Part 1 (BISCUIT-Part 1). J Autism Dev Disord 41: 1139-1146.
45. McGraw MB. 1943. The neuromuscular maturation of the infant. New York: Columbia University Press. pp 3-23.
46. Michelotti J, Charman T, Slonims V, Baird G. 2002. Follow-up of children with language delay and features of autism from preschool years to middle childhood. Devel Med Child Neurol 44: 812-819.
47. Minshew NJ, Scherf KS, Behrmann M, Humphreys K. 2011. Autism as a developmental neurobiological disorder: New insights from functional imaging. In: Amaral DG, Dawson G, Geschwind DH, editors. Autism spectrum disorders. Oxford: Oxford University Press. pp 632-650.
48. Mitchell SK. 1978. Interobserver agreement, reliability, and generalizability of data collected in observational studies. Psychol Bull 86: 376-390.
49. Moore V, Goodson S. 2003. How well does early diagnosis of autism stand the test of time? Autism 7: 47-63.
50. Moss J, Magiati I, Charman T, Howlin P. 2008. Stability of Autism Diagnostic Interview-Revised from pre-school to elementary school age in children with autism spectrum disorders. J Autism Dev Disord 38: 1081-1091.
51. Moura DR, Costa JC, Santos IS, Barros AJD, Matijasevich A, Halpern R, Dumith S, Karam S, Barros FC. 2010. Natural history of suspected developmental delay between 12 and 24 months of age in the 2004 Pelotas birth cohort. J Pediatr Child Health 46: 329-336.
52. Peters-Martin P, Wachs TD. 1984. A longitudinal study of temperament and its correlates in the first 12 months. Infant Behav Dev 7: 285-298.
53. Piek JP, Dawson L, Smith LM, Gasson N. 2008. The role of early fine and gross motor development on later motor and cognitive ability. Hum Mov Sci 27: 668-681.
54. Robins DL, Fein D, Barton ML, Green JA. 2001. The Modified Checklist for Toddlers: An initial study investigating the early detection of autism and pervasive developmental disorders. J Autism Dev Disord 31: 131-144.
55. Rogers S. 2009. What are infants teaching us about autism in infancy? Autism Res 2: 125-137.
56. Rose SA, Feldman JF, Jankowski JJ. 2009. A cognitive approach to the development of early language. Child Dev 80: 134-150.
57. Rothbart MK, Ahadi SA, Hershey KL, Fisher P. 2001. Investigations of temperament at three to seven years: The Children's Behavior Questionnaire. Child Dev 72: 1394-1408.
58. Shattuck PT, Mailick Seltzer M, Greenberg JS, Orsmond GI, Bolt D, Kring S, Lounds J, Lord C. 2007. Change in autism symptoms and maladaptive behaviors in adolescents and adults with an autism spectrum disorder. J Autism Dev Disord 37: 1735-1747.
59. Shrout PE. 1998. Measurement reliability and agreement in psychiatry. Stat Methods Med Res 7: 301-317.
60. Soke GN, Philofsky A, Diguiseppi C, Lezotte D, Rogers S, Hepburn S. 2011. Longitudinal changes in scores on the Autism Diagnostic Interview-Revised (ADI-R) in pre-school children with autism: Implications for diagnostic classification and symptom stability. Autism 15: 545-562.
61. Starr E, Szatmari P, Bryson S, Zwaigenbaum L. 2003. Stability and change among high-functioning children with pervasive developmental disorders: A 2-year outcome study. J Autism Dev Disord 33: 15-22.
62. Stone WL, Lee EB, Ashford L, Brissie J, Hepburn SL, Coonrod EE, Weiss BH. 1999. Can autism be diagnosed accurately in children under 3 years? J Child Psychol Psychiatr 40: 219-226.
63. Tinsley HEA, Weiss DJ. 1975. Interrater reliability and agreement of subjective judgments. J Couns Psychol 22: 358-376.
64. Turner LM, Stone WL. 2007. Variability in outcome for children with an ASD diagnosis at age 2. J Child Psychol Psychiatry 48: 793-802.
65. van Daalen E, Kemner C, Dietz C, Swinkels SHN, Buitelaar JK, van Engeland H. 2009. Inter-rater reliability and stability of diagnosis of autism spectrum disorder in children identified through screening at a very young age. Eur Child Adolesc Psychiatry 18: 663-674.
66. Ventola P, Kleinman J, Pandey J, Wilson L, Esser E, Boorstein H, Dumont-Mathieu T, Marshia G, Barton M, Hodgson S, et al. 2007. Differentiating between autism spectrum disorders and other developmental disabilities in children who failed a screening instrument for ASD. J Autis Dev Disord 37: 425-436.
67. Vickers AJ, Cronin AM, Begg CB. 2011. One statistical test is sufficient for assessing new predictive markers. BMC Med Res Methodol 11: 13-19.
68. Worley JA, Matson JL, Mahan S, Kozlowski AM, Neal D. 2011. Stability of symptoms of autism spectrum disorders in toddlers: An examination using the Baby and Infant Screen for Children with aUtIsm Traits-Part 1 (BISCUIT). Dev Neurorehabil 14: 36-40.
69. Yama B, Freeman T, Graves E, Yuan S, Campbell MK. 2012. Examination of the properties of the Modified Checklist for Autism in Toddlers (M-CHAT) in a population sample. J Autism Dev Disord 42: 23-34.