Psychometric Analysis of the Social Communication Questionnaire Using an Item-Response Theory Framework: Implications for the Use of the Lifetime and Current Forms

Journal of Psychopathology and Behavioral Assessment

Volumn 37, Issue 3, 2015, Pages 469-480

  Wei, Tianlan ^a,b   Chesnut, Steven Randall ^a   Barnard Brak, Lucy ^a   Richman, David ^a  

^a TEXAS TECH UNIVERSITY   (United States)

^b MISSISSIPPI STATE UNIVERSITY   (United States)

Author keywords

Autism spectrum disorder (ASD); Current form; Item response theory (IRT); Lifetime form; Measurement equivalence; Social Communication Questionnaire (SCQ)

Indexed keywords

ARTICLE; AUTISM; AUTISM DIAGNOSTIC INTERVIEW REVISED; CONVERGENT VALIDITY; DISCRIMINANT VALIDITY; FEMALE; HUMAN; INTERNAL CONSISTENCY; INTERNAL VALIDITY; INTERPERSONAL COMMUNICATION; ITEM RESPONSE THEORY; LANGUAGE; LIFESPAN; MAJOR CLINICAL STUDY; MALE; QUESTIONNAIRE; SOCIAL COMMUNICATION QUESTIONNAIRE; SOCIAL INTERACTION; STEREOTYPY; THEORY;

EID: 84938992032     PISSN: 08822689     EISSN: 15733505     Source Type: Journal    
DOI: 10.1007/s10862-014-9468-4     Document Type: Article

References (56)

1. Aldred, C., Green, J., & Adams, C. (2004). A new social communication intervention for children with autism: Pilot randomised controlled treatment study suggesting effectiveness. Journal of Child Psychology and Psychiatry, 45(8), 1420–1430.
2. Allen, C. W., Silove, N., Williams, K., & Hutchins, P. (2007). Validity of the social communication questionnaire in assessing risk of autism in preschool children with developmental problems. Journal of Autism and Developmental Disorders, 37(7), 1272–1278.
3. Baker, F. B. (1985). The basics of item response theory. Portsmouth: Heinemann.
4. Baker, F. B. (2001). The basics of Item Response Theory (2nd ed.). College Park, MD: ERIC Clearinghouse on Assessment and Evaluation, University of Maryland.
5. Baranek, G. T. (2002). Efficacy of sensory and motor interventions for children with autism. Journal of Autism and Developmental Disorders, 5, 397–422.
6. Bauminger, N. (2002). The facilitation of social-emotional understanding and social interaction in high-functioning children with autism: Intervention outcomes. Journal of Autism and Developmental Disorders, 32(4), 283–298.
7. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B Methodological, 57, 289–300.
8. Bentler, P. M. (2007). On tests and indices for evaluating structural models. Personality and Individual Differences, 42, 825–829.
9. Berument, S. K., Rutter, M., Lord, C., Pickles, A., & Bailey, A. (1999). Autism screening questionnaire: Diagnostic validity. British Journal of Psychiatry, 175, 444–451.
10. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 392–479). Reading: Addison-Wesley.
11. Blumberg, S. J., Bramlett, M. D., Kogan, M. D., Schieve, L. A., Jones, J. R., & Lu, M. C. (2013). Changes in prevalence of parent-reported autism spectrum disorder in school-aged U.S. children: 2007 to 2011–2012. National health statistics reports; no 65.
12. Breslow, N. E., & Day, N. E. (1980). Statistical methods in cancer research: Volume 1 the analysis of case-control studies. Lyon: International Agency for Research on Cancer.
13. Brooks, W. T., & Benson, B. A. (2013). The validity of the social communication questionnaire in adults with intellectual disability. Research in Autism Spectrum Disorders, 7, 247–255.
14. Bussey, K., & Bandura, A. (1992). Self-regulatory mechanisms governing gender development. Child Development, 63, 1236–1250.
15. Bussey, K., & Bandura, A. (2004). Social cognitive theory of gender development and differentiation. In A. H. Eagly, A. E. Beall, & R. J. Sternberg (Eds.), The psychology of gender (2nd ed., pp. 92–119). New York: Guilford Press.
16. Cai, L., Thissen, D., & du Toit, S. H. (2011). IRTPRO: Flexible, multidimensional, multiple categorical IRT modeling [Computer software]. Lincolnwood, IL: Scientific Software International.
17. Corsello, C., Hus, V., Pickles, A., Risi, S., Cook, E. H., Leventhal, B. L., & Lord, C. (2007). Between a ROC and a hard place: Decision making and making decisions about using the SCQ. Journal of Child Psychology and Psychiatry, 48(9), 932–940.
18. Dawson, J. E., Matson, J. L., & Cherry, K. E. (1998). An analysis of maladaptive behaviors in persons with autism, PDD-NOS, and mental retardation. Research in Developmental Disabilities, 19, 439–448.
19. de Ayala, R. J. (2009). The theory and practice of item response theory. New York: The Guilford Press.
20. Eaves, L. C., Wingert, H. D., Ho, H. H., & Mickelson, E. C. (2006). Screening for autism spectrum disorders with the social communication questionnaire. Developmental and Behavioral Pediatrics, 27(2), 94–103.
21. Gall, M. D., Gall, J. P., & Borg, W. R. (2006). Educational research: An introduction (8th ed.). Boston: Pearson.
22. Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Norwell: Kluwer Academic Publishers.
23. Hess, K. L., Morrier, M. J., Heflin, L. J., & Ivey, M. L. (2008). Autism treatment survey: Services received by children with autism spectrum disorders in public school classrooms. Journal of Autism and Developmental Disorders, 38(5), 961–971.
24. Hill, J., & Furniss, F. (2006). Patterns of emotional and behavioural disturbance associated with autistic traits in young people with severe intellectual disabilities and challenging behaviours. Research in Developmental Disabilities, 27(5), 517–528.
25. Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale: Lawrence Erlbaum Associates.
26. Howlin, P., Mawhood, L., & Rutter, M. (2000). Autism and developmental receptive language disorder—a follow‐up comparison in early adult life. II: Social, behavioural, and psychiatric outcomes. Journal of Child Psychology and Psychiatry, 41(5), 561–578.
27. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.
28. Johnson, S., Hollis, C., Hennessy, E., Kochhar, P., Wolke, D., & Marlow, N. (2011). Screening for autism in preterm children: Diagnostic utility of the social communication questionnaire. Archives of Disease in Childhood, 96, 73–77.
29. Kim, J., & Oshima, T. C. (2012). Effect of multiple testing adjustment in differential item functioning detection. Educational and Psychological Measurement. doi:10.1177/0013164412467033. Advance online publication.
30. Lee, L., David, A. B., Rusyniak, J., Landa, R., & Newschaffer, C. J. (2007). Performance of the social communication questionnaire in children receiving preschool special education services. Research in Autism Spectrum Disorders, 1(2), 126–138.
31. Lord, F., & Novick, M. R. (Eds.). (1968). Statistical theories of mental test scores. Reading: Addison-Wesley.
32. Magyar, C. I., Pandolfi, V., & Dill, C. A. (2012). An initial evaluation of the social communication questionnaire for the assessment of autism spectrum disorder in children with down syndrome. Journal of Developmental and Behavioral Pediatrics, 33(2), 134–145.
33. Mantel, N. (1963). Chi-square tests with one degree of freedom; Extension of the Mantel-Haenszel procedure. Journal of the American Statistical Association, 58, 690–700.
34. Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719–748.
35. Matson, J. L., & Shoemaker, M. (2009). Intellectual disability and its relationship to autism spectrum disorders. Research in Developmental Disabilities, 30(6), 1107–1114.
36. Matson, J. L., & Smith, K. R. (2008). Current status of intensive behavioral interventions for young children with autism and PDD-NOS. Research in Autism Spectrum Disorders, 2(1), 60–74.
37. Muthén, L. K., & Muthén, B. O. (2010). Mplus user’s guide (6th ed.). Los Angeles: Muthén & Muthén.
38. Oosterling, I., Rommelse, N., de Jonge, M., van der Gaag, R., Swinkels, S., Roos, S., & Buitelaar, J. (2010). How useful is the social communication questionnaire in toddlers at risk of autism spectrum disorder? Journal of Child Psychology and Psychiatry, 51(11), 1260–1268.
39. Penfield, R. D. (2012). DIFAS 5.0. Differential item functioning analysis system: User’s manual. Unpublished manuscript.
40. Penfield, R. D., & Algina, J. (2006). A generalized DIF effect variance estimator for measuring unsigned differential test functioning in mixed format tests. Journal of Educational Measurement, 43(3), 295–312.
41. Pfeiffer, B. A., Koenig, K., Kinnealey, M., Sheppard, M., & Henderson, L. (2011). Effectiveness of sensory integration interventions in children with autism spectrum disorders: A pilot study. The American Journal of Occupational Therapy, 65(1), 76–85.
42. Robins, D. L., Fein, D., Barton, M., & Green, J. A. (2001). The modified checklist for autism in toddlers: An initial study investigating the early detection of autism and pervasive developmental disorders. Journal of Autism and Developmental Disorders, 31, 131–144.
43. Rogers, S. J., Hepburn, S., & Wehner, E. (2003). Parent reports of sensory symptoms in toddlers with autism and those with other developmental disorders. Journal of Autism and Developmental Disorders, 33(6), 631–642.
44. Rutter, M., Bailey, A., & Lord, C. (2003a). The social communication questionnaire manual. Los Angeles: Western Psychological Services.
45. Rutter, M., Le Couteur, A., & Lord, C. (2003b). Autism diagnostic interview–revised manual. Los Angeles: Western Psychological Services.
46. Schanding, G. T., Nowell, K. P., & Goin-Kochel, R. P. (2012). Utility of the social communication questionnaire-current and social responsiveness scale as teacher-report screening tools for autism spectrum disorders. Journal of Autism and Developmental Disorders, 42, 1705–1716.
47. Schmitt, T. A. (2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29(4), 304–321.
48. Snow, A. V., & Lecavalier, L. (2008). Sensitivity and specificity of the modified checklist for autism in toddlers and the social communication questionnaire in preschoolers suspected of having pervasive developmental disorders. Autism: The International Journal of Research and Practice, 12(6), 627–644.
49. Studts, C. R. (2008). Improving screening for externalizing behavior problems in very young children: applications of item response theory to evaluate instruments in pediatric primary care (Doctoral dissertation). From http://digital.library.louisville.edu/utils/getfile/collection/etd/id/450/filename/451.pdf.
50. Teresi, J. A. (2006). Overview of quantitative measurement methods - equivalence, invariance, and differential item functioning in health applications. Medical Care, 44(11), S39–S49.
51. Tomchek, S. D., & Dunn, W. (2007). Sensory processing in children with and without autism: A comparative study using the short sensory profile. The American Journal of Occupational Therapy, 61(2), 190–200.
52. Wells, C. S., Subkoviak, M. J., & Serlin, R. C. (2002). The effect of item parameter drift on examinee ability estimates. Applied Psychological Measurement, 26, 77–87.
53. Wiggins, L. D., Bakeman, R., Adamson, L. B., & Robins, D. L. (2007). The utility of the social communication questionnaire in screening for autism in children referred for early intervention. Focus on Autism and Other Developmental Disabilities, 22(1), 33–38.
54. Wilkinson, L. A. (2010). A best practice guide to assessment and intervention for autism and Asperger syndrome in schools. London: Jessica Kingsley Publishers.
55. Witwer, A. N., & Lecavalier, L. (2007). Autism screening tools: An evaluation of the social communication questionnaire and the developmental behaviour checklist-autism screening algorithm. Journal of Intellectual and Developmental Disability, 32(3), 179–187.
56. Yu, C. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. (Doctoral dissertation, University of California, Los Angeles). Retrieved from http://statmodel2.com/download/Yudissertation.pdf.