What range of trait levels can the Autism-Spectrum Quotient (AQ) measure reliably? An item response theory analysis

Psychological Assessment

Volumn 28, Issue 6, 2016, Pages 673-683

  Murray, Aja Louise ^a   Booth, Tom ^b   McKenzie, Karen ^c   Kuenssberg, Renate ^d  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c NORTHUMBRIA UNIVERSITY   (United Kingdom)

^d NHS FIFE   (United Kingdom)

Author keywords

AQ; Autism Spectrum Quotient; Autistic traits; Item response theory; Reliable range of measurement

Indexed keywords

ADULT; ARTICLE; ATTENTION; AUTISM ASSESSMENT; AUTISM SPECTRUM QUOTIENT; CLINICAL FEATURE; FEMALE; HUMAN; IMAGINATION; INTERPERSONAL COMMUNICATION; MAJOR CLINICAL STUDY; MALE; MEASUREMENT PRECISION; PSYCHOMETRY; RELIABILITY; SOCIAL ADAPTATION; AUTISM SPECTRUM DISORDER; DEVICES; PSYCHOLOGICAL RATING SCALE; STANDARDS; YOUNG ADULT;

ADULT; AUTISM SPECTRUM DISORDER; FEMALE; HUMANS; MALE; PSYCHIATRIC STATUS RATING SCALES; PSYCHOMETRICS; YOUNG ADULT;

EID: 84939832437     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000215     Document Type: Article

References (52)

1. Allison, C., Auyeung, B., & Baron-Cohen, S. (2012). Toward brief "red flags" for autism screening: The short autism spectrum quotient and the short quantitative checklist in 1,000 cases and 3,000 controls. Journal of the American Academy of Child & Adolescent Psychiatry, 51, 202-212.
2. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
3. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.
4. Austin, E. J. (2005). Personality correlates of the broader autism phenotype as assessed by the Autism Spectrum Quotient (AQ). Personality and Individual Differences, 38, 451-460. http://dx.doi.org/10.1016/j.paid.2004.04.022.
5. Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The "Reading the Mind in the Eyes" Test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, 42, 241-251. http://dx.doi.org/10.1111/1469-7610.00715.
6. Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The autism-spectrum quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31, 5-17. http://dx.doi.org/10.1023/A:1005653411471.
7. Booth, T., Murray, A. L., McKenzie, K., Kuenssberg, R., O'Donnell, M., & Burnett, H. (2013). Brief report: An evaluation of the AQ-10 as a brief screening instrument for ASD in adults. Journal of Autism and Developmental Disorders, 43, 2997-3000. http://dx.doi.org/10.1007/s10803-013-1844-5.
8. Caspi, A., & Moffitt, T. E. (2006). Gene-environment interactions in psychiatry: Joining forces with neuroscience. Nature Reviews Neuroscience, 7, 583-590. http://dx.doi.org/10.1038/nrn1925.
9. Chen, W. H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265-289. http://dx.doi.org/10.2307/1165285.
10. Constantino, J. N., & Gruber, C. P. (2005). Social Responsiveness Scale: Manual. Los Angeles, CA: Western Psychological Services.
11. Embretson, S. E. (1996). Item response theory models and spurious interaction effects in factorial ANOVA designs. Applied Psychological Measurement, 20, 201-212. http://dx.doi.org/10.1177/014662169602000302.
12. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
13. Frazier, T. W., Youngstrom, E. A., Sinclair, L., Kubu, C. S., Law, P., Rezai, A.,. Eng, C. (2010). Autism spectrum disorders as a qualitatively distinct category from typical behavior in a large, clinically ascertained sample. Assessment, 17, 308-320. http://dx.doi.org/10.1177/1073191109356534.
14. Gibbons, R. D., Bock, R. D., Hedeker, D., Weiss, D. J., Segawa, E., Bhaumik, D. K.,. Stover, A. (2007). Full-information item bifactor analysis of graded response data. Applied Psychological Measurement, 31, 4-19. http://dx.doi.org/10.1177/0146621606289485.
15. Hernández, A., Drasgow, F., & González-Romá, V. (2004). Investigating the functioning of a middle category by means of a mixed-measurement model. Journal of Applied Psychology, 89, 687-699. http://dx.doi.org/10.1037/0021-9010.89.4.687.
16. Hoekstra, R. A., Bartels, M., Cath, D. C., & Boomsma, D. I. (2008). Factor structure, reliability and criterion validity of the Autism-Spectrum Quotient (AQ): A study in Dutch population and patient groups. Journal of Autism and Developmental Disorders, 38, 1555-1566. http://dx.doi.org/10.1007/s10803-008-0538-x.
17. Hoekstra, R. A., Vinkhuyzen, A. A., Wheelwright, S., Bartels, M., Boomsma, D. I., Baron-Cohen, S.,. van der Sluis, S. (2011). The construction and validation of an abridged version of the autismspectrum quotient (AQ-Short). Journal of Autism and Developmental Disorders, 41, 589-596. http://dx.doi.org/10.1007/s10803-010-1073-0.
18. Hurley, R. S., Losh, M., Parlier, M., Reznick, J. S., & Piven, J. (2007). The broad autism phenotype questionnaire. Journal of Autism and Developmental Disorders, 37, 1679-1690. http://dx.doi.org/10.1007/s10803-006-0299-3.
19. Johnson, S. A., Filliter, J. H., & Murphy, R. R. (2009). Discrepancies between self-and parent-perceptions of autistic traits and empathy in high functioning children and adolescents on the autism spectrum. Journal of Autism and Developmental Disorders, 39, 1706-1714. http://dx.doi.org/10.1007/s10803-009-0809-1.
20. Kang, S. M., & Waller, N. G. (2005). Moderated multiple regression, spurious interaction effects, and IRT. Applied Psychological Measurement, 29, 87-105. http://dx.doi.org/10.1177/0146621604272737.
21. Klin, A., Danovitch, J. H., Merz, A. B., & Volkmar, F. R. (2007). Circumscribed interests in higher functioning individuals with autism spectrum disorders: An exploratory study. Research and Practice for Persons with Severe Disabilities, 32, 89-100. http://dx.doi.org/10.2511/rpsd.32.2.89.
22. Kuenssberg, R., Murray, A. L., Booth, T., & McKenzie, K. (2014). Structural validation of the abridged autism spectrum quotient-short form in a clinical sample of people with autism spectrum disorders. Autism: The International Journal of Research and Practice, 18, 69-75. http://dx.doi.org/10.1177/1362361312467708.
23. Kulas, J. T., & Stachowski, A. A. (2009). Middle category endorsement in odd-numbered Likert response scales: Associated item characteristics, cognitive demands, and preferred meanings. Journal of Research in Personality, 43, 489-493. http://dx.doi.org/10.1016/j.jrp.2008.12.005.
24. Kulas, J. T., & Stachowski, A. A. (2013). Respondent rationale for neither agreeing nor disagreeing: Person and item contributors to middle category endorsement intent on Likert personality indicators. Journal of Research in Personality, 47, 254-262. http://dx.doi.org/10.1016/j.jrp.2013.01.014.
25. Kulas, J. T., Stachowski, A. A., & Haynes, B. A. (2008). Middle response functioning in Likert-responses to personality items. Journal of Business and Psychology, 22, 251-259. http://dx.doi.org/10.1007/s10869-008-9064-2.
26. Lai, M. C., Lombardo, M. V., Auyeung, B., Chakrabarti, B., & Baron-Cohen, S. (2015). Sex/gender differences and autism: Setting the scene for future research. Journal of the American Academy of Child & Adolescent Psychiatry, 54, 11-24. http://dx.doi.org/10.1016/j.jaac.2014.10.003.
27. Lau, W. Y. P., Kelly, A. B., & Peterson, C. C. (2013). Further evidence on the factorial structure of the Autism Spectrum Quotient (AQ) for adults with and without a clinical diagnosis of autism. Journal of Autism and Developmental Disorders, 43, 2807-2815. http://dx.doi.org/10.1007/s10803-013-1827-6.
28. Liss, M., Mailloux, J., & Erchull, M. J. (2008). The relationships between sensory processing sensitivity, alexithymia, autism, depression, and anxiety. Personality and Individual Differences, 45, 255-259. http://dx.doi.org/10.1016/j.paid.2008.04.009.
29. Lozano, L. M., García-Cueto, E., & Muñiz, J. (2008). Effect of the number of response categories on the reliability and validity of rating scales. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 4, 73-79. http://dx.doi.org/10.1027/1614-2241.4.2.73.
30. Lundström, S., Chang, Z., Råstam, M., Gillberg, C., Larsson, H., Anckarsäter, H., & Lichtenstein, P. (2012). Autism spectrum disorders and autistic like traits: Similar etiology in the extreme end and the normal variation. Archives of General Psychiatry, 69, 46-52. http://dx.doi.org/10.1001/archgenpsychiatry.2011.144.
31. Meijer, R. R., & Egberink, I. J. (2012). Investigating invariant item ordering in personality and clinical scales: Some empirical findings and a discussion. Educational and Psychological Measurement, 72, 589-607. http://dx.doi.org/10.1177/0013164411429344.
32. Murray, A. L., Allison, C., Smith, P., Baron-Cohen, S., Booth, T., & Auyeung, B. (2015). Investigating diagnostic bias in autism spectrum conditions: An item response theory analysis of sex bias in the AQ-10. Manuscript submitted for publication.
33. Murray, A. L., Booth, T., McKenzie, K., Kuenssberg, R., & O'Donnell, M. (2014). Are autistic traits measured equivalently in individuals with and without an autism spectrum disorder? An invariance analysis of the Autism Spectrum Quotient Short Form. Journal of Autism and Developmental Disorders, 44, 55-64. http://dx.doi.org/10.1007/s10803-013-1851-6.
34. Murray, A. L., Booth, T., & Molenaar, D. (2015). When "middle" really means "top" or "bottom." An analysis of the 16PF5 using Bock's nomimal response model. Manuscript submitted for publication.
35. Murray, A. L., McKenzie, K., Kuenssberg, R., & Booth, T. (2015). Do the Autism Spectrum Quotient (AQ) and Autism Spectrum Quotient Short Form (AQ-S) primarily reflect general ASD traits or specific ASD traits?: A bi-factor analysis. Manuscript submitted for publication.
36. Murray, A. L., McKenzie, K., Kuenssberg, R., & O'Donnell, M. (2014). Are we under-estimating the association between autism symptoms?: The importance of considering simultaneous selection when using samples of individuals who meet diagnostic criteria for an autism spectrum disorder. Journal of Autism and Developmental Disorders, 44, 2921-2930. http://dx.doi.org/10.1007/s10803-014-2154-2.
37. Murray, A. L., Molenaar, D., Johnson, W., & Krueger, R. (2015). Dependence of gene-by-environment interactions (G×E) on scaling: Comparing the use of sum scores, transformed sum scores and IRT scores for the phenotype in tests of G×E. Manuscript submitted for publication.
38. Muthén, L. K., & Muthén, B. O. (1998-2013). Mplus user's guide (6th ed.). Los Angeles, CA: Author.
39. Naito, K., Matsui, Y., Maeda, K., & Tanaka, K. (2010). Evaluation of the validity of the Autism Spectrum Quotient (AQ) in differentiating highfunctioning autistic spectrum disorder from schizophrenia. The Kobe Journal of Medical Sciences, 56, E116-E124.
40. Rammstedt, B., & Krebs, D. (2007). Does response scale format affect the answering of personality scales? Assessing the Big Five dimensions of personality with different response scales in a dependent sample. European Journal of Psychological Assessment, 23, 32-38. http://dx.doi.org/10.1027/1015-5759.23.1.32.
41. Reckase, M. D., & McKinley, R. L. (1991). The discriminating power of items that measure more than one dimension. Applied Psychological Measurement, 15, 361-373. http://dx.doi.org/10.1177/014662169101500407.
42. Reise, S. P., Morizot, J., & Hays, R. D. (2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care & Rehabilitation, 16(Suppl. 1), 19-31. http://dx.doi.org/10.1007/s11136-007-9183-7.
43. Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27-48. http://dx.doi.org/10.1146/annurev.clinpsy.032408.153553.
44. Ruzich, E., Allison, C., Smith, P., Watson, P., Auyeung, B., Ring, H., & Baron-Cohen, S. (2015). Measuring autistic traits in the general population: A systematic review of the Autism-Spectrum Quotient (AQ) in a nonclinical population sample of 6,900 typical adult males and females. Molecular Autism, 6, 2. http://dx.doi.org/10.1186/2040-2392-6-2.
45. Schwabe, I., & van den Berg, S. M. (2014). Assessing genotype by environment interaction in case of heterogeneous measurement error. Behavior Genetics, 44, 394-406.
46. Sizoo, B. B., van den Brink, W., Gorissen-van Eenige, M., Koeter, M. W., van Wijngaarden-Cremers, P. J., & van der Gaag, R. J. (2009). Using the autism-spectrum quotient to discriminate autism spectrum disorder from ADHD in adult patients with and without comorbid substance use disorder. Journal of Autism and Developmental Disorders, 39, 1291-1297. http://dx.doi.org/10.1007/s10803-009-0743-2.
47. Spek, A. A., & Wouters, S. G. (2010). Autism and schizophrenia in high functioning adults: Behavioral differences and overlap. Research in Autism Spectrum Disorders, 4, 709-717. http://dx.doi.org/10.1016/j.rasd.2010.01.009.
48. Thomas, M. L. (2011). The value of item response theory in clinical assessment: A review. Assessment, 18, 291-307. http://dx.doi.org/10.1177/1073191110374797.
49. van den Oord, E. J., Pickles, A., & Waldman, I. D. (2003). Normal variation and abnormality: An empirical study of the liability distributions underlying depression and delinquency. Journal of Child Psychology and Psychiatry, 44, 180-192. http://dx.doi.org/10.1111/1469-7610.00112.
50. Wakabayashi, A., Baron-Cohen, S., & Wheelwright, S. (2006). Are autistic traits an independent personality dimension? A study of the Autism-Spectrum Quotient (AQ) and the NEO-PI-R. Personality and Individual Differences, 41, 873-883. http://dx.doi.org/10.1016/j.paid.2006.04.003.
51. Wheelwright, S., Auyeung, B., Allison, C., & Baron-Cohen, S. (2010). Defining the broader, medium and narrow autism phenotype among parents using the Autism Spectrum Quotient (AQ). Molecular Autism, 1, 10. http://dx.doi.org/10.1186/2040-2392-1-10.
52. Wheelwright, S., Baron-Cohen, S., Goldenfeld, N., Delaney, J., Fine, D., Smith, R.,. Wakabayashi, A. (2006). Predicting autism spectrum quotient (AQ) from the systemizing quotient-revised (SQ-R) and empathy quotient (EQ). Brain Research, 1079, 47-56. http://dx.doi.org/10.1016/j.brainres.2006.01.012.