Structural and incremental validity of the wechsler adult intelligence scale-fourth edition with a clinical sample

Psychological Assessment

Volumn 25, Issue 2, 2013, Pages 618-630

  Nelson, Jason M ^a   Canivez, Gary L ^b   Watkins, Marley W ^c  

^a UNIVERSITY OF GEORGIA   (United States)

^b EASTERN ILLINOIS UNIVERSITY   (United States)

^c BAYLOR UNIVERSITY   (United States)

Author keywords

Factor analysis; Intelligence; WAIS IV; Wechsler Adult Intelligence Scale Fourth Edition

Indexed keywords

ACADEMIC ACHIEVEMENT; ADULT; ARTICLE; CONFIRMATORY FACTOR ANALYSIS; CONTROLLED STUDY; FACTORIAL ANALYSIS; FEMALE; FULL SCALE IQ; HIERARCHICAL MODEL; HUMAN; INCREMENTAL VALIDITY; INTELLIGENCE; MALE; SCORING SYSTEM; SKILL; STATISTICAL MODEL; STRUCTURAL VALIDITY; UNIVERSITY STUDENT; VALIDITY; WECHSLER INTELLIGENCE SCALE;

ADOLESCENT; ADULT; EDUCATIONAL STATUS; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MIDDLE AGED; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; WECHSLER SCALES; YOUNG ADULT;

EID: 84882707591     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0032086     Document Type: Article

References (74)

1. Beaujean, A. A., Firmin, M. W., Michonski, J. D., Berry, T., & Johnson, C. (2010). A multitrait-multimethod examination of the Reynolds Intellectual Assessment Scales in a college sample. Assessment, 17, 347-360. doi:10.1177/1073191109356865
2. Benson, N., Hulac, D. M., & Kranzler, J. H. (2010). Independent examination of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS- IV): What does the WAIS-IV measure. Psychological Assessment, 22, 121-130. doi:10.1037/a0017767
3. Bodin, D., Pardini, D. A., Burns, T. G., & Stevens, A. B. (2009). Higher order factor structure of the WISC-IV in a clinical neuropsychological sample. Child Neuropsychology, 15, 417- 424. doi:10.1080/ 09297040802603661
4. Bowden, S. C., Gregg, N., Bandalos, D., Davis, M., Coleman, C., Holdnack, J. A., & Weiss, L. G. (2008). Latent mean and covariance differences with measurement equivalence in college students with developmental difficulties versus the Wechsler Adult Intelligence Scale-III/ Wechsler Memory Scale-III normative sample. Educational and Psychological Measurement, 68, 621- 642. doi:10.1177/ 0013164407310126
5. Bowden, S. C., Saklofske, D. H., & Weiss, L. G. (2011a). Augmenting the core battery with supplemental subtests: Wechsler Adult Intelligence Scale-IV measurement invariance across the United States and Canada. Assessment, 18, 133-140. doi:10.1177/1073191110381717
6. Bowden, S. C., Saklofske, D. H., & Weiss, L. G. (2011b). Invariance of the measurement model underlying the Wechsler Adult Intelligence Scale-IV in the United States and Canada. Educational and Psychological Measurement, 71, 186-199. doi:10.1177/0013164410387382
7. Brown, J. I., Fishco, V. V., & Hanna, G. (1993a). Nelson-Denny Reading Test. Chicago, IL: Riverside.
8. Brown, J. I., Fishco, V. V., & Hanna, G. (1993b). Nelson-Denny Reading Test Technical Report Forms G & H. Chicago, IL: Riverside.
9. Brown, R. T., Reynolds, C. R., & Whitaker, J. S. (1999). Bias in mental testing since Bias in Mental Testing. School Psychology Quarterly, 14, 208-238. doi:10.1037/h0089007
10. Brunner, M., Nagy, G., & Wilhelm, O. (2012). A tutorial on hierarchically structured constructs. Journal of Personality, 80, 796-846. doi:10.1111/ j.1467-6494.2011.00749.x
11. Byrne, B. (2006). Structural equation modeling with EQS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
12. Canivez, G. L. (2008). Orthogonal higher order factor structure of the Stanford-Binet Intelligence Scales-Fifth Edition for children and adolescents. School Psychology Quarterly, 23, 533-541. doi:10.1037/ a0012884
13. Canivez, G. L. (2011). Hierarchical factor structure of the Cognitive Assessment System: Variance partitions from the Schmid-Leiman (1957) procedure. School Psychology Quarterly, 26, 305-317. doi: 10.1037/a0025973
14. Canivez, G. L. (in press). Incremental criterion validity of WAIS-IV factor index scores: Relationships with WIAT-II and WIAT-III subtest and composite scores. Psychological Assessment.
15. Canivez, G. L., Konold, T. R., Collins, J. M., & Wilson, G. (2009). Construct validity of the Wechsler Abbreviated Scale of Intelligence and Wide Range Intelligence Test: Convergent and structural validity. School Psychology Quarterly, 24, 252-265. doi:10.1037/a0018030
16. Canivez, G. L., & Watkins, M. W. (1998). Long-term stability of the Wechsler Intelligence Scale for Children-Third Edition. Psychological Assessment, 10, 285-291.
17. Canivez, G. L., & Watkins, M. W. (2010a). Exploratory and higher-order factor analyses of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) adolescent subsample. School Psychology Quarterly, 25, 223-235. doi:10.1037/a0022046
18. Canivez, G. L., & Watkins, M. W. (2010b). Investigation of the factor structure of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV): Exploratory and higher order factor analyses. Psychological Assessment, 22, 827-836. doi:10.1037/a0020429
19. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
20. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
21. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
22. DiStefano, C., & Dombrowski, S. C. (2006). Investigating the theoretical structure of the Stanford-Binet-Fifth Edition. Journal of Psychoeducational Assessment, 24, 123-136. doi:10.1177/0734282905285244
23. Dombrowski, S. C., Watkins, M. W., & Brogan, M. J. (2009). An exploratory investigation of the factor structure of the Reynolds Intellectual Assessment Scales (RIAS). Journal of Psychoeducational Assessment, 27, 494-507. doi:10.1177/0734282909333179
24. Frazier, T. W., Demaree, H. A., & Youngstrom, E. A. (2004). Metaanalysis of intellectual and neuropsychological test performance in attention- deficit/hyperactivity disorder. Neuropsychology, 18, 543-555. doi:10.1037/0894-4105.18.3.543
25. Gignac, G. E. (2005). Revisiting the factor structure of the WAIS-R: Insights through nested factor modeling. Assessment, 12, 320-329. doi:10.1177/1073191105278118
26. Gignac, G. E. (2006). The WAIS-III as a nested factors model: A useful alternative to the more conventional oblique and higher-order models. Journal of Individual Differences, 27, 73-86. doi:10.1027/1614-0001 .27.2.73
27. Gignac, G. E. (2008). Higher-order models versus direct hierarchical models: g as superordinate or breadth factor. Psychology Science Quarterly, 50, 21-43.
28. Glutting, J. J., Watkins, M. W., Konold, T. R., & McDermott, P. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. Journal of Special Education, 40, 103-114. doi: 10.1177/00224669060400020101
29. Glutting, J. J., Youngstrom, E. A., Ward, T., Ward, S., & Hale, R. L. (1997). Incremental efficacy of WISC-III factor scores in predicting achievement: What do they tell us. Psychological Assessment, 9, 295- 301. doi:10.1037/1040-3590.9.3.295
30. Golay, P., & Lecerf, T. (2011). Orthogonal higher order structure and confirmatory factor analysis of the French Wechsler Adult Intelligence Scale (WAIS-III). Psychological Assessment, 23, 143-152. doi: 10.1037/a0021230
31. Golay, P., Reverte, I., Rossier, J., Favez, N., & Lecerf, T. (2012). Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling. Psychological Assessment. Advance online publication. doi:10.1037/a0030676
32. Gorsuch, R. L. (1988). Exploratory factor analysis. In J. R. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 231-258). New York, NY: Plenum Press.
33. Gregg, N. (2009). Adolescents and adults with learning disabilities and ADHD: Assessment and accommodation. New York, NY: Guilford Press.
34. Hale, J. B., Fiorello, C. A., Kavanagh, J. A., Holdnack, J. A., & Aloe, A. M. (2007). Is the demise of IQ interpretation justified? A response to special issue authors. Applied Neuropsychology, 14, 37-51. doi:10.1080/ 09084280701280445
35. Holdnack, J. A., Zhou, X., Larrabee, G. J., Millis, S. R., & Salthouse, T. A. (2011). Confirmatory factor analysis of the WAIS-IV/WMS-IV. Assessment, 18, 178-191. doi:10.1177/1073191110393106
36. Hu, L.-T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
37. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
38. Hunsley, J. (2003). Introduction to the special section on incremental validity and utility in clinical assessment. Psychological Assessment, 15, 443-445. doi:10.1037/1040-3590.15.4.443
39. Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York, NY: Guilford Press.
40. Lassiter, K. S., Bell, N. L., Hutchinson, M. B., & Matthews, T. D. (2001). College student performance on the General Ability Measure for Adults and the Wechsler Intelligence Scale for Adults-Third Edition. Psychology in the Schools, 38, 1-10. doi:10.1002/1520-6807(200101)38:1<1:: AID-PITS1>3.0.CO;2-M
41. Lubinski, D. (2000). Scientific and social significance of assessing individual differences: "Sinking shafts at a few critical points". Annual Review of Psychology, 51, 405-444. doi:10.1146/annurev.psych.51.1 .405
42. Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57, 519-530. doi:10.1093/biomet/57.3.519
43. McGrew, K. S., Schrank, F. A., & Woodcock, R. W. (2007). Woodcock- Johnson III Normative Update technical manual. Rolling Meadows, IL: Riverside.
44. McGrew, K. S., & Wendling, B. J. (2010). Cattell-Horn-Carroll cognitive-achievement relations: What we have learned from the past 20 years of research. Psychology in the Schools, 47, 651-675.
45. Mundfrom, D. J., & Shaw, D. G. (2005). Minimum sample size recommendations for conducting factor analyses. International Journal of Testing, 5, 159-168. doi:10.1207/s15327574ijt0502_4
46. NCS Pearson. (2009). Wechsler Individual Achievement Test-Third Edition. San Antonio, TX: Author.
47. Nelson, J. M., & Canivez, G. L. (2012). Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample. Psychological Assessment, 24, 129-140. doi:10.1037/a0024878
48. Nelson, J. M., Canivez, G. L., Lindstrom, W., & Hatt, C. (2007). Higherorder exploratory factor analysis of the Reynolds Intellectual Assessment Scales with a referred sample. Journal of School Psychology, 45, 439-456. doi:10.1016/j.jsp.2007.03.003
49. Niileksela, C. R., Reynolds, M. R., & Kaufman, A. S. (2012). An alternative Cattell-Horn-Carroll (CHC) factor structure of the WAIS-IV: Age invariance of an alternative model for ages 70-90. Psychological Assessment. Advance online publication. doi:10.1037/a0031175
50. Oh, H.-J., Glutting, J. J., Watkins, M. W., Youngstrom, E. A., & McDermott, P. A. (2004). Correct interpretation of latent versus observed abilities: Implications from structural equation modeling applied to the WISC-III and WIAT linking sample. Journal of Special Education, 38, 159-173. doi:10.1177/00224669040380030301
51. Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction (3rd ed.). New York, NY: Harcourt Brace.
52. Raykov, T., & Marcoulides, G. A. (2000). A first course in structural equation modeling. Mahwah, NJ: Erlbaum.
53. Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696. doi:10.1080/00273171 .2012.715555
54. Sattler, J. M., & Ryan, J. J. (2009). Assessment with the WAIS-IV. San Diego, CA: Sattler.
55. Schmid, J., & Leiman, J. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. doi:10.1007/BF02289209
56. Schneider, W. J. (2008). Playing statistical Ouija Board with commonality analysis: Good questions, wrong assumptions. Applied Neuropsychology, 15, 44-53. doi:10.1080/09084280801917566
57. Sechrest, L. (1963). Incremental validity: A recommendation. Educational and Psychological Measurement, 23, 153-158. doi:10.1177/ 001316446302300113
58. Stinnett, T. A., Havey, J. M., & Oehler-Stinnett, J. (1994). Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment, 12, 331-350. doi:10.1177/ 073428299401200403
59. Strauss, E., Spreen, O., & Hunter, M. (2000). Implications for test revisions for research. Psychological Assessment, 12, 237-244. doi:10.1037/1040- 3590.12.3.237
60. Swanson, H. L., & Hsieh, C. (2009). Reading disabilities in adults: A selective meta-analysis of the literature. Review of Educational Research, 79, 1362-1390. doi:10.3102/0034654309350931
61. Trainin, G., & Swanson, H. L. (2005). Cognition, metacognition, and achievement of college students with learning disabilities. Learning Disability Quarterly, 28, 261-272. doi:10.2307/4126965
62. Ward, L. C., Bergman, M. A., & Hebert, K. R. (2012). WAIS-IV subtest covariance structure: Conceptual and statistical considerations. Psychological Assessment, 24, 328-340. doi:10.1037/
63. Watkins, C. E., Jr., Campbell, V. L., Nieberding, R., & Hallmark, R. (1995). Contemporary practice of psychological assessment by clinical psychologists. Professional Psychology: Research and Practice, 26, 54-60. doi:10.1037/0735-7028.26.1.54
64. Watkins, M. W. (2006). Orthogonal higher order structure of the Wechsler Intelligence Scale for Children-Fourth Edition. Psychological Assessment, 18, 123-125. doi:10.1037/1040-3590.18.1.123
65. Watkins, M. W. (2010). Structure of the Wechsler Intelligence Scale for Children-Fourth Edition among a national sample of referred students. Psychological Assessment, 22, 782-787. doi:10.1037/a0020043
66. Watkins, M. W. (2013). Omega [Computer software]. Phoenix, AZ: Ed & Psych Associates.
67. Watkins, M. W., Glutting, J. J., & Lei, P. (2007). Validity of the Full-Scale IQ when there is significant variability among WISC-III and WISC-IV factor scores. Applied Neuropsychology, 14, 13-20. doi:10.1080/ 09084280701280353
68. Watkins, M. W., Wilson, S. M., Kotz, K. M., Carbone, M. C., & Babula, T. (2006). Factor structure of the Wechsler Intelligence Scale for Children-Fourth Edition among referred students. Educational and Psychological Measurement, 66, 975-983. doi:10.1177/0013164406288168
69. Wechsler, D. (1997). Wechsler Adult Intelligence Scale-Third Edition. San Antonio, TX: Pearson.
70. Wechsler, D. (2001). Wechsler Individual Achievement Test-Second Edition. San Antonio, TX: Psychological Corporation.
71. Wechsler, D. (2008a). Wechsler Adult Intelligence Scale-Fourth Edition. San Antonio, TX: Pearson.
72. Wechsler, D. (2008b). Wechsler Adult Intelligence Scale-Fourth Edition technical and interpretive manual. San Antonio, TX: Pearson.
73. Woodcock, R. W., McGrew, K. S., & Mather, N. (2007). Woodcock- Johnson III Tests of Achievement Normative Update. Itasca, IL: Riverside
74. Youngstrom, E. A., Kogos, J. L., & Glutting, J. J. (1999). Incremental efficacy of Differential Ability Scales factor scores in predicting individual achievement criteria. School Psychology Quarterly, 14, 26-39. doi:10.1037/h0088996