Interpretation of KABC-II scores: An evaluation of the incremental validity of Cattell-Horn-Carroll (CHC) factor scores in predicting achievement

Psychological Assessment

Volumn 27, Issue 4, 2015, Pages 1417-1426

  McGill, Ryan J ^a  

^a TEXAS WOMAN'S UNIVERSITY   (United States)

Author keywords

CHC; Incremental validity; KABC II; Test interpretation

Indexed keywords

ACADEMIC ACHIEVEMENT; ADOLESCENT; ADULT; AFRICAN AMERICAN; ARTICLE; CATTELL HORN CARROLL FACTOR SCORE; CAUCASIAN; CHILD; CHILD PARENT RELATION; CONTROLLED STUDY; EFFECT SIZE; FEMALE; FLUID CRYSTALLIZED INDEX; HISPANIC; HUMAN; KAUFMAN ASSESSMENT BATTERY FOR CHILDREN; KAUFMAN ASSESSMENT BATTERY FOR CHILDREN SECOND EDITION; MALE; PARENTING EDUCATION; PSYCHOLOGICAL RATING SCALE; SCORING SYSTEM; STANDARDIZATION; ACHIEVEMENT; EDUCATION; FACTOR ANALYSIS; INTELLIGENCE TEST; REPRODUCIBILITY; STANDARD; STANDARDS;

ACHIEVEMENT; ADOLESCENT; CHILD; EDUCATIONAL MEASUREMENT; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; INTELLIGENCE TESTS; MALE; REFERENCE STANDARDS; REPRODUCIBILITY OF RESULTS;

EID: 84927943281     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000127     Document Type: Article

References (66)

1. Bain, K., & Gray, R. (2008). Test reviews:Kaufman, A. S., & Kaufman, N. L. (2004). Kaufman assessment battery for children, 2nd ed. Journal of Psychoeducational Assessment, 26, 92-101. http://dx.doi.org/10.1177/0734282907300461.
2. Bangirana, P., Seggane-Musisi, Allebeck, P., Giordani, B., John, C. C., Opoka, O. R., Boivin, M. J. (2009). A preliminary examination of the construct validity of the KABC-II in Ugandan children with a history of cerebral malaria. African Health Sciences, 9, 186-192. http://www.ajol.info/index.php/ahs/article/view/49010/35360.
3. Beaujean, A. A., Parkin, J., & Parker, S. (2014). Comparing Cattell-Horn-Carroll factor models:Differences between bifactor and higher order factor models in predicting language achievement. Psychological Assessment, 26, 789-805. http://dx.doi.org/10.1037/a0036745.
4. Brown, R. T., Reynolds, C. R., & Whitaker, J. S. (1999). Bias in mental testing since bias in mental testing. School Psychology Quarterly, 14, 208-238. http://dx.doi.org/10.1037/h0089007.
5. Canivez, G. L. (2011, February). Incremental predictive validity of Cognitive Assessment System PASS scores. Paper presented at the 2011. Annual Convention of the National Association of School Psychologists, San Francisco, CA.
6. Canivez, G. L. (2013a). Incremental criterion validity of WAIS-IV factor index scores:Relationships with WIAT-II and WIAT-III subtest and composite scores. Psychological Assessment, 25, 484-495. http://dx.doi.org/10.1037/a0032092.
7. Canivez, G. L. (2013b). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In D. H. Saklofske, C. R. Reynolds, & V. L. Schwean (Eds.), The Oxford handbook of child psychological assessment (pp. 84-112). New York, NY:Oxford University Press. http://dx.doi.org/10.1093/oxfordhb/9780199796304.013.0004.
8. Canivez, G. L. (2014). Review of the Wechsler preschool and primary scale of intelligence. In J. F. Carlson, K. F. Geisinger, & J. L. Jonson (Eds.), The nineteenth mental measurements yearbook (4th ed., pp. 732-737). Lincoln, NE:Buros Institute of Mental Measurements.
9. Canivez, G. L., & Kush, J. C. (2013). WAIS-IV and WISC-IV structural validity:Alternate methods, alternate results. commentary on Weiss et al. (2013a) and Weiss et al. (2013b). Journal of Psychoeducational Assessment, 31, 157-169. http://dx.doi.org/10.1177/0734282913478036.
10. Canivez, G. L., & Watkins, M. W. (2001). Long-term stability of the Wechsler intelligence scale for children-third edition among students with disabilities. School Psychology Review, 30, 438-453. Retrieved from https://www.nasponline.org
11. Canivez, G. L., Watkins, M. W., James, T., Good, R., & James, K. (2014). Incremental validity of WISC-IV(UK) factor index scores with a referred Irish sample:Predicting performance on the WIAT-II(UK.). British Journal of Educational Psychology, 84, 667-684. http://dx.doi.org/10.1111/bjep.12056.
12. Carroll, J. B. (1995). On methodology in the study of cognitive abilities. Multivariate Behavioral Research, 30, 429-452. http://dx.doi.org/10.1207/s15327906mbr3003_6.
13. Cattell, R. B. (1987). Intelligence:Its structure, growth, and action. New York, NY:Elsevier Science.
14. Cohen, J. (1988). Statistical power analysis for the behavior sciences (2nd ed.). New York, NY:Psychology Press.
15. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ:Erlbaum.
16. Decker, S. L., Hale, J. B., & Flanagan, D. P. (2013). Professional practice issues in the assessment of intellectual development in children for educational applications. Psychology in the Schools, 50, 300-313. http://dx.doi.org/10.1002/pits.21675.
17. Flanagan, D. P., & Alfonso, V. C. (Eds.). (2011). Essentials of specific learning disability identification. Hoboken, NJ:Wiley.
18. Gignac, G. E. (2014). Dynamic mutualism versus g factor theory:An empirical test. Intelligence, 42, 89-97. http://dx.doi.org/10.1016/j.intell.2013.11.004.
19. Glutting, J. J., Watkins, M. W., Konold, T. R., & McDermott, P. A. (2006). Distinctions without a difference:The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. The Journal of Special Education, 40, 103-114. http://dx.doi.org/10.1177/00224669060400020101.
20. Golay, P., Reverte, I., Rossier, J., Favez, N., & Lecerf, T. (2013). Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling. Psychological Assessment, 25, 496-508. http://dx.doi.org/10.1037/a0030676.
21. Gottfredson, L. S. (2002). g:Highly general and highly practical. In R. J. Sternberg & E. L. Grigorenko (Eds.), The general factor of intelligence:How general is it? (pp. 331-380). Mahwah, NJ:Erlbaum.
22. Gottfredson, L. S., & Saklofske, D. H. (2009). Intelligence:Foundations and issues in assessment. Canadian Psychology, 50, 183-195. http://dx.doi.org/10.1037/a0016641.
23. Hale, J. B., Fiorello, C. A., Kavanagh, J. A., Holdnack, J. A., & Aloe, A. M. (2007). Is the demise of IQ justified? A response to the special issue authors. Applied Neuropsychology, 14, 37-51. http://dx.doi.org/10.1080/09084280701280445.
24. Hunsley, J. (2003). Introduction to the special section on incremental validity and utility in clinical assessment. Psychological Assessment, 15, 443-445.
25. Jones, W. T. (1952). A history of western philosophy. New York, NY:Harcourt-Brace.
26. Kaufman, A. S., & Kaufman, N. L. (1983). Kaufman assessment battery for children. Circle Pines, MN:American Guidance Service.
27. Kaufman, A. S., & Kaufman, N. L. (2004a). Kaufman assessment battery for children (2nd ed.). Circle Pines, MN:American Guidance Service.
28. Kaufman, A. S., & Kaufman, N. L. (2004b). Kaufman assessment battery for children (2nd ed. manual). Circle Pines, MN:American Guidance Service.
29. Kaufman, A. S., & Kaufman, N. L. (2004c). Kaufman test of educational achievement (2nd ed.). Circle Pines, MN:American Guidance Service.
30. Kaufman, A. S., & Kaufman, N. L. (2004d). Kaufman Test of Educational Achievement (2nd ed. manual). Circle Pines, MN:American Guidance Service.
31. Kaufman, A. S., Lichtenberger, E. O., Fletcher-Janzen, E., & Kaufman, N. L. (2005). Essentials of KABC-II assessment. Hoboken, NJ:Wiley.
32. Kaufman, S. B., Reynolds, M. R., Liu, X., Kaufman, A. S., & McGrew, K. S. (2012). Are cognitive g and academic achievement g one and the same g? An exploration on the Woodcock-Johnson and Kaufman tests. Intelligence, 40, 123-138. http://dx.doi.org/10.1016/j.intell.2012.01.009.
33. Keith, T. Z. (1994). Intelligence is important, intelligence is complex. School Psychology Quarterly, 9, 209-221. http://dx.doi.org/10.1037/h0088286.
34. Kranzler, J. H., & Floyd, R. G. (2013). Assessing intelligence in children and adolescents:A practical guide. New York, NY:Guilford Press.
35. Luria, A. R. (1966). Human brain and psychological processes. New York, NY:Harper Row.
36. McDermott, P. A., Watkins, M. W., & Rhoad, A. M. (2014). Whose IQ is it?-Assessor bias variance in high-stakes psychological assessment. Psychological Assessment, 26, 207-214. http://dx.doi.org/10.1037/a0034832.
37. McGill, R. J. (2015). Incremental criterion validity of the WJ-III COG clinical clusters:Marginal predictive effects beyond the general factor. Canadian Journal of School Psychology, 30, 51-63. http://dx.doi.org/10.1177/0829573514553926.
38. McGill, R. J., & Busse, R. T. (2014). Incremental validity of the WJ III COG:Limited predictive effects beyond the GIA-E. School Psychology Quarterly. Advance online publication. http://dx.doi.org/10.1037/spq0000094.
39. McGrew, K. S., LaForte, E. M., & Schrank, F. A. (2014). Woodcock-Johnson IV technical manual. Rolling Meadows, IL:Riverside.
40. Meehl, P. E. (2002). Cliometric metatheory:II. Criteria scientists use in theory appraisal and why it is rational to do so. Psychological Reports, 91, 339-404. http://dx.doi.org/10.2466/pr0.2002.91.2.339.
41. Morgan, K. E., Rothlisberg, B. A., McIntosh, D. E., & Hunt, M. S. (2009). Confirmatory factor analysis of the KABC-II in preschool children. Psychology in the Schools, 46, 515-525. http://dx.doi.org/10.1002/pits.20394.
42. Mundfrom, D. J., Perrett, J. J., Schaffer, J., Piccone, A., & Roozeboom, M. (2006). Bonferroni adjustments in tests for regression coefficients. Multiple Linear Regression Viewpoints, 32, 1-6. Retrieved from http://mlrv.ua.edu/2006/Mundfrom-etal-MLRV-3.pdf
43. Nelson, J. M., & Canivez, G. L. (2012). Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample. Psychological Assessment, 24, 129-140. http://dx.doi.org/10.1037/a0024878.
44. Nelson, J. M., Canivez, G. L., & Watkins, M. W. (2013). Structural and incremental validity of the Wechsler Adult Intelligence Scale-fourth edition with a clinical sample. Psychological Assessment, 25, 618-630. http://dx.doi.org/10.1037/a0032086.
45. Pedhazur, E. J. (1997). Multiple regression in behavioral research:Explanation and prediction (3rd ed.). New York, NY:Holt, Rinehart, & Winston.
46. Reynolds, M. R., Keith, T. Z., Fine, J. G., Fisher, M. E., & Low, J. (2007). Confirmatory factor structure of the Kaufman Assessment Battery for Children-2nd ed.:Consistency with Cattell-Horn-Carroll theory. School Psychology Quarterly, 22, 511-539. http://dx.doi.org/10.1037/1045-3830.22.4.511.
47. Reynolds, M. R., Keith, T. Z., Flanagan, D. P., & Alfonso, V. C. (2013). A cross-battery, reference variable, confirmatory factor analytic investigation of the CHC taxonomy. Journal of School Psychology, 51, 535-555. http://dx.doi.org/10.1016/j.jsp.2013.02.003.
48. Schmidt, J., & Leiman, J. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. http://dx.doi.org/10.1007/BF02289209.
49. Schmidt, F. L., & Hunter, J. (2004). General mental ability in the world of work:Occupational attainment and job performance. Journal of Personality and Social Psychology, 86, 162-173. http://dx.doi.org/10.1037/0022-3514.86.1.162.
50. Schneider, W. J. (2008). Playing statistical Ouija board with commonality analysis:Good questions, wrong assumptions. Applied Neuropsychology, 15, 44-53. http://dx.doi.org/10.1080/09084280801917566.
51. Schneider, W. J. (2013). What if we took our models seriously? Estimating latent scores in individuals. Journal of Psychoeducational Assessment, 31, 186-201. http://dx.doi.org/10.1177/0734282913478046.
52. Schneider, W. J., & McGrew, K. S. (2012). The Cattell-Horn-Carroll model of intelligence. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment:Theories, tests, and issues (3rd ed., pp. 99-144). New York, NY:Guilford Press.
53. Singer, J. K., Lichtenberger, E. O., Kaufman, J. C., Kaufman, A. S., & Kaufman, N. L. (2012). The Kaufman assessment battery for children-2nd ed. and the Kaufman test of educational achievement-2nd ed. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment:Theories, tests, and issues (3rd ed., pp. 269-296). New York, NY:Guilford Press.
54. Thorndike, R. L. (1986). The role of general ability in prediction. Journal of Vocational Behavior, 29, 332-339. http://dx.doi.org/10.1016/0001-8791(86)90012-6.
55. Thorndike, R. M. (2005). Review of Kaufman assessment battery for children. In R. A. Spies & B. S. Plake (Eds.), The sixteenth mental measurements yearbook (2nd ed., pp. 520-522). Lincoln, NE:University of Nebraska.
56. Tucker-Drob, E. M. (2009). Differentiation of cognitive abilities across the life span. Developmental Psychology, 45, 1097-1118. http://dx.doi.org/10.1037/a0015864.
57. Watkins, M. W. (2000). Cognitive profile analysis:A shared professional myth. School Psychology Quarterly, 15, 465-479. http://dx.doi.org/10.1037/h0088802.
58. Watkins, M. W. (2009). Errors in diagnostic decision making and clinical judgment. In T. B. Gutkin & C. R. Reynolds (Eds.), Handbook of school psychology (4th ed., pp. 210-229). Hoboken, NJ:Wiley.
59. Watkins, M. W., & Glutting, J. J. (2000). Incremental validity of WISC-III profile elevation, scatter, and shape information for predicting reading and math achievement. Psychological Assessment, 12, 402-408. http://dx.doi.org/10.1037/1040-3590.12.4.402.
60. Wechsler, D. (2001). Wechsler Individual Achievement (2nd ed.). San Antonio, TX:Psychological Corporation.
61. Wechsler, D. (2014). Wechsler intelligence scale for children-fifth edition technical and interpretive manual. Bloomington, MN:Pearson.
62. Weiss, L. G., Keith, T. Z., Zhu, J., & Chen, H. (2013a). Technical and practical issues in the structure and clinical invariance of the Wechsler scales:A rejoinder to commentaries. Journal of Psychoeducational Assessment, 31, 235-243. http://dx.doi.org/10.1177/0734282913478050.
63. Weiss, L. G., Keith, T. Z., Zhu, J., & Chen, H. (2013b). WAIS-IV and clinical validation of the four-and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 93-113.
64. Weiss, L. G., Keith, T. Z., Zhu, J., & Chen, H. (2013c). WISC-IV and clinical validation of the four-and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 114-131. http://dx.doi.org/10.1177/0734282913478032.
65. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III Tests of Achievement. Itasca, IL:Riverside.
66. Youngstrom, E. A., Kogos, J. L., & Glutting, J. J. (1999). Incremental efficacy of Differential Ability Scales factor scores in predicting individual achievement criteria. School Psychology Quarterly, 14, 26-39. http://dx.doi.org/10.1037/h0088996.