Incremental validity of the WJ III COG: Limited predictive effects beyond the GIA-E

School Psychology Quarterly

Volumn 30, Issue 3, 2015, Pages 353-365

  McGill, Ryan J ^a   Busse, R T ^b  

^a TEXAS WOMAN'S UNIVERSITY   (United States)

^b CHAPMAN UNIVERSITY   (United States)

Author keywords

CHC; Incremental validity; Predictive validity; WJ III COG

Indexed keywords

ACHIEVEMENT; ADOLESCENT; CHILD; COGNITION; FEMALE; HUMAN; INTELLIGENCE; INTELLIGENCE TEST; MALE; PHYSIOLOGY; PSYCHOMETRY; REGRESSION ANALYSIS; REPRODUCIBILITY; STANDARDS; VALIDATION STUDY;

ACHIEVEMENT; ADOLESCENT; CHILD; COGNITION; FEMALE; HUMANS; INTELLIGENCE; INTELLIGENCE TESTS; MALE; PSYCHOMETRICS; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS;

EID: 84940895536     PISSN: 10453830     EISSN: 19391560     Source Type: Journal    
DOI: 10.1037/spq0000094     Document Type: Article

References (55)

1. Canivez, G. L. (2011, February). Incremental predictive validity of Cognitive Assessment System PASS scores. Poster presented at the 2011 Annual Convention of the National Association of School Psychologists, San Francisco, CA.
2. Canivez, G. L. (2013a). Incremental criterion validity of WAIS-IV factor index scores: Relationships with WIAT-II and WIAT-III subtest and composite scores. Psychological Assessment, 25, 484-495. http://dx.doi.org/10.1037/a0032092
3. Canivez, G. L. (2013b). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In D. H. Saklofske, C. R. Reynolds, & V. L. Schwean (Eds.), The Oxford handbook of child psychological assessment (pp. 84-112). New York, NY: Oxford University Press. http://dx.doi.org/10.1093/oxfordhb/9780199796304.013.0004
4. Carroll, J. B. (1976). Psychometric tests as cognitive tasks: A new structure of intellect. In L. B. Resnick (Ed.), The nature of intelligence (pp. 27-56). Hillsdale, NJ: Erlbaum.
5. Carroll, J. B. (1993). Human cognitive abilities: A survey of factor analytic studies. New York, NY: Cambridge University Press. http://dx.doi.org/10.1017/CBO9780511571312
6. Cattell, R. B. (1971). Abilities: Their structure, growth, and action. Boston, MA: Houghton Mifflin.
7. Cizek, G. J. (2003). Review of the Woodcock-Johnson III. In B. S. Plake & J. C. Impara (Eds.), The fifteenth mental measurements yearbook (pp. 10240-11024). Lincoln, NE: Buros Institute of Mental Measurements.
8. Cohen, J. (1988). Statistical power analysis for the behavior sciences (2nd ed.). New York, NY: Psychology Press.
9. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum.
10. Dana, J., & Dawes, R. M. (2007). Comment of Fiorello et al. "Interpreting intelligence test results for children with disabilities: Is global intelligence relevant?" Applied Neuropsychology, 14, 21-25. http://dx.doi.org/10.1080/09084280701280379
11. Dombrowski, S. C. (2013). Investigating the structure of the WJ-III Cognitive at school age. School Psychology Quarterly, 28, 154-169. http://dx.doi.org/10.1037/spq0000010
12. Dombrowski, S. C. (2014). Investigating the structure of the WJ-III Cognitive in early school age through two exploratory bifactor analysis procedures. Journal of Psychoeducational Assessment, 32, 483-494. http://dx.doi.org/10.1177/0734282914530838
13. Dombrowski, S. C., & Watkins, M. W. (2013). Exploratory and higher order factor analysis of the WJ-III full test battery: A school-aged analysis. Psychological Assessment, 25, 442-455. http://dx.doi.org/10.1037/a0031335
14. Enders, C. K. (2010). Applied missing data analysis. New York, NY: Guilford Press.
15. Evans, J. J., Floyd, R. G., McGrew, K. S., & Leforgee, M. H. (2001). The relations between measures of Cattell-Horn-Carroll (CHC) cognitive abilities and reading achievement during childhood and adolescence. School Psychology Review, 31, 246-262. Retrieved from http://www.nasponline.org
16. Fiorello, C. A., Hale, J. B., & Snyder, L. E. (2006). Cognitive hypothesis testing and response to intervention for children with reading problems. Psychology in the Schools, 43, 835-853. http://dx.doi.org/10.1002/pits.20192
17. Flanagan, D. P., Alfonso, V. C., & Mascolo, J. T. (2011). A CHC-based operational definition of SLD: Integrating multiple data sources and multiple data-gathering methods. In D. P. Flanagan & V. C. Alfonso (Eds.), Essentials of specific learning disability identification (pp. 233-298). Hoboken, NJ: Wiley.
18. Flanagan, D. P., Ortiz, S. O., & Alfonso, V. C. (2013). Essentials of cross-battery assessment (3rd ed.). Hoboken, NJ: Wiley.
19. Floyd, R. G., Evans, J. J., & McGrew, K. S. (2003). Relations between measures of Cattell-Horn-Carroll (CHC) cognitive abilities and mathematics achievement across the school-age years. Psychology in the Schools, 40, 155-171. http://dx.doi.org/10.1002/pits.10083
20. Floyd, R. G., McGrew, K. S., Barry, A., Rafael, F., & Rogers, J. (2009). General and specific effects on Cattell-Horn-Carroll Broad Ability Composites: Analysis of the Woodcock-Johnson III Normative Update Cattell-Horn-Carroll factor clusters across development. School Psychology Review, 38, 249-265. Retrieved from http://www.nasponline.org
21. Floyd, R. G., McGrew, K. S., & Evans, J. J. (2008). The relative contributions of the Cattell-Horn-Carroll (CHC) cognitive abilities in explaining writing achievement during childhood and adolescence. Psychology in the Schools, 45, 132-144. http://dx.doi.org/10.1002/pits.20284
22. Glutting, J. J., Watkins, M. W., Konold, T. R., & McDermott, P. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. The Journal of Special Education, 40, 103-114. http://dx.doi.org/10.1177/00224669060400020101
23. Glutting, J. J., Youngstrom, E. A., Ward, T., Ward, S., & Hale, R. L. (1997). Incremental efficacy of the WISC-III factor scores in predicting achievement: What do they tell us? Psychological Assessment, 9, 295-301. http://dx.doi.org/10.1037/1040-3590.9.3.295
24. Gottfredson, L. S. (1997). Why g matters: The complexity of everyday life. Intelligence, 24, 79-132. http://dx.doi.org/10.1016/S0160-2896(97)90014-3
25. Hale, J. B., Fiorello, C. A., Kavanuagh, J. A., Holdnack, J. A., & Aloe, A. M. (2007). Is the demise of IQ interpretation justified? A response to special issue authors. Applied Neuropsychology, 14, 37-51. http://dx.doi.org/10.1080/09084280701280445
26. Horn, J. L. (1991). Measurement of intellectual capabilities: A review of theory. In K. McGrew, J. K. Werder, & R. W. Woodcock (Eds.), WJ-R technical manual (pp. 197-232). Itasca, IL: Riverside Publishing.
27. Hunsley, J. (2003). Introduction to the special section on incremental validity and utility in clinical assessment. Psychological Assessment, 15, 443-445. http://dx.doi.org/10.1037/1040-3590.15.4.443
28. Jaffe, L. E. (2009). Development, interpretation, and application of the W score and the relative proficiency index (Woodcock-Johnson III Assessment Service Bulletin No. 11). Rolling Meadows, IL: Riverside Publishing.
29. Jones, W. T. (1952). A history of Western philosophy. New York, NY: Harcourt-Brace.
30. Keith, T. Z. (2006). Multiple regression and beyond. Boston, MA: Allyn and Bacon.
31. Keith, T. Z., & Reynolds, M. R. (2010). Cattell-Horn-Carroll abilities and cognitive tests: What we've learned from 20 years of research. Psychology in the Schools, 47, 635-650.
32. Mather, N., Wendling, B. J., & Woodcock, R. W. (2001). Essentials of WJ III Tests of Achievement assessment. New York, NY: Wiley.
33. Mather, N., & Woodcock, R. W. (2001). Woodcock-Johnson III Tests of Cognitive Abilities examiner's manual. Itasca, IL. Riverside.
34. McGill, R. J., & Busse, R. T. (2013, February). The incremental validity of CHC factors on the KABCII. Poster presented at the annual meeting of the National Association of School Psychologists, Seattle, WA.
35. McGrew, K. S., Schrank, F. A., & Woodcock, R. W. (2007). Woodcock-Johnson III Normative Update technical manual. Rolling Meadows, IL: Riverside.
36. McGrew, K. S., & Wendling, B. J. (2010). Cattell-Horn-Carroll cognitive-achievement relations: What we have learned from the last 20 years of research. Psychology in the Schools, 47, 651-675.
37. McGrew, K. S., & Woodcock, R. W. (2001). Woodcock-Johnson III technical manual. Itasca, IL: Riverside.
38. Mundform, D. J., Perett, J. J., Schaffer, J., Piccone, A., & Roozeboom, M. (2006). Bonferroni adjustments in tests for regression coefficients. Multiple Linear Regression Viewpoints, 32, 1-6. Retrieved from http://mlrv.ua.edu/2006/Mundfrom-etal-MLRV-3.pdf
39. Nelson, J. M., & Canivez, G. L. (2012). Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample. Psychological Assessment, 24, 129-140. http://dx.doi.org/10.1037/a0024878
40. Nelson, J. M., Canivez, G. L., & Watkins, M. W. (2013). Structural and incremental validity of the Wechsler Adult Intelligence Scale-Fourth Edition with a clinical sample. Psychological Assessment, 25, 618-630. http://dx.doi.org/10.1037/a0032086
41. Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction (3rd ed.). New York, NY: Holt, Rinehart, & Winston.
42. Sandoval, J. (2003). Review of the Woodcock-Johnson III. In B. S. Plake & J. C. Impara (Eds.), The fifteenth mental measurements yearbook (pp. 1024-1028). Lincoln, NE: Buros Institute of Mental Measurements.
43. Schmid, J., & Leiman, J. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. http://dx.doi.org/10.1007/BF02289209
44. Schneider, W. J. (2008). Playing statistical ouija board with commonality analysis: Good questions, wrong assumptions. Applied Neuropsychology, 15, 44-53. http://dx.doi.org/10.1080/09084280801917566
45. Schneider, W. J., & McGrew, K. S. (2012). The Cattell-Horn-Carroll model of intelligence. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed., pp. 99-144). New York, NY: Guilford Press.
46. Spearman, C. (1904). "General intelligence," objectively determined and measured. The American Journal of Psychology, 15, 201-293. http://dx.doi.org/10.2307/1412107
47. Tabachnick, B. G., & Fiddell, L. S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Pearson.
48. Taub, G. E., Floyd, R. G., Keith, T. Z., & McGrew, K. S. (2008). Effects of general and broad cognitive abilities on mathematics achievement. School Psychology Quarterly, 23, 187-198. http://dx.doi.org/10.1037/1045-3830.23.2.187
49. Weiner, I. B. (1989). On competence and ethicality in psychodiagnostic assessment. Journal of Personality Assessment, 53, 827-831. http://dx.doi.org/10.1207/s15327752jpa5304_18
50. Wendling, B. J., Mather, N., & Schrank, F. A. (2009). Woodcock-Johnson III Tests of Cognitive Abilities. In J. A. Naglieri & S. Goldstein (Eds.), Practitioner's guide to assessing intelligence and achievement (pp. 191-229). Hoboken, NJ: Wiley.
51. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001a). Woodcock-Johnson III. Itasca, IL: Riverside.
52. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001b). Woodcock-Johnson III Tests of Achievement. Itasca, IL: Riverside.
53. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001c). Woodcock-Johnson III Tests of Cognitive Abilities. Itasca, IL: Riverside.
54. Yin, P., & Fan, X. (2001). Estimating R2 shrinkage in multiple regression: A comparison of different analytical methods. Journal of Experimental Education, 69, 203-224. http://dx.doi.org/10.1080/00220970109600656
55. Youngstrom, E. A., Kogos, J. L., & Glutting, J. J. (1999). Incremental efficacy of Differential Ability Scales factor scores in predicting individual achievement criteria. School Psychology Quarterly, 14, 26-39. http://dx.doi.org/10.1037/h0088996