Incremental validity of WISC-IVUK factor index scores with a referred Irish sample: Predicting performance on the WIAT-IIUK

British Journal of Educational Psychology

Volumn 84, Issue 4, 2014, Pages 667-684

  Canivez, Gary L ^a   Watkins, Marley W ^b   James, Trevor ^c   Good, Rebecca ^c   James, Kate ^c  

^a EASTERN ILLINOIS UNIVERSITY   (United States)

^b BAYLOR UNIVERSITY   (United States)

^c Agenda Communications and Conference Services   (Ireland)

Author keywords

Achievement prediction; Construct validity; Hierarchical multiple regression; Incremental validity; WIAT IIUK; WISC IVUK

Indexed keywords

ACHIEVEMENT; ADOLESCENT; CHILD; EDUCATIONAL STATUS; FEMALE; HUMAN; IRELAND; LEARNING DISORDERS; MALE; PATIENT REFERRAL; PSYCHOLOGY; PSYCHOMETRY; REFERENCE VALUE; REPRODUCIBILITY; STATISTICS AND NUMERICAL DATA; WECHSLER INTELLIGENCE SCALE;

ACHIEVEMENT; ADOLESCENT; CHILD; EDUCATIONAL STATUS; FEMALE; HUMANS; IRELAND; LEARNING DISORDERS; MALE; PSYCHOMETRICS; REFERENCE VALUES; REFERRAL AND CONSULTATION; REPRODUCIBILITY OF RESULTS; WECHSLER SCALES;

EID: 84910635237     PISSN: 00070998     EISSN: 20448279     Source Type: Journal    
DOI: 10.1111/bjep.12056     Document Type: Article

References (99)

1. American Educational Research Association, American Psychological Association, and the National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: Author.
2. Binet, A., & Simon, T. (1904). Methodes nouvelles pour le diagnostic du niveau intellectuel des anormaux [New methods for the diagnosis of abnormal intellectual level]. L'annee Psychologique, 11, 191-244. doi:10.3406/psy.1904.3675
3. Bodin, D., Pardini, D. A., Burns, T. G., & Stevens, A. B. (2009). Higher order factor structure of the WISC-IV in a clinical neuropsychological sample. Child Neuropsychology, 15, 417-424.
4. Brody, N. (2002). g and the one-many problem: Is one enough? In G. R. Bock, J. A. Goode & K. Webb (Eds.), The nature of intelligence (Novartis Foundation Symposium 233) (pp. 122-135). New York, NY: Wiley.
5. Brown, R. T., Reynolds, C. R., & Whitaker, J. S. (1999). Bias in mental testing since Bias in Mental Testing. School Psychology Quarterly, 14, 208-238. doi:10.1037/h0089007
6. Canivez, G. L. (2008). Orthogonal hierarchical factor structure of the Stanford-Binet Intelligence Scales-Fifth Edition for children and adolescents. School Psychology Quarterly, 23, 533-541. doi:10.1037/a0012884
7. Canivez, G. L. (2011). Hierarchical factor structure of the Cognitive Assessment System: Variance partitions from the Schmid-Leiman (1957) procedure. School Psychology Quarterly, 26, 305-317. doi:10.1037/a0025973
8. Canivez, G. L. (2013a). Incremental validity of WAIS-IV factor index scores: Relationships with WIAT-II and WIAT-III subtest and composite scores. Psychological Assessment, 25, 484-495. doi:10.1037/a0032092
9. Canivez, G. L. (2013b). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In D. H. Saklofske, C. R. Reynolds & V. L. Schwean (Eds.), The Oxford handbook of child psychological assessments (pp. 84-112). New York, NY: Oxford University Press.
10. Canivez, G. L. (2014). Construct validity of the WISC-IV with a referred sample: Direct versus indirect hierarchical structures. School Psychology Quarterly, 29, 38-51. doi:10.1037/spq0000032
11. Canivez, G. L., Konold, T. R., Collins, J. M., & Wilson, G. (2009). Construct validity of the Wechsler Abbreviated Scale of Intelligence and Wide Range Intelligence Test: Convergent and structural validity. School Psychology Quarterly, 24, 252-265. doi:10.1037/a0018030
12. Canivez, G. L., & Watkins, M. W. (1998). Long term stability of the Wechsler Intelligence Scale for Children-Third Edition. Psychological Assessment, 10, 285-291. doi:10.1037/1040-3590.10.3.285
13. Canivez, G. L., & Watkins, M. W. (2010a). Investigation of the factor structure of the Wechsler Adult Intelligence Scale - Fourth Edition (WAIS-IV): Exploratory and higher order factor analyses. Psychological Assessment, 22, 827-836. doi:10.1037/a0020429
14. Canivez, G. L., & Watkins, M. W. (2010b). Exploratory and higher-order factor analyses of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) adolescent subsample. School Psychology Quarterly, 25, 223-235. doi:10.1037/a0022046
15. Carroll, J. B. (1993). Human cognitive abilities. Cambridge, UK: Cambridge University Press. doi:10.1017/CBO9780511571312
16. Carroll, J. B. (1995). On methodology in the study of cognitive abilities. Multivariate Behavioral Research, 30, 429-452. doi:10.1207/s15327906mbr3003_6
17. Carroll, J. B. (1997). Theoretical and technical issues in identifying a factor of general intelligence. In B. Devlin, S. E. Fienberg, D. P. Resnick & K. Roeder (Eds.), Intelligence, genes, and success: Scientists respond to the bell curve (pp. 125-156). New York, NY: Springer-Verlag. doi:10.1007/978-1-4612-0669-9_6
18. Central Statistics Office (2013). Retrieved from http://www.cso.ie/px/pxeirestat/Statire/SelectVarVal/Define.asp?maintable=CD204
19. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. (2nd ed.) Hillsdale, NJ: Lawrence Erlbaum.
20. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334. doi:10.1007/BF02310555
21. Dana, J., & Dawes, R. M. (2007). Comment on Fiorello et al. "Interpreting intelligence test results for children with disabilities: Is global intelligence relevant?". Applied Neuropsychology, 14, 21-25. doi:10.1080/09084280701280379
22. Deary, I. J., Strand, S., Smith, P., & Fernandes, C. (2007). Intelligence and educational achievement. Intelligence, 35, 13-21. doi:10.1016/j.intell.2006.02.001.
23. Dombrowski, S. C. (2013). Investigating the structure of the WJ-III Cognitive at school age. School Psychology Quarterly, 28, 154-169. doi:10.1037/spq0000010
24. Dombrowski, S. C. (2014a). Exploratory bifactor analysis of the WJ-III Cognitive in adulthood via the Schmid-Leiman procedure. Journal of Psychoeducational Assessment, 32, 330-341. doi:10.1177/0734282913508243
25. Dombrowski, S. C. (2014b). Investigating the structure of the WJ-III Cognitive in early school age through two exploratory bifactor analysis procedures. Journal of Psychoeducational Assessment, 32, 483-494. doi:10.1177/0734282914530838
26. Dombrowski, S. C., & Watkins, M. W. (2013). Exploratory and higher order factor analysis of the WJ-III full test battery: A school aged analysis. Psychological Assessment, 25, 442-455. doi:10.1037/a0031335
27. Dombrowski, S. C., Watkins, M. W., & Brogan, M. J. (2009). An exploratory investigation of the factor structure of the Reynolds Intellectual Assessment Scales (RIAS). Journal of Psychoeducational Assessment, 27, 494-507. doi:10.1177/0734282909333179
28. Elliott, C. D. (2007). Differential Ability Scales-Second Edition: Introductory and technical handbook. San Antonio, TX: The Psychological Corporation.
29. Ford, G., Andrews, R., Booth, A., Dibdin, J., Hardingham, S., & Kelly, T. P. (2008). Screening for learning disability in an adolescent forensic population. The Journal of Forensic Psychiatry & Psychology, 3, 371-381. doi:10.1080/14789940802120944
30. Freberg, M. E., Vandiver, B. J., Watkins, M. W., & Canivez, G. L. (2008). Significant factor score variability and the validity of the WISC-III Full Scale IQ in predicting later academic achievement. Applied Neuropsychology, 15, 131-139. doi:10.1080/09084280802084010
31. Gignac, G. E. (2005). Revisiting the factor structure of the WAIS-R: Insights through nested factor modeling. Assessment, 12, 320-329. doi:10.1177/1073191105278118
32. Gignac, G. E. (2006). The WAIS-III as a nested factors model: A useful alternative to the more conventional oblique and higher-order models. Journal of Individual Differences, 27, 73-86. doi:10.1027/1614-0001.27.2.73
33. Gignac, G. E., & Watkins, M. W. (2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48, 639-662. doi:10.1080/00273171.2013.804398
34. Glutting, J. J., Adams, W., & Sheslow, D. (2000). Wide Range Intelligence Test: Manual. Wilmington, DE: Wide Range Inc.
35. Glutting, J. J., Watkins, M. W., Konold, T. R., & McDermott, P. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. The Journal of Special Education, 40, 103-114. doi:10.1177/00224669060400020101
36. Glutting, J. J., Youngstrom, E. A., Ward, T., Ward, S., & Hale, R. L. (1997). Incremental efficacy of WISC-III factor scores in predicting achievement: What do they tell us? Psychological Assessment, 9, 295-301. doi:10.1037/1040-3590.9.3.295
37. Golay, P., & Lecerf, T. (2011). Orthogonal higher order structure and confirmatory factor analysis of the French Wechsler Adult Intelligence Scale (WAIS-III). Psychological Assessment, 23, 143-152. doi:10.1037/a0021230
38. Golay, P., Reverte, I., Rossier, J., Favez, N., & Lecerf, T. (2013). Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling (BSEM). Psychological Assessment, 25, 496-508. doi:10.1037/a0030676
39. Gordon, S., Duff, S., Davidson, T., & Whitaker, S. (2010). Comparison of the WAIS-III and WISC-IV in 16-year-old special education students. Journal of Applied Research in Intellectual Disabilities, 23, 197-200. doi:10.1111/j.1468-3148.2009.00538.x
40. Gottfredson, L. S. (1997). Intelligence and social policy. Intelligence, 24, 288-320. doi:10.1016/S0160-2896(97)90010-6
41. Gottfredson, L. S. (2008). Of what value is intelligence? In A. Prifitera, D. Saklofske & L. G. Weiss (Eds.), WISC-IV clinical assessment and intervention (2nd ed., pp. 545-564). Amsterdam, The Netherlands: Elsevier.
42. Gustafsson, J. E., & Undheim, J. O. (1996). Individual differences in cognitive functions. In D. C. Berliner & R. C. Calfee (Eds.), Handbook of educational psychology (pp. 186-242). New York, NY: Macmillan.
43. Hale, J. B., Fiorello, C. A., Kavanagh, J. A., Hodnack, J. A., & Aloe, A. M. (2007). Is the demise of IQ interpretation justified? A response to special issue authors. Applied Neuropsychology, 14, 37-51. doi:10.1080/09084280701280445
44. Haynes, S. N., & Lench, H. C. (2003). Incremental validity of new clinical assessment measures. Psychological Assessment, 15, 456-466. doi:10.1037/1040-3590.15.4.456
45. Hunsley, J. (2003). Introduction to the special section on incremental validity and utility in clinical assessment. Psychological Assessment, 15, 443-445. doi:10.1037/1040-3590.15.4.443
46. Hunsley, J., & Meyer, G. J. (2003). The incremental validity of psychological testing and assessment: Conceptual, methodological, and statistical issues. Psychological Assessment, 15, 446-455. doi:10.1037/1040- 3590.15.4.446
47. IBM Corp. (2011). IBM SPSS statistics for Mac, version 20.0. Armonk, NY: IBM Corp.
48. Jensen, A. R. (1998). The g factor: The science of mental ability. Westport, CT: Praeger.
49. Jones, W. T. (1952). A history of western philosophy. New York, NY: Harcourt, Brace.
50. Kahana, S. Y., Youngstrom, E. A., & Glutting, J. J. (2002). Factor and subtest discrepancies on the Differential Abilities Scale: Examining prevalence and validity in predicting academic achievement. Assessment, 9, 82-93. doi:10.1177/1073191102009001010
51. Kaufman, A. S., & Kaufman, N. L. (1993). Kaufman Adolescent and Adult Intelligence Test. Circle Pines, MN: American Guidance Service.
52. Kaufman, A. S., & Kaufman, N. L. (2004). Kaufman Assessment Battery for Children-Second Edition. Circle Pines, MN: AGS Publishing.
53. Kline, P. (1994). An easy guide to factor analysis. London, UK: Routledge.
54. Lubinski, D. (2000). Scientific and social significance of assessing individual differences: "Sinking shafts at a few critical points". Annual Review of Psychology, 51, 405-444. doi:10.1146/annurev.psych.51.1.405
55. Lubinski, D., & Dawis, R. V. (1992). Aptitudes, skills, and proficiencies. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 3, pp. 1-59). Palo Alto, CA: Consulting Psychology Press.
56. Lubinski, D., & Humphreys, L. G. (1997). Incorporating general intelligence into epidemiology and the social sciences. Intelligence, 24, 159-201. doi:10.1016/S0160-2896(97)90016-7
57. McFall, R. M. (2005). Theory and utility-Key themes in evidence-based assessment: Comment on the special section. Psychological Assessment, 17, 312-323. doi:10.1037/1040-3590.17.3.312
58. Meehl, P. E. (1959). Some ruminations on the validation of clinical procedures. Canadian Journal of Psychology, 13, 102-128. doi:10.1037/h0083769
59. Mullins-Sweatt, S. N., & Widiger, T. A. (2009). Clinical utility and DSM-V. Psychological Assessment, 21, 302-312. doi:10.1037/a0016607
60. Murray, A. L., & Johnson, W. (2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41, 407-422. doi:10.1016/j.intell.2013.06.004
61. Naglieri, J. A., & Bornstein, B. T. (2003). Intelligence and achievement: Just how correlated are they? Journal of Psychoeducational Assessment, 21, 244-260. doi:10.1177/073428290302100302
62. Naglieri, J. A., & Das, J. P. (1997). Cognitive Assessment System: Interpretive handbook. Itasca, IL: Riverside.
63. Neisser, U., Boodoo, G., Bouchard, Jr, T. J., Boykin, A. W., Brody, N., Ceci, S. J., ... Urbina, S. (1996). Intelligence: Knowns and unknowns. American Psychologist, 51, 77-101. doi:10.1037/0003-066X.51.2.77
64. Nelson, J. M., & Canivez, G. L. (2012). Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample. Psychological Assessment, 24, 129-140. doi:10.1037/a0024878
65. Nelson, J. M., Canivez, G. L., Lindstrom, W., & Hatt, C. (2007). Higher-order exploratory factor analysis of the Reynolds Intellectual Assessment Scales with a referred sample. Journal of School Psychology, 45, 439-456. doi:10.1016/j.jsp.2007.03.003
66. Nelson, J. M., Canivez, G. L., & Watkins, M. W. (2013). Structural and incremental validity of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) with a clinical sample. Psychological Assessment, 25, 618-630. doi:10.1037/a0032086
67. Niileksela, C. R., Reynolds, M. R., & Kaufman, A. S. (2013). An alternative Cattell-Horn-Carroll (CHC) factor structure of the WAIS-IV: Age invariance of an alternative model for ages 70-90. Psychological Assessment, 25, 391-404. doi:10.1037/a0031175
68. Oh, H. J., Glutting, J. J., Watkins, M. W., Youngstrom, E. A., & McDermott, P. A. (2004). Correct interpretation of latent versus observed abilities: Implications from structural equation modeling applied to the WISC-III and WIAT linking sample. The Journal of Special Education, 38, 159-173. doi:10.1177/00224669040380030301
69. Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction. (3rd ed.) New York, NY: Harcourt Brace.
70. Reynolds, C. R., & Kamphaus, R. W. (2003). Reynolds Intellectual Assessment Scales. Lutz, FL: Psychological Assessment Resources Inc.
71. Roid, G. H. (2003). Stanford-Binet Intelligence Scales-Fifth Edition: Technical manual. Itasca, IL: Riverside Publishing.
72. Ryan, J. J., Kreiner, D. S., & Burton, D. B. (2002). Does high scatter affect the predictive validity of WAIS-III IQs? Applied Neuropsychology, 9, 173-178. doi:10.1207/S15324826AN0903_5
73. Schneider, J. (2008). Playing statistical Ouija Board with commonality analysis (and other errors). Applied Neuropsychology, 15, 44-53. doi:10.1080/09084280801917566
74. Sechrest, L. (1963). Incremental validity: A recommendation. Educational and Psychological Measurement, 23, 153-158. doi:10.1177/001316446302300113
75. Thorndike, R. L. (1986). The role of general ability in prediction. Journal of Vocational Behavior, 29, 332-339. doi:10.1016/0001- 8791(86)90012-6
76. Watkins, M. W. (2006). Orthogonal higher order structure of the Wechsler Intelligence Scale for Children-Fourth Edition. Psychological Assessment, 18, 123-125. doi:10.1037/1040-3590.18.1.123
77. Watkins, M. W. (2010). Structure of the Wechsler Intelligence Scale for Children - Fourth Edition among a national sample of referred students. Psychological Assessment, 22, 782-787. doi:10.1037/a0020043
78. Watkins, M. W., & Beaujean, A. A. (2014). Bifactor structure of the Wechsler Preschool and Primary Scale of Intelligence - Fourth Edition. School Psychology Quarterly, 29, 52-63. doi:10.1037/spq0000038
79. Watkins, M. W., & Canivez, G. L. (2004). Temporal stability of WISC-III subtest composite strengths and weaknesses. Psychological Assessment, 16, 133-138. doi:10.1037/1040-3590.16.2.133
80. UK with a large referred Irish sample. International Journal of School and Educational Psychology, 1, 102-111. doi:10.1080/21683603.2013.794439
81. Watkins, M. W., Glutting, J. J., & Lei, P.-W. (2007). Validity of the full-scale IQ when there is significant variability among WISC-III and WISC-IV factor scores. Applied Neuropsychology, 14, 13-20. doi:10.1080/09084280701280353
82. Watkins, M. W., Lei, P., & Canivez, G. L. (2007). Psychometric intelligence and achievement: A cross-lagged panel analysis. Intelligence, 35, 59-68. doi:10.1016/j.intell.2006.04.005
83. Watkins, M. W., & Smith, L. (2013). Long-term stability of the Wechsler Intelligence Scale for Children-Fourth Edition. Psychological Assessment, 25, 477-483. doi:10.1037/a0031653
84. Watkins, M. W., Wilson, S. M., Kotz, K. M., Carbone, M. C., & Babula, T. (2006). Factor structure of the Wechsler Intelligence Scale for Children-Fourth Edition among referred students. Educational and Psychological Measurement, 66, 975-983. doi:10.1177/0013164406288168
85. Wechsler, D. (2003a). Wechsler Intelligence Scale for Children - Fourth Edition. San Antonio, TX: Psychological Corporation.
86. Wechsler, D. (2003b). Wechsler Intelligence Scale for Children - Fourth Edition: Technical and interpretive manual. San Antonio, TX: Psychological Corporation.
87. Wechsler, D. (2004a). Wechsler Intelligence Scale for Children - Fourth UK Edition. London, UK: Harcourt Assessment.
88. Wechsler, D. (2004b). Wechsler Intelligence Scale for Children - Fourth UK Edition: Administration and scoring manual. London, UK: Harcourt Assessment.
89. Wechsler, D. (2005a). Wechsler Individual Achievement Test-Second UK Edition. London, UK: Pearson.
90. Wechsler, D. (2005b). Wechsler Individual Achievement Test-Second UK Edition: Examiners manual. London, UK: Pearson.
91. Wechsler, D. (2005c). Wechsler Individual Achievement Test-Second UK Edition: UK scoring and normative supplement. London, UK: Pearson.
92. Wechsler, D. (2008a). Wechsler Adult Intelligence Scale-Fourth Edition. San Antonio, TX: Pearson.
93. Wechsler, D. (2008b). Wechsler Adult Intelligence Scale-Fourth Edition: Technical and interpretive manual. San Antonio, TX: Pearson.
94. Wechsler, D., & Naglieri, J. A. (2006). Wechsler Nonverbal Scale of Ability. San Antonio, TX: The Psychological Corporation.
95. Weiner, I. B. (2003). Prediction and postdiction in clinical decision making. Clinical Psychology: Science and Practice, 10, 335-338. doi:10.1093/clipsy.bpg030
96. Weiss, L. G., & Prifitera, A. (1995). An evaluation of differential prediction of WIAT achievement scores from WISC-III FSIQ across ethnic and gender groups. Journal of School Psychology, 33, 297-304. doi:10.1016/0022-4405(95)00016-F
97. Wiggins, J. S. (1988). Personality and prediction: Principles of personality assessment. Malabar, FL: Krieger Publishing Company.
98. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III Tests of Cognitive Abilities. Itasca, IL: Riverside Publishing.
99. Youngstrom, E. A., Kogos, J. L., & Glutting, J. J. (1999). Incremental efficacy of Differential Ability Scales factor scores in predicting individual achievement criteria. School Psychology Quarterly, 14, 26-39. doi:10.1037/h0088996