Construct validity of the WISC-IV with a referred sample: Direct versus indirect hierarchical structures

School Psychology Quarterly

Volumn 29, Issue 1, 2014, Pages 38-51

  Canivez, Gary L ^a  

^a EASTERN ILLINOIS UNIVERSITY   (United States)

Author keywords

Confirmatory factor analysis; Hierarchical CFA; Intelligence; Wisc iv

Indexed keywords

ADOLESCENT; BAYES THEOREM; CHILD; FACTORIAL ANALYSIS; FEMALE; HUMAN; INTELLIGENCE; LEARNING DISORDERS; MALE; PSYCHOMETRY; REPRODUCIBILITY; VALIDATION STUDY; WECHSLER INTELLIGENCE SCALE;

ADOLESCENT; BAYES THEOREM; CHILD; FACTOR ANALYSIS, STATISTICAL; FEMALE; HUMANS; INTELLIGENCE; LEARNING DISORDERS; MALE; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; WECHSLER SCALES;

EID: 84897950607     PISSN: 10453830     EISSN: None     Source Type: Journal    
DOI: 10.1037/spq0000032     Document Type: Article

References (83)

1. Alfonso, V. C., Oakland, T. D., LaRocca, R., & Spanakos, A. (2000). The course on individual cognitive assessment. School Psychology Review, 29, 52-64.
2. Alfonso, V. C., & Pratt, S. I. (1997). Issues and suggestions for training professionals in assessing intelligence. In D. P. Flanagan, J. L. Genshaft, & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 326-344). New York, NY: Guilford Press.
3. Belter, R. W., & Piotrowski, C. (2001). Current status of doctoral-level training in psychological testing. Journal of Clinical Psychology, 57, 717-726
4. Benson, N., Hulac, D. M., & Kranzler, J. H. (2010). Independent examination of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV): What does the WAIS-IV measure? Psychological Assessment, 22, 121-130
5. Bentler, P. M., & Wu, E. J. C. (2012). EQS for Windows. Encino CA: Multivariate Software.
6. Bodin, D., Pardini, D. A., Burns, T. G., & Stevens, A. B. (2009). Higher order factor structure of the WISC-IV in a clinical neuropsychological sample. Child Neuropsychology, 15, 417-424
7. Brunner, M., Nagy, G., & Wilhelm, O. (2012). A tutorial on hierarchically structured constructs. Journal of Personality, 80, 796-846
8. Byrne, B. M. (2006). Structural equation modeling with EQS (2nd ed.). Mahwah, NJ: Erlbaum.
9. Canivez, G. L. (2008). Hierarchical factor structure of the Stanford-Binet Intelligence Scales-Fifth Edition. School Psychology Quarterly, 23, 533-541
10. Canivez, G. L. (2011). Hierarchical factor structure of the Cognitive Assessment System: Variance partitions from the Schmid-Leiman (1957). procedure. School Psychology Quarterly, 26, 305-317.
11. Canivez, G. L. (2013). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In D. H. Saklofske, C. R. Reynolds, & V. L. Schwean (Eds.), The Oxford handbook of child psychological assessments (pp. 84-112). New York, NY: Oxford University Press
12. Canivez, G. L., Konold, T. R., Collins, J. M., & Wilson, G. (2009). Construct validity of the Wechsler Abbreviated Scale of Intelligence and Wide Range Intelligence Test: Convergent and structural validity. School Psychology Quarterly, 24, 252-265
13. Canivez, G. L., & Kush, J. C. (2013). WISC-IV and WAIS-IV structural validity: Alternate methods, alternate results. Commentary on Weiss et al. (2013a) and Weiss et al. (2013b). Journal of Psychoeducational Assessment, 31, 157-169
14. Canivez, G. L., & Watkins, M. W. (1998). Long term stability of the Wechsler Intelligence Scale for Children-Third Edition. Psychological Assessment, 10, 285-291
15. Canivez, G. L., & Watkins, M. W. (2010a). Investigation of the factor structure of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV): Exploratory and higher order factor analyses. Psychological Assessment, 22, 827-836
16. Canivez, G. L., & Watkins, M. W. (2010b). Exploratory and higher-order factor analyses of the Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) adolescent subsample. School Psychology Quarterly, 25, 223-235
17. Carroll, J. B. (1993). Human cognitive abilities. Cambridge, England: Cambridge University Press.
18. Carroll, J. B. (1995). On methodology in the study of cognitive abilities. Multivariate Behavioral Research, 30, 429-452
19. Carroll, J. B. (2003). The higher-stratum structure of cognitive abilities: Current evidence supports g and about ten broad factors. In H. Nyborg (Ed.), The scientific study of general intelligence: Tribute to Arthur R. Jensen (pp. 5-21). New York, NY: Pergamon Press
20. Cattell, R. B., & Horn, J. L. (1978). A check on the theory of fluid and crystallized intelligence with description of new subtest designs. Journal of Educational Measurement, 15, 139-164
21. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
22. Chen, H., Keith, T. Z., Weiss, L., Zhu, J., & Li, Y. (2010). Testing for multigroup invariance of second-order WISC-IV structure across China, Hong Kong, Macau, and Taiwan. Personality and Individual Differences, 49, 677-682
23. Chen, H., & Zhu, J. (2012). Measurement invariance of WISC-IV across normative and clinical samples. Personality and Individual Differences, 52, 161-166
24. Chen, H.-Y., Keith, T. Z., Chen, Y.-H., & Chang, B.-S. (2009). What does the WISC-IV measure? Validation of the scoring and CHC-based interpretive approaches. Journal of Research in Education Sciences, 54, 85-108.
25. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255
26. Dombrowski, S. C., & Watkins, M. W. (2013). Exploratory and higher order factor analysis of the WJ-III full test battery: A school aged anal-ysis. Psychological Assessment. Advance online publication
27. Dombrowski, S. C., Watkins, M. W., & Brogan, M. J. (2009). An exploratory investigation of the factor structure of the Reynolds Intellectual Assessment Scales (RIAS). Journal of Psychoeducational Assessment, 27, 494-507
28. Georgas, J., van de Vijver, F. J. R., Weiss, L. G., & Saklofske, D. H. (2003). A cross-cultural analysis of the WISC-III. In J. Georgas, L. G. Weiss, & F. J. R. van de Vijver (Eds.), Culture and children's intelligence: Cross-cultural analysis of the WISC-III (pp. 278-312). San Diego, CA: Academic Press
29. Gignac, G. E. (2005). Revisiting the factor structure of the WAIS-R: Insights through nested factor modeling. Assessment, 12, 320-329
30. Gignac, G. E. (2006). The WAIS-III as a nested factors model: A useful alternative to the more conventional oblique and higher-order models. Journal of Individual Differences, 27, 73-86
31. Gignac, G. (2008). Higher-order models versus direct hierarchical models: g as superordinate or breadth factor? Psychology Science Quarterly, 50, 21-43.
32. Glutting, J. J., Adams, W., & Sheslow, D. (2000). Wide Range Intelligence Test: Manual. Wilmington, DE: Wide Range.
33. Goh, D. S., Teslow, C. J., & Fuller, G. B. (1981). The practice of psychological assessment among school psychologists. Professional Psychology, 12, 696-706
34. Golay, P., & Lecerf, T. (2011). Orthogonal higher order structure and confirmatory factor analysis of the French Wechsler Adult Intelligence Scale (WAIS-III). Psychological Assessment, 23, 143-152
35. Golay, P., Reverte, I., Rossier, J., Favez, N., & Lecerf, T. (2012). Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling. Psychological Assessment. Advance online publication
36. Gorsuch, R. L. (1988). Exploratory factor analysis. In J. R. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 231-258). New York, NY: Plenum Press
37. Holzinger, K. J., & Swineford, F. (1937). The bi-factor method. Psychometrika, 2, 41-54
38. Horn, J. L. (1991). Measurement of intellectual capabilities: A review of theory. In K. S. McGrew, J. K. Werder, & R. W. Woodcock (Eds.), Woodcock-Johnson technical manual (rev. ed., pp. 197-232). Itasca, IL: Riverside.
39. Horn, J. L., & Cattell, R. B. (1966). Refinement and test of the theory of fluid and crystallized general intelligence. Journal of Educational Psychology, 57, 253-270
40. Hu, L.-T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to under parameterized model misspecification. Psychological Methods, 3, 424-453
41. Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55
42. Hutton, J. B., Dubes, R., & Muir, S. (1992). Assessment practices of school psychologists: Ten years later. School Psychology Review, 21, 271-284.
43. Kaufman, A. S., & Lichtenberger, E. O. (2000). Essentials of WISC-III and WPPSI-R assessment. New York, NY: Wiley.
44. Keith, T. Z. (2005). Using confirmatory factor analysis to aid in understanding the constructs measured by intelligence tests. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 581-614). New York, NY: Guilford Press.
45. Keith, T. Z., Fine, J. G., Taub, G. E., Reynolds, M. R., & Kranzler, J. H. (2006). Higher-order, multi-sample, confirmatory factor analysis of the Wechsler Intelligence Scale for Children-Fourth Edition: What does it measure. School Psychology Review, 35, 108-127.
46. Lecerf, T., Rossier, J., Favez, N., Reverte, I., & Coleaux, L. (2010). The four-vs. alternative sixfactor structure of the French WISC-IV. Swiss Journal of Psychology/Schweizerische Zeitschrift für Psychologie/Revue Suisse de Psychologie, 69, 221-232
47. Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57, 519-530
48. Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesistesting approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999). findings. Structural Equation Modeling, 11, 320-341
49. McGrew, K. S. (1997). Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework. In D. P. Flanagan, J. L. Genshaft, & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 151-179). New York, NY: Guilford Press.
50. McGrew, K. S. (2005). The Cattell-Horn-Carroll theory of cognitive abilities: Past, present, and future. In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 136-181). New York, NY: Guilford Press.
51. McGrew, K. S., & Woodcock, R. W. (2001). Technical manual. Woodcock-Johnson III. Itasca, IL: Riverside Publishing.
52. Naglieri, J. A., & Das, J. P. (1997). Cognitive Assessment System: Interpretive handbook. Itasca, IL: Riverside Publishing.
53. Nelson, J. M., & Canivez, G. L. (2012). Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample. Psychological Assessment, 24, 129-140
54. Nelson, J. M., Canivez, G. L., Lindstrom, W., & Hatt, C. (2007). Higher-order exploratory factor analysis of the Reynolds Intellectual Assessment Scales with a referred sample. Journal of School Psychology, 45, 439-456
55. Niileksela, C. R., Reynolds, M. R., & Kaufman, A. S. (2012). An alternative Cattell-Horn-Carroll (CHC) factor structure of the WAIS-IV: Age invariance of an alternative model for ages 70-90. Psychological Assessment. Advance online publication.
56. Pfeiffer, S. I., Reddy, L. A., Kletzel, J. E., Schmelzer, E. R., & Boyer, L. M. (2000). The practitioner's view of IQ testing and profile analysis. School Psychology Quarterly, 15, 376-385
57. Prifitera, A., Saklofske, D. H., & Weiss, L. G. (2008). WISC-IV clinical use and interpretation: Scientist-practitioner perspectives (2nd ed.). San Diego, CA: Academic Press.
58. Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696
59. Reynolds, C. R., & Kamphaus, R. W. (2003). Reynolds Intellectual Assessment Scales. Lutz, FL: Psychological Assessment Resources.
60. Roid, G. (2003). Stanford-Binet Intelligence Scales: Fifth Edition. Itasca, IL: Riverside Publishing.
61. Schmid, J., & Leiman, J. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61
62. Spearman, C. (1904). "General intelligence": Objectively determined and measured. The American Journal of Psychology, 15, 201-293
63. Spearman, C. (1927). The abilities of man. New York, NY: Cambridge.
64. Stinnett, T. A., Havey, J. M., & Oehler-Stinnett, J. (1994). Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment, 12, 331-350.
65. Watkins, C. E., Jr., Campbell, V. L., Nieberding, R., & Hallmark, R. (1995). Contemporary practice of psychological assessment by clinical psychologists. Professional Psychology: Research and Practice, 26, 54-60
66. Watkins, M. W. (2006). Orthogonal higher order structure of the Wechsler Intelligence Scale for Children-Fourth Edition. Psychological Assessment, 18, 123-125
67. Watkins, M. W. (2010). Structure of the Wechsler Intelligence Scale for Children-Fourth Edition among a national sample of referred students. Psychological Assessment, 22, 782-787
68. Watkins, M. W. (2013). Omega [Computer software]. Phoenix, AZ: Ed. & Psych Associates.
69. Watkins, M. W., Canivez, G. L., James, T., James, K., & Good, R. (in press). Construct validity of the WISC-IVUK with a large referred Irish sample. International Journal of School and Educational Psychology.
70. Watkins, M. W., Wilson, S. M., Kotz, K. M., Carbone, M. C., & Babula, T. (2006). Factor structure of the Wechsler Intelligence Scale for Children-Fourth Edition among referred students. Educational and Psychological Measurement, 66, 975-983
71. Wechsler, D. (1939). The measurement of adult intelligence. Baltimore, MD: Williams & Wilkins.
72. Wechsler, D. (1958). The measurement and appraisal of adult intelligence (4th ed.). Baltimore, MD: Williams & Wilkins
73. Wechsler, D. (1991). Manual for the Wechsler Intelligence Scale for Children-Third Edition. San Antonio, TX: Psychological Corporation.
74. Wechsler, D. (1999). Wechsler Abbreviated Scale of Intelligence. San Antonio, TX: Psychological Corporation.
75. Wechsler, D. (2003a). Wechsler Intelligence Scale for Children-Fourth Edition. San Antonio, TX: Psychological Corporation.
76. Wechsler, D. (2003b). Wechsler Intelligence Scale for Children-Fourth Edition: Technical and interpretive manual. San Antonio, TX: Psychological Corporation.
77. Wechsler, D. (2004). Wechsler Intelligence Scale for Children-Fourth UK Edition. London, England: Harcourt Assessment.
78. Weiss, L. G., Keith, T. Z., Zhu, J., & Chen, H. (2013a). WISC-IV and clinical validation of the four-and five-factor interpretative approaches. Journal of Psycheducational Assessment, 31, 114-131
79. Weiss, L. G., Keith, T. Z., Zhu, J., & Chen, H. (2013b). WAIS-IV and clinical validation of the four-and five-factor interpretative approaches. Journal of Psycheducational Assessment, 31, 94-113
80. Weiss, L. G., Saklofske, D. H., & Prifitera, A. (2005). Interpreting the WISC-IV index scores. In A. Prifitera, D. H. Saklofske, & L. G. Weiss (Eds.), WISC-IV clinical use and interpretation: Scientist-practitioner perspectives (pp. 71-100). New York, NY: Elsevier Academic Press
81. Weiss, L. G., Saklofske, D. H., Prifitera, A., & Holdnack, J. A. (2006). WISC-IV advanced clinical interpretation. San Diego, CA: Academic Press.
82. Williams, P. E., Weiss, L. G., & Rolfhus, E. L. (2003). Clinical validity (WISC-IV Tech. Rep. No. 3). San Antonio, TX: Psychological Corporation.
83. Woodcock, R. W., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III Psychoeducational Battery. Itasca, IL: Riverside.