Myth of the master detective: Reliability of interpretations for Kaufman's "intelligent testing" approach to the WISC-III

School Psychology Quarterly

Volumn 12, Issue 3, 1997, Pages 197-234

  Macmann, Gregg M ^a   Barnett, David W ^b  

^a UNIVERSITY OF KENTUCKY   (United States)

^b UNIVERSITY OF CINCINNATI   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 17744370182     PISSN: 10453830     EISSN: None     Source Type: Journal    
DOI: 10.1037/h0088959     Document Type: Article

References (75)

1. American Educational Research Association, American Psychological Association, National Council on Measurement in Education (1985). Standards for educational and psychological testing. Washington, DC: Author.
2. Anastasi, A. (1976). Psychological testing (4th ed.). New York: Macmillan.
3. Atkinson, L. (1991). Mental retardation and WAIS-R difference scores. Journal of Mental Deficiency Research, 35, 537-542.
4. Bagnato, S. J., & Neisworth, J. T. (1994). A national study of the social and treatment invalidity of intelligence testing for early intervention. School Psychology Quarterly, 9, 81-102.
5. Barnett, D. W. (1988). Professional judgment: A critical appraisal. School Psychology Review, 17, 656-670.
6. Barnett, D. W., & Carey, K. T. (1992). Designing interventions for preschool learning and behavior problems. San Francisco: Jossey Bass.
7. Barnett, D. W., & Macmann, G. M. (1992a). Aptitude-achievement discrepancy scores: Accuracy in analysis misdirected. School Psychology Review, 21, 494-508.
8. Barnett, D. W., & Macmann, G. M. (1992b). Decision reliability and validity: Contributions and limitations of alternative assessment strategies. The Journal of Special Education, 25, 431-452.
9. Barnett, D. W., & Zucker, K. B. (1990). The personal and social assessment of children: Current status and professional practice issues. Boston: Allyn & Bacon.
10. Bauman, E. (1991). Stability of WISC-R scores in children with learning disabilities. Psychology in the Schools, 25, 95-100.
11. Bentler, P. M. (1993). EQS structural equations program manual. Los Angeles: BMDP Statistical Software.
12. Bracken, B. A., Howell, K. K., Harrison, T. E., Stanford, L. D., and Zahn, B. H. (1991). Ipsative subtest pattern stability of the Bracken Basic Concept Scale and the Kaufman Assessment Battery for Children in a preschool sample. School Psychology Review, 20, 315-330.
13. Brennan, R. L., & Prediger, D. J. (1981). Coefficient kappa: Some uses, misuses, and alternatives. Educational and Psychological Measurement, 41, 687-699.
14. Campbell, B., & Wilson, B. J. (1986). An investigation of Kaufman's method for determining scatter on the WISC-R. Journal of School Psychology, 24, 373-380.
15. Cattell, R. B. (1944). Psychological measurement: Normative, ipsative, interactive. Psychological Review, 51, 292-303.
16. Christenson, S. L., Ysseldyke, J. E., & Thurlow, M. L. (1989). Critical instructional factors for students with mild handicaps: An integrative review. Remedial and Special Education, 10, 21-31.
17. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
18. Cohen, J. (1983). The cost of dichotomization. Applied Psychological Measurement, 7, 249-253.
19. Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
20. Cook, T. D. (1985). Postpositivist critical multiplism. In R. L. Shetland & M. M. Mark (Eds.), Social science and social policy (pp. 21-62). Beverly Hill, CA: Sage.
21. Cronbach, L. J., Gleser, G. C., Nanda, N., and Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
22. Cronbach, L. J., & Snow, R. E. (1977). Aptitudes and instructional methods: A handbook for research on interactions. New York: Irvington.
23. Dawes, R. M. (1994). House of cards: Psychology and psychotherapy built on myth. New York: Free Press.
24. Dice, L. R. (1945). Measures of ecologic association between species. Ecology, 26, 297-302.
25. Evans, I. M. (1993). Constructional perspectives in clinical assessment. Psychological Assessment, 5, 264-272.
26. Gerber, M. M., & Semmel, M. I. (1984). Teacher as imperfect test: Reconceptualizing the referral process. Educational Psychologist, 19, 137-148.
27. Glutting, J. J., & McDermott, P. A. (1988). Generality of test-session observations to kindergartners' classroom behavior. Journal of Abnormal Child Psychology, 16, 527-537.
28. Glutting, J. J., Oakland, T., & McDermott, P. A. (1989). Observing child behavior during testing: Constructs, validity, and siruational generality. Journal of School Psychology, 27, 155-164.
29. Good, R. H., Vollmer, M., Creek, R. J., Katz, L., & Chowdri, S. (1993). Treatment utility of the Kaufman Assessment Battery for Children: Effects of matching instruction and student processing strength. School Psychology Review, 22, 8-26.
30. Gordon, M., DiNiro, D., Mettelman, B. B., & Tallmadge, J. (1989). Observations of test behavior, quantitative scores, and teacher ratings. Journal of Psychoeducational Assessment, 7, 141-147.
31. Graden, J., Curtis, M. J., & Zins, J. E. (Eds.) (1988). Alternative educational delivery systems: Enhancing instructional options for all students. Washington, DC: National Association of School Psychologists.
32. Gresham. F. M., & Witt, J. C. (1997). Utility of intelligence tests for treatment planning, classification, and placement decisions: Recent empirical findings and future directions. School Psychology Quarterly, 12, 000-000.
33. Kaplan, C. (1993). Reliability and validity of test-session behavior observations: Putting the cart before the horse. Journal of Psychoeducational Assessment, 11, 314-322.
34. Kamphaus, R. W. (1993). Clinical assessment of children's intelligence. Boston: Allyn & Bacon.
35. Kaufman, A. S. (1979). Intelligent testing with the WISC-R. New York: Wiley.
36. Kaufman, A. S. (1990). Assessing adolescent and adult intelligence. Boston: Allyn & Bacon.
37. Kaufman, A. S. (1994). Intelligent testing with the WISC-III. New York: Wiley.
38. Kavale, K. (1990). Effectiveness of special education. In T. B. Gutkin & C. R. Reynolds (Eds.), The handbook of school psychology (2nd ed., pp. 870-900). New York: Wiley.
39. Kovaleski, J. F., Tucker, J. A., & Duffy, D. J. (1995). School reform through instructional support: The Pennsylvania initiative. NASP Communique, 23(8).
40. Kramer, J. J., Henning-Stout, M., Ullman, D. P., & Schellenberg, R. P. (1987). The viability of scatter analysis on the WISC-R and SBIS: Examining a vestige. Journal of Psychoeducational Assessment, 5, 37-47.
41. Lentz, F. E., Allen, S. J., & Ehrhardt, K. E. (1996). The conceptual elements of strong interventions in school settings. School Psychology Quarterly, 11, 118-136.
42. Macmann, G. M., & Barnett, D. W. (1994a). Structural analysis of correlated factors: Lessons from the verbal-performance dichotomy of the Wechsler scales. School Psychology Quarterly, 9, 161-197.
43. Macmann, G. M., & Barnett, D. W. (1994b). Some additional lessons from the Wechsler scales: A rejoinder to Kaufman and Keith. School Psychology Quarterly, 9, 223-236.
44. Macmann, G. M., Barnett, D. W., Allen, S. J., Bramlett, R. K., Hall, J. D., Ehrhardt, K. E. (1996). Problem solving and intervention design: Guidelines for the evaluation of technical adequacy. School Psychology Quarterly, 11, 137-148.
45. Macmann, G. M., Barnett, D. W., Lombard, T. J., Belton-Kocher, E., & Sharpe, M. N. (1989). On the actuarial classification of children: Fundamental studies of classification agreement. The Journal of Special Education, 23, 127-149.
46. Macmann, G. M., Barnett, D. W., & Lopez, E. J. (1993). The Child Behavior Checklist/4-18 and related materials: Reliability and validity of syndromal assessment. School Psychology Review, 22, 322-333.
47. Macmann, G. M., Plasket, C. M., Barnett, D. W., & Siler, R. F. (1991). The factor structure of the WISC-R for children of superior intelligence. Journal of School Psychology, 29, 19-36.
48. McDermott, P. A., Fantuzzo, J. W., & Glutting, J. J. (1990). Just say no to subtest analysis: A critique of Wechsler theory and practice. Journal of Psychoeducational Assessment, 8, 290-302.
49. McDermott, P. A., Fantuzzo, J. W., Glutting, J. J., Watkins, M. W., & Baggaley, A. R. (1992). Illusions of meaning in the ipsative assessment of children's ability. The Journal of Special Education, 25, 504-526.
50. Meehl, P. & Rosen, A. (1955). Antecedent probability and the efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin, 52, 194-216.
51. Merluzzi, T. V., Glass, C. R., & Genest, M. (Eds.) (1981). Cognitive assessment. New York: Guilford.
52. Mischel, W. (1973). Toward a cognitive social learning reconceptualization of personality. Psychological Review, 80, 252-283.
53. Mischel, W. (1981). A cognitive-social learning approach to assessment. In T. V. Merluzzi, C. R. Glass, & M. Genest (Eds.), Cognitive assessment (pp. 479-502). New York: Guilford.
54. Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
55. Reschly, D. J., & Grimes, J. P. (1995). Best practices in intellectual assessment. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology - III (pp. 763-773). Washington, DC: National Association of School Psychologists.
56. Reschly, D. J., & Tilly, W. D. (1993). The WHY of system reform. NASP Communique, pp. 1, 4-6.
57. Reschly, D. J., & Yssyldyke, J. E. (1995). School psychology paradigm shift. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology - III (pp. 17-31). Washington, DC: National Association of School Psychologists.
58. Reynolds, C. R. (1979). Methodological and statistical problems in discerning profile reliability: Comment on Roffe and Bryant. Psychology in the Schools, 16, 505-507.
59. Roffe, M. W., & Bryant, C. K. (1979). How reliable are MSCA profile interpretations? Psychology in the Schools, 16, 14-18.
60. Salvia, J., & Hughes, C. (1990). Curriculum-based assessment: Testing what is taught. New York: Macmillan.
61. Sattler, J. M. (1988). Assessment of children (3rd ed.). San Diego: Author.
62. Shaywitz, S. E., Escobar, M. D., Shaywitz, B. A., Fletcher, J. M., & Makuch, R. (1992). Evidence that dyslexia may represent the lower tail of a normal distribution of reading ability. New England Journal of Medicine, 326, 145-150.
63. Sicoly, F. (1992). Estimating the accuracy of decisions based on cutting scores. Journal of Psychoeducational Assessment, 10, 26-36.
64. Slate, J. R., & Chick, D. ( 1989). WISC-R examiner errors: Cause for concern. Psychology in the Schools, 26, 78-84.
65. Slate, J. R., Jones, C. H., Coulter, C., & Covert, T. L. (1992). Practitioner's administration and scoring errors of the WISC-R: Evidence that we do err. Journal of School Psychology, 30, 77-82.
66. Snow, R. E., & Lohman, D. F. (1989). Implications of cognitive psychology for educational measurement. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 263-331). New York: Macmillan.
67. SPSS Inc. (1990). SPSS for OS/2: Operations guide, release 4.1. Chicago: Author.
68. Stinnett, T. A., Havey, J. A., & Oehler-Stinnett, J. (1994). Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment, 12, 331-350.
69. Sugai, G. M., & Tindal, G. A. (1993). Effective school consultation: An interactive approach. Pacific Grove, CA: Brooks/Cole.
70. Swets, J. A. (1992). The science of choosing the right decision threshold in high-stakes diagnostics. American Psychologist, 47, 522-532.
71. Webster, R. E. (1988). Statistical and individual temporal stability of the WISC-R for cognitively disabled adolescents. Psychology in the Schools, 25, 365-372.
72. Wechsler, D. (1974). Manual for the Wechsler Intelligence Scale for Children - Revised (WISC-R). San Antonio: Psychological Corporation.
73. Wechsler, D. (1981). Manual for the Wechsler Adult Intelligence Scale - Revised (WAIS-R). San Antonio, TX: Psychological Corporation.
74. Wechsler, D. (1991). Manual for the Wechsler Intelligence Scale for Children - Third Edition (WISC-III). San Antonio: Psychological Corporation.
75. Witt, J. C., & Gresham, F. M. (1985). Review of Wechsler Intelligence Scale for Children - Revised. In J. V. Mitchell, Jr. (Ed.), The ninth mental measurements yearbook (Vol. 2; pp. 1716-1719). Lincoln, NE: University of Nebraska Press.