Measurement error: Implications for diagnosis and discrepancy models of developmental dyslexia

Dyslexia

Volumn 11, Issue 3, 2005, Pages 186-202

  Cotton, Sue M ^a,b   Crewther, David P ^c   Crewther, Sheila G ^a  

^a LA TROBE UNIVERSITY   (Australia)

^b UNIVERSITY OF MELBOURNE   (Australia)

^c SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Classic test theory; Developmental dyslexia; Diagnosis; Measurement error

Indexed keywords

ACHIEVEMENT; ANALYTICAL ERROR; DIAGNOSTIC ACCURACY; DIAGNOSTIC ERROR; DIAGNOSTIC VALUE; DYSLEXIA; HUMAN; INTELLIGENCE; MATHEMATICAL COMPUTING; MEDICAL RESEARCH; READING; RELIABILITY; REPRODUCIBILITY; REVIEW; SCORING SYSTEM; TASK PERFORMANCE; THEORY;

CHILD; DIAGNOSTIC ERRORS; DYSLEXIA; HUMANS; INTELLIGENCE; MODELS, STATISTICAL; PSYCHOMETRICS; READING; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; STATISTICS;

EID: 23844542671     PISSN: 10769242     EISSN: None     Source Type: Journal    
DOI: 10.1002/dys.298     Document Type: Review

References (87)

1. Aaron, P. G. (1985). The paradoxical relationship between intelligence and reading disability. Perceptual and Motor Skills, 61, 1251-1261.
2. Aaron, P. G. (1997). A component-based approach to the diagnosis and treatment of reading disabilities. In B. Erickson, & J. Rönnberg (Eds.), Reading disability and its treatment. Norrköping: Malmquist Institution for Reading, Linköping University.
3. Aaron, P. G., Joshi, R. M., Ayotollah, M., Ellsberry A., Henderson, J., & Lindsey, K. (1999). Decoding and sight-word naming: Are they independent components of word recognition skill? Reading and Writing, 11(2), 89-127.
4. Algozzine, B., & Ysseldyke, J. E. (1981). An analysis of difference score reliabilities on three measures with a sample of low-achieving youngsters. Psychology in the Schools, 18, 133-138.
5. Algozzine, B., Ysseldyke, J. E., & Shinn, M. (1982). Identifying children with learning disabilities: When is a discrepancy severe? Journal of School Psychology, 20(4), 299-305.
6. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorder. Washington, DC: American Psychiatric Association.
7. Anastasi, A., & Urbina, S. (1997). Psychological testing. New Jersey: Prentice-Hall.
8. Atkinson, G., & Nevill, A. M. (1998). Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Medicine, 26(4), 217-238.
9. Beckerman, H., Roebroeck, M. E., Lankhorst, G. J., Cecher, J. G., Bezemer, P. D., & Verbeeck, A. L. M. (2001). Smallest real difference, a link between reproducibility and responsiveness. Quality of Life Research, 10, 571-578.
10. Bishop, D. V. M., & Butterworth, G. E. (1980). Verbal-performance discrepancies: Relationship to birth risk and specific reading retardation. Cortex, 16, 375-389.
11. Bland, J. M., & Altman, D. G. (1996). Statistic notes: Measurement error. British Medical Journal, 313, 744.
12. Bone, R. B., Cirino, P., Morris, R. D., & Morris, M. K. (2002). Reading and phonological awareness in reading-disabled adults. Developmental Neuropsychology, 2(3), 305-320.
13. Brennan, R. L. (2001). Some problems, pitfalls, and paradoxes in educational measurement. Educational Measurement: Issues and Practice, 20(4), 6-18.
14. Caruso, J. C., & Witkiewitz, K. (2002). Increasing the reliability of ability-achievement difference scores: An example using the Kaufman Assessment Battery for Children. Journal of Educational Measurement, 39(1), 39-58.
15. Cattell, R. B. (1982). The clinical use of difference scores: Some psychometric problems. Multivariate Experimental Clinical Research, 6(2), 87-98.
16. Charter, R. A. (1997). Effect of measurement error on tests of statistical significance. Journal of Clinical and Experimental Neuropsychology, 19(3), 458-462.
17. Charter, R. A., & Feldt, L. S. (2001). Meaning of reliability in terms of correct and incorrect clinical decisions: The art of decision making is still alive. Journal of Clinical and Experimental Neuropsychology, 23(4), 530-537.
18. Cone, T. E., & Wilson, L. R. (1981). Quantifying a severe discrepancy: A critical analysis. Learning Disability Quarterly, 4, 359-371.
19. Dudek, F. J. (1979). The continuing misinterpretation of the standard error of measurement. Psychological Bulletin, 86(2), 335-337.
20. Eden, G. F., Stein, J. F., & Wood, M. H. (1995). Verbal and visual problems in reading disability. Journal of Learning Disabilities, 28(5), 272-290.
21. Embreston, S. E. (1999). Issues in the measurement of cognitive abilities. In S. E. Embretson, & S. L. Hershberger (Eds.), The new rules of measurement: What every psychologist and educator should know (pp. 1-15). New Jersey: Lawrence Erlbaum Associates.
22. Feldt, L. S. (1995). Estimation of the reliability of differences under revised reliability of component score. Journal of Educational Measurement, 32(3), 295-301.
23. Finucci, J. M., Isaacs, S. D., Whitehouse, C. C., & Childs, B. (1982). Empirical validation of reading and spelling quotients. Developmental Medicine and Child Neurology, 24, 733-744.
24. Fletcher, J. M. (1992). The validity of distinguishing children with language and learning disabilities according to discrepancies with IQ: Introduction to the special series. Journal of Learning Disabilities, 25(9), 546-548.
25. Fletcher, J. M., Francis, D. J., Rourke, B. P., Shaywitz, S. E., & Shaywitz, B. A. (1992). The validity of discrepancy-based definitions of reading disabilities. Journal of Learning Disabilities, 25(9), 551-561.
26. Flowers, L., Meyer, M., Lovato, J., Wood, F., & Felton, R. (2000). Does third grade discrepancy status predict the course of reading development? Annals of Dyslexia, 50, 49-71.
27. Francis, D. J., Espy, K. A., Rourke, B. P., & Fletcher, J. M. (1991). Validity of intelligence test scores in the definition of learning disability: A critical analysis. In B. P. Rourke (Ed.), Validity issues in learning disabilities (pp. 12-40). New York: Guilford Press.
28. Francis, D. J., Shaywtiz, S. E., Stuebing, K. K., Shaywtiz, B. A., & Fletcher, J. M. (1996). Developmental lag versus deficit models of reading disability: A longitudinal, individual growth curves analysis. Journal of Educational Psychology, 88, 3-17.
29. Ghiselle, E. E., Campbell, J. P., & Zedeck, S. (1981). Measurement theory for the behavioral sciences. San Francisco: W.H. Freeman and Company.
30. Glutting, J. J., McDermott, P. A., & Stanley, J. C. (1987). Resolving differences among methods of establishing confidence limits for test scores. Educational and Psychological Measurement, 47, 607-614.
31. Groth-Marnat, G. (1999). Handbook of psychological assessment with WAIS-III supplement. New York: Wiley.
32. Guilliksen, H. (1950). Theory of mental tests. New York: Wiley.
33. Gustafson, S., & Samuelsson, S. (1999). Intelligence and dyslexia: Implications for diagnosis and intervention. Scandinavian Journal of Psychology, 40, 127-134.
34. Hageman, W. J. J. M., & Arrindell, W. A. (1999). Establishing clinically significant change: Increment of precision and the distinction between individual and group level of analysis. Behaviour Research and Therapy, 37, 1169-1193.
35. Jastak, S., & Wilkinson, G. S. (1984). Wide Range Achievement Test - Revised. Wilmington, DE: Jastak Associates.
36. Kane, M. (1996). The precision of measurements. Applied Measurement in Education, 9(4), 355-379.
37. Leeb, S., & Weinberg, S. (1977). Unreliability of difference scores: A clarification of the issues. Psychological Reports, 40, 931-935.
38. Levy, P. (1966). The reliability of a difference between two scores: A re-examination of assumption. Journal of Clinical Psychology, 22(3), 357-359.
39. Lezak, M. D. (1988). IQ: R.I.P. Journal of Clinical and Experimental Neuropsychology, 10(3), 351-361.
40. Lord, F. M. (1958). The utilization of unreliable difference scores. Journal of Educational Psychology, 49(3), 150-152.
41. Lyon, G. R. (1989). IQ is irrelevant to the definition of learning disabilities: A position in search of logic and data. Journal of Learning Disabilities, 22, 504-506.
42. Lyon, G. R. (1995). Towards a definition of dyslexia. Annals of Dyslexia, 45, 3-27.
43. Markwardt, F. C. (1989). Peabody Individual Achievement Test - Revised. Circle Pines, MN: American Guidance Service.
44. McArthur, G. M., Hogben, J. H., Edwards, V. T., Heath, S. M., & Mengler, E. D. (2000). On the 'specifics' of specific reading disability and specific language impairment. Journal of Child Psychology and Psychiatry, 41(7), 869-874.
45. Meyer, M. (2000). The ability-achievement discrepancy: Does it contribute to an understanding of learning disabilities. Educational Psychology Review, 12(3), 315-337.
46. Naglieri, J. A. (2001). Do ability and reading achievement correlate? Journal of Learning Disabilities, 34(4), 304-305.
47. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. New York: McGraw-Hill, Inc.
48. O'Donnell, L. E. (1980). Intra-individual discrepancy in diagnosing specific learning disabilities. Learning Disability Quarterly, 3, 10-18.
49. Overall, J. E., & Woodward, A. (1975). Unreliability of difference scores: A paradox for measurement of change. Psychological Bulletin, 82, 85-86.
50. Payne, R. W. (1989). Reliability theory and clinical psychology. Journal of Clinical Psychology, 45(2), 351-353.
51. Payne, R. W., & Jones, G. (1957). Statistics for the investigation of individual cases. Journal of Clinical Psychology, 13, 115-121.
52. Portney, L. G., & Watkins, M. P. (2000). Foundations of clinical research. Applications to practice (2nd ed.). New Jersey: Prentice-Hall Health.
53. Sattler, J. M. (1992). Assessment of Children. San Diego: Jerome M. Sattler Publisher, Inc.
54. Schulte, A., & Borich, G. D. (1984). Considerations in the use of difference scores to identify learning-disabled children. Journal of School Psychology, 22, 381-390.
55. Share, D. L., McGee, R., McKenzie, D., Williams, S., & Silva, P. A. (1987). Further evidence relating of the distinction between specific reading retardation and general reading backwardness. British Journal of Developmental Psychology, 5, 35-44.
56. Shaywitz, B. A., Fletcher, J. M., Holahan, J., & Shaywitz, S. E. (1992a). Discrepancy compared to low achievement definitions of reading disability: Results from the Connecticut Longitudinal Study. Journal of Learning Disabilities, 25, 639-648.
57. Shaywitz, S. E., Escobar, M. D., Shaywitz, B. A., Fletcher, J. M., & Makuch, R. (1992b). Distribution and temporal stability of dyslexia in and epidemiological sample of 414 children followed longitudinally. New England Journal of Medicine, 326, 145-150.
58. Siegel, L. S. (1988). Definitional and theoretical issues and research on learning disabilities. Journal of Learning Disabilities, 21, 264-266.
59. Siegel, L. S. (1989). Why we do not need intelligence tests scores in the definition and analyses of learning disabilities. Journal of Learning Disabilities, 22, 514-518.
60. Siegel, L. S. (1992a). Dyslexics vs. poor readers: Is there are difference? Journal of Learning Disabilities, 25, 618-629.
61. Siegel, L. S. (1992b). An evaluation of the discrepancy definition of dyslexia. Journal of Learning Disabilities, 25(10), 618-629.
62. Siegel, L. S. (2003). IQ-discrepancy definitions and the diagnosis of LD: Introduction to a special issue. Journal of Learning Disabilities, 36(1), 2-3.
63. Siegel, L. S., & Himel, N. (1998). Socioeconomic status, age and the classification of dyslexics and poor readers: The dangers of using IQ scores in the definition of reading disability. Dyslexia, 4, 90-104.
64. Silverstein, A. B. (1989a). Confidence intervals for test scores and significance tests for test score differences: A comparison of methods. Journal of Clinical Psychology, 45(45), 828-832.
65. Silverstein, A. B. (1989b). Reliability and abnormality of scaled-scores. Journal of Clinical Psychology, 45(6), 926-929.
66. Snowling, M. (2000). Dyslexia. Oxford: Blackwell Publishers.
67. Stage, S. A., Abbott, R. D., Jenkins, J. R., & Berninger, V. M. (2003). Predicting response to early reading intervention from verbal IQ, reading related language abilities, attention ratings, and verbal IQ-word reading discrepancy: Failure to validate discrepancy method. Journal of Learning Disabilities, 36(1), 24-33.
68. Stanovich, K. E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, XXI, 360-405.
69. Stanovich, K. E. (1988). The right and wrong places to look for the cognitive locus of reading disability. Annals of Dyslexia, 38, 154-177.
70. Stanovich, K. E. (1991). Discrepancy definitions of reading disability: Has intelligence led us astray? Reading Research Quarterly, 26, 7-29.
71. Stanovich, K. E. (1996). Toward a more inclusive definition of dyslexia. Dyslexia, 2, 154-166.
72. Stanovich, K. E., Cunningham, E., & Freeman, D. J. (1984). Intelligence, cognitive skills and reading progress. Reading Research Quarterly, 19, 3.
73. Sternberg, R. J., & Grigorenko, E. L. (2002). Difference scores in the identification of children with learning disabilities: It's time to use a different method. Journal of School Psychology, 40(1), 65-83.
74. Stratford, P. W., & Goldsmith, C. H. (1997). Use of the standard error as a reliability index of interest: An applied example using elbow flexor strength data. Physical Therapy, 77(7), 745-750.
75. Tallal, P., Stark, R. E., & Mellitis, E. D. (1985). Identification of language-impaired children on the basis of rapid perception and production skills. Brain and Language, 25, 314-322.
76. Thorndike, R. L., Hagen, E. P., & Sattler, J. M. (1986). Stanford-Binet Intelligence Scale (4th ed.). Chicago: Riverside.
77. Torgesen, K. (1989). Why IQ is relevant to the definition of learning disabilities. Journal of Learning Disabilities, 22, 484-486.
78. Vellutino, F. R., Scanlon, D. M., & Lyon, G. R. (2000). Differentiating between difficult-to-remediate and readily remediated poor readers. More evidence against the IQ-achievement discrepancy definition of reading disability. Journal of Learning Disabilities, 33(3), 223-238.
79. Wechsler, D. (1991). Manual for the Wechsler Intelligence Scale for Children (3rd ed.). San Antonio: The Psychological Corporation.
80. Wilkinson, G. S. (1993). WRAT3 administration manual. Delaware: Wide Range.
81. Wilson, L. R., & Cone, T. (1984). The regression equation method of determining academic discrepancy. Journal of School Psychology, 22, 95-110.
82. Woodcock, R. W., & Johnson, M. B. (1990). WJ-R Tests of Cognitive Ability - Standard and Supplemental Batteries: Examiner's Manual. In R. W. Woodcock & B. Johnson (Eds.), Woodcock-Johnson Psycho-Educational Battery - Revised. Chicago: Riverside.
83. Woodcock, R. W., & Mather, N. (1989). Woodcock-Johnson Tests of Achievement: Examiner's Manual. In R. W. Woodcock & M. B. Johnson (Eds.), Woodcock-Johnson Psycho-Educational Battery - Revised. Chicago: Riverside.
84. World Health Organization. (1993). ICD 10 classification of mental and behavioural disorders. Diagnostic criteria for research. Geneva: World Health Organization.
85. Yule, W., Rutter, M., Berger, M., & Thompson, J. (1974). Over and under achievement in reading: Distribution in the general population. British Journal of Educational Psychology, 44, 1-12.
86. Zimmerman, D. W. (1994). A note on interpretation of formulas for the reliability of differences. Journal of Educational Measurement, 31(2), 143-147.
87. Zimmerman, D. W., & Williams, R. H. (1966). Interpretation of the standard error of measurement when true scores and error scores on mental tests are not independent. Psychological Reports, 19, 611-617.