Comparing patients' predicted test scores from a regression equation with their obtained scores: A significance test and point estimate of abnormality with accompanying confidence limits

Neuropsychology

Volumn 20, Issue 3, 2006, Pages 259-271

  Crawford, John R ^a   Garthwaite, Paul H ^b  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b The Open University

Author keywords

Neuropsychological assessment; Regression equations; Single case methods

Indexed keywords

ARTICLE; COMPUTER PROGRAM; CONFIDENCE INTERVAL; ERROR; MONTE CARLO METHOD; POPULATION; PREDICTION; PRIORITY JOURNAL; PSYCHOLOGIST; REGRESSION ANALYSIS; SAMPLE; SCORING SYSTEM; STANDARD; VALIDATION PROCESS;

CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HUMANS; MONTE CARLO METHOD; NEUROPSYCHOLOGICAL TESTS; PREDICTIVE VALUE OF TESTS; PSYCHOMETRICS; REGRESSION ANALYSIS; SENSITIVITY AND SPECIFICITY; WEIGHTS AND MEASURES;

EID: 33745103346     PISSN: 08944105     EISSN: None     Source Type: Journal    
DOI: 10.1037/0894-4105.20.3.259     Document Type: Article

References (36)

1. American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
2. Box, G. E. P., & Muller, M. E. (1958). A note on the generation of random normal deviates. Annals of Mathematical Statistics, 28, 610-611.
3. Chelune, G. J. (2003). Assessing reliable neuropsychological change. In R. D. Franklin (Ed.), Prediction in forensic and neuropsychology: Sound statistical practices (pp. 123-147). Mahwah, NJ: Erlbaum.
4. Chelune, G. J., Naugle, R. I., Lüders, H., Sedlak, J., & Awad, I. A. (1993). Individual change after epilepsy surgery: Practice effects and base rate information. Neuropsychology, 7, 41-52.
5. Christensen, L., & Mendoza, J. L. (1986). A method of assessing change in a single subject: An alteration of the RC index. Behavior Therapy, 17, 305-308.
6. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum.
7. Crawford, J. R. (1996). Assessment. In J. G. Beaumont, P. M. Kenealy, & M. J. Rogers (Eds.), The Blackwell dictionary of neuropsychology (pp. 108-116). London: Blackwell.
8. Crawford, J. R. (2004). Psychometric foundations of neuropsychological assessment. In L. H. Goldstein & J. E. McNeil (Eds.), Clinical neuropsychology: A practical guide to assessment and management for clinicians (pp. 121-140). Chichester: Wiley.
9. Crawford, J. R., & Garthwaite, P. H. (2002). Investigation of the single case in neuropsychology: Confidence limits on the abnormality of test scores and test score differences. Neuropsychologia, 40, 1196-1208.
10. Crawford, J. R., & Howell, D. C. (1998a). Comparing an individual's test score against norms derived from small samples. The Clinical Neuropsychologist, 12, 482-486.
11. Crawford, J. R., & Howell, D. C. (1998b). Regression equations in clinical neuropsychology: An evaluation of statistical methods for comparing predicted and obtained scores. Journal of Clinical and Experimental Neuropsychology, 20, 755-762.
12. Crawford, J. R., Moore, J. W., & Cameron, I. M. (1992). Verbal fluency: A NART-based equation for the estimation of premorbid performance. British Journal of Clinical Psychology, 31, 327-329.
13. Cumming, G., & Finch, S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and non-central distributions. Educational and Psychological Measurement, 61, 532-574.
14. Daly, F., Hand, D. J., Jones, M. C., Lunn, A. D., & McConway, K. J. (1995). Elements of statistics. Wokingham, England: Addison Wesley.
15. Franzen, M. D., Burgess, E. J., & Smith-Seemiller, L. (1997). Methods of estimating premorbid functioning. Archives of Clinical Neuropsychology, 12, 711-738.
16. Gardner, M. J., & Altman, D. G. (1989). Statistics with confidence: Confidence intervals and statistical guidelines. London: British Medical Journal.
17. Heaton, R. K., Grant, I., Ryan, L., & Matthews, C. G. (1996). Demographic influences on neuropsychological test performance. In I. Grant & K. M. Adams (Eds.), Neuropsychological assessment of neuropsychiatric disorders (2nd ed., pp. 141-163). New York: Oxford University Press.
18. Heaton, R. K., & Marcotte, T. D. (2000). Clinical neuropsychological tests and assessment techniques. In F. Boller & J. Grafman (Eds.), Handbook of neuropsychology (2nd ed., Vol. 1, pp. 27-52). Amsterdam: Elsevier.
19. Howell, D. C. (2002). Statistical methods for psychology (5th ed.). Belmont, CA: Duxbury Press.
20. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.
21. Kennedy, W. J., & Gentle, J. E. (1980). Statistical computing. New York: Marcel Dekker.
22. Knight, R. G., & Shelton, E. J. (1983). Tables for evaluating predicted retest changes in Wechsler Adult Intelligence Scale scores. British Journal of Clinical Psychology, 22, 77-81.
23. Lezak, M. D., Howieson, D. B., Loring, D. W., Hannay, H. J., & Fischer, J. S. (2004). Neuropsychological assessment (4th ed.). New York: Oxford University Press.
24. Maassen, G. H. (2000). Principles of defining reliable change indices. Journal of Clinical and Experimental Neuropsychology, 22, 622-632.
25. Maassen, G. H. (2004). The standard error in the Jacobson and Traux Reliable Change Index: The classical approach to the assessment of reliable change. Journal of the International Neuropsychological Society, 10, 888-893.
26. McSweeny, A. J., Naugle, R. I., Chelune, G. J., & Lüders, H. (1993). "T scores for change": An illustration of a regression approach to depicting change in clinical neuropsychology. The Clinical Neuropsychologist, 7, 300-312.
27. Paolo, A. M., Ryan, J. J., Troster, A. I., & Hilmer, C. D. (1996). Demographically based regression equations to estimate WAIS-R subtest scaled scores. Clinical Neuropsychologist, 10, 130-140.
28. Press, W. H., Flannery, B. P., Teukolsky, S. A., & Vetterling, W. T. (1989). Numerical recipes in Pascal. Cambridge, England: Cambridge University Press.
29. Sawrie, S. M. (2002). Analysis of cognitive change: A commentary on Keith et al. (2002). Neuropsychology, 16, 429-431.
30. Sherman, E. M. S., Slick, D. J., Connolly, M. B., Steinbok, P., Martin, R., Strauss, E., et al. (2003). Reexamining the effects of epilepsy surgery on IQ in children: Use of regression-based change scores. Journal of the International Neuropsychological Society, 9, 879-886.
31. Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York: Harper Collins.
32. Temkin, N. R. (2004). The standard error in the Jacobson and Traux Reliable Change Index: The "classical approach" leads to poor estimates. Journal of the International Neuropsychological Society, 10, 899-901.
33. Temkin, N. R., Heaton, R. K., Grant, I., & Dikmen, S. S. (1999). Detecting significant change in neuropsychological test performance: A comparison of four models. Journal of the International Neuropsychological Society, 5, 357-369.
34. Wise, E. A. (2004). Methods for analyzing psychotherapy outcomes: A review of clinical significance, reliable change, and recommendations for future directions. Journal of Personality Assessment, 82, 50-59.
35. Zachary, R. A., & Gorsuch, R. L. (1985). Continuous norming: Implications for the WAIS-R. Journal of Clinical Psychology, 41, 86-94.
36. Zar, J. H. (1996). Biostatistical analysis (3rd ed.). London: Prentice Hall.