Current topics in science and practice evidence-based indicators of neuropsychological change in the individual patient: Relevant concepts and methods

Archives of Clinical Neuropsychology

Volumn 27, Issue 3, 2012, Pages 248-261

  Duff, Kevin ^a  

^a UNIVERSITY OF UTAH SCHOOL OF MEDICINE   (United States)

Author keywords

Assessment; Practice effects; Reliable change

Indexed keywords

AGE; EVIDENCE BASED MEDICINE; HUMAN; MENTAL DISEASE; METHODOLOGY; NEUROPSYCHOLOGICAL TEST; NEUROPSYCHOLOGY; OUTCOME ASSESSMENT; PSYCHOLOGICAL ASPECT; REPRODUCIBILITY; REVIEW; SEX DIFFERENCE; STANDARD; TIME;

AGE FACTORS; EVIDENCE-BASED MEDICINE; HUMANS; MENTAL DISORDERS; NEUROPSYCHOLOGICAL TESTS; NEUROPSYCHOLOGY; OUTCOME ASSESSMENT (HEALTH CARE); REPRODUCIBILITY OF RESULTS; SEX FACTORS; TIME FACTORS;

EID: 84863321680     PISSN: 08876177     EISSN: 18735843     Source Type: Journal    
DOI: 10.1093/arclin/acr120     Document Type: Article

References (72)

1. Attix, D. K., Story, T. J., Chelune, G. J., Ball, J. D., Stutts, M. L., Hart, R. P., et al. (2009). The prediction of change: Normative neuropsychological trajectories. The Clinical Neuropsychologist, 23 (1), 21-38.
2. Barr, W. B. (2003). Neuropsychological testing of high school athletes. Preliminary norms and test-retest indices. Archives of Clinical Neuropsychology, 18 (1), 91-101. (Pubitemid 36120397)
3. Barr, W. B., & McCrea, M. (2001). Sensitivity and specificity of standardized neurocognitive testing immediately following sports concussion. Journal of the International Neuropsychological Society, 7 (6), 693-702. (Pubitemid 32936853)
4. Beglinger, L. J., Gaydos, B., Tangphao-Daniels, O., Duff, K., Kareken, D. A., Crawford, J., et al. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20 (4), 517-529. (Pubitemid 40719554)
5. Benedict, R. H. B. (1997). Brief Visuospatial Memory Test-Revised. Odessa, FL: Psychological Assessment Resources.
6. Benedict, R. H. (2005). Effects of using same-versus alternate-form memory tests during short-interval repeated assessments in multiple sclerosis. Journal of the International Neuropsychological Society, 11 (6), 727-736. (Pubitemid 41631486)
7. Benedict, R. H., Schretlen, D., Groninger, L., & Brandt, J. (1998). Hopkins verbal learning test-revised: Normative data and analysis of inter-form and test-retest reliability. The Clinical Neuropsychologist, 12 (1), 43-55. (Pubitemid 28168220)
8. Calero, M. D., & Navarro, E. (2007). Cognitive plasticity as a modulating variable on the effects of memory training in elderly persons. Archives of Clinical Neuropsychology, 22 (1), 63-72. (Pubitemid 46209591)
9. Chelune, G. J., Naugle, R. I., Luders, H., Sedlak, J., & Awad, I. A. (1993). Individual change after epilepsy surgery: Practice effects and base-rate information. Neuropsychology, 7 (1), 41-52.
10. Crawford, J. R., & Garthwaite, P. H. (2006). Comparing patients' predicted test scores from a regression equation with their obtained scores: A significance test and point estimate of abnormality with accompanying confidence limits. Neuropsychology, 20 (3), 259-271. (Pubitemid 43886861)
11. Crawford, J. R., & Garthwaite, P. H. (2007). Using regression equations built from summary data in the neuropsychological assessment of the individual case. Neuropsychology, 21 (5), 611-620. (Pubitemid 47488802)
12. Cysique, L. A., Franklin, D., Jr., Abramson, I., Ellis, R. J., Letendre, S., Collier, A., et al. (2011) Normative data and validation of a regression based summary score for assessing meaningful neuropsychological change. Journal of Clinical and Experimental Neuropsychology, 33 (5), 505-522.
13. Darby, D., Maruff, P., Collie, A., & McStephen, M. (2002). Mild cognitive impairment can be detected by multiple assessments in a single day. Neurology, 59 (7), 1042-1046.
14. Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. A. (2000). California Verbal Learning Test-Second Edition. San Antonio: Psychological Corporation.
15. Dirks, J. (1982). The effect of a commercial game on children's block design scores on the WISC-R IQ test. Intelligence, 6, 109-123.
16. Duff, K., Beglinger, L. J., Moser, D. J., & Paulsen, J. S. (2010). Predicting cognitive change within domains. Clinical Neuropsychology, 24 (5), 779-792.
17. Duff, K., Beglinger, L. J., Moser, D. J., Paulsen, J. S., Schultz, S. K., & Arndt, S. (2010). Predicting cognitive change in older adults: The relative contribution of practice effects. Archives of Clinical Neuropsychology, 25 (2), 81-88.
18. Duff, K., Beglinger, L. J., Moser, D. J., Schultz, S. K., & Paulsen, J. S. (2010). Practice effects and outcome of cognitive training: Preliminary evidence from a memory training course. American Journal of Geriatric Psychiatry, 18 (1), 91.
19. Duff, K., Beglinger, L., Schultz, S., Moser, D., McCaffrey, R., Haase, R., et al. (2007). Practice effects in the prediction of long-term cognitive outcome in three patient samples: A novel prognostic index. Archives of Clinical Neuropsychology, 22 (1), 15-24. (Pubitemid 46209588)
20. Duff, K., Beglinger, L., Van Der Heiden, S., Moser, D., Arndt, S., Schultz, S., et al. (2008). Short-term practice effects in amnestic mild cognitive impairment: Implications for diagnosis and treatment. International Psychogeriatrics, 20 (5), 986-999.
21. Duff, K., Schoenberg, M. R., Patton, D. E., Mold, J., Scott, J. G., & Adams, R. A. (2004). Predicting change with the RBANS in a community dwelling elderly sample. Journal of the International Neuropsychological Society, 10, 828-834. (Pubitemid 39480813)
22. Duff, K., Schoenberg, M. R., Patton, D. E., Mold, J.W., Scott, J. G., & Adams, R. L. (2008). Predicting cognitive change across 3 years in community-dwelling elders. Clinical Neuropsychology, 22 (4), 651-661. (Pubitemid 351931883)
23. Frerichs, R. J., & Tuokko, H. A. (2005). A comparison of methods for measuring cognitive change in older adults. Archives of Clinical Neuropsychology, 20 (3), 321-333. (Pubitemid 40431777)
24. Friedman, M. A., Fernandez, M., Wefel, J. S., Myszka, K. A., Champlin, R. E., & Meyers, C. A. (2009). Course of cognitive decline in hematopoietic stem cell transplantation: A within-subjects design. Archives of Clinical Neuropsychology, 24 (7), 689-698.
25. Heaton, R. K., Temkin, N., Dikmen, S., Avitable, N., Taylor, M. J., Marcotte, T. D., et al. (2001). Detecting change: A comparison of three neuropsychological methods, using normal and clinical samples. Archives of Clinical Neuropsychology, 16 (1), 75-91. (Pubitemid 32054794)
26. Heilbronner, R. L., Sweet, J. J., Attix, D. K., Krull, K. R., Henry, G. K., & Hart, R. P. (2010). Official position of the American Academy of Clinical Neuropsychology on serial neuropsychological assessments: The utility and challenges of repeat test administrations in clinical and forensic contexts. Clinical Neuropsychology, 24 (8), 1267-1278.
27. Hensel, A., Luck, T., Luppa, M., Glaesmer, H., Angermeyer, M. C., & Riedel-Heller, S. G. (2009). Does a reliable decline in Mini Mental State Examination total score predict dementia? Diagnostic accuracy of two reliable change indices. Dementia and Geriatric Cognitive Disorders, 27 (1), 50-58.
28. Hermann, B. P., Seidenberg, M., Schoenfeld, J., Peterson, J., Leveroni, C., & Wyler, A. R. (1996). Empirical techniques for determining the reliability, magnitude, and pattern of neuropsychological change after epilepsy surgery. Epilepsia, 37 (10), 942-950. (Pubitemid 26314954)
29. Higginson, C. I., Wheelock, V. L., Levine, D., King, D. S., Pappas, C. T., & Sigvardt, K. A. (2009). The clinical significance of neuropsychological changes following bilateral subthalamic nucleus deep brain stimulation for Parkinson's disease. Journal of Clinical and Experimental Neuropsychology, 31 (1), 65-72.
30. Hinton-Bayre, A. D. (2005). Methodology is more important than statistics when determining reliable change. Journal of the International Neuropsychological Society, 11 (6), 788-789. (Pubitemid 41631493)
31. Hinton-Bayre, A. D. (2010). Deriving reliable change statistics from test-retest normative data: Comparison of models and mathematical expressions. Archives of Clinical Neuropsychology, 25 (3), 244-256.
32. Iverson, G. L. (2001). Interpreting change on the WAIS-III/WMS-III in clinical samples. Archives of Clinical Neuropsychology, 16 (2), 183-191. (Pubitemid 32186440)
33. Ivnik, R. J., Smith, G. E., Lucas, J. A., Petersen, R. C., Boeve, B. F., Kokmen, E., et al. (1999). Testing normal older people three or four times at 1-to 2-year intervals: Defining normal variance. Neuropsychology, 13 (1), 121-127. (Pubitemid 29066445)
34. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59 (1), 12-19.
35. Koh, C. L., Lu, W. S., Chen, H. C., Hsueh, I. P., Hsieh, J. J., & Hsieh, C. L. (2011) Test-retest reliability and practice effect of the oral-format Symbol Digit Modalities Test in patients with stroke. Archives of Clinical Neuropsychology, 26 (4), 356-363.
36. Kormi-Nouri, R., Nilsson, L. G., & Ohta, N. (2005). The novelty effect: Support for the novelty-encoding hypothesis. Scandinavian Journal of Psychology, 46 (2), 133-143. (Pubitemid 40419314)
37. Levine, A. J., Hinkin, C. H., Miller, E. N., Becker, J. T., Selnes, O. A., & Cohen, B. A. (2007). The generalizability of neurocognitive test/retest data derived from a nonclinical sample for detecting change among two HIV+ cohorts. Journal of Clinical and Experimental Neuropsychology, 29 (6), 669-678. (Pubitemid 47254602)
38. Loring, D. W., Williamson, D. J., Meador, K. J., Wiegand, F., & Hulihan, J. (2011) Topiramate dose effects on cognition: A randomized double-blind study. Neurology, 76 (2), 131-137.
39. Maassen, G. H., Bossema, E. R., & Brand, N. (2006). Reliable change assessment with practice effects in sport concussion research: A comment on Hinton-Bayre. British Journal of Sports Medicine, 40 (10), 829-833. (Pubitemid 44526049)
40. Maassen, G. H., Bossema, E., & Brand, N. (2009). Reliable change and practice effects: Outcomes of various indices compared. Journal of Clinical and Experimental Neuropsychology, 31 (3), 339-352.
41. Martin, R., Griffith, H. R., Sawrie, S., Knowlton, R., & Faught, E. (2006). Determining empirically based self-reported cognitive change: Development of reliable change indices and standardized regression-based change norms for the multiple abilities self-report questionnaire in an epilepsy sample. Epilepsy Behavior, 8 (1), 239-245. (Pubitemid 43103854)
42. Martin, R., Sawrie, S., Gilliam, F., Mackey, M., Faught, E., Knowlton, R., et al. (2002). Determining reliable cognitive change after epilepsy surgery: Development of reliable change indices and standardized regression-based change norms for the WMS-III and WAIS-III. Epilepsia, 43 (12), 1551-1558. (Pubitemid 35429774)
43. McSweeny, A. J., Naugle, R. I., Chelune, G. J., & Luders, H. (1993). T scores for change: An illustration of a regression approach to depicting change in clinical neuropsychology. The Clinical Neuropsychologist, 7, 300-312. (Pubitemid 23279991)
44. Mikos, A., Zahodne, L., Okun, M. S., Foote, K., & Bowers, D. (2010). Cognitive declines after unilateral deep brain stimulation surgery in Parkinson's disease: A controlled study using Reliable Change, part II. Clinical Neuropsychology, 24 (2), 235-245.
45. Millis, S. R., Rosenthal, M., Novack, T. A., Sherer, M., Nick, T. G., Kreutzer, J. S., et al. (2001). Long-term neuropsychological outcome after traumatic brain injury. Journal of Head Trauma Rehabilitation, 16 (4), 343-355. (Pubitemid 32730343)
46. Mohile, S. G., Lacy, M., Rodin, M., Bylow, K., Dale, W., Meager, M. R., et al. (2010) Cognitive effects of androgen deprivation therapy in an older cohort of men with prostate cancer. Critical Reviews in Oncology/Hematology, 75 (2), 152-159.
47. Muslimovic, D., Post, B., Speelman, J. D., De Haan, R. J., & Schmand, B. (2009). Cognitive decline in Parkinson's disease: A prospective longitudinal study. Journal of the International Neuropsychological Society, 15 (3), 426-437.
48. Nakhutina, L., Pramataris, P., Morrison, C., Devinsky, O., & Barr, W. B. (2010). Reliable change indices and regression-based measures for the Rey-Osterreith Complex Figure test in partial epilepsy patients. Clinical Neuropsychology, 24 (1), 38-44.
49. O'Mahar, K. M., Duff, K., Scott, J. G., Linck, J. F., Adams, R. L., & Mold, J.W. (in press). The temporal stability of the Repeatable Battery for the Assessment of Neuropsychological Status Effort Index in geriatric samples. Archives of Clinical Neuropsychology.
50. Ouimet, L. A., Stewart, A., Collins, B., Schindler, D., & Bielajew, C. (2009). Measuring neuropsychological change following breast cancer treatment: An analysis of statistical models. Journal of Clinical and Experimental Neuropsychology, 31 (1), 73-89.
51. Patton, D. E., Duff, K., Schoenberg, M. R., Mold, J., Scott, J. G., & Adams, R. L. (2005). Base rates of longitudinal RBANS discrepancies at one-and two-year intervals in community-dwelling older adults. Clinical Neuropsychology, 19 (1), 27-44. (Pubitemid 40463789)
52. Poppenk, J., Kohler, S., & Moscovitch, M. (2010). Revisiting the novelty effect: When familiarity, not novelty, enhances memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36 (5), 1321-1330.
53. Portaccio, E., Goretti, B., Zipoli, V., Iudice, A., Pina, D. D., Malentacchi, G. M., et al. (2010). Reliability, practice effects, and change indices for Rao's Brief Repeatable Battery. Multiple Sclerosis, 16 (5), 611-617.
54. Putnam, S. H., Adams, K. M., & Schneider, A. M. (1992). One-day test-retest reliability of neuropsychological tests in a personal injury case. Psychological Assessment, 4, 312-316.
55. Rapport, L. J., Brines, D. B., Axelrod, B. N., & Theisen, M. E. (1997). Full scale IQ as a mediator of practice effects: The rich get richer. The Clinical Neuropsychologist, 11 (4), 375-380. (Pubitemid 28015254)
56. Reid-Arndt, S. A., Hsieh, C., & Perry, M. C. (2010). Neuropsychological functioning and quality of life during the first year after completing chemotherapy for breast cancer. Psychooncology, 19 (5), 535-544.
57. Rinehardt, E., Duff, K., Schoenberg, M., Mattingly, M., Bharucha, K., & Scott, J. (2010) Cognitive change on the repeatable battery of neuropsychological status (RBANS) in Parkinson's disease with and without bilateral subthalamic nucleus deep brain stimulation surgery. Clinical Neuropsychology, 24 (8), 1339-1354.
58. Rossetti, H. C., Munro Cullum, C., Hynan, L. S., & Lacritz, L. H. (2010). The CERAD Neuropsychologic Battery Total Score and the progression of Alzheimer disease. Alzheimer Disease and Associated Disorders, 24 (2), 138-142.
59. Salthouse, T. A. (2010). Influence of age on practice effects in longitudinal neurocognitive change. Neuropsychology, 24 (5), 563-572.
60. Sawrie, S. M., Chelune, G. J., Naugle, R. I., & Luders, H. O. (1996). Empirical methods for assessing meaningful neuropsychological change following epilepsy surgery. Journal of the International Neuropsychological Society, 2 (6), 556-564. (Pubitemid 126449822)
61. Schoenberg, M. R., Rinehardt, E., Duff, K., Mattingly, M., Bharucha, K. G., & Scott, J. G. (in press) Assessing reliable change using the Repeatable Battery for the Assessment of Neuropsychological Status for Patients with Parkinson's disease undergoing Deep Brain Stimulation (DBS) surgery. The Clinical Neuropsychologist.
62. Sherman, E. M., Wiebe, S., Fay-McClymont, T. B., Tellez-Zenteno, J., Metcalfe, A., Hernandez-Ronquillo, L., et al. (2011). Neuropsychological outcomes after epilepsy surgery: Systematic review and pooled estimates. Epilepsia, 52 (5), 857-869.
63. Suchy, Y., Kraybill, M. L., & Franchow, E. (2011). Practice effect and beyond: Reaction to novelty as an independent predictor of cognitive decline among older adults. Journal of the International Neuropsychological Society, 17 (1), 101-111.
64. Temkin, N. R., Heaton, R. K., Grant, I., & Dikmen, S. S. (1999). Detecting significant change in neuropsychological test performance: A comparison of four models. Journal of the International Neuropsychological Society, 5 (4), 357-369. (Pubitemid 29292202)
65. Till, C., Colella, B., Verwegen, J., & Green, R. E. (2008). Postrecovery cognitive decline in adults with traumatic brain injury. Archives of Physical Medicine and Rehabilitation, 89 (12 Suppl.), S25-S34.
66. Troster, A. I., Woods, S. P., & Morgan, E. E. (2007). Assessing cognitive change in Parkinson's disease: Development of practice effect-corrected reliable change indices. Archives of Clinical Neuropsychology, 22 (6), 711-718. (Pubitemid 47333037)
67. Vearncombe, K. J., Rolfe, M., Wright, M., Pachana, N. A., Andrew, B., & Beadle, G. (2009). Predictors of cognitive decline after chemotherapy in breast cancer patients. Journal of the International Neuropsychological Society, 15 (6), 951-962.
68. Wechsler, D. (2008). WAIS-IV technical and interpretive manual. San Antonio: Pearson.
69. Woods, S. P., Childers, M., Ellis, R. J., Guaman, S., Grant, I., & Heaton, R. K. (2006). A battery approach for measuring neuropsychological change. Archives of Clinical Neuropsychology, 21 (1), 83-89. (Pubitemid 41802929)
70. Woods, S. P., Delis, D. C., Scott, J. C., Kramer, J. H., & Holdnack, J. A. (2006). The California Verbal Learning Test-second edition: Test-retest reliability, practice effects, and reliable change indices for the standard and alternate forms. Archives of Clinical Neuropsychology, 21 (5), 413-420. (Pubitemid 44247520)
71. Zabel, T. A., von Thomsen, C., Cole, C., Martin, R., & Mahone, E. M. (2009). Reliability concerns in the repeated computerized assessment of attention in children. Clinical Neuropsychology, 23 (7), 1213-1231.
72. Zahodne, L. B., Okun, M. S., Foote, K. D., Fernandez, H. H., Rodriguez, R. L., Kirsch-Darrow, L., et al. (2009). Cognitive declines one year after unilateral deep brain stimulation surgery in Parkinson's disease: A controlled study using reliable change. Clinical Neuropsychology, 23 (3), 385-405.