The robust reliability of neuropsychological measures: Meta-analyses of test-retest correlations

Clinical Neuropsychologist

Volumn 27, Issue 7, 2013, Pages 1077-1105

  Calamia, Matthew ^a   Markon, Kristian ^a   Tranel, Daniel ^a,b  

^a E11 SSH   (United States)

^b UNIVERSITY OF IOWA   (United States)

Author keywords

Neuropsychological assessment; Reliability generalization; Serial testing

Indexed keywords

AGE; EXECUTIVE FUNCTION; HUMAN; MEMORY; META ANALYSIS (TOPIC); NEUROPSYCHOLOGICAL TEST; PSYCHOMETRY; REPRODUCIBILITY; REVIEW; STANDARD; STATISTICS; STANDARDS; STATISTICS AND NUMERICAL DATA;

AGE FACTORS; EXECUTIVE FUNCTION; HUMANS; MEMORY; META-ANALYSIS AS TOPIC; NEUROPSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 84884673641     PISSN: 13854046     EISSN: 17444144     Source Type: Journal    
DOI: 10.1080/13854046.2013.809795     Document Type: Article

References (120)

1. Amir, T. (2001). Benton Visual Retention Test: Reliability, gender, and the effect of extended practice on the performance of participants from UAE. Bulletin of the Faculty of the Arts: Cairo University, 61, 7-16.
2. Alder, A. G., Adam, J., & Arenberg, D. (1990). Individual-differences assessment of the relationship between change in and initial level of adult cognitive functioning. Psychology and Aging, 5, 560-568. doi:10.1037//0882-7974. 5.4.560
3. Attix, D. K., Story, T. J., Chelune, G. J., Ball, J. D., Stutts, M. L., Hart, R. P., & Barth, J. (2009). The prediction of change: Normative neuropsychological trajectories. The Clinical Neuropsychologist, 23, 21-38. doi:10.1080/13854040801945078
4. Azuma, T., Cruz, R. F., Bayles, K. A., Tomoeda, C. K., & Montgomery, E. B.Jr (2003). A longitudinal study of neuropsychological change in individuals with Parkinson's disease. International Journal of Geriatric Psychiatry, 18, 1115-1120. doi:10.1002/gps.1015
5. Basso, M. R., Bornstein, R. A., & Lang, J. M. (1999). Practice effects on commonly used measures of executive function across twelve months. The Clinical Neuropsychologist, 13, 283-292. doi:10.1076/clin.13.3.283.1743
6. Beglinger, L. J., Gaydos, B., Tangphao-Daniels, O., Duff, K., Kareken, D. A., Crawford, J., Siemers, E. R. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20, 517-529. doi:10.1016/j. acn.2004.12.003
7. Beilin, B., Hoofien, D., Poran, R., Gral, I., Grinevich, G., Butin, B., Shavit, Y. (2008). Comparison of two patient-controlled analgesia techniques on neuropsychological functioning in the immediate postoperative period. Journal of Clinical and Experimental Neuropsychology, 30, 674-682. doi:10.1080/ 13803390701667310
8. Benedict, R. H. B. (2005). Effects of using same-versus alternate-form memory tests during short-interval repeated assessments in multiple sclerosis. Journal of the International Neuropsychological Society, 11, 727-736. doi:10.1017/S1355617705050782
9. Berry, D. T. R., Allen, R. S., & Schmitt, F. A. (1991). Rey-osterrieth complex figure: Psychometric characteristics in a geriatric sample. The Clinical Neuropsychologist, 5, 143-153. doi:10.1080/ 13854049108403298
10. Boone, D. E. (1991). Item-reduction vs. subtest-reduction short forms on the WAIS-R with psychiatric inpatients. Journal of Clinical Psychology, 47, 271-276.
11. Bornstein, R. A., Baker, G. B., & Douglass, A. B. (1987). Short-term retest reliability of the Halstead-Reitan Battery in a normal sample. The Journal of Nervous and Mental Disease, 175, 229-232. doi:10.1097/00005053- 198704000-00007
12. Bruggemans, E. F., Vijver, F. J. R. V., & Huysmans, H. A. (1997). Assessment of cognitive deterioration in individual patients following cardiac surgery: Correcting for measurement error and practice effects. Journal of Clinical and Experimental Neuropsychology, 19, 543-559. doi:10.1080/ 01688639708403743
13. Burns, J., Hitchcock, A., Elias, M., & St. Germain, R. (1978). Use of the Satz-Mogel abbreviated WAIS with hospitalized geriatric patients. Experimental Aging Research, 4, 479-491. doi:10.1080/03610737808257170
14. Canter, A. H. (1951). Direct and indirect measures of psychological deficit in multiple scleroris: Part II. The Journal of General Psychology, 44, 27-50. doi:10.1080/00221309.1951.9711236
15. Carlozzi, N. E., Stout, J. C., Mills, J. A., Duff, K., Beglinger, L. J., Aylward, E. H., & , (2011). The PREDICT-HD Investigators of the Huntington Study Group. Estimating premorbid IQ in the prodromal phase of a neurodegenerative disease. The Clinical Neuropsychologist, 25, 757-777. doi:10.1080/13854046.2011.577811
16. Carvajal, H., Schrader, M. S., & Holmes, C. B. (1996). Retest reliability of the Wechsler Adult Intelligence Scale-Revised for 18-to 19-Year-Olds. Psychological Reports, 78, 211-214. doi:10.2466/pr0.1996.78.1.211
17. Catron, D. W. (1978). Immediate test-retest changes in WAIS scores among college males. Psychological Reports, 43, 279-290. doi:10.2466/pr0.1978.43.1.279
18. Chaves, O. C., Lombardo, L. E., Bearden, C. E., Woolsey, M. D., Martinez, D. M., Barrett, J. A., Glahn, D. C. (2011). Association of clinical symptoms and neurocognitive performance in bipolar disorder: A longitudinal study. Bipolar Disorders, 13, 118-123. doi:10.1111/j.1399-5618.2011.00888.x
19. Cuesta, M. J., Peralta, V., Zarzuela, A., & Zandio, M. (2006). Insight dimensions and cognitive function in psychosis: A longitudinal study. BMC Psychiatry, 6, 26. doi:10.1186/1471-244X-6-26
20. Dangour, A. D., Allen, E., Elbourne, D., Fasey, N., Fletcher, A. E., Hardy, P., Uauy, R. (2010). Effect of 2-yn- 3 long-chain polyunsaturated fatty acid supplementation on cognitive function in older people: A randomized, double-blind, controlled trial. The American Journal of Clinical Nutrition, 91, 1725-1732. doi:10.3945/ajcn.2009.29121
21. Delis, D., Kaplan, E., Kramer, J., & Ober, B. (2000). California Verbal Learning Test-II. San Antonio, TX: The Psychological Corporation.
22. Delis, D., Kramer, J., Kaplan, E., & Ober, B. (1987). California Verbal Learning Test. San Antonio, TX: The Psychological Corporation.
23. Delis, D. C., McKee, R., Massman, P. J., & Kramer, J.H. (1991). Alternate form of the California Verbal Learning Test: Development and reliability. The Clinical Neuropsychologist, 5, 154-162. doi:10.1080/ 13854049108403299
24. Demakis, G. J. (1999). Serial malingering on verbal and nonverbal fluency and memory measures: An analog investigation. Archives of Clinical Neuropsychology, 14, 401-410. doi:10.1016/S0887-6177(98)00039-0
25. Dikmen, S. S., Heaton, R. K., Grant, I., & Temkin, N. R. (1999). Test-retest reliability and practice effects of Expanded Halstead-Reitan Neuropsychological Rest Battery. Journal of the International Neuropsychological Society, 5, 346-356. doi:10.1111/j.1528-1157.1995. tb00976.x
26. Dodrill, C. B., & Troupin, A. S. (1975). Effects of repeated administrations of a comprehensive neuropsychological battery among chronic epileptics. Journal of Nervous and Mental Disorders, 161, 185-190. doi:10.1097/00005053-197509000-00006
27. Duff, K., Beglinger, L. J., Van Der Heiden, S., Moser, D. J., Arndt, S., Schultz, S. K., & Paulsen, J. (2008). Short-term practice effects in amnestic mild cognitive impairment: Implications for diagnosis and treatment. International Psychogeriatrics, 20, 986-999. doi:10.1017/S1041610208007254
28. Duff, K., Westervelt, H. J., McCaffrey, R. J., & Haase, R. F. (2001). Practice effects, test-retest stability, and dual baseline assessments with the California Verbal Learning Test in an HIV sample. Archives of Clinical Neuropsychology, 16, 461-476. doi:10.1093/arclin/16.5.461
29. Duke, R. B., Bloor, B. M., & Nugent, G. R. (1968). Changes in performance on WAIS, trail making test and finger tapping test associated with carotid artery surgery. Perceptual and Motor Skills, 26, 399-404.
30. Eckardt, M. J., & Matarazzo, J. D. (1981). Test-retest reliability of the Halstead Impairment Index in hospitalized alcoholic and nonalcoholic males with mild to moderate neuropsychological impairment. Journal of Clinical and Experimental Neuropsychology, 3, 257-269. doi:10.1080/01688638108403129
31. Elwood, D. L. (1972). Test-retest reliability and cost analyses of automated and face to face intelligence testing. International Journal of Man-Machine Studies, 4, 1-22. doi:10.1016/S0020-7373(72)80017-8
32. Estevis, E., Basso, M., & Combs, D. (2012). Effects of practice on the Wechsler Adult Intelligence Scale-IV across 3-and 6-month intervals. The Clinical Neuropsychologist, 26, 239-254. doi:10.1080/13854046.2012.659219
33. Ettenhofer, M. L., Hambrick, D. Z., & Abeles, N. (2006). Reliability and stability of executive functioning in older adults. Neuropsychology, 20, 607-613. doi:10.1037/0894-4105.20.5.607
34. Flanagan, J. L., & Jackson, S. T. (1997). Test-retest reliability of three aphasia tests: Performance of non-brain-damaged older adults. Journal of Communication Disorders, 30, 33-43. doi:10.1016/S0021-9924(96)00039-1
35. Franzen, M. D., Paul, D., & Iverson, G. L. (1996). Reliability of alternate forms of the trail making test. The Clinical Neuropsychologist, 10, 125-129. doi:10.1080/13854049608406672
36. Ganguli, M., Seaberg, E. C., Ratcliff, G. G., Belle, S. H., & DeKosky, S. T. (1996). Cognitive stability over 2 Years in a rural elderly population: The MoVIES project. Neuroepidemiology, 15, 42-50. doi:10.1159/000109888
37. Geffen, G. M., Butterworth, P., & Geffen, L. B. (1994). Test-retest reliability of a new form of the auditory verbal learning test (AVLT). Archives of Clinical Neuropsychology, 9, 303-316. doi:10.1016/0887-6177(94)90018-3
38. Goldstein, G., & Watson, J. R. (1989). Test-retest reliability of the Halstead-Reitan battery and the WAIS in a neuropsychiatric population. The Clinical Neuropsychologist, 3, 265-272. doi:10.1080/13854048908404088
39. Greig, T. C., Nicholls, S. S., Wexler, B. E., & Bell, M. D. (2004). Test-retest stability of neuropsychological testing and individual differences in variability in schizophrenia outpatients. Psychiatry Research, 129, 241-247. doi:10.1016/j.psychres.2004.09.006
40. Gregory, T., Nettelbeck, T., Howard, S., & Wilson, C. (2008). Inspection time: A biomarker for cognitive decline. Intelligence, 36, 664-671. doi:10.1016/j.intell.2008.03.005
41. Greve, K. W., Love, J. M., Sherwin, E., Mathias, C. W., Houston, R. J., & Brennan, A. (2002). Temporal stability of the Wisconsin Card Sorting Test in a chronic traumatic brain injury sample. Assessment, 9, 271. doi:10.1177/1073191102009003006
42. Harciarek, M., Biedunkiewicz, B., Lichodziejewska-Niemierko, M., Debska-Slizen, A., & Rutkowski, B. (2009). Cognitive performance before and after kidney transplantation: A prospective controlled study of adequately dialyzed patients with end-stage renal disease. Journal of the International Neuropsychological Society, 15, 684-694. doi:10.1017/S1355617709990221
43. Harvey, P. D., Palmer, B. W., Heaton, R. K., Mohamed, S., Kennedy, J., & Brickman, A. (2005). Stability of cognitive performance in older patients with schizophrenia: An 8-week test-retest study. American Journal of Psychiatry, 162, 110-117. doi:10.1176/appi. ajp.162.1.110
44. Hatsukami, D. K., Mitchell, J. E., Morley, J. E., Morgan, S. F., & Levine, A. S. (1986). Effect of naltrexone on mood and cognitive functioning among overweight men. Biological Psychiatry, 21, 293-300. doi:10.1016/0006- 3223(86)90050-8
45. Heaton, R. K., Temkin, N., Dikmen, S., Avitable, N., Taylor, M. J., Marcotte, T. D., & Grant, I. (2001). Detecting change: A comparison of three neuropsychological methods, using normal and clinical samples. Archives of Clinical Neuropsychology, 16, 75-91. doi:10.1093/arclin/16.1.75
46. Hermann, B. P., Seidenberg, M., Schoenfeld, J., Peterson, J., Leveroni, C., & Wyler, A. R. (1996). Empirical techniques for determining the reliability, magnitude, and pattern of neuropsychological change after epilepsy surgery. Epilepsia, 37, 942-950. doi:10.1111/j.1528-1157.1996.tb00531.x
47. Hopp, G. A., Dixon, R. A., Grut, M., & Bäckman, L. (1997). Longitudinal and psychometric profiles of two cognitive status tests in very old adults. Journal of Clinical Psychology, 53, 673-686. doi:10.1002/(SICI)1097- 4679(199711)53:7673::AID-JCLP53.0.CO;2-J
48. Hoth, K. F., Haley, A. P., Gunstad, J., Paul, R. H., Poppas, A., Jefferson, A. L., Cohen, R. (2008). Elevated c-reactive protein is related to cognitive decline in older adults with cardiovascular disease. Journal of the American Geriatrics Society, 56, 1898-1903.
49. doi:10.1111/j.1532-5415.2008.01930.x Hubley, A. M., & Jassal, S. (2006). Comparability of the Rey-Osterrieth and Modified Taylor Complex Figures using total scores, completion times, and construct validation. Journal of Clinical and Experimental Neuropsychology, 28, 1482-1497.
50. Ingram, F., Greve, K. W., Ingram, P. T. F., & Soukup, V. M. (1999). Temporal stability of the Wisconsin Card Sorting Test in an untreated patient sample. British Journal of Clinical Psychology, 38, 209-211. doi:10.1348/014466599162764
51. Ishizaki, J., Meguro, K., Ohe, K., Kimura, E., Tsuchiya, E., Ishii, H., Yamadori, A. (2002). Therapeutic psychosocial intervention for elderly subjects with very mild Alzheimer disease in a community: The tajiri project. Alzheimer Disease & Associated Disorders, 16, 261.
52. doi:10.1097/00002093-200210000-00008
53. Kelland, D. Z., & Lewis, R. F. (1994). Evaluation of the reliability and validity of the repeatable cognitive-perceptual-motor battery. The Clinical Neuropsychologist, 8, 295-308. doi:10.1080/13854049408404136
54. Kent, P. S., & Luszcz, M. A. (2002). A review of the Boston Naming Test and multiple-occasion normative data for older adults on 15-item versions. The Clinical Neuropsychologist, 16, 555-574. doi:10.1076/clin.16.4.555.13916
55. Killian, G. A., Holzman, P. S., Davis, J. M., & Gibbons, R. D. (1984). Effects of psychotropic medication on selected cognitive and perceptual measures. Journal of Abnormal Psychology, 93, 58-70. doi:10.1037//0021-843X.93. 1.58
56. Klonoff, H., Fibiger, C. H., & Hutton, G. H. (1970). Neuropsychological patterns in chronic schizophrenia. Journal of Nervous and Mental Disease, 150, 291-300. doi:10.1097/00005053-197004000-00004
57. Krupp, L., Christodoulou, C., Melville, P., Scherl, W., MacAllister, W., & Elkins, L. (2004). Donepezil improved memory in multiple sclerosis in a randomized clinical trial. Neurology, 63, 1579-1585.
58. Langenecker, S. A., Zubieta, J. K., Young, E. A., Akil, H., & Nielson, K. A. (2007). A task to manipulate attentional load, set-shifting, and inhibitory control: Convergent validity and test-retest reliability of the parametric Go/No-go test. Journal of Clinical and Experimental Neuropsychology, 29, 842-853. doi:10.1080/13803390601147611
59. Lehrner, J., Willfort, A., Mlekusch, I., Guttmann, G., Minar, E., Ahmadi, R., Lang, W. (2005). Neuropsychological outcome 6 months after unilateral carotid stenting. Journal of Clinical and Experimental Neuropsychology, 27, 859-866. doi:10.1080/13803390490919083
60. Lemay, S., Bedard, M. A., Rouleau, I., & Tremblay, P. L. (2004). Practice effect and test-retest reliability of attentional and executive tests in middle-aged to elderly subjects. The Clinical Neuropsychologist, 18, 284-302. doi:10.1080/13854040490501718
61. Levine, A., Miller, E., Becker, J., Selnes, O., & Cohen, B. (2004). Normative data for determining significance of test-retest differences on eight common neuropsychological instruments. The Clinical Neuropsychologist, 18, 373-384. doi:10.1080/1385404049052420
62. Lu, P. H., Masterman, D. A., Mulnard, R., Cotman, C., Miller, B., Yaffe, K., Cummings, J. (2006). Effects of testosterone on cognition and mood in male patients with mild Alzheimer disease and healthy elderly men. Archives of Neurology, 63, 177. doi:10.1001/archneur.63.2. nct50002
63. Margolis, R. B., Dunn, E. J., & Taylor, J. M. (1985). Parallel-form reliability of the Wechsler Memory Scale in a geriatric population with suspected dementia. The Journal of Psychology, 119, 81-85. doi:10.1080/00223980. 1985.9712609
64. Martin, R., Sawrie, S., Gilliam, F., Mackey, M., Faught, E., Knowlton, R., Kuzniekcy, R. (2002). Determining reliable cognitive change after epilepsy surgery: Development of reliable change indices and standardized Regression-based change norms for the WMS-III and WAIS-III. Epilepsia, 43, 1551-1558.
65. Matarazzo, J. D., & Herman, D. O. (1984). Base rate data for the WAIS-R: Test-retest stability and VIQ-PIQ differences. Journal of Clinical Neuropsychology, 6, 351-366.
66. Matarazzo, J. D., Wiens, A. N., Matarazzo, R. G., & Goldstein, S. G. (1974). Psychometric and clinical test-retest reliability of the Halstead Impairment Index in a sample of healthy, young, normal men. Journal of Nervous and Mental Disease, 158, 37-49. doi:10.1097/00005053-197401000-00006
67. McCaffrey, R. J., Cousins, J. P., Westervelt, H. J., Martynowicz, M., Remick, S. C., Szebenyi, S., Haase, R. (1995). Practice effects with the NIMH AIDS abbreviated neuropsychological battery. Archives of Clinical Neuropsychology, 10, 241-250. doi:10.1093/arclin/10.3.241
68. McCaffrey, R. J., Ortega, A., Orsillo, S. M., & Nelles, W. B. (1992). Practice effects in repeated neuropsychological assessments. The Clinical Neuropsychologist, 6, 32-42. doi:10.1080/13854049208404115
69. McCracken, L. M., & Franzen, M. D. (1992). Principal-components analysis of the equivalence of alternate forms of the Trail Making Test. Psychological Assessment, 4, 235-238. doi:10.1037//1040-3590.4.2.235
70. McCaffrey, R. J., Westervelt, H. J., & Haase, R. F. (2001). Serial neuropsychological assessment with the National Institute of Mental Health (NIMH) AIDS Abbreviated Neuropsychological Battery. Archives of Clinical Neuropsychology, 16, 9-18. doi:10.1093/arclin/16.1.9
71. Messinis, L., Lyros, E., Georgiou, V., & Papathanasopoulos, P. (2009). Benton Visual Retention Test performance in normal adults and acute stroke patients: Demographic considerations, discriminant validity, and test-retest reliability. The Clinical Neuropsychologist, 23, 962-977. doi:10.1080/13854040902740691
72. Mitrushina, M., & Satz, P. (1991). Effect of repeated administration of a neuropsychological battery in the elderly. Journal of Clinical Psychology, 47, 790-801. doi:10.1002/1097-4679 (199111)47:6790::AID-JCLP22704706103.0.CO;2-C
73. Moritz, S., Iverson, G. L., & Woodward, T. S. (2003). Reliable change indexes for memory performance in schizophrenia as a means to determine drug-induced cognitive decline. Applied Neuropsychology, 10, 115-120. doi:10.1207/S15324826AN1002-07
74. Morris, J. C., Heymann, A., Mohs, R. C., Hughes, J. R., van Belle, G., Fillenbaum, G., Clark, C. (1989). The Consortium to Establish a Registry for Alzheimer's Disease (CERAD). Part I. Clinical and neuropsychological assessment of Alzheimer's disease. Neurology, 39, 1159-1165.
75. Mortensen, E. L., & Kleven, M. (1993). A WAIS longitudinal study of cognitive development during the life span from ages 50 to 70. Developmental Neuropsychology, 9, 115-130. doi:10.1080/87565649109540548
76. Muslimovi?, D., Post, B., Speelman, J. D., de Haan, R. J., & Schmand, B. (2009). Cognitive decline in Parkinson's disease: A prospective longitudinal study. Journal of the International Neuropsychological Society, 15, 426-437. doi:10.1017/S135561770909061
77. Nakhutina, L., Pramataris, P., Morrison, C., Devinsky, O., & Barr, W. B. (2010). Reliable change indices and regression-based measures for the Rey-Osterreith Complex Figure Test in partial epilepsy patients. The Clinical Neuropsychologist, 24, 38-44. doi:10.1080/13854040902960091
78. Netherton, S. D., Elias, J. W., Albrecht, N. N., & Acosta, C. (1989). Changes in the performance of parkinsonian patients and normal aged on the Benton Visual Retention Test. Experimental Aging Research, 15, 13-18. doi:10.1080/03610738908259753
79. Newson, R. S., & Kemps, E. B. (2005). General lifestyle activities as a predictor of current cognition and cognitive change in older adults: A cross-sectional and longitudinal examination. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 60, P113-P120. doi:10.1093/geronb/60.3.P113
80. Paolo, A. M., Axelrod, B. N., & Tröster, A. I. (1996). Test-retest stability of the Wisconsin Card Sorting Test. Assessment, 3, 137-143. doi:10.1177/107319119600300205
81. Paolo, A. M., Tröster, A. I., & Ryan, J. J. (1997). Test-retest stability of the California Verbal Learning Test in older persons. Neuropsychology, 11, 613-616. doi:10.1037/0894-4105.11.4.613
82. Rabin, A. I. (1944). Test constancy and variation in the mentally ill. Journal of General Psychology, 31, 231-239.
83. Rezvanfard, M., Ekhtiari, H., Maryam Noroozian, M., & Nilipour, R. (2011). The Rey Auditory Verbal Learning Test: Alternate forms equivalency and reliability for the Iranian Adult Population (Persian Version). Archives of Iranian Medicine, 14, 104-109.
84. Rönnlund, M., & Nilsson, L. G. (2006). Adult life-span patterns in WAIS-R Block Design performance: Cross-sectional versus longitudinal age gradients and relations to demographic factors. Intelligence, 34, 63-78. doi:10.1016/j.intell.2005.06.004
85. Rosen, M., Stallings, L., Floor, L., & Nowakiwska, M. (1968). Reliability and stability of Wechsler IQ scores for institutionalized mental subnormals. American Journal of Mental Deficiency, 73, 218-225.
86. Ross, T. P. (2003). The reliability of cluster and switch scores for the Controlled Oral Word Association Test. Archives of Clinical Neuropsychology, 18, 153-164. doi:10.1016/S0887-6177(01)00192-5
87. Ruff, R. M., Light, R. H., & Parker, H. S. (1996). Benton Controlled Oral Word Association Test: Reliability and updated norms. Archives of Clinical Neuropsychology, 11, 329-338. doi:10.1093/arclin/11.4.329
88. Ryan, J., Geisser, M. E., Randall, D. M., & Georgemiller, R. J. (1986). Alternate form reliability and equivalency of the Rey Auditory Verbal Learning Test. Journal of Clinical and Experimental Neuropsychology, 8, 611-616. doi:10.1080/01688638608405179
89. Ryan, J., Georgemiller, R. J., Geisser, M. E., & Randall, D. M. (1985). Test-retest stability of the WAIS-R in a clinical sample. Journal of Clinical Psychology, 41, 552-556. doi:10.1002/1097-4679(198507)41:4552::AID- JCLP22704104183.0.CO;2-#
90. Ryan, J. J., Paolo, A. M., & Brungardt, T. M. (1992). WAIS-R test-retest stability in normal persons 75 years and older. The Clinical Neuropsychologist, 6, 3-8. doi:10.1080/13854049208404111
91. Sachs, B. C., Lucas, J. A., Smith, G. E., Ivnik, R. J., Petersen, R. C., Graff-Radford, N. R., & Pedraza, O. (2012). Reliable change on the Boston Naming Test. Journal of the International Neuropsychological Society, 18, 375-378. doi:10.1017/S1355617711001810
92. Sano, M., Bell, K., Cote, L., Dooneief, G., Lawton, A., Legler, L., Mayeux, R. (1992). Double-blind parallel design pilot study of acetyl levocarnitine in patients with Alzheimer's disease. Archives of Neurology, 49, 1137-1141.
93. Santos, R. F., Galduroz, J. C., Barbieri, A., Castiglioni, M. L., Ytaya, L. Y., & Bueno, O. F. (2003). Cognitive performance, SPECT, and blood viscosity in elderly non-demented people using ginkgo biloba. Pharmacopsychiatry, 36, 127-133. doi:10.1055/s-2003-41197
94. Sawrie, S. M., Chelune, G. J., Naugle, R. I., & Lüders, H. O. (1996). Empirical methods for assessing meaningful neuropsychological change following epilepsy surgery. Journal of the International Neuropsychological Society, 2, 556-564. doi:10.1017/S1355617700001739
95. Sawrie, S. M., Marson, D. C., Boothe, A. L., & Harrell, L. E. (1999). A method for assessing clinically relevant individual cognitive change in older adult populations. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 54, P116-P124. doi:10.1093/geronb/54B.2.P116
96. Shaw, P. J., Bates, D., Cartlidge, N., French, J. M., Heaviside, D., Julian, D. G., & Shaw, D. A. (1987). Neurologic and neuropsychological morbidity following major surgery: Comparison of coronary artery bypass and peripheral vascular surgery. Stroke, 18, 700-707. doi:10.1161/01.STR.18.4.700
97. Shuttleworth-Edwards, A. B., Smith, I., & Radloff, S. E. (2008). Neurocognitive vulnerability amongst university rugby players versus noncontact sport controls. Journal of Clinical and Experimental Neuropsychology, 30, 870-884. doi:10.1080/13803390701846914
98. Silberstein, C. H., O'Dowd, M. A., Chartock, P., Schoenbaum, E. E., Friedland, G., Hartel, D., & McKegney, F. P. (1993). A prospective four-year follow-up of neuropsychological function in HIV seropositive and seronegative methadone-maintained patients. General Hospital Psychiatry, 15, 351-359. doi:10.1016/0163-8343(93)90001-5
99. Silverstein, S. M., Jaeger, J., Donovan-Lepore, A. M., Wilkniss, S. M., Savitz, A., Malinovsky, I., Dent, G. (2010). A comparative study of the MATRICS and IntegNeuro cognitive assessment batteries. Journal of Clinical and Experimental Neuropsychology, 32, 937-952. doi:10.1080/13803391003596496
100. Slate, J. R., Frost, J., & Cross, B. (1991). WAIS-R stability for college students with learning disabilities. Learning Disability Quarterly, 14, 2-6. doi:10.2307/1510369
101. Snow, W. G., Tierney, M. C., Zorzitto, M. L., & Fisher, R. H. (1989). WAIS-R test-retest reliability in a normal elderly sample. Journal of Clinical and Experimental Neuropsychology, 4, 423-428. doi:10.1080/01688638908400903
102. Steinmetz, J. P., Brunner, M., Loarer, E., & Houssemand, C. (2010). Incomplete psychometric equivalence of scores obtained on the manual and the computer version of the Wisconsin Card Sorting Test? Psychological Assessment, 22, 199-202. doi:10.1037/a0017661
103. Sweeney, J. A., Haas, G. L., Keilp, J. G., & Long, M. (1991). Evaluation of the stability of neuropsychological functioning after acute episodes of schizophrenia: One-year followup study. Psychiatry Research, 38, 63-76. doi:10.1016/0165-1781(91)90053-R
104. Tate, R. L., Perdices, M., & Maggiotto, S. (1998). Stability of the Wisconsin Card Sorting Test and the determination of reliability of change in scores. The Clinical Neuropsychologist, 12, 348-357. doi:10.1076/clin.12.3.348. 1988
105. Theisen, M. E. (1997). The effects of practice in repeated administration of the Wechsler Memory Scale-Revised and the California Verbal Learning Test in normal adults. (Doctoral Dissertation). Wayne State University, Detroit, Michigan.
106. Thompson, K., & Sergejew, A. A. (1998). Two-week test-retest of the WAIS-R and WMS-R subtests, the Purdue Pegboard, Trailmaking, and the Mental Rotation Test in women. Australian Psychologist, 33, 228-230. doi:10.1080/00050069808257410
107. Tröster, A. I., Woods, S. P., & Morgan, E. E. (2007). Assessing cognitive change in Parkinson's disease: Development of practice effect-corrected reliable change indices. Archives of Clinical Neuropsychology, 22, 711-718. doi:10.1016/j.acn.2007.05.004
108. Tuikka, R. A., Laaksonen, R. K., & Somer, H. V. K. (1993). Cognitive function in myotonic dystrophy: A follow-up study. European Neurology, 33, 436-441. doi:10.1159/000116989
109. Uchiyama, C. L., D'Elia, L. F., Dellinger, A. M., Becker, J. T., Selnes, O. A., Wesch, J. E., Miller, E. (1995). Alternate forms of the auditory-verbal learning test: Issues of test comparability, longitudinal reliability, and moderating demographic variables. Archives of Clinical Neuropsychology, 10, 133-145. doi:10.1093/arclin/10.2.133
110. Wagner, E. E., & Caldwell, M. S. (1979). WAIS test-retest reliability for a clinical out-patient sample. Perceptual and Motor Skills, 48, 131-137. doi:10.2466/pms.1979.48.1.131
111. Watkins, C.Jr, & Campbell, V. (1992). The test-retest reliability and stability of the WAIS-R in a sample of mentally retarded adults. Journal of Intellectual Disability Research, 36, 265-268. doi:10.1111/j.1365-2788.1992. tb00514.x
112. Wechsler, D. (1981). The Wechsler Adult Intelligence Scale-Revised Manual. San Antonio, TX: Psychological Corporation.
113. Wechsler, D. (1997). The Wechsler Adult Intelligence Scale-III Manual. San Antonio, TX: Psychological Corporation.
114. Wechsler, D. (1999). The Wechsler Abbreviated Scale of Intelligence Manual. San Antonio, TX: Psychological Corporation.
115. Wechsler, D. (2008). The Wechsler Adult Intelligence Scale-IV Manual. San Antonio, TX: Psychological Corporation.
116. Wechsler, D. (2011). The Wechsler Abbreviated Scale of Intelligence-Second Edition Manual. San Antonio, TX: Psychological Corporation.
117. Woods, S. P., Childers, M., Ellis, R. J., Guaman, S., Grant, I., & Heaton, R. K. (2006a). A battery approach for measuring neuropsychological change. Archives of Clinical Neuropsychology, 21, 83-89. doi:10.1016/j.acn.2005. 07.008
118. Woods, S. P., Delis, D. C., Scott, J. C., Kramer, J. H., & Holdnack, J. A. (2006b). The California Verbal Learning Test-second edition: Test-retest reliability, practice effects, and reliable change indices for the standard and alternate forms. Archives of Clinical Neuropsychology, 21, 413-420. doi:10.1016/j.acn.2006.06.002
119. Youngjohn, J. R., Larrabee, G. J., & Crook, T. H. (1992). Test-retest reliability of computerized, everyday memory measures and traditional memory tests. The Clinical Neuropsychologist, 6, 276-286. doi:10.1080/13854049208404129
120. Zec, R. F., Markwell, S. J., Burkett, N. R., & Larsen, D. L. (2005). A longitudinal study of confrontation naming in the normal elderly. Journal of the International Neuropsychological Society, 11, 716-726. doi:10.1017/ S1355617705050897