Parallel but not equivalent: Challenges and solutions for repeated assessment of cognition over time

Journal of Clinical and Experimental Neuropsychology

Volumn 34, Issue 7, 2012, Pages 758-772

  Gross, Alden L ^b,c   Inouye, Sharon K ^b,c   Rebok, George W ^a,d   Brandt, Jason ^a,d   Crane, Paul K ^e   Parisi, Jeanine M ^a   Tommet, Doug ^b   Bandeen Roche, Karen ^a   Carlson, Michelle C ^a   Jones, Richard N ^b,c  

^a JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^b Hebrew Senior Life   (United States)

^c HARVARD MEDICAL SCHOOL   (United States)

^d JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^e UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Alternate forms; Equating; Equipercentile; Longitudinal analysis; Neuropsychology; Parallel forms

Indexed keywords

AGED; ARTICLE; COGNITION; COGNITIVE DEFECT; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; FEMALE; HUMAN; INDIVIDUALITY; LEARNING; LONGITUDINAL STUDY; MALE; NEUROPSYCHOLOGICAL TEST; PSYCHOLOGICAL ASPECT; RANDOMIZED CONTROLLED TRIAL;

AGED; AGED, 80 AND OVER; COGNITION; COGNITION DISORDERS; FEMALE; HUMANS; INDIVIDUALITY; LONGITUDINAL STUDIES; MALE; NEUROPSYCHOLOGICAL TESTS; VERBAL LEARNING;

EID: 84864972337     PISSN: 13803395     EISSN: 1744411X     Source Type: Journal    
DOI: 10.1080/13803395.2012.681628     Document Type: Article

References (61)

1. Albano, A. (2011) equate: Statistical methods for test score equating. R package Version 1.1-2. [computer software] http://CRAN.R-project.org/package= equate (Accessed: 19 December 2011).
2. Alzheimer's Disease Neuroimaging Initiative. Welcome to ADNI. http://adni.loni.ucla.edu/(Accessed: 12 April 2012).
3. Anderson, J. R., and, Bower, G. H. 1972. Recognition and retrieval processes in free recall. Psychological Review, 79: 97-123.
4. Ball, K., Berch, D. B., Helmers, K. F., Jobe, J. B., Leveck, M. D., Marsiske, M. 2002. Effects of cognitive training interventions with older adults: A randomized controlled trial. Journal of the American Medical Association, 288: 2271-2281.
5. Battig, W. F., and, Montague, W. E. 1969. Category norms for verbal items in 56 categories: A replication and extension of the Connecticut category norms [Monograph]. Journal of Experimental Psychology, 80: 1-46.
6. Beckett, L. A., Harvey, D. J., Gamst, A., Donohue, M., Kornak, J., Zhang, H. 2010. The Alzheimer's Disease Neuroimaging Initiative: Annual change in biomarkers and clinical outcomes. Alzheimer's & Dementia: The Journal of the Alzheimer's Association, 6: 257-264.
7. Bollen, K. A., and, Curran, P. J. 2006. Latent curve models: A structural equation approach, Hoboken, NJ: Wiley.
8. Borsboom, D. 2005. Measuring the mind: Conceptual issues in contemporary psychometrics, Cambridge, UK: Cambridge University Press.
9. Brandt, J., and, Benedict, R. H. B. 2001. Hopkins Verbal Learning Test-Revised: Professional manual, Odessa, FL: Psychological Assessment Resources.
10. Carmichael, O., Schwarz, C., Drucker, D., Fletcher, E., Harvey, D., Beckett, L. 2010. Longitudinal changes in white matter disease and cognition in the first year of ADNI. Archives of Neurology, 67: 1370-1378.
11. Cozby, P. C. 2009. Methods in behavioral research, 10th, New York, NY: McGraw-Hill.
12. Crane, P. K., Carle, A., Gibbons, L. E., Insel, P., Mackin, S., and, Gross, A. L. 2012. Development and assessment of a psychometrically sophisticated composite score for memory in the Alzheimer's Disease Neuroimaging Initiative (ADNI), Manuscript submitted for publication. (for the Alzheimer's Disease Neuroimaging Initiative)
13. Crawford, J. R., Stewart, L. E., and, Moore, J. W. 1989. Demonstration of savings on the AVLT and development of a parallel form. Journal of Clinical and Experimental Neuropsychology, 11: 975-981.
14. Donders, A. R., van der Heijden, G. J., Stijnen, T., and, Moons, K. G. 2006. Review: A gentle introduction to imputation of missing values. Journal of Clinical Epidemiology, 59: 1087-1091.
15. Ebbinghaus, H. 1964. Memory: A contribution to experimental psychology, New York, NY: Dover. (Original work published 1895)
16. Ferrer, E., Salthouse, T., McArdle, J., Stewart, W., and, Schwartz, B. 2005. Multivariate modeling of age and retest in longitudinal studies of cognitive abilities. Psychology & Aging, 20 (3): 412-422.
17. Ferrer, E., Salthouse, T. A., Stewart, W. F., and, Schwartz, B. S. 2004. Modeling age and retest processes in longitudinal studies of cognitive abilities. Psychology & Aging, 19 (2): 243-259.
18. Fong, T. G., Fearing, M. A., Jones, R. N., Shi, P., Marcantonio, E. R., Rudolph, J. L. 2009. Telephone interview for cognitive status: Creating a crosswalk with the Mini-Mental State Examination. Alzheimers & Dementia, 5 (6): 492-497.
19. Fong, T. G., Jones, R. N., Rudolph, J. L., Yang, F. M., Tommet, D., Habtemariam, D. 2011. Development and validation of a brief cognitive assessment tool: The sweet 16. Archives of Internal Medicine, 171 (5): 432-437.
20. Fuller, K. H., Gouvier, W. D., and, Savage, R. M. 1997. Comparison of List B and List C of the Rey Auditory Verbal Learning Test. The Clinical Neuropsychologist, 11: 201-204.
21. Furukawa, T. A., Shear, M. K., Barlow, D. H., Gorman, J. M., Woods, S. W., Money, R. 2009. Evidence-based guidelines for interpretation of the Panic Disorder Severity Scale. Depression and Anxiety, 26 (10): 922-929.
22. Geffen, G. M., Butterworth, P., and, Geffen, L. B. 1994. Test-retest reliability of a new form of the Auditory Verbal Learning Test (AVLT). Archives of Clinical Neuropsychology, 9: 303-316.
23. Gross, A. L., and, Rebok, G. W. 2011. Memory training and strategy use among older adults: Results from the ACTIVE cognitive intervention trial. Psychology & Aging, 26: 503-517.
24. Gross, A. L., Rebok, G. W., Unverzagt, F. W., Willis, S. L., and, Brandt, J. 2011. Cognitive predictors of everyday functioning in the elderly: Results from the ACTIVE cognitive intervention trial. Journal of Gerontology: Psychological Sciences, 66: 557-566.
25. Hawkins, K. A., Dean, D., and, Pearlson, G. D. 2004. Alternative forms of the Rey Auditory Verbal Learning Test: A review. Behavioural Neurology, 15: 99-107.
26. Hinrichs, C., Singh, V., Xu, G., Johnson, S. C., and, Alzheimers Disease Neuroimaging Initiative. 2011. Predictive markers for AD in a multi-modality framework: An analysis of MCI progression in the ADNI population. NeuroImage, 55: 574-589.
27. Hu, L., and, Bentler, P. M. 1999. Cutoff criteria for fit indices in covariance structure analysis: Conventional versus new alternatives. Structural Equation Modeling, 6: 1-55.
28. Ivnik, R. J., Malec, J. F., Tangalos, E. G., Petersen, R. C., Kokmen, E., and, Kurland, L. T. 1990. The Auditory Verbal Learning Test (AVLT): Norms for ages 55 and older. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 2 (3): 304-312.
29. Jobe, J. B., Smith, D. M., Ball, K., Tennstedt, S. L., Marsiske, M., Willis, S. L. 2001. ACTIVE: A cognitive intervention trial to promote independence in older adults. Controlled Clinical Trials, 22: 453-479.
30. Kolen, M., and, Brennan, R. 1995. Test equating: Methods and practices, New York, NY: Springer.
31. Leucht, S., Kane, J. M., Kissling, W., Hamann, J., Etschel, E., and, Engel, R. R. 2005. What does the PANSS mean?. Schizophrenia Research, 79 (2-3): 231-238.
32. Lezak, M. D., Howieson, D. B., and, Loring, D. W. 2004. Neuropsychological assessment, 2nd, New York, NY: Oxford University Press.
33. Light, L. 1991. Memory and aging: Four hypotheses in search of data. Annual Review of Psychology, 42: 333-376.
34. Livingston, S. A. (2004). Equating test scores (without IRT). Educational Testing Service. http://www.ets.org/Media/Research/pdf/LIVINGSTON.pdf
35. McArdle, J. J., and, Bell, R. Q. 2000. Recent trends in modeling longitudinal data by latent growth curve methods. In Modeling longitudinal and multiple-group data: Practical issues, applied approaches, and scientific examples, Edited by: Little, T. D., Schnabel, K. U. and Baumert, J. 69-108. Mahwah, NJ: Lawrence Erlbaum Associates.
36. Mitrushina, M., Boone, K. B., Razani, J., and, D'Elia, L. F. 2005. Handbook of normative data for neuropsychological assessment, 2nd, New York, NY: Oxford University Press.
37. Montoya, A., Valladares, A., Lizán, L., San, L., Escobar, R., and, Paz, S. 2011. Validation of the Excited Component of the Positive and Negative Syndrome Scale (PANSS-EC) in a naturalistic sample of 278 patients with acute psychosis and agitation in a psychiatric emergency room. Health and Quality of Life Outcomes, 9: 18
38. Murphy, E. A., Holland, D., Donohue, M., McEvoy, L. K., Hagler, D. J. Jr., Dale, A. M. 2010. Six-month atrophy in MTL structures is associated with subsequent memory decline in elderly controls. NeuroImage, 53: 1310-1317.
39. Muthén, B. O. 1997. Latent variable modeling with longitudinal and multilevel data. In Sociological methodology, Edited by: Raftery, A. 453-480. Boston, MA: Blackwell Publishers.
40. Muthén, B. O., and, Curran, P. J. 1997. General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2: 371-402.
41. Muthén, L. K., and, Muthén, B. O. 1998-2010. Mplus user's guide, 6th, Los Angeles, CA: Muthén & Muthén. computer software
42. Noonan, V. K., Cook, K. F., Bamer, A. M., Choi, S. W., Kim, J., and, Amtmann, D. in press. Measuring fatigue in persons with multiple sclerosis: Creating a crosswalk between the Modified Fatigue Impact Scale and the PROMIS Fatigue Short Form. In Quality of Life Research, Advance online publication. doi: 10.1007/s11136-011-0040-3
43. Okonkwo, O. C., Mielke, M. M., Griffith, H. R., Moghekar, A. R., O'Brien, R. J., Shaw, L. M. 2011. Cerebrospinal fluid profiles and prospective course and outcome in patients with amnestic mild cognitive impairment. Archives of Neurology, 68: 113-119.
44. Paivio, A. 1968. A factor-analytic study of word attributes and verbal learning. Journal of Verbal Learning and Verbal Behavior, 7: 41-49.
45. Parisi, J. M., Gross, A. L., Rebok, G. W., Saczynski, J. S., Crowe, M., Cook, S. E. 2011. Modeling change in memory performance and perceptions: Findings from the ACTIVE study. Psychology & Aging, 26: 518-524.
46. Petersen, R. C., Aisen, P. S., Beckett, L. A., Donohue, M. C., Gamst, A. C., Harvey, D. J. 2010. Alzheimer's Disease Neuroimaging Initiative (ADNI): Clinical characterization. Neurology, 74: 201-209.
47. Proust, C., Jacqmin-Gadda, H., Taylor, J. M., Ganiayre, J., and, Commenges, D. 2006. A nonlinear model with latent process for cognitive evolution using multivariate longitudinal data. Biometrics, 62: 1014-1024.
48. R Development Core Team. (2009). R: A language and environment for statistical computing [computer software]. Vienna, Austria: R Foundation for Statistical Computing. http://www.R-project.org
49. Rabbitt, P., Diggle, P., Holland, F., and, McInnes, L. 2004. Practice and drop-out effects during a 17-year longitudinal study of cognitive aging. Journal of Gerontology, Series B: Psychological & Social Sciences, 59 (2): 84-97.
50. Rey, A. 1964. L'examen clinique en psychologie [The clinical examination in psychology], Paris, France: Presses Universitaires de France.
51. Rosenbaum, P. R., and, Rubin, D. 1983. The central role of the propensity score in observational studies for causal effects. Biometrika, 70 (1): 41-55.
52. Salthouse, T. A. 2010. Influence of age on practice effects in longitudinal neurocognitive change. Neuropsychology, 24: 563-572.
53. Salthouse, T., Schroeder, D., and, Ferrer, E. 2004. Estimating retest effects in longitudinal assessments of cognitive functioning in adults between 18 and 60 years of age. Developmental Psychology, 40 (5): 813-822.
54. Salthouse, T. A., and, Tucker-Drob, E. M. 2008. Implications of short-term retest effects for the interpretation of longitudinal change. Neuropsychology, 22: 800-811.
55. Schennach-Wolff, R., Obermeier, M., Seemller, F., Jger, M., Schmauss, M., Laux, G. 2010. Does clinical judgment of baseline severity and changes in psychopathology depend on the patient population? Results of a CGI and PANSS linking analysis in a naturalistic study. Journal of Clinical Psychopharmacology, 30: 726-731.
56. Schmidt, M. 2004. Rey Auditory and Verbal Learning Test: A handbook, Los Angeles, CA: Western Psychological Services.
57. StataCorp. 2011. Stata Statistical Software: Release 1 [Computer software], College Station, TX: StataCorp LP.
58. Steiger, J. H. 1989. EZPATH: A supplementary module for SYSTAT and SYGRAPH, Evanston, IL: Systat.
59. Taylor, E. M. 1959. The appraisal of children with cerebral deficits, Cambridge, MA: Harvard University Press.
60. Underwood, B. J. 1963. Coding processes in verbal learning. Journal of Verbal Learning and Verbal Behavior, 1: 250-257.
61. Willis, S. L., Tennstedt, S. L., Marsiske, M., Ball, K., Elias, J., Koepke, K. M. 2006. Long-term effects of cognitive training on everyday functional outcomes in older adults. Journal of the American Medical Association, 296: 2805-2814.