Judgment in older adults: Development and psychometric evaluation of the Test of Practical Judgment (TOP-J)

Journal of Clinical and Experimental Neuropsychology

Volumn 29, Issue 7, 2007, Pages 752-767

  Rabin, L A ^a,b,d   Borgos, M J ^a   Saykin, A J ^a   Wishart, H A ^a   Crane, P K ^c   Nutter Upham, K E ^a,b   Flashman, L A ^a  

^a DARTMOUTH MEDICAL SCHOOL   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

^c UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

^d Department of Psychology ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AGED; ALZHEIMER DISEASE; AMNESIA; ARTICLE; COGNITIVE DEFECT; CONTROLLED STUDY; DECISION MAKING; DEMOGRAPHY; ETHICS; FEMALE; FINANCIAL MANAGEMENT; HUMAN; LANGUAGE; MAJOR CLINICAL STUDY; MALE; MEDICAL ASSESSMENT; MEMORY; NEUROPSYCHOLOGY; PRIORITY JOURNAL; PSYCHOMETRY; RISK ASSESSMENT; SCORING SYSTEM; SOCIAL ASPECT;

AGED; AGED, 80 AND OVER; EVALUATION STUDIES AS TOPIC; FEMALE; GERIATRIC ASSESSMENT; HUMANS; JUDGMENT; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS;

EID: 34748825021     PISSN: 13803395     EISSN: 1744411X     Source Type: Journal    
DOI: 10.1080/13825580601025908     Document Type: Article

References (74)

1. Allaire, J.C., & Marsiske, M. (1999). Everyday cognition: Age and intellectual ability correlates. Psychology and Aging, 14, 627-644.
2. Barona, A., Reynolds, C., & Chastain, R. (1984). A demographically based index of premorbid intelligence for the WAIS-R. Journal of Consulting and Clinical Psychology, 52, 885-887.
3. Bertrand, R.M., & Willis, S.L. (1999). Everyday problem solving in Alzheimer's patients: A comparison of subjective and objective assessments. Aging & Mental Health, 3, 281-293.
4. Blanchard-Fields, F., Stein, R., & Watson, T.L. (2004). Age differences in emotion-regulation strategies in handling everyday problems. Journal of Gerontology: Psychological Sciences, 59B, P261-P269.
5. Borgos, M.J., Rabin, L.A., Koven, N.C., Roth, R.M., Flashman, L.A., & Saykin, A.J. (2006a). Assessment of practical judgment in a mixed neuropsychiatric sample using the TOP-J [Abstract]. Proceedings of the 34th Annual Meeting of the International Neuropsychological Society, 228.
6. Borgos, M.J., Rabin, L.A., Pixley, H.S., & Saykin, A.J. (2006b). Practices and perspectives regarding the assessment of judgment skills: A survey of clinical neuropsychologists [Abstract]. Proceedings of the 34th Annual Meeting of the International Neuropsychological Society, 24.
7. Camilli, G., & Shepard, L.A. (1994). Methods for identifying biased test items. Thousand Oaks, CA: Sage.
8. Channon, S. (2004). Frontal lobe dysfunction and everyday problem-solving: Social and non-social contributions. Acta Psychologica, 115, 235-254.
9. Channon, S., & Crawford, S. (1999). Problem-solving in real-life-type situations: The effects of anterior and posterior lesions on performance. Neuropsychologia, 37, 757-770.
10. Cornelius, S.W., & Caspi, A. (1987). Everyday problem solving in adulthood and old age. Psychology and Aging, 2, 144-153.
11. Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
12. Crowell, T.A., Luis, C.A., Vanderploeg, R.D., Schinka, J.A., & Mullan, M. (2002). Memory patterns and executive functioning in mild cognitive impairment and Alzheimer's disease. Aging, Neuropsychology, and Cognition, 9, 288-297.
13. Cummings, J.L., Mega, M., Gray, K., Rosenberg-Thompson, S., Carusi, D.A., & Gornbein, J. (1994). The Neuropsychiatric Inventory: Comprehensive assessment of psychopathology in dementia. Neurology, 44, 2308-2314.
14. Davie, J.E., Azuma, T., Goldinger, S.D., Connor, D.J., Sabbagh, M.N., & Silverberg, N.B. (2004). Sensitivity to expectancy violations in healthy aging and mild cognitive impairment. Neuropsychology, 18, 269-275.
15. Delis, D., & Kaplan, E. (2001). Delis-Kaplan Executive Function Battery. San Antonio, TX: Psychological Corporation.
16. Delis, D.C., Kramer, J.H., Kaplan, E., & Ober, B.A. (2000). The California Verbal Learning Test-Second Edition: Adult version manual. San Antonio, TX: Psychological Corporation.
17. Denney, N.W., & Pearce, K.A. (1989). A developmental study of practical problem solving in adults. Psychology and Aging, 4, 438-442.
18. Drane, D.L., & Osato, S.S. (1997). Using the Neurobehavioral Cognitive Status Examination as a screening measure for older adults. Archives of Clinical Neuropsychology, 12, 139-143.
19. Duke, L.M., & Kaszniak, A.W. (2000). Executive control functions in degenerative dementias: A comparative review. Neuropsychology Review, 10, 75-99.
20. Fitten, L.J., Lusky, R., & Hamann, C. (1990). Assessing treatment decision-making capacity in elderly nursing home residents. Journal of the American Geriatrics Society, 38, 1097-1104.
21. Folstein, M.F., Folstein, S.E., & McHugh, P.R. (1975). Mini-Mental State: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12, 189-198.
22. Gioia, G.A., Isquith, P.K., & Guy, S.C. (2001). Assessment of executive functions in children with neurological impairment. In R.J. Simeonsson & S.L. Rosenthal (Eds.), Psychological and developmental assessment: Children with disabilities and chronic conditions. New York: The Guilford Press.
23. Goodglass, H., Kaplan, E., & Barresi, B. (2001). Boston Diagnostic Aphasia Examination-Third Edition. Philadelphia: Lippincott Williams & Wilkins.
24. Grisso, T., Appelbaum, P.S., & Hill-Fotouhi, C. (1997). The MacCat-T: A clinical tool to assess patients' capacities to make treatment decisions. Psychiatric Services, 48, 1415-1420.
25. Grober, E., Sliwinski, M., Schwartz, M., & Saffran, E. (1989). The American version of the NART for predicting premorbid intelligence. Unpublished manuscript.
26. Heaton, R.K., Chelune, G.J., Talley, J.L., Kay, G.G., & Curtiss, G. (1993). Wisconsin Card Sorting Test manual: Revised and expanded. Lutz, FL: Psychological Assessment Resources.
27. Hinkle, D.E., Wiersma, W, & Jurs, S.G. (1988). Applied statistics for the behavioral sciences (2nd ed.). Boston: Houghton Mifflin Company.
28. Holland, P.W., & Wainer, H. (Eds.). (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
29. Hu, L.-T., & Bentler, P.M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
30. Jorm, A.F., Scott, R., & Jacomb, P.A. (1989). Assessment of cognitive decline in dementia and by informant questionnaire. International Journal of Geriatric Psychiatry, 4, 35-39.
31. Jurica, P., Leitten, C., & Mattis, S. (2001). Dementia Rating Scale-2. Lutz, FL: Psychological Assessment Resources.
32. Kajanne, A. (2003). Structure and content: The relationship between reflective judgment and laypeople's viewpoints. Journal of Adult Development, 10, 173-189.
33. Karlawish, J.H.T., Casarett, D.J., James, B.D., Xie, S. X., & Kim, S.Y.H. (2005). The ability of persons with Alzheimer disease (AD) to make a decision about taking an AD treatment. Neurology, 64, 1514-1519.
34. Kim, S.Y.H., Karlawish, J.H.T., & Caine, E.D. (2002). Current state of research on decision-making competence of cognitively impaired elderly persons. American Journal of Geriatric Psychiatry, 10, 151-165.
35. Knopman, D.S., DeKosky, S.T., Cummings, J.L., Chui, H., Corey-Bloom, J. Relkin, N., et al. (2001). Practice parameter: Diagnosis of dementia (an evidence-based review): Report on the Quality Standards Subcommittee of the American Academy of Neurology. Neurology, 56, 1143-1153.
36. LaFleche, G., & Albert, M. S. (1995). Executive function deficits in mild Alzheimer's disease. Neuropsychology, 9, 313-320.
37. Lowenstein, D., Amigo, E., Duara, R. Guterman, A., Hurwitz, D., Berkowitz, N., et al. (1989). A new scale for the assessment of functional status in Alzheimer's disease and related disorders. Journal of Gerontology: Psychological Sciences, 44, 114-121.
38. Marsiske, M., & Margrett, J.A. (2006). Everyday problem solving and decision making. In J. E. Birren & K. Warner Schaie (Eds.), Handbook of the psychology of aging (6th ed., pp. 315-342). New York: Academic Press.
39. Marson, D., & Harrell, L. (1999). Executive dysfunction and loss of capacity to consent to medical treatment in patients with Alzheimer's disease. Seminars in Clinical Neuropsychiatry, 4, 41-49.
40. Marson, D. C., Hawkins, L., McInturff, B., & Harrell, L. E. (1997). Cognitive models that predict physician judgments of capacity to consent in mild Alzheimer's disease. Journal of the American Geriatrics Society, 45, 458-464.
41. Marson, D.C., Schmitt, F.A., Ingram, K.K., & Harrell, L.E. (1994). Determining the competency of Alzheimer patients to consent to treatment and research. Alzheimer Disease and Associated Disorders, 8(Suppl. 4), 5-18.
42. McDonald, R.P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
43. McKhann, G., Drachman, D., Folstein, M., Katzman, R., Price, D., & Stadlan, E.M. (1984). Clinical diagnosis of Alzheimer's disease: Report of the NINCDS-ADRDA work group under the auspices of Department of Health and Human Services Task Force on Alzheimer's Disease. Neurology, 34, 939-944.
44. Muthén, B., & Muthén, L. (2004). Mplus (Version 3) [Computer program]. Los Angeles: Muthen & Muthen.
45. Northern California Neurobehavioral Group, Inc. (1988). Manual for The Neurobehavioral Cognitive Status Exam. Fairfax, CA: Author.
46. Nunnally, J.C., & Bernstein, I.H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
47. Petersen, R.C. (2004). Mild cognitive impairment as a diagnostic entity. Journal of Internal Medicine, 256, 183-194.
48. Petersen, R.C., Doody, R., Kurz, A., Mohs, R., Morris, J.C., Rabins, P.V., et al. (2001a). Current concepts in mild cognitive impairment. Archives of Neurology, 58, 1985-1992.
49. Petersen, R.C., Stevens, J.C., Ganguli, M., Tangalos, E. G., Cummings, J.L., & DeKosky, S.T. (2001b). Practice parameter: Early detection of dementia: Mild cognitive impairment (an evidence-based review): Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology, 56, 1133-1142.
50. Piatt, A.L., Fields, J.A., Paolo, A.M., & Troster, A.I. (1999). Action (verb naming) fluency as an executive function measure: Convergent and divergent evidence of validity. Neuropsychologia, 37, 1499-1503.
51. Psychological Corporation. (1997). Wechsler Memory Scale-Third Edition, WMS-III technical manual. San Antonio, TX: Author.
52. Rabin, L.A., Roth, R.M., Isquith, Wishart, H.A., Nutter-Upham, K.E., Pare, N., et al. (2006). Self-and informant reports of executive functions on the BRIEF-A in MCI and older adults with cognitive complaints. Archives of Clinical Neuropsychology, 21, 721-732.
53. Rabin, L.A., Saykin, A.J., Wishart, H.A., Flashman, L.A., Wang, P.J., Nutter-Upham, K.E., et al. (2004). Telephone-based screening for MCI and cognitive complaints: Preliminary validation by comprehensive assessment. Proceedings of the 32nd Annual Meeting of the International Neuropsychological Society Meeting, 3.
54. Ready, R.E., Ott, B.R., Grace, J., & Cahn-Weiner, D.A. (2003). Apathy and executive dysfunction in mild cognitive impairment and Alzheimer disease. American Journal of Geriatric Psychiatry, 11, 222-228.
55. Roth, R.M., Isquith, P.K., & Gioia, G.A. (2005). BRIEF-A: Behavior Rating Inventory of Executive Functions-Adult Version. Odessa, FL: Psychological Assessment Resources.
56. Santos, J.R.A. (1999). Cronbach's alpha: A tool for assessing the reliability of scales. Journal of Extension, 37. Retrieved April 21, 2006, from http://joe.org/joe/1999april/tt3.html
57. Santulli, R.B., Saykin, A.J., Rabin, L.A., Wishart, H.A., Flashman, L.A., Pare, N., et al. (2005, June). Differential sensitivity of cognitive complaints associated with amnestic MCI: Analysis of patient and informant reports. Presented at the Alzheimer's Association International Conference on Prevention of Dementia, Washington, DC.
58. Saykin, A.J. (1992). Neurobehavioral Function and Activities of Daily Living Rating Scale (NBFADL-63 item version). (Available from A. J. Saykin, Department of Psychiatry, Dartmouth Medical School One Medical Center Drive, Lebanon, NH 03756, USA).
59. Saykin, A.J., Wishart, H.A., Rabin, L.A., Santulli, R.B., Flashman, L.A., West, J.D., et al. (2006). Older adults with cognitive complaints show brain atrophy similar to that of amnestic MCI. Neurology, 67, 834-842.
60. Shrout, P.E., & Fleiss, J.L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
61. Squire, L.R., Wetzel, C.D., & Slater, P.C. (1979). Memory complaints after electroconvulsive therapy: Assessment with a new self-rating instrument. Biological Psychiatry, 14, 791-801.
62. Stern, R.A., & White, T. (2003). Neuropsychological Assessment Battery: Administration, scoring, and interpretation manual. Lutz, FL: Psychological Assessment Resources.
63. Tabachnick, B.G., & Fidell, L.S. (1996). Using multivariate statistics (3rd ed.). New York: Harper Collins.
64. Thornton, W.J.L., & Dumke, H.A. (2005). Age differences in everyday problem-solving and decision-making: A meta-analytic review. Psychology & Aging, 20, 85-99.
65. Vellinga, A., Smit, J.H., van Leeuwen, E., van Tilburg, W., & Jonker, C. (2004). Competence to consent to treatment of geriatric patients: Judgments of physicians, family members, and the vignette method. International Journal of Geriatric Psychiatry, 19, 645-654.
66. Wechsler, D. (1997). Wechsler Adult Intelligence Scale-Third Edition. San Antonio, TX: The Psychological Corporation.
67. White, T., & Stern, R.A. (2003). Neuropsychological Assessment Battery: Psychometric and technical manual. Lutz, FL: Psychological Assessment Resources, Inc.
68. Willis, S.L. (1993). Test manual for the Everyday Problems Test for Cognitively Challenged Elderly. University Park, PA: Pennsylvania State University.
69. Willis, S.L. (1996). Everyday cognitive competence in elderly persons: Conceptual issues and empirical findings. The Gerontologist, 36, 595-601.
70. Willis, S.L., Allen-Burge, R., Dolan, M.M., Bertrand, R.M., Yesavage, J., & Taylor, J.L. (1998). Everyday problem solving among individuals with Alzheimer's disease. The Gerontologist, 38, 569-577.
71. Willis, S.L., & Marsiske, M. (1993). Manual for the Everyday Problems Test. University Park, PA: Pennsylvania State University.
72. Winblad, B., Palmer, K., Kivipelto, M., Jelic, V., Fratiglioni, L., Wahlund, L.-O., et al. (2004). Mild cognitive impairment - beyond controversies, towards a consensus: Report of the International Working Group on Mild Cognitive Impairment. Journal of Internal Medicine, 256, 240-246.
73. Woods, D.C., Patterson, M.B., & Whitehouse, P.J. (2000). Utility of the Judgment Questionnaire subtest of the Neurobehavioral Cognitive Status Examination in the evaluation of individuals with Alzheimer's Disease. Clinical Gerontologist, 21, 49-66.
74. Yesavage. J.A, Brink, T.L., Rose, T.L., Lum, O., Huang, V., Adey, M., et al. (1982). Development and validation of a geriatric depression scale: A preliminary report. Journal of Psychiatric Research, 17, 37-49.