Validation of an integrated method for determining cognitive ability: Implications for routine assessments and clinical trials

Cortex

Volumn 54, Issue 1, 2014, Pages 51-62

  Godefroy, Olivier ^a,c   Gibbons, Laura ^b   Diouf, Momar ^c   Nyenhuis, David ^d   Roussel, Martine ^a,c,q   Black, Sandra ^e   Bugnicourt, Jean Marc ^a   Le Gall, D ^f   Bertola, C ^g   Giroire, J M ^h   Joseph, P A ^h   Seron, X ⁱ   Coyette, F ⁱ   Bretault, E ^j   Bernard, I ^j   Leclercq, M ^k   Azouvi, P ^l   Vallat Azouvi, C ^l   Pollack, P ^m   Ardouin, C ^m   Mosca, C ^m   Bindschadler, C ⁿ   Krier, M ^o   Meulemans, T ^p   Marquet, V ^p   Leys, D ^q   Renou, P ^r   Vercelletto, M ^r   Michel, E ^s   Robert, P ^s   Labauge, P ^t   Franconie, C ^t   Pillon, B ^u   Dubois, B ^u   Dieudonnee B ^v   Verny, M ^v   Lenoir, H ^w   De Rotrou, J ^w   Hannequin, D ^x   Bioux, S ^x   Fuchs, J ^y   Bellmann, A ^y   Vuadens, P ^y   more..

^a Department of Neurology and Laboratory of Functional Neurosciences University Hospital of Amiens ^*  (France)

^b UNIVERSITY OF WASHINGTON   (United States)

^c AMIENS UNIVERSITY HOSPITAL   (France)

^d Saint Mary's Health Care   (United States)

^e SUNNYBROOK RESEARCH INSTITUTE   (Canada)

^f Angers Hospital   (France)

^g Heliomarin Rehabilitation Center Berck   (France)

^h BORDEAUX UNIVERSITY HOSPITAL   (France)

ⁱ CLINIQUES UNIVERSITAIRES SAINT LUC   (Belgium)

^j General Hospital Cholet   (France)

^k Ottignies William Lennox Center   (France)

^l Garches University Hospital   (France)

^m GRENOBLE UNIVERSITY HOSPITAL   (France)

ⁿ LAUSANNE UNIVERSITY HOSPITAL   (Switzerland)

^o Lay St Christophe Rehabilitation Center   (United States)

^p Liége Department of Cognitive Sciences   (France)

^q Lille Nord de France University (EA 2694)   (France)

^r NANTES UNIVERSITY HOSPITAL   (France)

^s UNIVERSITY HOSPITAL OF NICE   (France)

^t Nimes University Hospital   (France)

^u Neurology Department   (France)

^v PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

^w Paris Descartes University   (France)

^x ROUEN UNIVERSITY HOSPITAL   (France)

^y Sion Rehabilitation Clinic   (France)

more..

Author keywords

Dementia; Diagnostic accuracy; Executive functions; Mild cognitive impairment; Sensitivity and specificity; Stroke

Indexed keywords

ADULT; AREA UNDER THE CURVE; ARTICLE; CLINICAL ASSESSMENT; COGNITION; COGNITIVE DEFECT; CONTROLLED STUDY; DIAGNOSTIC ACCURACY; EXECUTIVE FUNCTION; FEMALE; HUMAN; MAJOR CLINICAL STUDY; MALE; MIDDLE AGED; MONTE CARLO METHOD; PREVALENCE; PSYCHOLOGIC TEST; RECEIVER OPERATING CHARACTERISTIC; SENSITIVITY AND SPECIFICITY; STROOP TEST; TASK PERFORMANCE; DATA BASE; AGED; CLINICAL TRIAL (TOPIC); COGNITION DISORDERS; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; PSYCHOLOGY; VALIDATION STUDY;

ADULT; AGED; CLINICAL TRIALS AS TOPIC; COGNITION; COGNITION DISORDERS; EXECUTIVE FUNCTION; FEMALE; HUMANS; MALE; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS;

EID: 84896041170     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2014.01.016     Document Type: Article

References (56)

1. Adams R.J., Wilson M., Wang W.C. The multidimensional Random coefficients Multinomial Logit model. Applied Psychological Measurement 1997, 21:1-23.
2. Baddeley A.D., Logie R.H., Bressi S., Della Sala S., Spinnler H. Dementia and working memory. The Quarterly Journal of Experimental Psychology 1986, 38A:603-618.
3. Bateman R.J., Xiong C., Benzinger T.L., Fagan A.M., Goate A., Fox N.C., et al. Dominantly Inherited Alzheimer Network. Clinical and biomarker changes in dominantly inherited Alzheimer's disease. The New England Journal of Medicine 2012, 367:795-804.
4. Bossuyt P.M., Reitsma J.B., Bruns D.E., Gatsonis C.A., Glasziou P.P., Irwig L.M., et al. Standards for Reporting of Diagnostic Accuracy. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ 2003, 326:41-44.
5. Box G.E.P., Cox D.R. An analysis of transformations. Journal of the Royal Statistical Society. Series B 1964, 26:211-252.
6. Briggs D.C., Wilson M. An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement 2003, 4:87-100.
7. Brooks B.L., Iverson G.L. Comparing actual to estimated base rates of "abnormal" scores on neuropsychological test batteries: implications for interpretation. Archives of Clinical Neuropsychology 2010, 25:14-21.
8. Burgess P.W., Shallice T. Bizarre responses, rule detection and frontal lobe lesions. Cortex 1996, 32:241-259.
9. Cardebat D., Doyon B., Puel M., Goulet P., Joanette Y. Évocation lexicale formelle et sémantique chez des sujets normaux: Performances et dynamiques de production en fonction du sexe, de l'âge et du niveau d'étude. Acta Neurologica Belgica 1990, 90:207-217.
10. Clark L.R., Delano-Wood L., Libon D.J., McDonald C.R., Nation D.A., Bangen K.J., et al. Are empirically-derived subtypes of mild cognitive impairment consistent with conventional subtypes?. Journal of the International Neuropsychological Society 2013, 19:635-645.
11. Cooper J.A., Sagar H.J., Tidswell P., Jordan N. Slowed central processing in simple and go/no-go reaction time tasks in Parkinson's disease. Brain 1994, 117:517-529.
12. Crane P.K., Narasimhalu K. Composite scores for executive function items: demographic heterogeneity and relationships with quantitative magnetic resonance imaging. Journal of the International Neuropsychological Society 2008, 14:746-759.
13. Crawford J.R., Garthwaite C.H., Gault C.B. Estimating the percentage of the population with abnormally low scores (or abnormally large score differences) on standardized neuropsychological test batteries: a generic method with applications. Neuropsychology 2007, 21:419-430.
14. Dalrymple-Alford J.C., Livingston L., MacAskill M.R., Graham C., Melzer T.R., Porter R.J., et al. Characterizing mild cognitive impairment in Parkinson's disease. Mov Movement Disorders 2011, 26:629-636.
15. DeLong E.R., DeLong D.M., Clarke-Pearson D.L. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 1988, 44:837-845.
16. Dubois B., Feldman H.F., Jacova C., Cummings J.L., DeKosky S.T., Barberger-Gateau P., et al. Revising the definition of Alzheimer's disease: a new lexicon. Lancet Neurology 2010, 9:1118-1127.
17. Gibbons L.E., Carle A.C., Mackin R.S., Harvey D., Mukherjee S., Insel P., et al. Alzheimer's disease neuroimaging initiative. A composite score for executive functioning, validated in Alzheimer's Disease Neuroimaging Initiative (ADNI) participants with baseline mild cognitive impairment. Brain Imaging and Behavior 2012, 6:517-527.
18. Godefroy O. Frontal syndrome and disorders of executive functions. The Journal of Neurology 2003, 250:1-6.
19. Godefroy O. Syndromes frontaux et dysexécutifs. Revue Neurologique 2004, 160:899-909. et Groupe de Réflexion sur L'Evaluation des Fonctions EXecutives.
20. Godefroy O., Azouvi P., Robert P., Roussel M., LeGall D., Meulemans T. Dysexecutive syndrome: diagnostic criteria and validation study. Annals of Neurology 2010, 68:855-864. on the behalf of the GREFEX study group.
21. Godefroy O., Cabaret M., Rousseaux M. Vigilance and effects of fatigability, practice and motivation on simple reaction time tests in patients with lesion of the frontal lobe. Neuropsychologia 1994, 32:983-990.
22. Godefroy O., Dubois C., Debachy B., Leclerc M., Kreisler A. Vascular aphasias: main characteristics of patients hospitalized in acute stroke units. Stroke 2002, 33:702-705.
23. Godefroy O., Fickl A., Roussel M., Auribault C., Bugnicourt J.M., Lamy C., et al. Is the montreal cognitive assessment superior to the mini-mental state examination to detect post-stroke cognitive impairment? A study with neuropsychological evaluation. Stroke 2011, 42:1712-1716.
24. Godefroy O., Lhullier C., Rousseaux M. Non-spatial attention disorders in patients with frontal or posterior brain damage. Brain 1996, 119:191-202.
25. Godefroy O., Rousseaux M., Pruvo J.P., Cabaret M., Leys D. Neuropsychological changes related to unilateral lenticulostriate infarcts. Journal of Neurology, Neurosurgery, and Psychiatry 1994, 57:480-485.
26. Godefroy O., Roussel M., Leclerc X., Leys D. Deficit of episodic memory: anatomy and related patterns in stroke patients. Eur Neurology 2009, 61:223-229.
27. Hawass N.E.D. Comparing the sensitivities and specificities of two diagnostic procedures performed on the same group of patients. British Journal of Radiology 1997, 70:360-366.
28. Hill B.D., Rohling M.L., Boettcher A.C., Meyers J.E. Cognitive intra-individual variability has a positive association with traumatic brain injury severity and suboptimal effort. Archives of Clinical Neuropsychology 2013, 28:640-648. 10.1093/arclin/act045.
29. Hoijtink H., Rooks G., Wilmink F.W. Confirmatory factor analysis of items with a dichotomous response format using the multidimensional Rasch model. Psychological Methods 1999, 4:300-314.
30. Hultsch D.F., MacDonald S.W.S., Hunter M.A., Levy-Bencheton J., Strauss E. Intraindividual variability in cognitive performance in older adults: comparison of adults with mild dementia, adults with arthritis, and healthy adults. Neuropsychology 2000, 14:588-598.
31. Jurica P.L., Leitten C.L., Mattis S. Professional Manual for the dementia rating Scale - 2 2001, Psychological Assessment Resources Inc., Lutz, Florida.
32. Kelderman H., Rijkes C. Loglinear multidimensional IRT models for polytomously scored items. Psychometrika 1994, 59:149-176.
33. Knopman D.S., Jack R., Wiste H.J., Weigand S.D., Vemuri P., Lowe V., et al. Short-term clinical outcomes for stages of NIA-AA preclinical Alzheimer disease. Neurology 2012, 78:1576-1582.
34. Larrabee G.J. Performance validity and symptom validity in neuropsychological assessment. The Journal of the International Neuropsychological Society 2012, 18:625-630.
35. Lezak M.D., Howieson D.B., Loring D.W. Neuropsychological assessment 2004, Oxford University Press, New York (NY). 4th ed.
36. Litvan I., Goldman J.G., Tröster A.I., Schmand B.A., Weintraub D., Petersen R.C., et al. Diagnostic criteria for mild cognitive impairment in Parkinson's disease: Movement Disorder Society Task Force guidelines. Movement Disordorders 2012, 27:349-356.
37. Miller L.S., Rohling M.L. A statistical interpretive method for neuropsychological test data. Neuropsychology Review 2001, 11:143-169.
38. Moller J.T., Cluitmans P., Rasmussen L.S., Houx P., Rasmussen H., Canet J., et al. Long-term postoperative cognitive dysfunction in the elderly ISPOCD1 study. ISPOCD investigators. International study of post-operative cognitive dysfunction. Lancet 1998, 351:857-861.
39. Mungas D., Marshall S.C., Weldon M., Haan M., Reed B.R. Age and education correction of mini-mental state examination for English and Spanish-speaking elderly. Neurology 1996, 46:700-706.
40. Murkin J.M., Newman S.P., Stump D.A., Blumenthal J.A. Statement of consensus on assessment of neurobehavioral outcomes after cardiac surgery. The Annals of Thoracic Surgery 1995, 59:1289-1295.
41. Muthén L.K., Muthén B.O. Mplus: statistical analysis with latent variables 1998-2007, Muthén & Muthén, Los Angeles, CA.
42. Nelson H.E. A Modified Card Sorting test sensitive to frontal lobe defects. Cortex 1976, 12:313-324.
43. Randolph C. Manual for the Repeatable battery for the assessment of neuropsychological status 1998, The Psychological Corporation, New York, USA.
44. Rao S.M., Leo G.J., Bernardin L., Unverzagt F. Cognitive dysfunction in multiple sclerosis: frequency, patterns, and prediction. Neurology 1991, 41:685-691.
45. Reckess G.Z., Varvaris M., Gordon B., Schretlen D.J. Within-person distributions of neuropsychological test scores as a function of dementia severity. Neuropsychology 2013, 10.1037/neu0000017.
46. Reeve B.B., Hays R.D., Bjorner J.B., Cook K.F., Crane P.K., Teresi J.A., et al. Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care 2007, 45(Suppl 1):S22-S31. PROMIS Cooperative Group.
47. Reitan R.M. Validity of the Trail Making test as an indicator of organic brain damage. Perceptual & Motor Skills 1958, 8:271-276.
48. Reitan R., Wolfson D. The Halstead-Reitan neuropsychological test Battery: Theory and clinical interpretation 1993, Neuropsychology Press, Tucson, Arizona.
49. Roussel M., Dujardin K., Hénon H., Godefroy O. Is the frontal dysexecutive syndrome due to a working memory deficit? Evidence from patients with stroke. Brain 2012, 135:2192-2201.
50. Sepulcre J., Vanotti S., Hernández R., Sandoval G., Cáceres F., Garcea O., et al. Cognitive impairment in patients with multiple sclerosis using the Brief Repeatable Battery-Neuropsychology test. Multiple Sclerosis 2006, 12:187-195.
51. Shallice T., Burgess P.W. Deficits in strategy application following frontal lobe damage in man. Brain 1991, 114:727-741.
52. Stroop J.R. Studies of interference in serial verbal reaction. The Journal of Experimental Psychology 1935, 18:643-662.
53. Tatemichi T.K., Desmond D.W., Stern Y., Paik M., Sano M., Bagiella E. Cognitive impairment after stroke: frequency, patterns, and relationship to functional abilities. The Journal of Neurology, Neurosurgery, and Psychiatry 1994, 57:202-207.
54. Tractenberg R.E., Pietrzak R.H. Intra-individual variability in Alzheimer's disease and cognitive aging: definitions, context, and effect sizes. PLOS One 2011, 6:e16973.
55. Wechsler D. The measurement of adult intelligence 1944, The Williams and Wilkins Company, Baltimore, USA.
56. Winblad B., Palmer K., Kivipelto M., Jelic V., Fratiglioni L., Wahlund L.O., et al. Mild cognitive impairment-beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment. Journal of Internal Medicine 2004, 256:240-246.