A reappraisal of reliability and validity studies in stroke

Stroke

Volumn 27, Issue 12, 1996, Pages 2331-2336

  D'Olhaberriague, Luis ^a,b   Litvan, Irene ^b   Mitsias, Panayiotis ^a   Mansbach, Harry H ^a  

^a HENRY FORD HOSPITAL   (United States)

^b NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE   (United States)

Author keywords

cerebrovascular disorders; epidemiology; stroke assessment; stroke classification

Indexed keywords

ACCURACY; CEREBROVASCULAR ACCIDENT; CLINICAL EXAMINATION; CLINICAL RESEARCH; DISABILITY; HUMAN; PRIORITY JOURNAL; RELIABILITY; REVIEW; STROKE;

EID: 0030470955     PISSN: 00392499     EISSN: None     Source Type: Journal    
DOI: 10.1161/01.STR.27.12.2331     Document Type: Review

References (83)

1. Bamford J. Clinical examination in diagnosis and subclassification of stroke. Lancet. 1992;339:400-402.
2. Feinstein AR. An additional basic science for clinical medicine, I: the constraining fundamental paradigms. Ann Intern Med. 1983;99: 393-397.
3. Feinstein AR. An additional basic science for clinical medicine, III: the challenges of comparison and measurement. Ann Intern Med. 1983;99:705-712.
4. Feinstein AR. An additional basic science for clinical medicine, IV: the development of clinimetrics. Ann Intern Med. 1983;99:843-848.
5. Asplund K. Clinimetrics in stroke research. Stroke. 1987;18:528-530.
6. Posner KL, Sampson PD, Caplan RA, Ward RJ, Cheney FW. Measuring interrater reliability among multiple raters: an example of methods for nominal data. Stat Med. 1990;9:1103-1115.
7. Cyr L, Francis K. Measures of clinical agreement for nominal and categorical data: the kappa coefficient. Comput Biol Med. 1992;22: 239-246.
8. Gross ST. The kappa coefficient of agreement for multiple observer when the number of subjects is small. Biometrics. 1986;42:883-893.
9. Lyden PD, Lau GT. A critical appraisal of stroke evaluation and rating scales. Stroke. 1991;22:1345-1352.
10. Mittl RL, Broderic M, Carpenter JP, Goldberg HI, Listerud J, Mishkin MM, Berkowitz HD, Atlas SW. Blinded-reader comparison of magnetic resonance angiography and duplex ultrasonography for carotid artery bifurcation stenosis. Stroke. 1994;25:4-10.
11. Alexandrov AV, Bladin CF, Maggisano R, Norris JW. Measuring carotid stenosis: time for a reappraisal. Stroke. 1993;24:1292-1296.
12. Bamford J, Dennis M, Sandercock P, Burn J, Warlow CP. The frequency, causes, and timing of death within 30 days of a first stroke: the Oxfordshire Community Stroke Project. J Neurol Neurosurg Psychiatry. 1990;53:824-829.
13. Silver FL, Norris JW, Lewis AJ, Hachinski VC. Early mortality following stroke: a prospective review. Stroke. 1984;15:492-496.
14. Ringelstein EB, Koschorke S, Holling A, Thron A, Lambertz, H, Minale C. Computed tomographic patterns of proven embolic brain infarctions. Ann Neurol. 1989;26:759-765.
15. D'Olhaberriague L, Welch KMA, Nagesh V, Gymnopoulos C, Boska MD, Levine SR, Ewing JR, Schultz LR, Chopp M. Diffusion weighted and T2 MRI can discriminate embolic from non-embolic stroke in humans. Stroke. 1996;27:180. Abstract.
16. Van Gijn J. Measurement of outcome in stroke prevention trials. Cerebrovasc Dis. 1992;2(suppl 2):23-34.
17. Special Report from the National Institute of Neurological Disorders and Stroke: Classification of Cerebrovascular Diseases III. Stroke. 1990;21:637-676.
18. Hachinski VC. Classification of stroke for clinical trials. Stroke. 1990;21(suppl II):II-27-II-29.
19. Mohr JP, Sacco RL. Classification of ischemic strokes. In: Barnett HJM, Stein BM, Mohr JP, Yatsu FM, eds. Stroke: Pathophysiology, Diagnosis, and Management. 2nd ed. New York, NY: Churchill Livingstone Inc; 1992:271-283.
20. Bamford J, Sandercock P, Dennis M, Burn J, Warlow C. Classification and natural history of clinically identifiable subtypes of cerebral infarction. Lancet. 1991;337:1521-1526.
21. WHO Task Force on Stroke and Other Cerebrovascular Diseases. Recommendations on stroke prevention, diagnosis, and therapy. Stroke. 1989;20:1407-1431.
22. Bogousslavsky J, Van Melle G, Regli F. The Lausanne Stroke Registry: analysis of 1000 consecutive patients with first stroke. Stroke. 1988;19:1083-1092.
23. Boysen G. The Scandinavian Neurological Scale. In: Candelise L, ed. Stroke scores and scales. Cerebrovasc Dis. 1992;4:239-240.
24. Brott T. Utility of the NIH stroke scale. In: Candelise L, ed. Stroke scores and scales. Cerebrovasc Dis. 1992;4:241-242.
25. Orgogozo JM. Scaling neurological impairment after middle cerebral artery infarction. In: Candelise L, ed. Stroke scores and scales. Cerebrovasc Dis. 1992;4:242-243.
26. Côté R, Hachinski VC. The Canadian Neurological Scale. In: Candelise L, ed. Stroke scores and scales. Cerebrovasc Dis. 1992;4: 243-244.
27. Rankin J. Cerebral vascular accidents in patients over the age of 60, II: prognosis. Scott Med J. 1957;2:200-215.
28. Orgogozo JM, Dartigues JF. Methodology of clinical trials in acute cerebral ischemia: survival, functional and neurological outcome measures. Cerebrovasc Dis. 1991;1(suppl 1):100-111.
29. Van Gijn J, Warlow C. Down with stroke scales. In: Candelise L, ed. Stroke scores and scales. Cerebrovasc Dis. 1992;4:244-246.
30. EAFT (European Atrial Fibrillation Trial Study Group). Secondary prevention in non-rheumatic atrial fibrillation after transient ischemic attack or minor stroke. Lancet. 1993;342:1255-1262.
31. Albers GW, Sherman DG, Gress DR, Paulseth JE, Petersen P. Stroke prevention in nonvalvular atrial fibrillation: a review of prospective randomized trials. Ann Neurol. 1991;30:511-518.
32. North American Symptomatic Carotid Endarterectomy Trial Collaborators. Beneficial effect of carotid endarterectomy in symptomatic patients with high-grade carotid stenosis. N Engl J Med. 1991;325: 445-453.
33. Hass WK, Easton JD, Adams HP, Pryse-Phillips W, Molony BA, Anderson S, Kamm B. A randomized trial comparing ticlopidine hydrochloride with aspirin for the prevention of stroke in high-risk patients. N Engl J Med. 1989;321:501-507.
34. National Institute of Neurological Disorders and Stroke rt-PA Study Group. Tissue plasminogen activator for acute ischemic stroke. N Engl J Med. 1995;333:1581-1587. (This work was published after the bibliographical search but is included because of relevance.)
35. Gordon DL, Bendixen BH, Adams HP Jr, Clarke W, Kappelle LJ, Woolson RF, and the TOAST investigators. Interphysician agreement in the diagnosis of subtypes of acute ischemic stroke. Neurology. 1993;43:1021-1027.
36. Gross CR, Shinar D, Mohr JP, Hier DB, Caplan LR, Price TR, Wolf PA, Kase CS, Fishman IG, Carlingo S, Kunitz SC. Interobserver agreement in the diagnosis of stroke types. Arch Neurol. 1986;43: 893-898.
37. Lindley RI, Warlow CP, Wardlaw JM, Dennis MS, Slattery J, Sandercock PAG. Interobserver reliability of a clinical classification of acute cerebral infarction. Stroke. 1993;24:1801-1804.
38. Kessler C, Freyberger HJ, Dittmann V, Ringelstein EB. Interrater reliability in the assessment of neurovascular diseases. Cerebrovasc Dis. 1991;1:41-43.
39. Berger K, Case CS, Buring JE. Interobserver agreement in the classification of stroke in the Physicians Health Study. Stroke. 1996;27: 238-242. (This work was published after the bibliographical search but is included because of relevance.)
40. Shinar D, Gross CR, Mohr JP, Caplan LR, Price TR, Wolf PA, Hier D, Kase CS, Fishman IG, Wolf C, Kunitz SC. Interobserver variability in the assessment of neurologic history and examination in Stroke Data Bank. Arch Neurol. 1985;42:557-565.
41. Brott T, Adams HP Jr, Olinger CP, Marler JR, Barsan WG, Biller J, Spilker J, Holleran R, Eberle R, Herztberg V, Rorick M, Moonaw CJ, Walker M. Measurement of acute cerebral infarction: a clinical examination scale. Stroke. 1989;20:864-870.
42. Goldstein LB, Bertels C, Davis JN. Interrater reliability of the NIH stroke scale. Arch Neurol. 1989;46:660-662.
43. Gelmers HJ, Gorter K, de Weerdt CJ, Wiezer HJA. Assessment of interobserver variability in a Dutch multicenter study on acute ischemic stroke. Stroke. 1988;19:709-711.
44. Côté R, Battista RN, Wolfson C, Boucher J, Adam J, Hachinski VC. The Canadian Neurological Scale: validation and reliability assessment. Neurology. 1989;39:638-643.
45. Treves TA, Karepov VG, Aronovich AY, Gorbulev AY, Bornstein NM, Korczyn AD. Interrater agreement in evaluation of stroke patients with the Unified Neurological Stroke Scale. Stroke. 1994;25: 1263-1264.
46. Hanston L, De Weerdt W, De Keyser J, Diener HC, Franke C, Palm R, Van Osrhoven M, Schoonderwalt H, De Klippel N, Herroelen L, Feys H. The European Stroke Scale. Stroke. 1994;25:2215-2219.
47. Tomassello F, Mariani F, Fieschi C, Argentino C, Bono G, De Zanche L, Inzitari D, Martini A, Perrone P. Assessment of inter-observer differences in the Italian multicenter study on reversible cerebral ischemia. Stroke. 1982;13:32-35.
48. Rödén-Jüllig A, Britton M, Gustaffson C, Fugl-Meyer A. Validation of four scales for the acute stage of stroke. J Intern Med. 1994; 236:125-136.
49. Van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJA, Van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19:604-607.
50. Bamford JM, Sandercock PAG, Warlow CP, Slattery J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1989;20:828. Letter.
51. Wolfe CDA, Taub NA, Woodrow EJ, Burney PGJ. Assessment of scales of disability and handicap for stroke patients. Stroke. 1996; 22:1242-1244.
52. Lyden P, Brott T, Tilley B, Welch KMA, Mascha EJ, Levine S, Haley EC, Grotta J, Marler J, and the NINDS TPA Stroke Study Group. Improved reliability of the NIH Stroke Scale using video training. Stroke. 1994;25:2220-2226.
53. Bryan RN, Levy LM, Whitlow WD, Killiam JM, Preziosi TJ, Rosario JA. Diagnosis of acute cerebral infarction: comparison of CT and MR imaging. AJNR Am J Neuroradiol. 1991;12:611-620.
54. Mohr JP, Biller J, Hilal SK, Yuh WTC, Tatemichi TK, Hedges S, Tali E, Nguyen H, Mun I, Adams HP Jr, Grimsamn K. Magnetic resonance versus computed tomography imaging in acute stroke. Stroke. 1995;26:807-812.
55. Adams HP Jr, Bendixen BH, Kappelle LJ, Biller J, Love B, Lee Gordon D, Marsh EE III, and the TOAST investigators. Classification of subtype of acute ischemic stroke. Stroke. 1993;24:35-41.
56. Madden KP, Karanjia PN, Adams HP Jr, Clarke WR, and the TOAST investigators. Accuracy of initial stroke subtype diagnosis in the TOAST study. Neurology. 1995;45:1975-1979. (This work was published after the bibliographical search but is included because of relevance.)
57. Bogousslavsky J, Regli F, Besson G, Pinho e Melo T, Nater B. Early clinical diagnosis of stroke subtype. Cerebrovasc Dis. 1993;3:39-44.
58. Edwards DF, Chen YW, Diringer MN. Unified Neurological Stroke Scale is valid in ischemic and hemorrhagic stroke. Stroke. 1995;26: 1852-1858.
59. Mohr JP, Foulkes MA, Polis AT, Kase CS, Price TR, Tatemichi TK, Wolf PA. Infarct topography and hemiparesis profiles with cerebral convexity infarction: the Stroke Data Bank. J Neurol Neurosurg Psychiatry. 1993;56:344-351.
60. Fisher CM. Lacunar strokes and infarcts: a review. Neurology. 1982; 32:871-876.
61. Chamorro A, Sacco RL, Mohr JP, Foulkes MA, Kase CS, Tatemichi T, Wolf PA, Price TR, Hier DB. Clinical-computed tomographic correlations of lacunar infarction in the stroke data bank. Stroke. 1991;22:175-181.
62. Bogousslavsky J. Brain or nosology lacunes. Cerebrovasc Dis. 1991; 1:305. Editorial.
63. Arboix A, Martí-Vilalta JL, García JH. Clinical study of 227 patients with lacunar infarcts. Stroke. 1990;21:842-847.
64. Lodder J, Bamford J, Kappelle LJ, Boiten J. What causes false clinical predictors of small deep infarcts? Stroke. 1994;25:86-91.
65. Millikan C, Futrell N. The fallacy of the lacune hypothesis. Stroke. 1990;21:1251-1257.
66. D'Olhaberriague L, Hernández-Vidal A, Molina L, Soler-Singla LL, Marrugat J, Pons S, Moral A, Pou-Serradell A. A prospective study of atrial fibrillation and stroke. Stroke. 1989;20:648-652.
67. Bogousslavsky J, Hachinski VC, Boughner DR, Fox AJ, Vinuela F, Barnett HJM. Cardiac and arterial lesions in carotid transient ischemic attacks. Arch Neurol. 1986;43:223-228.
68. Bogousslavsky J, Hachinski VC, Boughner DR, Fox AJ, Viñuela F, Barnett HJM. Clinical predictors of cardiac and arterial lesions in carotid transient ischemic attacks. Arch Neurol. 1986;43:229-233.
69. Spitzer K, Becker V, Thie A, Kunze K. The Hamburg stroke data bank: goals, design and preliminary results. J Neurol. 1989;236: 139-144.
70. Foulkes MA, Wolf PA, Price TR, Mohr JP, Hier DB. The pilot stroke data bank: design, methods, and baseline characteristics. Stroke. 1988;19:547-554.
71. Mohr JP, Caplan LR, Melski JW, Goldstein RJ, Duncan GW, Kistler JP, Pessin MS, Bleich HL. The Harvard Cooperative Stroke Registry: a prospective registry. Neurology. 1978;28:754-762.
72. Brown EB, Tiejten GE, Deveshar RK, Ramadan NM, Levine SR, Dietrich KL, Nazareno DF, Welch KMA. Clinical stroke scales: an intra- and inter-scale evaluation. Neurology. 1990;40(S1):352. Abstract.
73. Wityk RJ, Pessin MS, Kaplan RF, Caplan LR. Serial assessment of acute stroke using the NIH Stroke Scale. Stroke. 1994;25:362-365.
74. Côté R, Hachinski VC, Shurvell BL, Norris JW, Wolfson C. The Canadian Neurological Scale: a preliminary study in acute stroke. Stroke. 1986;17:731-737.
75. Gresham GE. Rehabilitation of the stroke survivor. In: Barnett HJM, Stein BM, Mohr JP, Yatsu FM, eds. Stroke: Pathophysiology, Diagnosis, and Management. 2nd ed. New York, NY: Churchill Livingstone Inc; 1992:1189-1201.
76. Task Force on Stroke Impairment. Task Force on Stroke Disability and Task Force on Stroke Handicap: symposium recommendations for methodology in stroke outcome research. Stroke. 1990;21(suppl II):II-68-II-73.
77. Roth EJ, Mueller K, Green D. Stroke rehabilitation outcome: impact of coronary artery disease. Stroke. 1988;19:42-47.
78. Parikh RM, Robinson RG, Lipsey JR, Starkstein SE, Fedoroff P, Price T. The impact of poststroke depression on recovery in activities of daily living over a 2-year follow-up. Arch Neurol. 1990;47:785-789.
79. Mahoney FJ, Barthel DW. Functional evaluation: the Barthel Index. Md State Med J. 1965;14:61-65.
80. Burn JPS. Reliability of the modified Rankin scale. Stroke. 1992; 23:438. Letter.
81. Bloch RF. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19:1448. Letter.
82. Hanston L, De Keyser J. Neurological scales in the assessment of cerebral infarction. Cerebrovasc Dis. 1994(suppl 2):7-14.
83. Hacke W, Kaste M, Fieschi C, Toni D, Lesaffre E, von Kummer R, Boysen G, Bluhmki E, Höxter G, Mahagne MH, Hennerici M, for the ECASS Study Group. Intravenous thrombolysis with recombinant tissue plasminogen activator for acute hemispheric stroke: the European Cooperative Acute Stroke Study (ECASS). JAMA. 1995;274:1017-1026.