A critical review of stroke trial analytical methodology: Outcome measures, study design, and correction for imbalances

Translational Stroke Research: From Target Selection to Clinical Trials

Volumn , Issue , 2012, Pages 833-861

  Mandava, Pitchaiah ^a   Krumpelman, Chase S ^a   Murthy, Santosh B ^a   Kent, Thomas A ^a  

^a MICHAEL E DEBAKEY VETERANS AFFAIRS MEDICAL CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84937711503     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-1-4419-9530-8_40     Document Type: Chapter

References (105)

1. Fisher M, Feuerstein G, Howells DW, Hum PD, Kent TA, Savitz SI, et al. Update of the stroke therapy academic industry roundtable preclinical recommendations. Stroke. 2009;40(6): 2244-50.
2. Kidwell CS, Liebeskind DS, Starkman S, Saver JL. Trends in acute ischemic stroke trials through the 20th century. Stroke. 2001;32(6):1349-59.
3. Mann J. NINDS reanalysis committee's reanalysis of the NINDS trial. Stroke. 2005;36(2): 230-1.
4. Mandava P, Kalkonde YV, Rochat RH, Kent TA. A matching algorithm to address imbalances in study populations: application to the National Institute of Neurological Diseases and Stroke Recombinant Tissue Plasminogen Activator acute stroke trial. Stroke. 2010;41(4):765-70.
5. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629-34.
6. A controlled trial of recombinant methionyl human BDNF in ALS: the BDNF study group (phase III). Neurology. 1999;52(7):1427-33.
7. Doody RS. Evolving early (pre-dementia) Alzheimer's disease trials: suit the outcomes to the population and study design. J Nutr Health Aging. 2010;14(4):299-302.
8. C-path online depository. http://www.c-path.org/CAMD.cfm. Accessed 3 Aug 2011.
9. Tissue plasminogen activator for acute ischemic stroke. The national institute of neurological disorders and stroke rt-PA stroke study group. N Engl J Med. 1995;333(24):1581-7.
10. Furlan A, Higashida R, Wechsler L, Gent M, Rowley H, Kase C, et al. Intra-arterial prourokinase for acute ischemic stroke The PROACT II study: a randomized controlled trial. Prolyse in acute cerebral thromboembolism. JAMA. 1999;282(21):2003-11.
11. Hacke W, Kaste M, Bluhmki E, Brozman M, Davalos A, Guidetti D, et al. Thrombolysis with alteplase 3 to 4.5 hours after acute ischemic stroke. N Engl J Med. 2008;359(13):1317-29.
12. Davis SM, Donnan GA, Parsons MW, Levi C, Butcher KS, Peeters A, et al. Effects of alteplase beyond 3 h after stroke in the Echoplanar Imaging Thrombolytic Evaluation Trial (EPITHET): a placebo-controlled randomised trial. Lancet Neurol. 2008;7(4):299-309.
13. Pancioli AM, Broderick J, Brott T, Tomsick T, Khoury J, Bean J, et al. The combined approach to lysis utilizing eptifibatide and rt-PA in acute ischemic stroke: the CLEAR stroke trial. Stroke. 2008;39(12):3268-76.
14. Adams Jr HP, Davis PH, Leira EC, Chang KC, Bendixen BH, Clarke WR, et al. Baseline NIH stroke scale score strongly predicts outcome after stroke: a report of the trial of Org 10172 in acute stroke treatment (TOAST). Neurology. 1999;53(1):126-31.
15. Weimar C, König IR, Kraywinkel K, Ziegler A, Diener HC. Age and national institutes of health stroke scale score within 6 hours after onset are accurate predictors of outcome after cerebral ischemia: development and external validation of prognostic models. Stroke. 2004;35(1): 158-62.
16. Ingall TJ, O'Fallon WM, Asplund K, Goldfrank LR, Hertzberg VS, Louis TA, et al. Findings from the reanalysis of the NINDS tissue plasminogen activator for acute ischemic stroke treatment trial. Stroke. 2004;35(10):2418-24.
17. Grotta JC. The NINDS stroke study group response. J Stroke Cerebrovasc Dis. 2002;11(3-4): 121-4.
18. Clark WM, Madden KP. Keep the three hour TPA window: the lost study of Atlantis. J Stroke Cerebrovasc Dis. 2009;18(1):78-9.
19. Crager MR. Analysis of covariance in parallel-group clinical trials with pretreatment baselines. Biometrics. 1987;43(4):895-901.
20. Koch GG, Tangen CM, Jung JW, Amara IA. Issues for covariance analysis of dichotomous and ordered categorical data from randomized clinical trials and non-parametric strategies for addressing them. Stat Med. 1998;17(15-16):1863-92.
21. Martinez WL, Martinez AR. Computational statistics with Matlab. Boca Raton: Chapman and Hall/CRC; 2002. p. 285-8.
22. Mandava P, Kent TA. Intra-arterial therapies for acute ischemic stroke. Neurology. 2007;68:2132-9.
23. Ntaios G, Egli M, Faouzi M, Michel P. J-shaped association between serum glucose and functional outcome in acute ischemic stroke. Stroke. 2010;41(10):2366-70.
24. Lyden P, Shuaib A, Ng K, Levin K, et al. Clomethiazole acute stroke study in ischemic stroke. Final results. Stroke. 2002;33:122-9.
25. Garvey JE, Marschall EA, Wright RA. From star chars to stoenflies: detecting relationships in continuous bivariate data. Ecology. 1998;79:442-7.
26. Bushnell CD. Stroke and the female brain. Nat Clin Pract Neurol. 2008;4(1):22-33.
27. Kasner SE. Clinical interpretation and use of stroke scales. Lancet Neurol. 2006;5:603-12.
28. Shaltoni HM, Albright KC, Gonzales NR, Weir RU, et al. Is intra-arterial thrombolysis safe after full-dose intravenous recombinant tissue plasminogen activator for acute ischemic stroke? Stroke. 2007;38:80-4.
29. Rankin J. Cerebral vascular accidents in patients over the age of 60 II. Prognosis. Scott Med J. 1957;2(5):200-15.
30. Quinn TJ, Dawson J, Walters M. Dr John Rankin; his life, legacy and the 50th anniversary of the Rankin Stroke Scale. Scott Med J. 2008;53(1):44-7.
31. Duncan PW, Sullivan KJ, Behrman AL, Azen SP, Wu SS, Nadeau SE, et al. Protocol for the locomotor experience applied post-stroke (LEAPS) trial: a randomized controlled trial. BMC Neurol. 2007;7:39.
32. Farrell B, Godwin J, Richards S, Warlow C. The United Kingdom transient ischaemic attack (UK-TIA) aspirin trial: final results. J Neurol Neurosurg Psychiatry. 1991;54(12):1044-54.
33. Quinn TJ, Dawson J, Walters MR, Lees KR. Functional outcome measures in contemporary stroke trials. Int J Stroke. 2009;4(3):200-5.
34. van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJ, van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19(5):604-7.
35. Wilson JT, Hareendran A, Grant M, Baird T, Schulz UG, Muir KW, et al. Improving the assessment of outcomes in stroke: use of a structured interview to assign grades on the modified Rankin scale. Stroke. 2002;33(9):2243-6.
36. Wilson JT, Hareendran A, Hendry A, Potter J, Bone I, Muir KW. Reliability of the modified Rankin scale across multiple raters: benefits of a structured interview. Stroke. 2005;36(4):777-81.
37. Quinn TJ, Dawson J, Walters MR, Lees KR. Exploring the reliability of the modified Rankin scale. Stroke. 2009;40(3):762-6.
38. Quinn TJ, Dawson J, Walters MR, Lees KR. Variability in modified Rankin scoring across a large cohort of international observers. Stroke. 2008;39(11):2975-9.
39. Lai SM, Duncan PW. Stroke recovery profile and the modified Rankin assessment. Neuroepidemiology. 2001;20(1):26-30.
40. Mahoney FI, Barthel DW. Functional evaluation: the Barthel Index. Md State Med J. 1965;14:61-5.
41. Kwon S, Hartzema AG, Duncan PW, Min-Lai S. Disability measures in stroke: relationship among the Barthel Index, the functional independence measure, and the modified Rankin scale. Stroke. 2004;35(4):918-23.
42. Young FB, Lees KR, Weir CJ. Strengthening acute stroke trials through optimal use of disability end points. Stroke. 2003;34(11):2676-80.
43. Balu S. Differences in psychometric properties, cut-off scores, and outcomes between the Barthel Index and modified Rankin scale in pharmacotherapy-based stroke trials: systematic literature review. Curr Med Res Opin. 2009;25(6):1329-41.
44. Wright J, Bushnik T, O'Hare P. The center for outcome measurement in brain injury (COMBI): an internet resource you should know about. J Head Trauma Rehabil. 2000;15(1):734-8.
45. Sullivan KJ, Tilson JK, Cen SY, Rose DK, Hershberg J, Correa A, et al. Fugl-Meyer assessment of sensorimotor function after stroke: standardized training procedure for clinical practice and clinical trials. Stroke. 2011;42(2):427-32.
46. Chollet F, Tardy J, Albucher JF, Thalamas C, Berard E, Lamy C, et al. Fluoxetine for motor recovery after acute ischaemic stroke (FLAME): a randomised placebo-controlled trial. Lancet Neurol. 2011;10(2):123-30.
47. Lai SM, Perera S, Duncan PW, Bode R. Physical and social functioning after stroke: comparison of the Stroke Impact Scale and Short Form-36. Stroke. 2003;34(2):488-93.
48. The field administration of stroke therapy: magnesium phase 3 clinical trial. http://www.fastmag.info/. Accessed 19 Jan, 2012.
49. The Publications Committee for the Trial of ORG 10172 in Acute Stroke Treatment (TOAST) Investigators. Low molecular weight heparinoid, ORG 10172 (danaparoid), and outcome after acute ischemic stroke: a randomized controlled trial. JAMA. 1998;279(16):1265-72.
50. Teasdale GM, Pettigrew LE, Wilson JT, Murray G, Jennett B. Analyzing outcome of treatment of severe head injury: a review and update on advancing the use of the Glasgow outcome scale. J Neurotrauma. 1998;15(8):587-97.
51. Cooper DJ, Rosenfeld JV, Murray L, Arabi YM, Davies AR, D'Urso P, et al. Decompressive craniectomy in diffuse traumatic brain injury. N Engl J Med. 2011;364(16):1493-502.
52. Roozenbeek B, Lingsma HF, Perel P, Edwards P, Roberts I, Murray GD, et al. The added value of ordinal analysis in clinical trials: an example in traumatic brain injury. Crit Care. 2011;15(3):R127.
53. Jennett B, Bond M. Assessment of outcome after severe brain damage. Lancet. 1975;7905: 480-4.
54. Krams M, Lees KR, Hacke W, Grieve AP, Orgogozo JM, Ford GA. Acute stroke therapy by inhibition of neutrophils (ASTIN): an adaptive dose-response study of UK-279,276 in acute ischemic stroke. Stroke. 2003;34(11):2543-8.
55. Woo D, Broderick JP, Kothari RU, Lu M, Brott T, Lyden PD, NINDS t-PA Stroke Study Group, et al. Does the National Institutes of Health Stroke Scale favor left hemisphere strokes? Stroke. 1999;30(11):2355-9.
56. Sato S, Toyoda K, Uehara T, Toratani N, Yokota C, Moriwaki H, et al. Baseline NIH stroke scale score predicting outcome in anterior and posterior circulation strokes. Neurology. 2008;70(24 Pt 2):2371-7.
57. Lyden P, Claesson L, Havstad S, Ashwood T, Lu M. Factor analysis of the National Institutes of Health Stroke Scale in patients with large strokes. Arch Neurol. 2004;61(11):1677-80.
58. Hacke W, Kaste M, Fieschi C, von Kummer R, Davalos A, Meier D, et al. Randomised double-blind placebo-controlled trial of thrombolytic therapy with intravenous alteplase in acute ischaemic stroke (ECASS II). Second European-Australasian Acute Stroke Study Investigators. Lancet. 1998;352(9136):1245-51.
59. Juttler E, Schwab S, Schmiedek P, Unterberg A, Hennerici M, Woitzik J, et al. Decompressive surgery for the treatment of malignant infarction of the middle cerebral artery (DESTINY): a randomized, controlled trial. Stroke. 2007;38(9):2518-25.
60. Vahedi K, Vicaut E, Mateo J, Kurtz A, Orabi M, Guichard JP, et al. Sequential-design, multicenter, randomized, controlled trial of early decompressive craniectomy in malignant middle cerebral artery infarction (DECIMAL trial). Stroke. 2007;38(9):2506-17.
61. Tilley BC, Marler J, Geller NL, Lu M, Legler J, Brott T, et al. Use of a global test for multiple outcomes in stroke trials with application to the National Institute of Neurological Disorders and Stroke t-PA Stroke Trial. Stroke. 1996;27(11):2136-42.
62. Abciximab Emergent Stroke Treatment Trial (AbESTT) Investigators. Emergency administration of abciximab for treatment of patients with acute ischemic stroke: results of a randomized phase 2 trial. Stroke. 2005;36(4):880-90.
63. Saver JL, Yafeh B. Confirmation of tPA treatment effect by baseline severity-adjusted end point reanalysis of the NINDS-tPA stroke trials. Stroke. 2007;38(2):414-6.
64. Points to consider on clinical investigation of medicinal products for the treatment of acute stroke. The European agency for the evaluation of medicinal products. 2001. http://www.ema. europa.eu/docs/en_GB/document_library/Scientific_guideline/2009/09/WC500003342.pdf. Accessed 19 Jan, 2012.
65. Lees KR, Zivin JA, Ashwood T, Davalos A, Davis SM, Diener HC, et al. NXY-059 for acute ischemic stroke. N Engl J Med. 2006;354(6):588-600.
66. Shuaib A, Lees KR, Lyden P, Grotta J, Davalos A, Davis SM, et al. NXY-059 for the treatment of acute ischemic stroke. N Engl J Med. 2007;357(6):562-71.
67. Saver JL. Novel end point analytic techniques and interpreting shifts across the entire range of outcome scales in acute stroke trials. Stroke. 2007;38(11):3055-62.
68. Savitz SI, Lew R, Bluhmki E, Hacke W, Fisher M. Shift analysis versus dichotomization of the modified Rankin scale outcome scores in the NINDS and ECASS-II trials. Stroke. 2007;38(12):3205-12.
69. Mishra NK, Lyden P, Grotta JC, Lees KR. Thrombolysis is associated with consistent functional improvement across baseline stroke severity: a comparison of outcomes in patients from the Virtual International Stroke Trials Archive (VISTA). Stroke. 2010;41(11):2612-7.
70. Bruno A, Saha C, Williams LS. Using change in the National Institutes of Health Stroke Scale to measure treatment effect in acute stroke trials. Stroke. 2006;37(3):920-1.
71. Bath PM, Gray LJ, Collier T, Pocock S, Carpenter J. Can we improve the statistical analysis of stroke trials? Statistical reanalysis of functional outcomes in stroke trials. Stroke. 2007;38(6):1911-5.
72. Saver JL, Gornbein J. Treatment effects for which shift or binary analyses are advantageous in acute stroke trials. Neurology. 2009;72(15):1310-5.
73. Saver JL. Optimal end points for acute stroke therapy trials: best ways to measure treatment effects of drugs and devices. Stroke. 2011;42(8):2356-62.
74. Shannon CE. A mathematical theory of communication. Bell Sys Tech J. 1948;27:379-423. http://www.alcatel-lucent.com/bstj/vol27-1948/articles/bstj27-4-623.pdf. Accessed 19 Jan, 2012.
75. Altman DG, Royston P. The cost of dichotomising continuous variables. BMJ. 2006;332(7549):1080.
76. Federov V, Mannino F, Zhang R. Consequences of dichotomization. Pharm Stat. 2009;8:50-61.
77. Howard G. Nonconventional clinical trial designs: approaches to provide more precise estimates of treatment effects with a smaller sample size, but a cost. Stroke. 2007;38:804-8.
78. Hall CE, Mirski M, Palesch YY, Diringer MN, Qureshi AI, Robertson CS, et al. First neurocritical care research conference investigators. Clinical trial design in the neurocritical care unit. Neurocrit Care. 2012;16(1):6-19.
79. Bross IDJ. How to use RIDIT analysis. Biometrics. 1958;14:18-38.
80. Krumpelman CS, Mandava P, Kent TA. Error rate estimates for the modified Rankin Score shift analysis using information theory modeling. International Stroke Conference 2012. Stroke. 43:P290.
81. The Food and Drug Administration. Guidance for industry. Adaptive design clinical trials for drugs and biologics. 2010. http://www.fda.gov/downloads/Drugs/GuidanceCompliance RegulatoryInformation/Guidances/ucm201790.pdf. Accessed 19 Jan, 2012.
82. Elkind MS, Sacco RL, MacArthur RB, Fink DJ, Peerschke E, Andrews H, et al. The neuroprotection with Statin Therapy for Acute Recovery Trial (NeuSTART): an adaptive design phase I dose-escalation study of high-dose lovastatin in acute ischemic stroke. Int J Stroke. 2008;3(3):210-8.
83. Ginsberg MD, Palesch YY, Martin RH, Hül MD, Moy CS, Waldman BD, et al. The albumin in acute stroke (ALIAS) multicenter clinical trial: safety analysis of part 1 and rationale and design of part 2. Stroke. 2011;42(1):119-27.
84. Howard G, Coffey CS, Cutter GR. Is Bayesian analysis ready for use in phase III randomized clinical trials? Beware the sound of the sirens. Stroke. 2005;36(7):1622-3.
85. Mandava P, Kent TA. A method to determine stroke trial success using multidimensional pooled control functions. Stroke. 2009;40(5):1803-10.
86. Uchino K, Billheimer D, Cramer SC. Entry criteria and baseline characteristics predict outcome in acute stroke trials. Stroke. 2001;32(4):909-16.
87. Zar JH. Biostatistical analysis. 3rd ed. Upper Saddle: Prentice Hall; 1996. p. 282-3.
88. Lampl Y, Zivin JA, Fisher M, Lew R, Welin L, Dahlof B, et al. Infrared laser therapy for ischemic stroke: a new treament strategy: results of the NeuroThera Effectiveness and Safety Trial-1 (NEST-1). Stroke. 2007;38(6):1843-9.
89. Alexandrov AV, Molina CA, Grotta JC, Garami Z, Ford SR, Alvarez-Sabin J, et al. Ultrasound-enhanced systemic thrombolysis for acute ischemic stroke. N Engl J Med. 2004;351: 2170-8.
90. Ogawa A, Mori E, Minematsu K, Taki W, Takahashi A, Nemoto S, et al. Randomized trial of intra-arterial infusion of urokinase within 6 hours of middle cerebral artery stroke: the middle cerebral artery embolism local fibrinolytic intervention trial (MELT) Japan. Stroke. 2007;38(10):2633-9.
91. Lehman EL, D'Abrera HJM. Blocked comparisons for two treatments. Chapter 3 in Nonparametrics. Statistical methods based on ranks. San Francisco: Holden-Day Inc; 1975. p. 120-45.
92. Koziol JA, Feng AC. On the analysis and interpretation of outcome measures in stroke clinical trials: lessons from the SAINT I study of NXY-059 for acute ischemic stroke. Stroke. 2006;37(10):2644-7.
93. Koziol JA, Feng AC. On the analysis and interpretation of outcome measures in stroke clinical trials: lessons from the SAINT I study of NXY-059 for acute ischemic stroke. Response to letter by Saver. Stroke. 2007;38:258.
94. Adams Jr HP, Effron MB, Torner J, Dávalos A, Frayne J, Teal P, AbESTT-II Investigators, et al. Emergency administration of abciximab for treatment of patients with acute ischemic stroke: results of an international phase III trial: Abciximab in Emergency Treatment of Stroke Trial (AbESTT-II). Stroke. 2008;39(1):87-99.
95. Mandava P, Dalmeida W, Anderson JA, Thiagarajan P, Fabian RH, Weir RU, et al. A Pilot trial of low-dose intravenous abciximab and unfractionated heparin for acute ischemic stroke: translating GP IIb/IIIa receptor inhibition to clinical practice. Transl Stroke Res. 2010;1:170-7.
96. Clark WM, Wissman S, Albers GW, Jhamandas JH, Madden KP, Hamilton S. Recombinant tissue-type plasminogen activator (alteplase) for ischemic stroke 3 to 5 hours after symptom onset: the ATLANTIS study: a randomized controlled trial: alteplase thrombolysis for acute noninterventional therapy in ischemic stroke. JAMA. 1999;282(21):2019-26.
97. Bergstralh EJ, Kosanke JL. Computerized matching of cases to controls. Technical report 56. http://www.mayoresearch.mayo.edu/mayo/research/biostat/upload/56.pdf. Accessed 19 Jan, 2012.
98. Mandava P, Sarma AK, Martini SR, Kent TA. Evaluation of subject matching methods to adjust for imbalances in stroke trials. (Submitted).
99. NIST/SEMATECH e-Handbook of statistical methods. http://www.itl.nist.gov/div898/hand-book/. Accessed 19 Jan, 2012.
100. Egorova N, Giacovelli J, Greco G, Gelijns A, Kent CK, McKinsey JF. National outcomes for the treatment of ruptured abdominal aortic aneurysm: comparison of open versus endovascular repairs. J Vasc Surg. 2008;48(5):1092-100, 100 e1-2.
101. Black PE. Manhattan distance, in dictionary of algorithms and data structures (online). In: Black PE, editors. U.S. National Institute of Standards and Technology. http://www.nist. gov/dads/HTML/manhattanDistance.html. Accessed 31 May 2006.
102. Mandava P, Brooks M, Krumpelman C, Kent TA. A new more sensitive method to assess balance among stroke trial populations. International Stroke Conference 2012. Stroke. 43:P295.
103. Peacock JA. Two-dimensional goodness-of-fit testing in astronomy. Roy Astron Soc. 1983;202:615-27.
104. Fasano G, Franceschini A. A multidimensional version of the Kolmogorov-Smirnov test. Roy Astron Soc. 1987;225:155-70.
105. Lapchak PA. A critical assessment of edaravone acute ischemic stroke efficacy trials: is edaravone an effective neuroprotective therapy? Expert Opin Pharmacother. 2010;11(10): 1753-63.