An Approach to Comparing Accuracies of Two Flair MR Sequences in the Detection of Multiple Sclerosis Lesions in the Brain in the Absence of Gold Standard

Academic Radiology

Volumn 17, Issue 6, 2010, Pages 686-695

  Bilello, Michel ^a   Suri, Neeti ^a   Krejza, Jaroslaw ^a,b   Woo, John H ^a   Bagley, Linda J ^a   Mamourian, Alexander C ^a   Vossough, Arastoo ^a   Chen, James Y ^a   Millian, Bradd R ^a   Mulderink, Todd ^a   Markowitz, Clyde E ^a   Melhem, Elias R ^a  

^a HOSPITAL OF THE UNIVERSITY OF PENNSYLVANIA   (United States)

^b MEDICAL UNIVERSITY OF GDANSK   (Poland)

Author keywords

Accuracy studies; brain; equivalence tests; FLAIR; MR imaging; multiple sclerosis; ROC analysis

Indexed keywords

ADULT; AGED; ARTICLE; CLINICAL ARTICLE; CLINICAL PROTOCOL; COMPUTER SIMULATION; CONTROLLED STUDY; DIAGNOSTIC ACCURACY; FALSE POSITIVE RESULT; FEMALE; FLUID ATTENUATED INVERSION RECOVERY IMAGING; FOLLOW UP; HUMAN; IMAGE ANALYSIS; INTERMETHOD COMPARISON; MALE; MULTIPLE SCLEROSIS; NEURORADIOLOGY; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL;

ADULT; AGED; ALGORITHMS; BRAIN; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MULTIPLE SCLEROSIS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 77951842358     PISSN: 10766332     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.acra.2010.01.019     Document Type: Article

References (41)

1. Comi G., Pulizzi A., Rovaris M., et al. Effect of laquinimod on MRI-monitored disease activity in patients with relapsing-remitting multiple sclerosis: a multicentre, randomised, double-blind, placebo-controlled phase IIb study. Lancet 371 (2008) 2085-2092
2. McDonald W.I., Compston A., Edan G., et al. Recommended diagnostic criteria for multiple sclerosis: guidelines from the International Panel on the diagnosis of multiple sclerosis. Ann Neurol 50 (2001) 121-127
3. Polman C.H., Reingold S.C., Edan G., et al. Diagnostic criteria for multiple sclerosis: 2005 revisions to the "McDonald Criteria". Ann Neurol 58 (2005) 840-846
4. Kappos L., Gold R., Miller D.H., et al. Efficacy and safety of oral fumarate in patients with relapsing-remitting multiple sclerosis: a multicentre, randomised, double-blind, placebo-controlled phase IIb study. Lancet 372 (2008) 1463-1472
5. Brex P.A., Ciccarelli O., O'Riordan J.I., et al. A longitudinal study of abnormalities on MRI and disability from multiple sclerosis. N Engl J Med 346 (2002) 158-164
6. Yousry T.A., Filippi M., Becker C., et al. Comparison of MR pulse sequences in the detection of multiple sclerosis lesions. AJNR Am J Neuroradiol 18 (1997) 959-963
7. Bink A., Schmitt M., Gaa J., et al. Detection of lesions in multiple sclerosis by 2D FLAIR and single-slab 3D FLAIR sequences at 3.0 T: initial results. Eur Radiol 16 (2006) 1104-1110
8. Evans A.C., Frank J.A., Antel J., et al. The role of MRI in clinical trials of multiple sclerosis: comparison of image processing techniques. Ann Neurol 41 (1997) 125-132
9. Geurts J.J., Pouwels P.J., Uitdehaag B.M., et al. Intracortical lesions in multiple sclerosis: improved detection with 3D double inversion-recovery MR imaging. Radiology 236 (2005) 254-260
10. Moraal B., Meier D.S., Poppe P.A., et al. Subtraction MR images in a multiple sclerosis multicenter clinical trial setting. Radiology 250 (2009) 506-514
11. Bakshi R., Thompson A.J., Rocca M.A., et al. MRI in multiple sclerosis: current status and future prospects. Lancet Neurol 7 (2008) 615-625
12. Whiting P., Harbord R., Main C., et al. Accuracy of magnetic resonance imaging for the diagnosis of multiple sclerosis: systematic review. BMJ 332 (2006) 875-884
13. Begg C.B., and McNeil B.J. Assessment of radiologic tests: control of bias and other design considerations. Radiology 167 (1988) 565-569
14. Woo J.H., Henry L.P., Krejza J., et al. Detection of simulated multiple sclerosis lesions on T2-weighted and FLAIR images of the brain: observer performance. Radiology 241 (2006) 206-212
15. Herskovits E.H., Itoh R., and Melhem E.R. Accuracy for detection of simulated lesions: comparison of fluid-attenuated inversion-recovery, proton density-weighted, and T2-weighted synthetic brain MR imaging. AJR Am J Roentgenol 176 (2001) 1313-1318
16. Pikus L., Woo J.H., Wolf R.L., et al. Artificial multiple sclerosis lesions on simulated FLAIR brain MR images: echo time and observer performance in detection. Radiology 239 (2006) 238-245
17. Melhem E.R., and Itoh R. Effect of T1 relaxation time on lesion contrast enhancement in flair MR imaging: a study using computer-generated brain maps. AJR Am J Roentgenol 176 (2001) 537-539
18. JAFROC-1, software version 1.0, downloaded October 15, 2008. http://www.devchakraborty.com/downloads.html.
19. Dorfman D.D., Berbaum K.S., and Metz C.E. Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method. Invest Radiol 27 (1992) 723-731
20. DBM-MRMC, software version 2.2, downloaded March 25, 2009. http://perception.radiology.uiowa.edu.
21. Obuchowski N.A. Determining sample size for ROC studies: what is reasonable for the expected difference in tests' ROC areas?. Acad Radiol 10 (2003) 1327-1328
22. Polman C.H., O'Connor P.W., Havrdova E., et al. A randomized, placebo-controlled trial of natalizumab for relapsing multiple sclerosis. N Engl J Med 354 (2006) 899-910
23. Kundel H.L., Polansky M., Dalinka M.K., et al. Reliability of soft-copy versus hard-copy interpretation of emergency department radiographs: a prototype study. AJR Am J Roentgenol 177 (2001) 525-528
24. Warfield S.K., Zou K.H., and Wells W.M. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans Med Imaging 23 (2004) 903-921
25. Miller D.H., Grossman R.I., Reingold S.C., et al. The role of magnetic resonance techniques in understanding and managing multiple sclerosis. Brain 121 (1998) 3-24
26. Strasser-Fuchs S., Enzinger C., Ropele S., et al. Clinically benign multiple sclerosis despite large T2 lesion load: can we explain this paradox?. Mult Scler 14 (2008) 205-211
27. Daumer M., Neuhaus A., Morrissey S., et al. MRI as an outcome in multiple sclerosis clinical trials. Neurology 72 (2009) 705-711
28. Hashemi R.H. BWG, Lisanti C.J. MRI: the basics. Lippincott Williams & Wilkins, New York, 2003.
29. Gawne-Cain M.L., O'Riordan J.I., Thompson A.J., et al. Multiple sclerosis lesion detection in the brain: a comparison of fast fluid-attenuated inversion recovery and conventional T2-weighted dual spin echo. Neurology 49 (1997) 364-370
30. Wattjes M.P., Lutterbey G.G., Harzheim M., et al. Imaging of inflammatory lesions at 3.0 Tesla in patients with clinically isolated syndromes suggestive of multiple sclerosis: a comparison of fluid-attenuated inversion recovery with T2 turbo spin-echo. Eur Radiol 16 (2006) 1494-1500
31. Arakia Y., Ashikaga R., Fujii K., et al. MR fluid-attenuated inversion recovery imaging as routine brain T2-weighted imaging. Eur J Radiol 32 (1999) 136-143
32. Stevenson V.L., Parker G.J., Barker G.J., et al. Variations in T1 and T2 relaxation times of normal appearing white matter and lesions in multiple sclerosis. J Neurol Sci 178 (2000) 81-87
33. Chakraborty D.P., and Berbaum K.S. Observer studies involving detection and localization: modeling, analysis, and validation. Med Phys 31 (2004) 2313-2330
34. Chakraborty D.P. Counterpoint to "Performance assessment of diagnostic systems under the FROC paradigm" by Gur and Rockette. Acad Radiol 16 (2009) 507-510
35. Chakraborty D.P. Validation and statistical power comparison of methods for analyzing free-response observer performance studies. Acad Radiol 15 (2008) 1554-1566
36. Gur D., and Rockette H.E. Performance assessments of diagnostic systems under the FROC paradigm: experimental, analytical, and results interpretation issues. Acad Radiol 15 (2008) 1312-1315
37. Chakraborty D.P., and Winter L.H. Free-response methodology: alternate analysis and a new observer-performance experiment. Radiology 174 (1990) 873-881
38. Chakraborty D.P. Maximum likelihood analysis of free-response receiver operating characteristic (FROC) data. Med Phys 16 (1989) 561-568
39. Dodd L.E., Wagner R.F., Armato III S.G., et al. Assessment methodologies and statistical issues for computer-aided diagnosis of lung nodules in computed tomography: contemporary research topics relevant to the lung image database consortium. Acad Radiol 11 (2004) 462-475
40. Wagner R.F., Metz C.E., and Campbell G. Assessment of medical imaging systems and computer aids: a tutorial review. Acad Radiol 14 (2007) 723-748
41. Obuchowski N.A. Sample size tables for receiver operating characteristic studies. AJR Am J Roentgenol 175 (2000) 603-608