ISLES 2015 - A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI

Medical Image Analysis

Volumn 35, Issue , 2017, Pages 250-269

  Maier, Oskar ^a   Menze, Bjoern H ^e   von der Gablentz, Janina ^a   Häni, Levin ^c   Heinrich, Mattias P ^a   Liebrand, Matthias ^a   Winzeck, Stefan ^e   Basit, Abdul ^k   Bentley, Paul ^g   Chen, Liang ^g   Christiaens, Daan ^o,p   Dutil, Francis ^t   Egger, Karl ^h   Feng, Chaolu ⁱ   Glocker, Ben ^g   Götz, Michael ⁿ   Haeck, Tom ^o,p   Halme, Hanna Leena ^l,m   Havaei, Mohammad ^t   Iftekharuddin, Khan M ^q   Jodoin, Pierre Marc ^t   Kamnitsas, Konstantinos ^g   Kellner, Elias ^h   Korvenoja, Antti ^l   Larochelle, Hugo ^t   Ledig, Christian ^g   Lee, Jia Hong ^s   Maes, Frederik ^o,p   Mahmood, Qaiser ^j,k   Maier Hein, Klaus H ⁿ   McKinley, Richard ^d   Muschelli, John ^r   Pal, Chris ^u   Pei, Linmin ^q   Rangarajan, Janaki Raman ^o,p   Reza, Syed M S ^q   Robben, David ^o,p   Rueckert, Daniel ^g   Salli, Eero ^l   Suetens, Paul ^o,p   Wang, Ching Wei ^s   Wilms, Matthias ^a   Kirschke, Jan S ^f   Krämer, Ulrike M ^a   Münte, Thomas F ^a   Schramm, Peter ^b   Wiest, Roland ^d   Handels, Heinz ^a   Reyes, Mauricio ^c   more..

^a UNIVERSITY OF LÜBECK   (Germany)

^b Institute of Neuroradiology   (Germany)

^c UNIVERSITY OF BERN   (Switzerland)

^d UNIVERSITY OF BERN   (Switzerland)

^e TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^f TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^g IMPERIAL COLLEGE LONDON   (United Kingdom)

^h UNIVERSITY OF FREIBURG   (Germany)

ⁱ NORTHEASTERN UNIVERSITY   (China)

^j CHALMERS UNIVERSITY OF TECHNOLOGY   (Sweden)

^k PAKISTAN INSTITUTE OF NUCLEAR SCIENCE AND TECHNOLOGY   (Pakistan)

^l HELSINKI UNIVERSITY CENTRAL HOSPITAL   (Finland)

^m AALTO UNIVERSITY   (Finland)

ⁿ GERMAN CANCER RESEARCH CENTER DKFZ   (Germany)

^o UNIVERSITY OF LEUVEN   (Belgium)

^p UNIVERSITY HOSPITALS LEUVEN   (Belgium)

^q Old Dominion University   (United States)

^r JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^s NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

^t UNIVERSITÉ DE SHERBROOKE   (Canada)

^u ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

more..

Author keywords

Benchmark; Challenge; Comparison; Ischemic stroke; MRI; Segmentation

Indexed keywords

BENCHMARKING; DIAGNOSIS; IMAGE SEGMENTATION;

AUTOMATIC SEGMENTATIONS; CEREBROVASCULAR DISEASE; CHALLENGE; COMPARISON; ISCHEMIC STROKES; LESION SEGMENTATIONS; MAGNETIC RESONANCE IMAGING (MRI); ONLINE EVALUATION SYSTEMS;

MAGNETIC RESONANCE IMAGING;

GADOBUTROL;

ARTICLE; AUTOMATION; BRAIN HEMORRHAGE; BRAIN ISCHEMIA; CLASSIFICATION ALGORITHM; DIGITAL SUBTRACTION ANGIOGRAPHY; HEMISPHERIC DOMINANCE; HUMAN; ISCHEMIC STROKE LESION SEGMENTATION; MAJOR CLINICAL STUDY; NEUROIMAGING; NUCLEAR MAGNETIC RESONANCE IMAGING; NUCLEAR MAGNETIC RESONANCE SCANNER; OBSERVER VARIATION; PERFUSION WEIGHTED IMAGING; PRIORITY JOURNAL; QUALITY CONTROL; TUMOR LOCALIZATION; ALGORITHM; BENCHMARKING; CEREBROVASCULAR ACCIDENT; COMPUTER ASSISTED DIAGNOSIS; DIAGNOSTIC IMAGING; PROCEDURES;

ALGORITHMS; BENCHMARKING; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; STROKE;

EID: 84979950799     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2016.07.009     Document Type: Article

References (81)

1. Albers, G.W., Thijs, V.N., Wechsler, L.R., et al. Magnetic resonance imaging profiles predict clinical response to early reperfusion: the diffusion and perfusion imaging evaluation for understanding stroke evolution (DEFUSE) study. Ann. Neurol. 60:5 (2006), 508–517, 10.1002/ana.20976.
2. Artzi, M., Aizenstein, O., Jonas-Kimchi, T., et al. FLAIR lesion segmentation: application in patients with brain tumors and acute ischemic stroke. Eur. J. Radiol. 82:9 (2013), 1512–1518, 10.1016/j.ejrad.2013.05.029.
3. Avants, B.B., Epstein, C., Grossman, M., Gee, J., Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 12:1 (2008), 26–41, 10.1016/j.media.2007.06.004.
4. Bauer, S., Fejes, T., Reyes, M., A skull-stripping filter for ITK. Insight J, 2013.
5. Breiman, L., Random forests. Mach. Learn. 45:1 (2001), 5–32, 10.1023/A:1010933404324.
6. Christensen, S., Campbell, B.C., de la Ossa, N.P., Lansberg, M.G., Straka, M., De Silva, D.A., Nagakane, Y., Ogata, T., Mlynash, M., Bammer, R., Olivot, J.-M., Desmond, P., Albers, G.W., Donnan, G.A., Davis, S.M., Optimal perfusion thresholds for prediction of tissue destined for infarction in the combined EPITHET and DEFUSE dataset. Int. Stroke Conf, 2010.
7. Crimi, A., Maier, O., Menze, B., Reyes, M., Handels, H. (Eds.), 2016. In: LNCS Brainlesion: Glioma, MS, Stroke and Traumatic Brain Injuries - First International BrainLes Workshop MICCAI 2015. Springer.
8. Criminisi, A., Shotton, J. (Eds.), 2013. In: Decision forests for computer vision and medical image analysis. Springer.
9. Dastidar, P., Heinonen, T., Ahonen, J.-P., Jehkonen, M., Molnár, G., Volumetric measurements of right cerebral hemisphere infarction: use of a semiautomatic MRI segmentation technique. Comput. Biol. Med. 30:1 (2000), 41–54, 10.1016/S0010-4825(99)00022-0.
10. Derntl, A., Plant, C., Gruber, P., et al. Stroke lesion segmentation using a probabilistic atlas of cerebral vascular territories. Crimi, A., Maier, O., Menze, B., Reyes, M., Handels, H., (eds.) LNCS Brainlesion Glioma, MS, Stroke Trauma. Brain Inj. - First Int. BrainLes Work. MICCAI 2015, 2015, Springer Berlin Heidelberg, 11.
11. Feng, C., Li, C., Zhao, D., Davatzikos, C., Litt, H., Segmentation of the left ventricle using distance regularized two-layer level set approach. Med. Image Comput. Comput. Interv., 16, 2013, 477–484.
12. Fiez, J.A., Damasio, H., Grabowski, T.J., Lesion segmentation and manual warping to a reference brain: intra- and interobserver reliability. Hum. Brain Mapp. 9:4 (2000), 192–211.
13. Forbes, F., Doyle, S., Garcia-Lorenzo, D., Barillot, C., Dojat, M., Adaptive weighted fusion of multiple MR sequences for brain lesion segmentation. IEEE Int. Symp. Biomed. Imaging From Nano to Macro, 2010, IEEE, 69–72, 10.1109/ISBI.2010.5490413.
14. Forkert, N.D., Kaesemann, P., Treszl, A., et al. Comparison of 10 TTP and Tmax estimation techniques for MR perfusion-diffusion mismatch quantification in acute stroke. Am. J. Neuroradiol. 34:9 (2013), 1697–1703.
15. Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F., Dynamic classifier selection for One-vs-One strategy: avoiding non-competent classifiers. Pattern Recognit. 46:12 (2013), 3412–3424, 10.1016/j.patcog.2013.04.018.
16. Gao, J., Li, C., Feng, C., et al. Non-locally regularized segmentation of multiple sclerosis lesion from multi-channel MRI data. Magn. Reson. Imaging 32:8 (2014), 1058–1066, 10.1016/j.mri.2014.03.006.
17. Geurts, P., Ernst, D., Wehenkel, L., Extremely randomized trees. Mach. Learn. 63:1 (2006), 3–42, 10.1007/s10994-006-6226-1.
18. Ghosh, N., Sun, Y., Bhanu, B., Ashwal, S., Obenaus, A., Automated detection of brain abnormalities in neonatal hypoxia ischemic injury from MR images. Med. Image Anal. 18:7 (2014), 1059–1069, 10.1016/j.media.2014.05.002.
19. Goetz, M., Weber, C., Binczyk, F., et al. DALSA: domain adaptation for supervised learning from sparsely annotated MR images. IEEE Trans. Med. Imag. 35:1 (2016), 184–196, 10.1109/TMI.2015.2463078.
20. Goldstein, T., Bresson, X., Osher, S., Geometric applications of the split Bregman method: segmentation and surface reconstruction. J. Sci. Comput. 45:1–3 (2009), 272–293, 10.1007/s10915-009-9331-z.
21. Acute Ischemic Stroke - Imaging and Intervention. González, R.G., Hirsch, J.A., Lev, M.H., Schaefer, P.W., Schwamm, L.H., (eds.), 2, 2011, Springer, Berlin Heidelberg, 10.1007/978-3-642-12751-9.
22. Han, X., Jovicich, J., Salat, D., et al. Reliability of MRI-derived measurements of human cerebral cortical thickness: the effects of field strength, scanner upgrade and manufacturer. Neuroimage 32:1 (2006), 180–194, 10.1016/j.neuroimage.2006.02.051.
23. Ioffe, S., Szegedy, C., Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. 2015 1502.03167.
24. Išgum, I., Benders, M.J.N.L., Avants, B.B., et al. Evaluation of automatic neonatal brain segmentation algorithms: the NeoBrainS12 challenge. Med. Image Anal. 20:1 (2015), 135–151, 10.1016/j.media.2014.11.001.
25. Islam, A., Reza, S.M.S., Iftekharuddin, K.M., Multifractal texture estimation for detection and segmentation of brain tumors. IEEE Trans. Biomed. Eng. 60:11 (2013), 3204–3215, 10.1109/TBME.2013.2271383.
26. James, J.R., Yoder, K.K., Osuntokun, O., et al. A supervised method for calculating perfusion/diffusion mismatch volume in acute ischemic stroke. Comput. Biol. Med. 36:11 (2006), 1268–1287, 10.1016/j.compbiomed.2005.05.007.
27. Jenkinson, M., Pechaud, M., Smith, S., BET2: MR-based estimation of brain, skull and scalp surfaces. Eleventh Annual Meeting of the Organization for Human Brain Mapping, 17, 2005, 167 citeulike-article-id:1179617.
28. Jovicich, J., Czanner, S., Han, X., et al. MRI-derived measurements of human subcortical, ventricular and intracranial brain volumes: reliability effects of scan sessions, acquisition sequences, data analyses, scanner upgrade, scanner vendors and field strengths. Neuroimage 46:1 (2009), 177–192, 10.1016/j.neuroimage.2009.02.010.
29. Kabir, Y., Dojat, M., Scherrer, B., Forbes, F., Garbay, C., Multimodal MRI segmentation of ischemic stroke lesions. IEEE Eng. Med. Biol. Soc, 2007, IEEE, 1595–1598, 10.1109/IEMBS.2007.4352610.
30. Kemmling, A., Flottmann, F., Forkert, N.D., et al. Multivariate dynamic prediction of ischemic infarction and tissue salvage as a function of time and degree of recanalization. J. Cereb. Blood Flow Metab. 35:9 (2015), 1397–1405, 10.1038/jcbfm.2015.144.
31. Kistler, M., Bonaretti, S., Pfahrer, M., Niklaus, R., Büchler, P., The virtual skeleton database: an open access repository for biomedical research and collaboration. J. Med. Internet Res., 15(11), 2013, e245, 10.2196/jmir.2930.
32. Klein, S., Staring, M., Murphy, K., Viergever, M.A., Pluim, J.P.W., elastix: a toolbox for intensity-based medical image registration. IEEE Trans. Med. Imag. 29:1 (2010), 196–205, 10.1109/TMI.2009.2035616.
33. Konukoglu, E., Glocker, B., Zikic, D., Criminisi, A., Neighbourhood approximation using randomized forests. Med. Image Anal. 17:7 (2013), 790–804, 10.1016/j.media.2013.04.013.
34. Krähenbühl, P., Koltun, V., Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials. 2012 1210.5644.
35. Langerak, T.R., Van Der Heide, U.A., Kotte, A.N.T.J., et al. Label fusion in atlas-based segmentation using a selective and iterative method for performance level estimation (SIMPLE). Med. Imag. IEEE Trans. 29:12 (2010), 2000–2008.
36. Lansberg, M.G., Straka, M., Kemp, S., et al. MRI profile and response to endovascular reperfusion after stroke (DEFUSE 2): a prospective cohort study. Lancet. Neurol. 11:10 (2012), 860–867, 10.1016/S1474-4422(12)70203-X.
37. Li, W., Tian, J., Li, E., Dai, J., Robust unsupervised segmentation of infarct lesion from diffusion tensor MR images using multiscale statistical classification and partial volume voxel reclassification. Neuroimage 23:4 (2004), 1507–1518, 10.1016/j.neuroimage.2004.08.009.
38. Litjens, G., Toth, R., van de Ven, W., et al. Evaluation of prostate segmentation algorithms for MRI: the PROMISE12 challenge. Med. Image Anal. 18:2 (2014), 359–373, 10.1016/j.media.2013.12.002.
39. Mah, Y.-H., Jager, R., Kennard, C., Husain, M., Nachev, P., A new method for automated high-dimensional lesion segmentation evaluated in vascular injury and applied to the human occipital lobe. Cortex 56 (2014), 51–63, 10.1016/j.cortex.2012.12.008.
40. Maier, O., MedPy - Medical image processing in Python. 2016.
41. Maier, O., Reyes, M., Menze, B., Handels, H. (Eds.), 2015. In: ISLES 2015: Ischemic Stroke Lesion Segmentation - Proceedings.
42. Maier, O., Schröder, C., Forkert, N.D., Martinetz, T., Handels, H., Classifiers for ischemic stroke lesion segmentation: a comparison study. PLoS One, 10(12), 2015, e0145118, 10.1371/journal.pone.0145118.
43. Maier, O., Wilms, M., von der Gablentz, J., Krämer, U.M., Handels, H., Ischemic stroke lesion segmentation in multi-spectral MR images with support vector machine classifiers. Aylward, S., Hadjiiski, L.M., (eds.) SPIE Med. Imaging, 2014, International Society for Optics and Photonics, 903504, 10.1117/12.2043494.
44. Maier, O., Wilms, M., von der Gablentz, J., et al. Extra tree forests for sub-acute ischemic stroke lesion segmentation in MR sequences. J. Neurosci. Methods 240 (2015), 89–100, 10.1016/j.jneumeth.2014.11.011.
45. Maier, O., Wilms, M., Handels, H., Image features for brain lesion segmentation using random forests. Crimi, A., Maier, O., Menze, B., Reyes, M., Handels, H., (eds.) LNCS Brainlesion Glioma, MS, Stroke Trauma. Brain Inj. - First Int. BrainLes Work. MICCAI 2015, 2016, Springer Berlin Heidelberg.
46. Martel, A.L., Allder, S.J., Delay, G.S., Morgan, P.S., Moody, A.R., Measurement of infarct volume in stroke patients using adaptive segmentation of diffusion Weighted MR Images. Taylor, C., Colchester, A., (eds.) Med. Image Comput. Comput. Interv, 1999, Springer Berlin Heidelberg, Berlin, Heidelberg, 22–31, 10.1007/10704282.
47. Menze, B.H., Jakab, A., Bauer, S., et al. The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans. Med. Imag. 34:10 (2015), 1993–2024, 10.1109/TMI.2014.2377694.
48. Muda, A.F., Saad, N.M., Abu-Bakar, S.A.R., Muda, A.S., Abdullah, A.R., Brain lesion segmentation using fuzzy C-means on diffusion-weighted imaging. ARPN J. Eng. Appl. Sci., 10(3), 2015.
49. Mujumdar, S., Varma, R., Kishore, L.T., A novel framework for segmentation of stroke lesions in diffusion weighted MRI using multiple b-value data. Int. Conf. Pattern Recognit, 2012, IEEE, 3762–3765.
50. Murphy, K., Development and evaluation of automated image analysis techniques in thoracic CT, 2011, Utrecht University Ph.D. thesis.
51. Murphy, K., van Ginneken, B., Reinhardt, J.M., et al. Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge. IEEE Trans. Med. Imag. 30:11 (2011), 1901–1920, 10.1109/TMI.2011.2158349.
52. Nabizadeh, N., John, N.M., Wright, C., Histogram-based gravitational optimization algorithm on single MR modality for automatic brain lesion detection and segmentation. Expert Syst. Appl. 41:17 (2014), 7820–7836, 10.1016/j.eswa.2014.06.043.
53. Neumann, A.B., Jonsdottir, K.Y., Mouridsen, K., et al. Interrater agreement for final infarct MRI lesion delineation. Stroke 40:12 (2009), 3768–3771, 10.1161/STROKEAHA.108.545368.
54. Olivot, J.-M., Mlynash, M., Thijs, V.N., et al. Optimal Tmax threshold for predicting penumbral tissue in acute stroke. Stroke 40:2 (2009), 469–475, 10.1161/STROKEAHA.108.526954.
55. Olivot, J.-M., Mlynash, M., Zaharchuk, G., et al. Perfusion MRI (Tmax and MTT) correlation with xenon CT cerebral blood flow in stroke patients. Neurology 72:13 (2009), 1140–1145, 10.1212/01.wnl.0000345372.49233.e3.
56. Petitjean, C., Zuluaga, M.A., Bai, W., et al. Right ventricle segmentation from cardiac MRI: a collation study. Med. Image Anal. 19:1 (2015), 187–202, 10.1016/j.media.2014.10.004.
57. Porz, N., Bauer, S., Pica, A., et al. Multi-modal glioblastoma segmentation: man versus machine. PLoS One, 9(5), 2014, e96873, 10.1371/journal.pone.0096873.
58. Prakash, K.N.B., Gupta, V., Bilello, M., Beauchamp, N.J., Nowinski, W.L., Identification, segmentation, and image property study of acute infarcts in diffusion-weighted images by using a probabilistic neural network and adaptive Gaussian mixture model. Acad. Radiol. 13:12 (2006), 1474–1484, 10.1016/j.acra.2006.09.045.
59. Rekik, I., Allassonnière, S., Carpenter, T.K., Wardlaw, J.M., Medical image analysis methods in MR/CT-imaged acute-subacute ischemic stroke lesion: segmentation, prediction and insights into dynamic evolution simulation models. a critical appraisal. NeuroImage Clin. 1:1 (2012), 164–178, 10.1016/j.nicl.2012.10.003.
60. Reza, S.M.S., Iftekharuddin, K.M., Multi-fractal texture features for brain tumor and edema segmentation. Aylward, S., Hadjiiski, L.M., (eds.) SPIE Med. Imaging, 2014, International Society for Optics and Photonics, 903503, 10.1117/12.2044264.
61. Robben, D., Christiaens, D., Rangarajan, J.R., et al. A Voxel-wise, cascaded classification approach to ischemic stroke lesion segmentation. Crimi, A., Maier, O., Menze, B., Reyes, M., Handels, H., (eds.) LNCS Brainlesion Glioma, MS, Stroke Trauma. Brain Inj. - First Int. BrainLes Work. MICCAI 2015, 2016, Springer accepted.
62. Rudyanto, R.D., Kerkstra, S., van Rikxoort, E.M., et al. Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study. Med. Image Anal. 18:7 (2014), 1217–1232, 10.1016/j.media.2014.07.003.
63. Saad, N.M., Abu-Bakar, S.A.R., Muda, S., Mokji, M.M., Salahuddin, L., Brain lesion segmentation of Diffusion-weighted MRI using gray level co-occurrence matrix. IEEE Int. Conf. Imaging Syst. Tech, 2011, IEEE, 284–289, 10.1109/IST.2011.5962179.
64. Salli, E., Aronen, H.J., Savolainen, S., Korvenoja, A., Visa, A., Contextual clustering for analysis of functional MRI data. IEEE Trans. Med. Imag. 20:5 (2001), 403–414, 10.1109/42.925293.
65. Seghier, M.L., Ramlackhansingh, A., Crinion, J., Leff, A.P., Price, C.J., Lesion identification using unified segmentation-normalisation models and fuzzy clustering. Neuroimage 41:4 (2008), 1253–1266, 10.1016/j.neuroimage.2008.03.028.
66. Shattuck, D.W., Prasad, G., Mirza, M., Narr, K.L., Toga, A.W., Online resource for validation of brain segmentation methods. Neuroimage 45:2 (2009), 431–439, 10.1016/j.neuroimage.2008.10.066.
67. Sled, J.G., Zijdenbos, A.P., Evans, A.C., A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans. Med. Imag. 17:1 (1998), 87–97, 10.1109/42.668698.
68. Soltanian-Zadeh, H., Bagher-Ebadian, H., Ewing, J.R., et al. Multiparametric iterative self-organizing data analysis of ischemic lesions using pre- or post-Gd T1 MRI. Cerebrovasc. Dis. 23:2–3 (2007), 91–102, 10.1159/000097044.
69. Straka, M., Albers, G.W., Bammer, R., Real-time diffusion-perfusion mismatch analysis in acute stroke. J. Magn. Reson. Imag. 32:5 (2010), 1024–1037, 10.1002/jmri.22338.
70. Styner, M., Lee, J., Chin, B., et al. 3D segmentation in the clinic: a grand challenge II: MS lesion segmentation. Midas J, 2008.
71. Takasawa, M., Jones, P.S., Guadagno, J.V., et al. How reliable is perfusion MR in acute stroke? Validation and determination of the penumbra threshold against quantitative PET. Stroke 39:3 (2008), 870–877, 10.1161/STROKEAHA.107.500090.
72. Tobon-Gomez, C., De Craene, M., McLeod, K., et al. Benchmarking framework for myocardial tracking and deformation algorithms: an open access database. Med. Image Anal. 17:6 (2013), 632–648, 10.1016/j.media.2013.03.008.
73. Tsai, J.-Z., Peng, S.-J., Chen, Y.-W., et al. Automatic detection and quantification of acute cerebral infarct by fuzzy clustering and histographic characterization on diffusion weighted MR imaging and apparent diffusion coefficient map. Biomed. Res. Int., 2014, 2014, 13, 10.1155/2014/963032.
74. Urban, G., Bendszus, M., Hamprecht, F.A., Kleesiek, J., Multi-modal brain tumor segmentation using deep convolutional neural networks. MICCAI BraTS (Brain Tumor Segmentation) Challenge. Proceedings, Win. Contrib., 2014, 31–35.
75. Wang, C.-W., Budiman Gosno, E., Li, Y.-S., Fully automatic and robust 3D registration of serial-section microscopic images. Sci. Rep., 5, 2015, 15051, 10.1038/srep15051.
76. Warfield, S.K., Zou, K.H., Wells, W.M., Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. Med. Imag. IEEE Trans. 23:7 (2004), 903–921.
77. Wheeler, H.M., Mlynash, M., Inoue, M., et al. Early diffusion-weighted imaging and perfusion-weighted imaging lesion volumes forecast final infarct size in DEFUSE 2. Stroke 44:3 (2013), 681–685, 10.1161/STROKEAHA.111.000135.
78. WHO, Cause-specific mortality - estimates for 2000–2012. Technical Report, 2012.
79. Wilcoxon, F., Individual comparisons by ranking methods. Biometrics Bull. 1:6 (1945), 80–83.
80. Woloszynski, T., Kurzynski, M., A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recognit. 44:10–11 (2011), 2656–2668, 10.1016/j.patcog.2011.03.020.
81. Xu, L., Krzyzak, A., Suen, C.Y., Methods of combining multiple classifiers and their applications to handwriting recognition. Syst. Man Cybern. IEEE Trans. 22:3 (1992), 418–435.