Multi-Modality Vertebra Recognition in Arbitrary Views Using 3D Deformable Hierarchical Model

IEEE Transactions on Medical Imaging

Volumn 34, Issue 8, 2015, Pages 1676-1693

  Cai, Yunliang ^a   Osman, Said ^b   Sharma, Manas ^a   Landis, Mark ^c   Li, Shuo ^d  

^a UNIVERSITY OF WESTERN ONTARIO   (Canada)

^b ST JOSEPH S HEALTH CENTRE   (Canada)

^c LONDON HEALTH SCIENCES CENTRE   (Canada)

^d GE HEALTHCARE   (Canada)

Author keywords

Spine recognition; vertebra detection; vertebra pose estimation; vertebra segmentation

Indexed keywords

AUTOMATION; COMPUTER AIDED DIAGNOSIS; COMPUTERIZED TOMOGRAPHY; DEFORMATION; DIAGNOSIS; HIERARCHICAL SYSTEMS; IMAGE PROCESSING; LOCATION; MEDICAL INFORMATION SYSTEMS; MEDICAL PROBLEMS; SHAPE OPTIMIZATION; THREE DIMENSIONAL COMPUTER GRAPHICS;

AUTOMATIC IDENTIFICATION; POSE ESTIMATION; QUANTITATIVE ASSESSMENTS; QUANTITATIVE DIAGNOSIS; SIMULTANEOUS IDENTIFICATION; SPINE RECOGNITION; STRUCTURAL INFORMATION; VERTEBRA DETECTIONS;

MUSCULOSKELETAL SYSTEM;

ANATOMICAL CONCEPTS; ARTICLE; AUTOMATED PATTERN RECOGNITION; CERVICAL SPINE; CERVICAL SPINE RADIOGRAPHY; CONE BEAM COMPUTED TOMOGRAPHY; CONTROLLED STUDY; DEFORMABLE HIERARCHICAL MODEL; GEOMETRY; HUMAN; LUMBAR SPINE; MEASUREMENT ACCURACY; MODEL; MULTIDETECTOR COMPUTED TOMOGRAPHY; NUCLEAR MAGNETIC RESONANCE IMAGING; QUANTITATIVE ANALYSIS; RIGIDITY; VERTEBRA; VERTEBRA RECOGNITION; ALGORITHM; ANATOMY AND HISTOLOGY; COMPUTER ASSISTED TOMOGRAPHY; FACTUAL DATABASE; MULTIMODAL IMAGING; PATHOLOGY; PROCEDURES; RADIOGRAPHY; SPINE; SPINE FRACTURE; SPONDYLOSIS; THEORETICAL MODEL; THREE DIMENSIONAL IMAGING;

ALGORITHMS; DATABASES, FACTUAL; HUMANS; IMAGING, THREE-DIMENSIONAL; MAGNETIC RESONANCE IMAGING; MODELS, THEORETICAL; MULTIMODAL IMAGING; SPINAL FRACTURES; SPINE; SPONDYLOSIS; TOMOGRAPHY, X-RAY COMPUTED;

EID: 84938651808     PISSN: 02780062     EISSN: 1558254X     Source Type: Journal    
DOI: 10.1109/TMI.2015.2392054     Document Type: Article

References (44)

1. V. Pekar, D. Bystrov, H. S. Heese, S. P. Dries, S. Schmidt, R. Grewer, C. J. Den Harder, R. C. Bergmans, A. W. Simonetti, and A. M. Van Muiswinkel, "Automated planning of scan geometries in spine MRI scans, " in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2007. New York: Springer, 2007, pp. 601-608.
2. T. Klinder et al., "Automated model-based vertebra detection, identification, segmentation in CT images, " Med. Image Anal., vol. 13, no. 3, pp. 471-482, 2009.
3. Y. Zhan, D. Maneesh, M. Harder, and X. S. Zhou, "Robust MR spine detection using hierarchical learning and local articulated model, " in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2012. New York: Springer, 2012, pp. 141-148.
4. B. Glocker, J. Feulner, A. Criminisi, D. R. Haynor, and E. Konukoglu, "Automatic localization and identification of vertebrae in arbitrary field-of-view CT scans, " in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2012. New York: Springer, 2012, pp. 590-598.
5. D. Major, J. Hladuvka, F. Schulze, and K. Bühler, "Automated landmarking and labeling of fully and partially scanned spinal columns in CT images, " Med. Image Anal., vol. 17, no. 8, pp. 1151-1163, 2013.
6. L. R. Long and G. R. Thoma, "Identification and classification of spine vertebrae by automated methods, " Proc. SPIE Med. Imag., pp. 1478-1489, 2001.
7. S. Seifert, O. Burgert, I. Wächter, R. Dillmann, and U. Spetzger, "Deformable modelling of the cervical spine for neurosugical navigation, " Int. Congr. Ser., vol. 1268.
8. M. G. Roberts, T. F. Cootes, and J. E. Adams, "Automatic location of vertebrae on dxa images using random forest regression, " in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2012. New York: Springer, 2012, pp. 361-368.
9. D. Štern, B. Likar, F. Pernuš, and T. Vrtovec, "Automated detection of spinal centrelines, vertebral bodies and intervertebral discs in CT and MR images of lumbar spine, " Phys. Med. Biol., vol. 55, no. 1, p. 247, 2010.
10. B. Michael Kelm et al., "Spine detection in CT and MR using iterated marginal space learning, " Med. Image Anal., vol. 17, no. 8, pp. 1283-1292, 2012.
11. M. Lootus, T. Kadir, and A. Zisserman, "Vertebrae detection and labelling in lumbar MR images, " in MICCAI Workshop: Computational Methods and Clinical Applications for Spine Imaging, Nagoya, Japan, 2013.
12. B. Glocker, D. Zikic, E. Konukoglu, D. R. Haynor, and A. Criminisi, "Vertebrae localization in pathological spine CT via dense classification from sparse annotations, " in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2013. New York: Springer, 2013, pp. 262-270.
13. S. Schmidt, J. Kappes, M. Bergtholdt, V. Pekar, S. Dries, D. Bystrov, and C. Schnörr, "Spine detection and labeling using a part-based graphical model, " in Information Processing in Medical Imaging. New York: Springer, 2007, pp. 112-133.
14. R. S. Alomari, J. J. Corso, and V. Chaudhary, "Labeling of lumbar discs using both pixel-and object-level features with a two-level probabilistic model, " IEEE Trans. Med. Imag., vol. 30, no. 1, pp. 1-10, Jan. 2011.
15. S. Seifert et al., "Hierarchical parsing and semantic navigation of full body CT data, " in Proc. SPIE Med. Imag., 2009, pp. 1478-1489.
16. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active shape models-their training and application, " Comput. Vis. Image Understand., vol. 61, no. 1, pp. 38-59, 1995.
17. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, 2001.
18. J. Liu and J. K. Udupa, "Oriented active shape models, " IEEE Trans. Med. Imag., vol. 28, no. 4, pp. 571-584, Apr. 2009.
19. P. Markelj, D. Tomazevic, F. Pernus, and B. Likar, "Robust gradientbased 3-D/2-D registration of CT and MR to X-ray images, " IEEE Trans. Med. Imag., vol. 27, no. 12, pp. 1704-1714, Dec. 2008.
20. S. Kadoury, H. Labelle, and N. Paragios, "Automatic inference of articulated spine models in CT images using high-order Markov random fields, " Med. Image Anal., vol. 15, no. 4, pp. 426-437, 2011.
21. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition, " Int. Journal Comput. Vis., vol. 61, no. 1, pp. 55-79, 2005.
22. P. H. Lim, U. Bagci, and L. Bai, "Introducing willmore flow into level set segmentation of spinal vertebrae, " IEEE Trans. Biomed. Eng., vol. 60, no. 1, pp. 115-122, Jan. 2013.
23. P. Zhang and T. F. Cootes, "Automatic construction of parts+geometry models for initializing groupwise registration, " IEEE Trans. Med. Imag., vol. 31, no. 2, pp. 341-358, Feb. 2012.
24. A. Rasoulian, R. Rohling, and P. Abolmaesumi, "Lumbar spine segmentation using a statistical multi-vertebrae anatomical shape+ pose model, " IEEE Trans. Med. Imag., vol. 32, no. 10, p. 1890, Oct. 2013.
25. S. Kadoury, H. Labelle, and N. Paragios, "Spine segmentation in medical images using manifold embeddings and higher-order MRFs, " IEEE Trans. Med. Imag., vol. 32, no. 7, pp. 1227-1238, Jul. 2013.
26. B. Ibragimov, B. Likar, F. Pernus, and T. Vrtovec, "Shape representation for efficient landmark-based segmentation in 3d, " IEEE Trans. Med. Imag., vol. 33, no. 4, pp. 861-874, Apr. 2014.
27. Y. Zhan, M. Dewan, and X. S. Zhou, "Cross modality deformable segmentation using hierarchical clustering and learning, " in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2009. New York: Springer, 2009, pp. 1033-1041.
28. J. Ma et al., "Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model, " in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2010. New York: Springer, 2010, pp. 19-27.
29. U. Bagci, X. Chen, and J. K. Udupa, "Hierarchical scale-based multiobject recognition of 3-d anatomical structures, " IEEE Trans. Med. Imag., vol. 31, no. 3, pp. 777-789, Mar. 2012.
30. J. Ngiam et al., "Multimodal deep learning, " in Proc. 28th Int. Conf. Machine Learn., 2011, pp. 689-696.
31. N. Srivastava and R. Salakhutdinov, "Multimodal learning with deep boltzmann machines, " in Adv. Neural Inf. Process. Syst., 2012, pp. 2222-2230.
32. H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, "Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, " in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 609-616.
33. G. E. Hinton and R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, no. 5786, pp. 504-507, 2006.
34. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection, " in Proc. IEEE Comput. Vis. Pattern Recognit., 2005, vol. 1, pp. 886-893.
35. R. M. Murray, Z. Li, and S. S. Sastry, A Methematical Introduction to Robotics Manipulation. Boca Raton, FL: CRC Press, 1994.
36. Y. Cai and G. Baciu, "Detecting, grouping, structure inference for invariant repetitive patterns in images, " IEEE Trans. Image Process., vol. 22, no. 6, pp. 2343-2355, Jun. 2013.
37. E. G. Learned-Miller, "Data driven image models through continuous joint alignment, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 2, pp. 236-250, Feb. 2006.
38. T. Drummond and R. Cippolla, "Application of lie algebra to visual servoing, " Int. J. Comput. Vis., vol. 37, no. 1, pp. 21-41, 2000.
39. M. R. Sabuncu, B. T. Yeo, K. Van Leemput, B. Fischl, and P. Golland, "A generative model for image segmentation based on label fusion, " IEEE Trans. Med. Imag., vol. 29, no. 10, pp. 1714-1729, Oct. 2010.
40. D. Ramanan, "Learning to parse images of articulated bodies, " in Adv. Neural Inf. Process. Systems., 2006, pp. 1129-1136.
41. A. Myronenko and X. Song, "Point set registration: Coherent point drift, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 12, pp. 2262-2275, Dec. 2010.
42. C. M. Bishop et al., Neural Networks for Pattern Recognition. New York: Oxford Univ. Press, 1995.
43. A. L. Yuille and N. M. Grzywacz, "A mathematical analysis of the motion coherence theory, " Int. J. Comput. Vision., vol. 3, no. 2, pp. 155-175, 1989.
44. G. Mori, "Guiding model search using segmentation, " in Proc. IEEE Int. Conf. Comput. Vis., 2005, vol. 2, pp. 1417-1423.