Efficient and robust model-to-image alignment using 3D scale-invariant features

Medical Image Analysis

Volumn 17, Issue 3, 2013, Pages 271-282

  Toews, Matthew ^a   Wells, William M ^a,b  

^a BRIGHAM AND WOMEN S HOSPITAL   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

3D scale invariant feature; Feature descriptor; Image alignment; Orientation assignment; Probabilistic model

Indexed keywords

ALIGNMENT ACCURACY; COMPUTATION RESOURCES; FEATURE DESCRIPTORS; IMAGE ALIGNMENT; MAXIMUM A POSTERIORI; PROBABILISTIC MODELS; REGISTRATION METHODS; SCALE-INVARIANT;

ALIGNMENT; COMPUTERIZED TOMOGRAPHY; EXPERIMENTS; MAGNETIC RESONANCE; THREE DIMENSIONAL COMPUTER GRAPHICS;

THREE DIMENSIONAL;

ACCURACY; ARTICLE; BRAIN; FEATURE BASED ALIGNMENT; HUMAN; IMAGE ANALYSIS; IMAGE RECONSTRUCTION; MODEL TO IMAGE ALIGNMENT; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; THREE DIMENSIONAL IMAGING; VOLUMETRY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MODELS, ANATOMIC; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 84875259656     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2012.11.002     Document Type: Article

References (86)

1. Akgul C.B., Rubin D.L., Napel S., Beaulieu C.F., Greenspan H., Acar B. Content-based image retrieval in radiology: current status and future directions. Journal of Digital Imaging 2011, 24(2):208-222.
2. Allaire, S., Kim, J., Breen, S., Jaffray, D., Pekar, V., 2008. Full orientation invariance and improved feature selectivity of 3d sift with application to medical image analysis. In: MMBIA.
3. Amit Y., Kong A. Graphical templates for model registration. IEEE TPAMI 1996, 18(3):225-236.
4. Archip N., Clatz O., Whalen S., Kacher D., Fedorov A., Kot A., Chrisochoides N., Jolesz F., Golby A., Black P., Warfield S. Non-rigid alignment of pre-operative mri, fmri, and dt-mri with intra-operative mri for enhanced visualization and navigation in image-guided neurosurgery. NeuroImage 2007, 35(2):609-624.
5. Arsigny V., Pennec X., Ayache N. Polyrigid and polyaffine transformations: a novel geometrical tool to deal with non-rigid deformations - application to the registration of histological slices. MIA 2005, 9(6):507-523.
6. Avants B.B., Epstein C.L., Grossman M., Gee J.C. Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. MIA 2008, 12(1):26-41.
7. Baiker M., Milles J., Dijkstra J., Henning T.D., Weber A.W., Que I., Kaijzel E.L., Lwik C.W., Reibera J.H., Lelieveldt B.P. Atlas-based whole-body segmentation of mice from low-contrast micro-CT data. Medical Image Analysis 2010, 14(6):723-737.
8. Barber D. Digital computer processing of brain scans using principal components. Physics in Medicine and Biology 1976, 21(5):792-803.
9. Beichel R., Bischof H., Leberl F., Sonka M. Robust active appearance models and their application to medical image analysis. IEEE TMI 2005, 24(9):1151-1169.
10. Beis, J.S., Lowe, D.G., 1997. Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: CVPR, pp. 1000-1006.
11. Blezek, D.J., Miller, J.V., 2006. Atlas stratification. In: MICCAI.
12. Brummer M.E. Hough transform detection of the longitudinal fissure in tomographic head images. IEEE TMI 1991, 10(1):74-81.
13. Camara O., Delso G., Colliot O., Antonio M.-I. Explicit incorporation of prior anatomical information into a nonrigid registration of thoracic and abdominal CT and 18-FDG whole-body emission PET images. IEEE TMI 2007, 26(2):164-178.
14. Carneiro G., Georgescu B., Good S., Comaniciu D. Detection and measurement of fetal anatomies from ultrasound images using a constrained probabilistic boosting tree. IEEE TMI 2008, 27(9):1342-1355.
15. Carneiro, G., Jepson, A., 2003. Multi-scale phase-based local features. In: CVPR, vol. 1, pp. 736-743.
16. Cheung W., Hamarneh G. N-sift: N-dimensional scale invariant feature transform. IEEE TIP 2009, 18(9):2012-2021.
17. Chung, M.K., 2006. Heat kernel smoothing on unit sphere. In: ISBI.
18. Clatz O., Delingette H., Talos I.-F., Golby A.J., Kikinis R., Jolesz F.A., Ayache N., Warfield S.K. Robust nonrigid registration to capture brain shift from intraoperative MRI. IEEE TMI 2005, 24(11):1417-1427.
19. Cleary, K., 2010. National library of medicine: liver ct. insight-journal.org/midas.
20. Collins D.L., Neelin P., Peters T.M., Evans A.C. Automatic 3D inter-subject registration of MR volumetric data in standardized talairach space. Journal of Computer Assisted Tomography 1994, 18(2):192-205.
21. Comaniciu D., Meer P. Mean shift: a robust approach toward feature space analysis. IEEE TPAMI 2002, 24(5):603-619.
22. Cootes T., Edwards G., Taylor C. Active appearance models. IEEE PAMI 2001, 23(6):681-684.
23. Criminisi, A., Shotton, J., Bucciarelli, S., 2009. Decision forests with long-range spatial context for organ localization in CT volumes. In: MICCAI Workshop on Probabilistic Models for Medical Image Analysis.
24. Duda R.O., Hart P.E., Stork D.G. Pattern classification 2001, Wiley. 2nd ed.
25. El-Naqa I., Yang Y., Galatsanos N., Nishikawa R., Wernick M. A similarity learning approach to content-based image retrieval: application to digital mammography. IEEE TMI 2004, 23(10):1233-1244.
26. Evans, Hastings, Peacock Statistical Distributions 1993, John Wiley and Sons. second ed.
27. Felzenszwalb P.F., Huttenlocher D. Pictorial structures for object recognition. IJCV 2005, 61(1):55-79.
28. Fergus R., Perona P., Zisserman A. Weakly supervised scale-invariant learning of models for visual recognition. IJCV 2006, 71(3):273-303.
29. Fischler M., Elschlager R. The representation and matching of pictorial structures. IEEE Transactions on Computers 1973, 22(1):67-92.
30. Flitton, G., Breckon, T.P., Megherbi, N., 2010. Object recognition using 3D SIFT in complex CT volumes. In: BMVC.
31. Freund Y., Schapire R.E. A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 1997, 55(1):119-139.
32. Grimson W.E.L., Lozano-Perez T. Localizing overlapping parts by searching the interpretive tree. IEEE TPAMI 1987, 9(4):469-482.
33. Guld M.O., Kohnen M., Keysers D., Schubert H., Wein B., Bredno J., Lehmann T.M. Quality of dicom header information for image categorization. International Symposium on Medical Imaging 2002, vol. 4685:280-287. SPIE.
34. Harris, C., Stephens, M., 1988. A combined corner and edge detector. In: Proceedings of the 4th Alvey Vision Conference, pp. 147-151.
35. Jager F., Hornegger J. Nonrigid registration of joint histograms for intensity standardization in magnetic resonance imaging. IEEE TMI 2009, 28(1):137-150.
36. Jenkinson M., Smith S.M. A global optimisation method for robust affine registration of brain images. MIA 2001, 5(2):143-156.
37. Jian B., Vemuri B. Robust point set registration using gaussian mixture models. IEEE TPAMI 2011, 33(8).
38. Johnson C., Chen M., Toledano A., Heiken J., Dachman A., Kuo M., Menias C., Siewert B., Cheema J., Obregon R., Fidler J., Zimmerman P., Horton K., Coakley K., Iyer R., Hara A., Halvorsen R.J., Casola G., Yee J., Herman B., Burgart L., Limburg P. Accuracy of CT colonography for detection of large adenomas and cancers. New England Journal of Medicine 2008, 359(12):1207-1217.
39. Kadir T., Brady M. Saliency, scale and image description. IJCV 2001, 45(2):83-105.
40. Klein A., Andersson J., Ardekani B.A., Ashburner J., Avants B., Chiang M.-C., Christensen G.E., Collins D.L., Gee J., Hellier P., Song J.H., Jenkinson M., Lepage C., Rueckert D., Thompson P., Vercauteren T., Woods R.P., Mann J.J., Parsey R.V. Evaluation of 14 nonlinear deformation algorithms applied to human brain mri registration. NeuroImage 2009, 46(3):786-802.
41. Klein S., Staring M., Murphy K., Viergever M., Pluim J. Elastix: a toolbox for intensity based medical image registration. IEEE TMI 2010, 29(1):196-205.
42. Kloppel S., Stonnington C.M., Chu C., Draganski B., Scahill R.I., Rohrer J.D., Fox N.C., Jack C.R., Ashburner J., Frackowiak R.S.J. Automatic classification of mr scans in alzheimer's disease. Brain 2008, 131:681-689.
43. Laptev I. On space-time interest points. IJCV 2005, 64(2/3):107-123.
44. Lehmanna T.M., Gld M.O., Deselaers T., Keysers D., Schubert H., Spitzer K., Ney H., Wein B. Automatic categorization of medical images for content-based retrieval and data mining. Computerized Medical Imaging and Graphics 2005, 29:143-155.
45. Leibe, B., Leonardis, A., Schiele, B., 2004. Combined object categorization and segmentation with an implicit shape model. In: ECCV Workshop on Statistical Learning in Computer Vision.
46. Li B., Christensen G.E., Hoffman E.A., McLennan G., Reinhardt J.M. Establishing a normative atlas of the human lung: intersubject warping and registration of volumetric CT images. Academic Radiology 2003, 10(3):255-265.
47. Lindeberg T. Feature detection with automatic scale selection. IJCV 1998, 30(2):79-116.
48. Lowe D.G. Distinctive image features from scale-invariant keypoints. IJCV 2004, 60(2):91-110.
49. Marcus D., Wang T., Parker J., Csernansky J., Morris J., Buckner R. Open access series of imaging studies (oasis): cross-sectional mri data in young, middle aged, nondemented and demented older adults. Journal of Cognitive Neuroscience 2007, 19:1498-1507.
50. Marr, D., Poggio, T., 1977. A theory of human stereo vision. In: MIT AI Memo, vol. 451.
51. Mikolajczyk K., Schmid C. Scale and affine invariant interest point detectors. IJCV 2004, 60(1):63-86.
52. Mikolajczyk K., Tuytelaars T., Schmid C., Zisserman A., Matas J., Schaffalitzky F., Kadir T., Gool L.V. A comparison of affine region detectors. IJCV 2005, 65:43-72.
53. Moravec, H.P., 1979. Visual mapping by a robot rover. In: Proc. of the 6th International Joint Conference on Artificial Intelligence, pp. 598-600.
54. Murphy K., van Ginneken B., Reinhardt J.M., Kabus S., Ding K., Deng X., Cao K., Du K., Christensen G.E., Garcia V., Vercauteren T., Ayache N., Commowick O., Malandain G., Glocker B., Paragios N., Navab N., Gorbunova V., Sporring J., de Bruijne M., Han X., Heinrich M.P., Schnabel J.A., Jenkinson M., Lorenz C., Modat M., McClelland J.R., Ourselin S., Muenzing S.E.A., Viergever M.A., de Nigris D., Collins D.L., Arbel T., Peroni M., Li R., Sharp G.C., Schmidt-Richberg A., Ehrhardt J., Werner R., Smeets D., Loeckx D., Song G., Tustison N., Avants B., Gee J.C., Staring M., Klein S., Stoel B.C., Urschler M., Werlberger M., Vandemeulebroucke J., Rit S., Sarrut D., Pluim J.P.W. Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge. IEEE TMI 2011, 30(11):1901-1920.
55. National Alliance for Medical Image Computing (NAMIC), 2011. NAMIC traumatic brain injury. <>. http://www.na-mic.org/Wiki/index.php/DBP3:UCLA.
56. Ni, D., Qu, Y., Yang, X., Chui, Y.P., Wong, T.-T., Ho, S., Heng, P.A., 2008. Volumetric ultrasound panorama based on 3D SIFT. In: MICCAI.
57. Niemeijer M., Garvin M.K., Lee, Kyungmoo van Ginneken B., Abramoff M.D., Sonka M. Registration of 3D spectral OCT volumes using 3D SIFT feature point matching. Medical Imaging 2009: Image Processing 2009, vol. 7259. SPIE.
58. Nister, D. Stewenius, H., 2006. Scalable recognition with a vocabulary tree. In: CVPR, pp. 2161-2168.
59. Nowinski W., Qian G., Bhanu P.K., Hu Q., Aziz A. Fast talairach transformation for magnetic resonance neuroimages. Journal of Computer Assisted Tomography 2006, 30(4):629-641.
60. Ou Y., Sotiras A., Paragios N., Davatzikos C. Dramms: deformable registration via attribute matching and mutual-saliency weighting. Medical Image Analysis 2011, 15(4):622-639.
61. Ourselin S., Roche A., Subsol G., Pennec X., Ayache N. Reconstructing a 3d structure from serial histological sections. Image and Vision Computing 2001, 19(1-2):25-31.
62. Pennec X., Ayache N., Thirion J.-P. Landmark-Based Registration Using Features Identified Through Differential Geometry 2000, Academic Press, (Chapter 31, pp. 499-513).
63. Periaswamy S., Farid H. Medical image registration with partial data. Medical Image Analysis 2006, 10:452-464.
64. Potesil, V., Kadir, T., Platsch, G., Brady, M., 2010. Improved anatomical landmark localization in medical images using dense matching of graphical models. In: BMVC.
65. Rasmussen, C.E., 2001. The infinite gaussian mixture model. In: Neural Information Processing Systems, pp. 554-560.
66. Rohr K. On 3D differential operators for detecting point landmarks. Image and Vision Computing 1997, 15(3):219-233.
67. Rohr K., Stiehl H.S., Sprengel R., Buzug T.M., Weese J., Kuhn M.H. Landmark-based elastic registration using approximating thin-plate splines. IEEE TMI 2001, 20(6):526-534.
68. Romeny B.t.H. Front-End Vision and Multi-Scale Image Analysis 2003, Kluwer Academic Publisher.
69. Scovanner, P., Ali, S., Shah, M., 2007. A 3-dimensional sift descriptor and its application to action recognition. In: International conference on Multimedia, pp. 357-360.
70. Stewart C.V., Tsai C.-L., Roysam B. The dual-bootstrap iterative closest point algorithm with application to retinal image registration. IEEE TMI 2003, 22(11):1379-1394.
71. Talairach J., Tournoux P. Co-planar Stereotactic Atlas of the Human Brain: 3-Dimensional Proportional System: An Approach to Cerebral Imaging 1988, Georg Thieme Verlag, Stuttgart.
72. Tao Y., Peng Z., Krishnan A., Zhou X.S. Robust learning-based parsing and annotation of medical radiographs. IEEE TMI 2011, 30(2):338-350.
73. Toews M., Arbel T. A statistical parts-based appearance model of anatomical variability. IEEE TMI 2007, 26(4):497-508.
74. Toews M., Arbel T. Detection, localization and sex classification of faces from arbitrary viewpoints and under occlusion. IEEE TPAMI 2009, 31(9):1567-1581.
75. Toews, M., Wells III, W.M., 2009. Sift-rank: ordinal descriptors for invariant feature correspondence. In: CVPR.
76. Toews, M., Wells III, W.M., 2010. A mutual-information scale-space for image feature detection and feature-based classification of volumetric brain images. In: MMBIA.
77. Toews M., Wells W.M., Collins D.L., Arbel T. Feature-based morphometry: discovering group-related anatomical patterns. NeuroImage 2010, 49(3):2318-2327.
78. Tomasi, C., Shi, J., 1994. Good features to track. In: CVPR, pp. 593-600.
79. Turk M., Pentland A.P. Eigenfaces for recognition. CogNeuro 1991, 3(1):71-96.
80. Urschler, M., Zach, C., Ditt, H., Bischof, H., 2006. Automatic point landmark matching for regularizing nonlinear intensity registration: application to thoracic CT images. In: MICCAI, pp. 710-717.
81. Viola, P., Jones, M., 2001. Rapid object detection using a boosted cascade of simple features. In: CVPR, pp. 511-518.
82. Wells W.M. Statistical approaches to feature-based object recognition. IJCV 1997, 21:63-98.
83. Wels, M., Zheng, Y., Carneiro, G., Huber, M., Hornegger, J., Comaniciu, D., 2009. Fast and Robust 3-D MRI Brain Structure Segmentation. In: MICCAI.
84. Wu G., Wang Q., Jia H., Shen D. Feature-based groupwise registration by hierarchical anatomical correspondence detection. Human Brain Mapping 2012, 33(2):253-271.
85. Yang J., Williams J.P., Sun Y., Blum R.S., Xu C. A robust hybrid method for nonrigid image registration. Pattern Recognition 2011, 44:764-776.
86. Zhang P., Cootes T.F. Automatic construction of parts+geometry models for initializing groupwise registration. IEEE TMI 2012, 31(2):341-358.