Cross-scale coefficient selection for volumetric medical image fusion

IEEE Transactions on Biomedical Engineering

Volumn 60, Issue 4, 2013, Pages 1069-1079

  Shen, Rui ^a   Cheng, Irene ^a   Basu, Anup ^a  

^a UNIVERSITY OF ALBERTA   (Canada)

Author keywords

3 D image fusion; fusion rule; medical image fusion; multiscale analysis

Indexed keywords

CLINICAL PRACTICES; FUSION RULE; IMAGE FUSION TECHNIQUES; MEDICAL COMMUNITY; MEDICAL IMAGE FUSION; MULTI SCALE ANALYSIS; MULTISCALE REPRESENTATIONS; NEIGHBORHOOD INFORMATION;

MEDICAL IMAGING;

IMAGE FUSION;

ARTICLE; DECOMPOSITION; IMAGING; MEDICAL IMAGE FUSION; THREE DIMENSIONAL IMAGING; VOLUMETRY;

ALGORITHMS; BRAIN; DATABASES, FACTUAL; DIAGNOSTIC IMAGING; HUMANS; IMAGING, THREE-DIMENSIONAL; REPRODUCIBILITY OF RESULTS; WAVELET ANALYSIS;

EID: 84875145188     PISSN: 00189294     EISSN: 15582531     Source Type: Journal    
DOI: 10.1109/TBME.2012.2211017     Document Type: Article

References (56)

1. J. B. A. Maintz and M. A. Viergever, "A survey of medical image registration," Med. Image Anal., vol. 2, no. 1, pp. 1-36, 1998. (Pubitemid 128500719)
2. V. D. Calhoun and T. Adali, "Feature-based fusion of medical imaging data," IEEE Trans. Inf. Technol. Biomed., vol. 13, no. 5, pp. 711-720, Sep. 2009.
3. B. Solaiman, R. Debon, F. Pipelier, J.-M. Cauvin, and C. Roux, "Information fusion: Application to data and model fusion for ultrasound image segmentation," IEEE Trans. Biomed. Eng., vol. 46, no. 10, pp. 1171-1175, Oct. 1999. (Pubitemid 29451075)
4. C. S. Pattichis,M. S. Pattichis, and E. Micheli-Tzanakou, "Medical imaging fusion applications: An overview," in Proc. 35th Asilomar Conf. Signals, Syst. Comput., vol. 2, 2001, pp. 1263-1267. (Pubitemid 34244828)
5. R. S. Blum, Z. Xue, and Z. Zhang, "An overview of image fusion," in Multi-Sensor Image Fusion and Its Applications. Boca Raton, FL: CRC Press, 2005, pp. 1-36.
6. M. C. Valdés Hernández, K. Ferguson, F. Chappell, and J.Wardlaw, "New multispectral MRI data fusion technique for white matter lesion segmentation: method and comparison with thresholding in FLAIR images," Eur. Radiol., vol. 20, no. 7, pp. 1684-1691, 2010.
7. M. C.Valdés Hernández, T. H. Jeong, C. Murray, M. E. Bastin, F.Chappell, I. J. Deary, and J. Wardlaw, "Reliability of two techniques for assessing cerebral iron deposits with structural magnetic resonance imaging," J. Magn. Reson. Imaging, vol. 33, no. 1, pp. 54-61, 2011.
8. M. Mahvash, R. König, H. Urbach, J. von Ortzen, B. Meyer, J. Schramm, and C. Schaller, "FLAIR-/T1-/T2-co-registration for image-guided diagnostic and resective epilepsy surgery," Neurosurgery, vol. 58, no. 1, pp. 69-75, 2006.
9. S. F.Nemec, M. A. Donat, S. Mehrain,K. Friedrich, C.Krestan, C. Matula, H. Imhof, and C. Czerny, "CT-MR image data fusion for computer assisted navigated neurosurgery of temporal bone tumors," Eur. J. Radiol., vol. 62, no. 2, pp. 192-198, 2007. (Pubitemid 46560332)
10. O. F. Donati, T. F. Hany, C. S. R. CS, G. K. von Schulthess, B. Marincek, B. Seifert, and D. Weishaupt, "Value of retrospective fusion of PET and MRimages in detection of hepatic metastases: Comparisonwith 18 F-FDG PET/CT and Gd-EOB-DTPA-enhanced MRI," J. Nucl. Med., vol. 51, no. 5, pp. 692-699, 2010.
11. A. Boss, S. Bisdas, A. Kolb, M. Hofmann, U. Ernemann, C. D. Claussen, C. Pfannenberg, B. J. Pichler, M. Reimold, and L. Stegger, "Hybrid PET/MRI of intracranial masses: Initial experiences and comparison to PET/CT," J. Nucl. Med., vol. 51, no. 8, pp. 1198-1205, 2010.
12. M. Farhadi, S. Mahmoudian, F. Saddadi, A. R. Karimian, M. Mirzaee, M. Ahmadizadeh, K. Ghasemikian, S. Gholami, E. Ghoreyshi, S. Beyty, A. Shamshiri, S. Madani, V. Bakaev, S. Moradkhani, and G. Raeisali, "Functional brain abnormalities localized in 55 chronic tinnitus patients: Fusion of SPECT coincidence imaging and MRI," J. Cereb. Blood. Flow. Metab., vol. 30, no. 4, pp. 864-870, 2010.
13. M. J. Gooding, K. Rajpoot, S. Mitchell, P. Chamberlain, S. H. Kennedy, and J. A. Noble, "Investigation into the fusion of multiple 4-D fetal echocardiography images to improve image quality," Ultrasound Med. Biol., vol. 36, no. 6, pp. 957-966, 2010.
14. H. Amthauer, T. Denecke, T. Rohlfing, J. Ruf, M. Bohmig, M. Gutberlet, U. Plokinger, R. Felix, and A. J. Lemke, "Value of image fusion using single photon emission computed tomography with integrated low dose computed tomography in comparison with a retrospective voxel-based method in neuroendocrine tumours," Eur. Radiol., vol. 15, no. 7, pp. 1456-1462, 2005. (Pubitemid 40983531)
15. H. Amthauer, R. Wurm, D. Kuczer, J. Ruf, R. Michel, J. Eisenacher, F. Stockhammer, T. Denecke, R. Felix, and M. Plotkin, "Relevance of image fusionwithMRIfor the interpretation of I-123 iodo-methyl-tyrosine scans in patients with suspected recurrent or residual brain tumor," Clin. Nucl. Med., vol. 31, no. 4, pp. 189-192, 2006. (Pubitemid 44310032)
16. A. Jackson, N. A. Thacker, and S. M. Stivaros, "3D image fusion," in Image Processing in Radiology: Current Applications. NewYork: Springer, 2007, pp. 101-122.
17. T. Z. Wong, T. G. Turkington, T. C. Hawk, and R. E. Coleman, "PET and brain tumor image fusion," Cancer J., vol. 10, no. 4, pp. 234-242, 2004. (Pubitemid 44313552)
18. F. L. Giesel, A. Mehndiratta, J. Locklin, M. J. McAuliffe, S. White, P. L. Choyke, M. V. Knopp, B. J. Wood, U. Haberkorn, and H. von Tengg-Kobligk, "Image fusion using CT, MRI, and PET for treatment planning, navigation, and follow up in percutaneous RFA," Exp. Oncol., vol. 31, no. 2, pp. 106-114, 2009.
19. B. C. Porter, D. J. Rubens, J. G. Strang, J. Smith, S. Totterman, and K. J. Parker, "Three-dimensional registration and fusion of ultrasound and MRI using major vessels as fiducial markers," IEEE Trans. Med. Imag., vol. 20, no. 4, pp. 354-359, Apr. 2001. (Pubitemid 32536144)
20. M. I. Smith and J. P. Heather, "A review of image fusion technology in 2005," in Proc. SPIE, vol. 5782, 2005, pp. 29-45. (Pubitemid 41433017)
21. G. Piella, "A general framework for multiresolution image fusion: from pixels to regions," Inf. Fusion, vol. 4, no. 4, pp. 259-280, 2003. (Pubitemid 37344935)
22. M. Aguilar and J. R. New, "Fusion of multi-modality volumetric medical imagery," in Proc. Int. Conf. Inf. Fusion, vol. 2, 2002, pp. 1206-1212.
23. P. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Comm., vol. 31, no. 4, pp. 532-540, Apr. 1983. (Pubitemid 13521088)
24. A. Toet, "Hierarchical image fusion," Mach. Vision Appl., vol. 3, no. 1, pp. 1-11, 1990. (Pubitemid 20673226)
25. P. J. Burt and R. J. Kolczynski, "Enhanced image capture through fusion," in Proc. Int. Conf. Comput. Vis., 1993, pp. 173-182.
26. V. Petrović and C. Xydeas, "Gradient-based multiresolution image fusion," IEEE Trans. Image Process., vol. 13, no. 2, pp. 228-237, Feb. 2004.
27. S. G. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, Jul. 1989.
28. S. Li, B. Yang, and J. Hu, "Performance comparison of different multiresolution transforms for image fusion," Inf. Fusion, vol. 12, no. 2, pp. 74-84, 2011.
29. I. W. Selesnick, R. G. Baraniuk, and N. C. Kingsbury, "The dual-tree complex wavelet transform," IEEE Signal Process. Mag., vol. 22, no. 6, pp. 123-151, Nov. 2005. (Pubitemid 46404908)
30. G. Pajares and J. M. de la Cruz, "A wavelet-based image fusion tutorial," Pattern Recognit., vol. 37, no. 9, pp. 1855-1872, 2004. (Pubitemid 38804473)
31. J.Yang andR. S.Blum, "Image fusion using the expectation- maximization algorithm and a hidden Markov model," in Proc. 60th IEEE Veh. Tech. Conf., vol. 6, Sep. 2004, pp. 4563-4567. (Pubitemid 40513049)
32. H. Li, B. S. Manjunath, and S. K. Mitra, "Multisensor image fusion using the wavelet transform," Graph. Models Image Process., vol. 57, no. 3, pp. 235-245, 1995.
33. V. Petrović and C. Xydeas, "Cross-band pixel selection in multiresolution image fusion," in Proc. SPIE, vol. 3719, 1999, pp. 319-326.
34. Z. Zhang and R. S. Blum, "Region-based image fusion scheme for concealed weapon detection," in Proc. Annu. Conf. Inf. Sci. Syst., 1997, pp. 168-173.
35. K. Rajpoot, J. A. Noble, V. Grau, C. Szmigielski, and H. Becher, "Multiview RT3D echocardiography image fusion," in Proc. FIMH, vol. 5528, 2009, pp. 134-143.
36. Z.Wang and Y. Ma, "Medical image fusion using m-PCNN," Inf. Fusion, vol. 9, no. 2, pp. 176-185, 2008. (Pubitemid 351312929)
37. Y. Yang, D. S. Park, S. Huang, and N. Rao, "Medical image fusion via an effective wavelet-based approach," EURASIP J. Adv. Signal Process., vol. 2010, no. 579341, pp. 1-13, 2010.
38. C. Wang and Z. Ye, "First-order fusion of volumetric medical imagery," IEE Proc., Vis. Image Process., vol. 153, no. 2, pp. 191-198, 2006.
39. R. Shen, I. Cheng, J. Shi, and A. Basu, "Generalized random walks for fusion of multi-exposure images," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3634-3646, Dec. 2011.
40. E. Hering, "The natural color system," in Outlines of a Theory of the Light Sense. Cambridge, MA: Harvard Univ. Press, 1964, pp. 25-65.
41. K. T. Mullen, "The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings," J. Physiol., vol. 359, pp. 381-400, 1985. (Pubitemid 15152944)
42. J. M. Rovamo, M. I. Kankaanpaa, and H. Kukkonen, "Modelling spatial contrast sensitivity functions for chromatic and luminance-modulated gratings," Vision Res., vol. 39, no. 14, pp. 2387-2398, 1999. (Pubitemid 29195994)
43. J. E. Thornton and E. N. Pugh, "Red/green color opponency at detection threshold," Science, vol. 219, no. 4581, pp. 191-193, 1983. (Pubitemid 13217234)
44. A. Toet, "Natural colour mapping for multiband nightvision imagery," Inf. Fusion, vol. 4, no. 3, pp. 155-166, 2003. (Pubitemid 37058810)
45. A. M. Waxman, M. Aguilar, D. A. Fray, D. B. Ireland, J. P. Racamato Jr.,W. D. Ross, J. E. Carrick, A. N. Gove, M. C. Seibert, E. D. Savoye, R. K. Reich, B. E. Burke, W. H. McGonagle, and D. M. Craig, "Solidstate color night vision: Fusion of low-light visible and thermal infrared imagery," Linc. Lab. J., vol. 11, no. 1, pp. 41-60, 1998.
46. M. Aguilar, D. A. Fay, W. D. Ross, A. M. Waxman, D. B. Ireland, and J. P. Racamato, "Real-time fusion of low-light CCD and uncooled IR imagery for color night vision," in Proc. SPIE, vol. 3364, 1998, pp. 124-135.
47. S. Cai, K. Li, and I. Selesnick,Wavelet software at Polytechnic University, Brooklyn, NY. (2010). [Online]. Available: http://eeweb.poly.edu/ iselesni/WaveletSoftware/
48. A. F. Abdelnour and I. W. Selesnick, "Design of 2-band orthogonal nearsymmetric CQF," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., vol. 6, 2001, pp. 3693-3696. (Pubitemid 32838422)
49. C. S. Xydeas and V. Petrović, "Objective image fusion performance measure," Electron. Lett., vol. 36, no. 4, pp. 308-309, 2000. (Pubitemid 30557385)
50. V. Petrović, "Subjective tests for image fusion evaluation and objective metric validation," Inf. Fusion, vol. 8, no. 2, pp. 208-216, 2007. (Pubitemid 46177793)
51. Z. Liu, E. Blasch, Z. Xue, J. Zhao, R. Laganiere, and W. Wu, "Objective assessment of multiresolution fusion algorithms for context enhancement in night vision: A comparative study," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 94-109, 2011.
52. R. K.-S. Kwan, A. C. Evans, and G. B. Pike. (1999, Nov.). MRI simulation-based evaluation of image-processing and classification methods. [Online]. 18(11), pp. 1085-1097. Available: http://www.bic.mni.mcgill.ca/ brainweb/
53. Brain Development Cooperative Group and A. C. Evans. (2006). The NIH MRI study of normal brain development. NeuroImage [Online]. 30(1), pp. 184-202. Available: https://nihpd.crbs.ucsd.edu/nihpd/info/ (Pubitemid 43243209)
54. K. A. Johnson and J. A. Becker. The whole brain altas. (2011). [Online]. Available: http://www.med.harvard.edu/aanlib/
55. Z. Xue and R. S. Blum, "Concealed weapon detection using color image fusion," in Proc. Int. Conf. Inf. Fusion, vol. 1, 2003, pp. 622-627.
56. A. Loza, D. Bull, N. Canagarajah, and A. Achim, "Non-Gaussian modelbased fusion of noisy images in the wavelet domain," Comput. Vis. Image Understanding, vol. 114, no. 1, pp. 54-65, 2010.