Generation of synthetic but visually realistic time series of cardiac images combining a biophysical model and clinical images

IEEE Transactions on Medical Imaging

Volumn 32, Issue 1, 2013, Pages 99-109

  Prakosa, Adityo ^a   Sermesant, Maxime ^a   Delingette, Hervé ^a   Marchesseau, Stéphanie ^a   Saloux, Eric ^b   Allain, Pascal ^c   Villain, Nicolas ^c   Ayache, Nicholas ^a  

^a INRIA   (France)

^b CAEN UNIVERSITY HOSPITAL   (France)

^c PHILIPS HEALTHCARE   (United States)

Author keywords

Cardiac electromechanical model; nonrigid registration; synthetic 4 D cardiac sequences

Indexed keywords

BIOPHYSICAL MODEL; BIOPHYSICAL PARAMETERS; CARDIAC IMAGES; CARDIAC MOTION; CLINICAL IMAGES; DESIRED CONDITIONS; ELECTROMECHANICAL MODELS; END-DIASTOLIC; IMAGE PROCESSING ALGORITHM; IMAGE SEQUENCE; LEARNING APPROACH; NONRIGID IMAGE REGISTRATION; NONRIGID REGISTRATION; REALISTIC IMAGES; SYNTHETIC 4-D CARDIAC SEQUENCES; SYNTHETIC-TIME;

BIOPHYSICS; COMPUTER SIMULATION; IMAGE REGISTRATION; IMAGE SEGMENTATION; TIME SERIES;

HEART;

ALGORITHM; ARTICLE; CARDIAC IMAGING; CONGESTIVE CARDIOMYOPATHY; ECHOCARDIOGRAPHY; ELECTRIC CONDUCTIVITY; HEART FAILURE; HEART FUNCTION; HEART MUSCLE; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE QUALITY; KERNEL METHOD; MACHINE LEARNING; NUCLEAR MAGNETIC RESONANCE IMAGING; TIME SERIES ANALYSIS; ADULT; BIOLOGICAL MODEL; COMPUTER SIMULATION; DIAGNOSTIC IMAGING; FACTUAL DATABASE; HEART; HISTOLOGY; HUMAN; MALE; METHODOLOGY; MOTION; PHYSIOLOGY; VERY ELDERLY;

ADULT; AGED, 80 AND OVER; ALGORITHMS; COMPUTER SIMULATION; DATABASES, FACTUAL; DIAGNOSTIC IMAGING; HEART; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; MODELS, CARDIOVASCULAR; MOTION;

MLCS; MLOWN;

EID: 84872000373     PISSN: 02780062     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMI.2012.2220375     Document Type: Article

References (53)

1. C. Y. Ho and S. D. Solomon, "A clinician's guide to tissue Doppler imaging," Circulation, vol. 113, no. 10, pp. e396-e398, Mar. 2006. (Pubitemid 43739460)
2. X. Liu and J. Prince, "Shortest path refinement for motion estimation from tagged MR images," IEEE Trans. Med. Imag., vol. 29, no. 8, pp. 1560-1572, Aug. 2010.
3. C. Ozturk, J. Derbyshire, and E. McVeigh, "Estimating motion from MRI data," Proc. IEEE, vol. 91, no. 10, pp. 1627-1648, Oct. 2003.
4. A. Elen, H. F. Choi, D. Loeckx, H. Gao, P. Claus, P. Suetens, F. Maes, and J. D'hooge, "Three-dimensional cardiac strain estimation using spatio-temporal elastic registration of ultrasound images: A feasibility study," IEEE Trans. Med. Imag., vol. 27, no. 11, pp. 1580-1591, Nov. 2008.
5. M. D. Craene, G. Piella, N. Duchateau, E. Silva, A. Doltra, H. Gao, J. D'hooge, O. Camara, J. Brugada, and M. Sitges, "Temporal diffeomorphic free-form deformation for strain quantification in 3-D-US images," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2010, ser. LNCS, T. Jiang, N. Navab, J. Pluim, and M. Viergever, Eds. New York: Springer, 2010, vol. 6362, pp. 1-8.
6. T. Mansi, X. Pennec, M. Sermesant, H. Delingette, and N. Ayache, "iLogDemons: A demons-based registration algorithm for tracking incompressible elastic biological tissues," Int. J. Comput. Vis., vol. 92, pp. 92-111, 2011.
7. A. K. Rutz, S. Ryf, S. Plein, P. Boesiger, and S. Kozerke, "Accelerated whole-heart 3-D CSPAMM for myocardial motion quantification," Magn. Reson. Med., vol. 59, no. 4, pp. 755-63, 2008. (Pubitemid 351501940)
8. J.-F. Daisne, M. Sibomana, A. Bol, G. Cosnard, M. Lonneux, and V. Grégoire, "Evaluation of a multimodality image (CT, MRI and PET) coregistration procedure on phantom and head and neck cancer patients: Accuracy, reproducibility and consistency," Radiother. Oncol., vol. 69, no. 3, pp. 237-245, 2003. (Pubitemid 37485997)
9. T. Boltz, W. Pavlicek, R. Paden, M. Renno, A. Jensen, andM. Akay, "An anthropomorphic beating heart phantom for cardiac X-ray CT imaging evaluation," J. Appl. Clin. Med. Phys., vol. 11, no. 1, p. 3129, 2010.
10. H. Benoit-Cattin, G. Collewet, B. Belaroussi, H. Saint-Jalmes, and C. Odet, "The SIMRI project: A versatile and interactiveMRI simulator," J. Magn. Reson., vol. 173, pp. 97-115, 2005. (Pubitemid 40206422)
11. B. Aubert-Broche, A. C. Evans, and L. Collins, "A new improved version of the realistic digital brain phantom," NeuroImage, vol. 32, pp. 138-145, 2006. (Pubitemid 44079960)
12. C. Tobon-Gomez, F. M. Sukno, B. H. Bijnens, M. Huguet, and A. F. Frangi, "Realistic simulation of cardiac magnetic resonance studies modeling anatomical variability, trabeculae, papillary muscles," Magn. Reson. Med., vol. 65, no. 1, pp. 280-288, 2011.
13. Q. Duan, P. Moireau, E. D. Angelini, D. Chapelle, and A. F. Laine, "Simulation of 3-D ultrasound with a realistic electro-mechanical model of the heart," in Functional Imaging and Modeling of the Heart, ser. LNCS, F. B. Sachse and G. Seemann, Eds. New York: Springer, 2007, vol. 4466, pp. 463-473. (Pubitemid 47289918)
14. C. Butakoff, S. Balocco, S. Ordas, and A. F. Frangi, "Simulated 3-D ultrasound LV cardiac images for active shape model training," in Med. Imag. 2007: Image Process., J. P. W. Pluimand J. M. Reinhardt, Eds., 2007, vol. 6512, p. 65123U.
15. O. Kutter, R. Shams, and N. Navab, "Visualization and GPU-accelerated simulation of medical ultrasound from CT images," Comput. Methods Programs Biomed., vol. 94, pp. 250-266, Jun. 2009.
16. W. P. Segars, M. Mahesh, T. J. Beck, E. C. Frey, and B. M.W. Tsui, "Realistic CT simulation using the 4-D XCAT phantom," Med. Phys., vol. 35, no. 8, pp. 3800-3808, 2008.
17. A. Veress, W. Segars, B. Tsui, and G. Gullberg, "Incorporation of a left ventricle finite element model defining infarction into the XCAT imaging phantom," IEEE Trans. Med. Imag., vol. 30, no. 4, pp. 915-927, Apr. 2011.
18. A. Marion, G. Forestier, H. Benoit-Cattin, S. Camarasu-Pop, P. Clarysse, R. da Silva, B. Gibaud, T. Glatard, P. Hugonnard, C. Lartizien, H. Liebgott, S. Specovius, J. Tabary, S. Valette, and D. Friboulet, "Multimodality medical image simulation of biological models with the virtual imaging platform (VIP)," in Proc. 2011 24th Int. Symp. Comput.-Based Med. Syst., Jun. 2011, pp. 1-6.
19. W. Segars, D. Lalush, and B. Tsui, "A realistic spline-based dynamic heart phantom," IEEE Trans. Nucl. Sci., vol. 46, no. 3, pp. 503-506, Jun. 1999. (Pubitemid 30504993)
20. J. Montagnat and H. Delingette, "4-D deformable models with temporal constraints: Application to 4-D cardiac image segmentation," Med. Image Anal., vol. 9, no. 1, pp. 87-100, Feb. 2005. (Pubitemid 40003896)
21. J. A. Jensen, "FIELD: A program for simulating ultrasound systems," in 10th Nordic-Baltic Conf. Biomed. Imag, 1996, vol. 34, pp. 351-353.
22. M. J. Ledesma-Carbayo, J. Kybic, M. Desco, A. Santos, M. Sühling, P. Hunziker, and M. Unser, "Spatio-temporal nonrigid registration for ultrasound cardiac motion estimation," IEEE Trans. Medical Imag., vol. 24, no. 9, pp. 1113-1126, Sep. 2005. (Pubitemid 41337152)
23. H. Gao, H. F. Choi, P. Claus, S. Boonen, G. Van der Perre, W. Lauriks, and J. D'hooge, "A new convolution-based methodology to simulate ultrasound images in a 2-D/3-D sector format," in IEEE Ultrason. Symp., 2007, pp. 2243-2246.
24. T. Glatard, A.Marion, H. Benoit-Cattin, S. Camarasu-op, P. Clarysse, R. Ferreira da Silva, G. Forestier, B. Gibaud, C. Lartizien, H. Liebgott, K. Moulin, and D. Friboulet, "Multi-modality image simulation with the virtual imaging platform: Illustration on cardiac MRI and echography," in IEEE Int. Symp. Biomed. Imag., Barcelona, Spain, 2012, pp. 98-101.
25. R. Haddad, I. Magnin, and P. Clarysse, "A new fully-digital anthropomorphic and dynamic thorax/heart model," in Proc. 29th Annu. Int. Conf. Eng. Med. Biol. Soc., Aug. 2007, pp. 5999-6002.
26. M. Sermesant, H. Delingette, and N. Ayache, "An electromechanical model of the heart for image analysis and simulation," IEEE Trans. Med. Imag., vol. 25, no. 5, pp. 612-625, May 2006.
27. M. Sermesant, R. Chabiniok, P. Chinchapatnam, T. Mansi, F. Billet, P. Moireau, J. Peyrat, K. Wong, J. Relan, K. Rhode, M. Ginks, P. Lambiase, H. Delingette,M. Sorine, C. Rinaldi, D. Chapelle, R. Razavi, and N. Ayache, "Patient-specific electromechanical models of the heart for the prediction of pacing acute effects in CRT: A preliminary clinical validation," Med. Image Anal., vol. 16, no. 1, pp. 201-215, 2012.
28. D. Chapelle, P. Le Tallec, P. Moireau, and M. Sorine, "An energypreserving muscle tissue model: Formulation and compatible discretizations," Int. J. Multiscale Computat. Eng., vol. 10, no. 2, pp. 189-211, 2012.
29. N. Smith, D. Nickerson, E. Crampin, and P. Hunter, "Computational mechanics of the heart. from tissue structure to ventricular function," J. Elasticity, vol. 61, no. 1, pp. 113-141, 2000. (Pubitemid 32723826)
30. M. E. Belik, T. P. Usyk, and A. D. McCulloch, "Computational methods for cardiac electrophysiology," in Computational Models for the Human Body, ser. Handbook of Numerical Analysis, N. Ayache, Ed. New York: Elsevier, 2004, vol. 12, pp. 129-187.
31. J. Sainte-Marie, D. Chapelle, R. Cimrman, and M. Sorine, "Modeling and estimation of the cardiac electromechanical activity," Comput, Struct., vol. 84, pp. 1743-1759, 2006. (Pubitemid 44397150)
32. P. Shi and H. Liu, "Stochastic finite element framework for simultaneous estimation of cardiac kinematic functions and material parameters," Med. Image Anal., vol. 7, no. 4, pp. 445-464, 2003. (Pubitemid 37322310)
33. V. Y. Wang, H. I. Lam, D. B. Ennis, B. R. Cowan, A. A. Young, and M. P. Nash, "Modelling passive diastolic mechanics with quantitative MRI of cardiac structure and function," Med. Image Anal., vol. 13, no. 5, pp. 773-784, Oct. 2009.
34. H. Delingette, F. Billet, K. C. L. Wong, M. Sermesant, K. Rhode, M. Ginks, C. A. Rinaldi, R. Razavi, and N. Ayache, "Personalization of cardiac motion and contractility from images using variational data assimilation," IEEE Trans. Biomed. Eng., vol. 59, no. 1, pp. 20-24, Jan. 2012.
35. J. Xi, P. Lamata, J. Lee, P. Moireau, D. Chapelle, and N. Smith, "Myocardial transversely isotropic material parameter estimation from in-silico measurements based on reduced-order unscented Kalman filter," J. Mechan. Behav. Biomed. Mater., vol. 4, no. 7, pp. 1090-1102, 2011.
36. R. Chabiniok, P. Moireau, P.-F. Lesault, A. Rahmouni, J.-F. Deux, and D. Chapelle, "Estimation of tissue contractility from cardiac cine-MRI using a biomechanical heart model," Biomechan. Model. Mechanobiol., vol. 11, pp. 609-630, 2012.
37. O. Camara,M. Schweiger, R. Scahill,W. Crum, B. Sneller, J. Schnabel, G. Ridgway, D. Cash, D. Hill, and N. Fox, "Phenomenological model of diffuse global and regional atrophy using finite-element methods," IEEE Trans. Med. Imag., vol. 25, no. 11, pp. 1417-1430, Nov. 2006. (Pubitemid 44711690)
38. P. Clarysse, J. Tafazzoli, P. Delachartre, and P. Croisille, "Simulation based evaluation of cardiac motion estimation methods in tagged-MR image sequences," J. Cardiovas. Magn. Reson., vol. 13, p. P360, 2011.
39. C. Tobon-Gomez, C. Butakoff, S. Aguade, F. Sukno, G. Moragas, and A. Frangi, "Automatic construction of 3-D-ASM intensity models by simulating image acquisition: Application to myocardial gated SPECT studies," IEEE Trans.Med. Imag., vol. 27, no. 11, pp. 1655-1667, Nov. 2008.
40. N. Toussaint, T. Mansi, H. Delingette, N. Ayache, and M. Sermesant, "An integrated platformfor dynamic cardiac simulation and image processing: Application to personalised tetralogy of fallot simulation," presented at the Eurograph. Workshop Vis. Comput. Biomed., Delft, The Netherlands, 2008.
41. L. Rineau, S. Tayeb, and M. Yvinec, "3-D mesh generation," in CGAL User and Reference Manual, 3rd ed. : CGAL, 2009.
42. Q. Fang and D. A. Boas, "Tetrahedral mesh generation from volumetric binary and gray-scale images," in IEEE Int. Symp. Biomed. Imag. (ISBI), 2009, pp. 1142-1145.
43. M. Sermesant, E. Konukoglu, H. Delingette,Y. Coudiere, P. Chinchaptanam, K. Rhode, R. Razavi, and N. Ayache, "An anisotropic multifront fast marching method for real-time simulation of cardiac electrophysiology," in Funct. Imag. Model. Heart, ser. LNCS, F. B. Sachse andG. Seemann, Eds. NewYork: Springer, Jun. 7-9, 2007, vol. 4466, pp. 160-169. (Pubitemid 47289888)
44. S. Julier and J. Uhlmann, "A new extension of the Kalman filter to nonlinear systems," in Int. Symp. Aerospace/Defense Sens., Simulat. Controls, 1997, vol. 3, p. 26.
45. S. Marchesseau, H. Delingette, M. Sermesant, and N. Ayache, "Fast parameter calibration of a cardiac electromechanical model from medical images based on the unscented transform," Biomechan. Model. Mechanobiol., Oct. 2012.
46. T. Vercauteren, X. Pennec, A. Perchant, and N. Ayache, "Symmetric logdomain diffeomorphic registration: A demons-based approach," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2008, ser. LNCS, D. Metaxas, L. Axel, G. Fichtinger, and G. Székely, Eds. New York: Springer, Sep. 2008, vol. 5241, pp. 754-761.
47. F. Dru and T. Vercauteren, "An ITK implementation of the symmetric log-domain diffeomorphic demons algorithm," Insight J., May 2009.
48. M. Bossa and S. Olmos, "A new algorithm for the computation of the group logarithm of diffeomorphisms," in Proc. 2nd MICCAI Workshop Math. Foundat. Computat. Anat., X. Pennec,Ed.,New-York, Oct. 2008.
49. F. Faure, C. Duriez, H. Delingette, J. Allard, B. Gilles, S. Marchesseau, H. Talbot, H. Courtecuisse, G. Bousquet, I. Peterlik, and S. Cotin, "Sofa: A multi-model framework for interactive physical simulation," in Soft Tissue Biomechanical Modeling for Computer Assisted Surgery, ser. Studies in Mechanobiology, Tissue Engineering and Biomaterials, Y. Payan, Ed. New York: Springer, 2012, vol. 11, pp. 283-321.
50. OSIRIX, Dicom sample image sets [Online]. Available: http://pubimage. hcuge.ch:8080/DATA/MAGIX.zip
51. K. McLeod, A. Prakosa, T. Mansi, M. Sermesant, and X. Pennec, "An incompressible log-domain demons algorithm for tracking heart tissue," in Statistical Atlases and Computational Models of the Heart. Imaging and Modelling Challenges, ser. LNCS, O. Camara, E. Konukoglu, M. Pop, K. Rhode, M. Sermesant, and A. Young, Eds. New York: Springer, Sep. 2012, vol. 7085, pp. 55-67.
52. A. Prakosa, M. Sermesant, H. Delingette, E. Saloux, P. Allain, P. Cathier, P. Etyngier, N. Villain, and N. Ayache, "Synthetic echocardiographic image sequences for cardiac inverse electro-kinematic learning," in Medical Image Computing and Computer-Assisted Intervention-MICCAI 2011, ser. LNCS, G. Fichtinger, A. Martel, and T. Peters, Eds. New York: Springer, Sep. 2011, vol. 6891, pp. 500-507.
53. A. Prakosa, M. Sermesant, H. Delingette, E. Saloux, P. Allain, P. Cathier, P. Etyngier, N. Villain, and N. Ayache, "Non-invasive activation times estimation using 3-D echocardiography," in Statistical Atlases and Computational Models of the Heart, ser. LNCS, O. Camara, M. Pop, K. Rhode, M. Sermesant, N. Smith, and A. Young, Eds. New York: Springer, 2010, vol. 6364, pp. 212-221.