Image reconstruction by domain-transform manifold learning

Nature

Volumn 555, Issue 7697, 2018, Pages 487-492

  Zhu, Bo ^a,b,c   Liu, Jeremiah Z ^d   Cauley, Stephen F ^a,b   Rosen, Bruce R ^a,b   Rosen, Matthew S ^a,b,c  

^a MASSACHUSETTS GENERAL HOSPITAL   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

^c HARVARD UNIVERSITY   (United States)

^d HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; DATA SET; IMAGE CLASSIFICATION; IMAGE PROCESSING; IMAGING METHOD; METHODOLOGY; RECONSTRUCTION; SENSOR;

ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATION; IMAGE PROCESSING; IMAGE RECONSTRUCTION; INTERMETHOD COMPARISON; NUCLEAR MAGNETIC RESONANCE IMAGING; PRIORITY JOURNAL; SUPERVISED MACHINE LEARNING; ARTIFACT; MACHINE LEARNING; POSITRON EMISSION TOMOGRAPHY; PROCEDURES;

ARTIFACTS; IMAGE PROCESSING, COMPUTER-ASSISTED; MACHINE LEARNING; MAGNETIC RESONANCE IMAGING; NEURAL NETWORKS (COMPUTER); POSITRON-EMISSION TOMOGRAPHY;

EID: 85044273620     PISSN: 00280836     EISSN: 14764687     Source Type: Journal    
DOI: 10.1038/nature25988     Document Type: Article

References (67)

1. Grangeat, P. Tomography (John Wiley & Sons, 2013).
2. Gull, S. F. & Daniell, G. J. Image reconstruction from incomplete and noisy data. Nature 272, 686-690 (1978).
3. Zeng, G. L. Medical Image Reconstruction (Springer, 2010).
4. Yu, Z., Thibault, J.-B., Bouman, C. A., Sauer, K. D. & Hsieh, J. Fast model-based X-ray CT reconstruction using spatially nonhomogeneous ICD optimization. IEEE Trans. Image Process. 20, 161-175 (2011).
5. Pruessmann, K. P., Weiger, M., Börnert, P. & Boesiger, P. Advances in sensitivity encoding with arbitrary k-space trajectories. Magn. Reson. Med. 46, 638-651 (2001).
6. Hinton, G. et al. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Process. Mag. 29, 82-97 (2012).
7. Krizhevsky, A., Sutskever, I. & Hinton, G. E. ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 1097-1105 (2012).
8. Gilbert, C. D., Sigman, M. & Crist, R. E. The neural basis of perceptual learning. Neuron 31, 681-697 (2001).
9. Lu, Z.-L., Hua, T., Huang, C.-B., Zhou, Y. & Dosher, B. A. Visual perceptual learning. Neurobiol. Learn. Mem. 95, 145-151 (2011).
10. Vincent, P., Larochelle, H., Bengio, Y. & Manzagol, P.-A. Extracting and composing robust features with denoising autoencoders. In Proc. 25th Int. Conf. on 'Machine Learning' 1096-1103, http://www.cs.toronto.edu/- larocheh/publications/icml-2008-denoising-autoencoders.pdf (2008).
11. Ogawa, T., Kosugi, Y. & Kanada, H. Neural network based solution to inverse problems. In IEEE World Congr. on 'Computational Intelligence' Vol. 3, 2471-2476, http://ieeexplore.ieee.org/document/687250/ (1998).
12. Schiller, H. & Doerffer, R. Neural network for emulation of an inverse model operational derivation of Case II water properties from MERIS data. Int. J. Remote Sens. 20, 1735-1746 (1999).
13. Hoole, S. R. H. Artificial neural networks in the solution of inverse electromagnetic field problems. IEEE Trans. Magn. 29, 1931-1934 (1993).
14. Floyd, C. E. An artificial neural network for SPECT image reconstruction. IEEE Trans. Med. Imaging 10, 485-487 (1991).
15. Pelt, D. M. & Batenburg, K. J. Fast tomographic reconstruction from limited data using artificial neural networks. IEEE Trans. Image Process. 22, 5238-5251 (2013).
16. Jin, K. H., McCann, M. T., Froustey, E. & Unser, M. Deep convolutional neural network for inverse problems in imaging. IEEE Trans. Image Process. 26, 4509-4522 (2017).
17. Hammernik, K. et al. Learning a variational network for reconstruction of accelerated MRI data. Magn. Reson. Med. 79, 3055-3071 (2017).
18. Lustig, M., Donoho, D. & Pauly, J. M. Sparse MRI: The application of compressed sensing for rapid MR imaging. Magn. Reson. Med. 58, 1182-1195 (2007).
19. Fan, Q. et al. MGH-USC Human Connectome Project datasets with ultra-high b-value diffusion MRI. Neuroimage 124, 1108-1114 (2016).
20. Deng, J. et al. ImageNet: A large-scale hierarchical image database. In IEEE Conf. on 'Computer Vision and Pattern Recognition' 248-255, http://www. image-net.org/papers/imagenet-cvpr09.pdf (2009).
21. Hornik, K., Stinchcombe, M. & White, H. Multilayer feedforward networks are universal approximators. Neural Netw. 2, 359-366 (1989).
22. Di Carli, M. F. & Lipton, M. J. Cardiac PET and PET/CT Imaging (Springer, 2007).
23. Yang, Z. & Jacob, M. Mean square optimal NUFFT approximation for efficient non-Cartesian MRI reconstruction. J. Magn. Reson. 242, 126-135 (2014).
24. Virtue, P. & Lustig, M. On the empirical effect of Gaussian noise in undersampled MRI reconstruction. Preprint at https://arxiv.org/abs/1610.00410 (2016).
25. Brown, R. W., Cheng, Y. C. N., Haacke, E. M., Thompson, M. R. & Venkatesan, R. Magnetic Resonance Imaging: Physical Principles and Sequence Design 2nd edn (Wiley, 2014).
26. Gold, J., Bennett, P. J. & Sekuler, A. B. Signal but not noise changes with perceptual learning. Nature 402, 176-178 (1999).
27. Wright, J. et al. Sparse representation for computer vision and pattern recognition. Proc. IEEE 98, 1031-1044 (2010).
28. Maaten, L. V. D. & Hinton, G. Visualizing Data using t-SNE. J. Mach. Learn. Res. 9, 2579-2605 (2008).
29. Getis, A. in Handbook of Applied Spatial Analysis (eds Fisher, M. M. & Getis, A.) 255-278 (Springer, 2010).
30. Kubo, T. et al. Radiation dose reduction in chest CT: A review. Am. J. Roentgenol. 190, 335-343 (2008).
31. Daigle, O., Djazovski, O., Laurin, D., Doyon, R. & Artigau, É. Characterization results of EMCCDs for extreme low-light imaging. In Proc. SPIE on 'High Energy, Optical, and Infrared Detectors for Astronomy V' Vol. 8453, 845303, https://doi. org/10.1117/12.926385 (2012).
32. Girard, J. N. et al. Sparse representations and convex optimization as tools for LOFAR radio interferometric imaging. J. Instrum. 10, C08013 (2015).
33. Lebed, E., Sarunic, M. V., Beg, M. F. & Mackenzie, P. J. Rapid volumetric OCT image acquisition using compressive sampling. Opt. Exp. 18, 21003-21012 (2010).
34. Fessler, J. A. & Sutton, B. P. Nonuniform fast Fourier transforms using min-max interpolation. IEEE Trans. Signal Process. 51, 560-574 (2003).
35. Kim, D. H., Adalsteinsson, E. & Spielman, D. M. Simple analytic variable density spiral design. Magn. Reson. Med. 50, 214-219 (2003).
36. Uecker, M., Ong, F., Tamir, J. I. & Bahri, D. Berkeley advanced reconstruction toolbox. Proc. Int. Soc. Magnetic Resonance in Medicine 2486 (2015).
37. Abadi, M. et al. TensorFlow: Large-scale machine learning on heterogeneous distributed systems. Preprint at https://arxiv.org/abs/1603.04467 (2016).
38. Nair, V. & Hinton, G. E. Rectified linear units improve restricted Boltzmann machines. In Proc. 27th Int. Conf. on 'Machine Learning' 807-814 (ACM, 2010).
39. Makhzani, A. & Frey, B. J. Winner-take-all autoencoders. Adv. Neural Inf. Process. Syst. 28, 2791-2799 (2015).
40. Reeder, S. B. et al. Practical approaches to the evaluation of signal-to-noise ratio performance with parallel imaging: Application with cardiac imaging and a 32-channel cardiac coil. Magn. Reson. Med. 54, 748-754 (2005).
41. Duyn, J. H., Yang, Y., Frank, J. A. & van der Veen, J. W. Simple correction method for k-space trajectory deviations in MRI. J. Magn. Reson. 132, 150-153 (1998).
42. Pruessmann, K. P., Weiger, M., Scheidegger, M. B. & Boesiger, P. SENSE: Sensitivity encoding for fast MRI. Magn. Reson. Med. 42, 952-962 (1999).
43. Saad, Y. & Schultz, M. H. GMRES: A generalized minimal residual algorithm for solving nonsymmetric linear systems. SIAM J. Sci. Statist. Comput. 7, 856-869 (1986).
44. Comtat, C, et al. OSEM-3D Reconstruction Strategies for the ECAT HRRT. IEEE Symp. Conf. Record Nuclear Science 6, 3492-3496 (2004).
45. Izquierdo-Garcia, D. et al. An SPM8-based approach for attenuation correction combining segmentation and nonrigid template formation: Application to simultaneous PET/MR brain imaging. J. Nucl. Med. 55, 1825-1830 (2014).
46. Yu, K. & Zhang, T. Improved local coordinate coding using local tangents. In Proc. 27th Int. Conf. on 'Machine Learning' 1215-1222 (ACM, 2010).
47. Anderes, E. & Coram, M. A general spline representation for nonparametric and semiparametric density estimates using diffeomorphisms. Preprint at https://arxiv.org/abs/1205.5314 (2012).
48. Zhang, M., Singh, N. & Fletcher, P. T. Bayesian estimation of regularization and atlas building in diffeomorphic image registration. Int. Conf. Inf. Process. Med. Imaging 37-48 (Springer, 2013).
49. Fishbaugh, J., Prastawa, M., Gerig, G. & Durrleman, S. Geodesic image regression with a sparse parameterization of diffeomorphisms. In 1st Int. Conf. on 'Geometric Science of Information' GSI 2013 (eds Nielsen, F. & Barbaresco, F.) Vol. 8085, 95-102, https://link.springer.com/ chapter/10.1007/978-3-642-40020-9-9 (2013).
50. Bernstein, A., Kuleshov, A. & Yanovich, Y. Manifold Learning in Regression Tasks. Statistical Learning and Data Sciences 414-423 (Springer, 2015).
51. Hornik, K. Approximation capabilities of multilayer feedforward networks. Neural Netw. 4, 251-257 (1991).
52. Irie, B. & Miyake, S. Capabilities of three-layered perceptrons. In IEEE Int. Conf. on 'Neural Networks' Vol. 1, 641-648 (1988).
53. Cybenko, G. Approximation by superpositions of a sigmoidal function. Math. Contr. Signals Syst. 2, 303-314 (1989).
54. Barron, A. R. Approximation and estimation bounds for artificial neural networks. Mach. Learn. 14, 115-133 (1994).
55. Mordvintsev, A., Olah, C. & Tyka, M. DeepDream-a code example for visualizing neural networks. https://research.googleblog.com/2015/07/ deepdream-code-example-for-visualizing.html (Google Res, 2015).
56. Addy, N. O., Wu, H. H. & Nishimura, D. G. Simple method for MR gradient system characterization and k-space trajectory estimation. Magn. Reson. Med. 68, 120-129 (2012).
57. Han, H., Ouriadov, A. V., Fordham, E. & Balcom, B. J. Direct measurement of magnetic field gradient waveforms. Concepts Magn. Reson. 36A, 349-360 (2010).
58. Goodfellow, I., Pouget-Abadie, J. & Mirza, M. Generative adversarial nets. Adv. Neural Inf. Process. Syst. 2672-2680 (2014).
59. Haskell, M., Cauley, S. F. & Wald, L. L. TArgeted Motion Estimation and Reduction (TAMER): Data consistency based motion mitigation for MRI using a reduced model joint optimization. IEEE Trans. Med. Imaging PP, 99, http://doi. org/10.1109/TMI.2018.2791482 (2018).
60. Fessler, J. A., Lee, S., Olafsson, V. T., Shi, H. R. & Noll, D. C. Toeplitz-based iterative image reconstruction for MRI with correction for magnetic field inhomogeneity. IEEE Trans. Signal Process. 53, 3393-3402 (2005).
61. Cauley, S. F. et al. Fast reconstruction for multichannel compressed sensing using a hierarchically semiseparable solver. Magn. Reson. Med. 73, 1034-1040 (2015).
62. Xi, Y., Xia, J., Cauley, S. & Balakrishnan, V. Superfast and stable structured solvers for Toeplitz least squares via randomized sampling. SIAM J. Matrix Anal. Appl. 35, 44-72 (2014).
63. Xia, J., Chandrasekaran, S., Gu, M. & Li, X. S. Fast algorithms for hierarchically semiseparable matrices. Numer. Linear Algebra Appl. 17, 953-976 (2010).
64. Weller, D. S., Ramani, S. & Fessler, J. A. Augmented Lagrangian with variable splitting for faster non-Cartesian L1-SPIRiT MR image reconstruction. IEEE Trans. Med. Imaging 33, 351-361 (2014).
65. Zhao, B., Setsompop, K., Ye, H., Cauley, S. F. & Wald, L. L. Maximum likelihood reconstruction for magnetic resonance fingerprinting. IEEE Trans. Med. Imaging 35, 1812-1823 (2016).
66. Han, S., Mao, H. & Dally, W. J. Deep compression: Compressing deep neural networks with pruning, trained quantization and Huffman coding. Preprint at https://arxiv.org/abs/1510.00149 (2015).
67. Hu, H., Peng, R., Tai, Y.-W. & Tang, C.-K. Network trimming: A data-driven neuron pruning approach towards efficient deep architectures. Preprint at https://arxiv.org/abs/1607.03250 (2016).