Efficient training of convolutional deep belief networks in the frequency domain for application to high-resolution 2D and 3D images

Neural Computation

Volumn 27, Issue 1, 2015, Pages 211-227

  Brosch, Tom ^a,b   Tam, Roger ^a,b  

^a MS/MRI Research Group   (Canada)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTIFICIAL NEURAL NETWORK; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; HUMAN; LEARNING; PHYSIOLOGY;

ALGORITHMS; ANIMALS; COMPUTER GRAPHICS; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; LEARNING; NEURAL NETWORKS (COMPUTER);

EID: 84920106320     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00682     Document Type: Letter

References (20)

1. Brosch, T., & Tam, R. (2013).Manifold learning of brainMRIs by deep learning. In K. Mori, I. Sakuma, Y. Sato, C. Barillot, & N. Navab (Eds.), Medical image computing and computer-assisted intervention 2013, Part II, LNCS 8150 (pp. 633-640). Berlin: Springer.
2. Ciresan, D., Giusti, A., & Schmidhuber, J. (2012). Deep neural networks segment neuronal membranes in electron microscopy images. In F. Pereira, C. J. C. Burges, L. Bottou, & K. Q. Weinberger (Eds.), Advances in neural information processing systems, 25 (pp. 1-9). Red Hook, NY: Curran.
3. Cruz-Roa, A. A., Edison, J., Ovalle, A., Madabhushi, A., & Gonz, F. A. (2013). A deep learning architecture for image representation, visual interpretability and automated basal-cell carcinoma cancer detection. In K. Mori, I. Sakuma, Y. Sato, C. Barillot, & N. Navab (Eds.), Medical image computing and computer-assisted intervention, 2013, Part II, LNCS 8150 (pp. 403-410). Berlin: Springer.
4. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009). ImageNet: A large-scale hierarchical image database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 248-255). Piscataway, NJ: IEEE.
5. Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8), 1771-1800.
6. Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18(7), 1527-1554.
7. Hinton, G. E., & Srivastava, N. (2012). Improving neural networks by preventing coadaptation of feature detectors. arXiv preprint arXiv:1207.0580.
8. Krizhevsky, A. (2012). High-performance C++/CUDA implementation of convolutional neural networks. http://code.google.com/p/cuda-convnet/
9. Krizhevsky, A., Sutskever, I., & Hinton, G. (2012). ImageNet classification with deep convolutional neural networks. In F. Pereira, C. J. C. Burges, L. Bottou, & K.Weinberger (Eds.), Advances in neural information processing systems, 25 (pp. 1-9). Red Hook, NY: Curran.
10. Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009). Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. In Proceedings of the 26th Annual International Conference on Machine Learning (pp. 609-616). New York: ACM.
11. Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2011). Unsupervised learning of hierarchical representations with convolutional deep belief networks. Communications of the ACM, 54(10), 95-103.
12. Lee, N., Laine, A.,& Klein, A. (2011). Towards a deep learning approach to brain parcellation. In Proceedings of the IEEE International Symposium on Biomedical Imaging (pp. 321-324). Piscataway, NJ: IEEE.
13. Liao, S., Gao, Y., Oto, A., & Shen, D. (2013). Representation learning: A unified deep learning framework for automatic prostate MR segmentation. In K. Morin, I. Sakuma, Y. Sato, C. Barillot, & N. Navab (Eds.), Medical image computing and computer-assisted intervention, 2013, Part II, LNCS 8150 (pp. 254-261). Berlin: Springer.
14. Marcus, D. S., Wang, T. H., Parker, J., Csernansky, J. G., Morris, J. C., & Buckner, R. L. (2007). Open access series of imaging studies (OASIS): Cross-sectional MRI data in young, middle aged, nondemented, and demented older adults. Journal of Cognitive Neuroscience, 19(9), 1498-1507.
15. Mathieu, M., Henaff, M., & LeCun, Y. (2014). Fast training of convolutional networks through FFTs. In Proceedings of the 2nd International Conference on Learning Representations (pp. 1-9). arXiv.org
16. Nair, V., & Hinton, G. E. (2010). Rectified linear units improve restricted Boltzmann machines. In Proceedings of the 27th Annual International Conference on Machine Learning (pp. 807-814). Madison,WI: Omnipress.
17. Raina, R., & Madhavan, A. (2009). Large-scale deep unsupervised learning using graphics processors. In L. Bottou & M. Littman (Eds.), Proceedings of the 26th International Conference on Machine Learning. Madison, WI:Omnipress.
18. Scherer, D., Müller, A., & Behnke, S. (2010). Evaluation of pooling operations in convolutional architectures for object recognition. In Proceedings of the 20th International Conference on Artificial Neural Networks (pp. 92-101). Berlin: Springer.
19. Wu, G., Kim, M., Wang, Q., & Gao, Y. (2013). Unsupervised deep feature learning for deformable registration of MR brain images. In K. Mori, I. Sakuma, Y. Sato, C. Barillot, & N. Navab (Eds.), Medical image computing and computer-assisted intervention, 2013, Part II, LNCS 8150 (pp. 649-656).
20. Zeiler, M. D., & Fergus, R. (2013). Stochastic pooling for regularization of deep convolutional neural networks. In Proceedings of the 1st International Conference on Learning Representations (pp. 1-9). arXiv.org