Parallel multi-dimensional LSTM, with application to fast biomedical volumetric image segmentation

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 2998-3006

  Stollenga, Marijn F ^a,b,c   Byeon, Wonmin ^a,b,d,e   Liwicki, Marcus ^d   Schmidhuber, Juergen ^a,b,c  

^a DALLE MOLLE INSTITUTE FOR ARTIFICIAL INTELLIGENCE IDSIA   (Switzerland)

^b UNIVERSITY OF APPLIED SCIENCES AND ARTS OF SOUTHERN SWITZERLAND   (Switzerland)

^c UNIVERSITY OF LUGANO   (Switzerland)

^d France   (Germany)

^e GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BRAIN MAPPING; INFORMATION SCIENCE; NEURAL NETWORKS; PIXELS; PROGRAM PROCESSORS;

BRAIN IMAGES; CONVOLUTIONAL NEURAL NETWORK; LOCAL CONTEXTS; LONG SHORT TERM MEMORY; MULTI DIMENSIONAL; SEGMENTATION RESULTS; SPATIO TEMPORAL; VOLUMETRIC IMAGE SEGMENTATION;

IMAGE SEGMENTATION;

EID: 84965136278     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. S. Hochreiter and J. Schmidhuber. "Long Short-Term Memory". In: Neural Computation 9. 8 (1997). Based on TR FKI-207-95, TUM (1995), pp. 1735-1780.
2. F. A. Gers, J. Schmidhuber, and F. Cummins. "Learning to Forget: Continual Prediction with LSTM". In: ICANN. 1999.
3. A. Graves, M. Liwicki, S. Fernandez, R. Bertolami, H. Bunke, and J. Schmidhuber. "A Novel Connectionist System for Improved Unconstrained Handwriting Recognition". In: PAMI 31. 5 (2009).
4. H. Sak, A. Senior, and F. Beaufays. "Long Short-Term Memory Recurrent Neural Network Architectures for Large Scale Acoustic Modeling". In: Proc. Interspeech. 2014.
5. I. Sutskever, O. Vinyals, and Q. V. Le. Sequence to Sequence Learning with Neural Networks. Tech. rep. NIPS. 2014.
6. A. Graves, S. Fernández, and J. Schmidhuber. "Multi-dimensional Recurrent Neural Networks". In: ICANN. 2007.
7. A. Graves and J. Schmidhuber. "Offline Handwriting Recognition with Multidimensional Recurrent Neural Networks". In: NIPS. 2009.
8. W. Byeon, T. M. Breuel, F. Raue, and M. Liwicki. "Scene Labeling With LSTM Recurrent Neural Networks". In: CVPR. 2015.
9. M. Kass, A. Witkin, and D. Terzopoulos. "Snakes: Active contour models". In: International Journal of Computer Vision (1988).
10. L. Wang, Y. Gao, F. Shi, G. Li, J. H. Gilmore, W. Lin, and D. Shen. "LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images". In: NeuroImage (2015).
11. D. C. Ciresan, A. Giusti, L. M. Gambardella, and J. Schmidhuber. "Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images". In: NIPS. 2012.
12. A. Cardona, S. Saalfeld, S. Preibisch, B. Schmid, A. Cheng, J. Pulokas, P. Tomancak, and V. Hartenstein. "An integrated micro- and macroarchitectural analysis of the Drosophila brain by computer-assisted serial section electron microscopy". In: PLoS biology 8. 10(2010), e1000502.
13. A. M. Mendrik, K. L. Vincken, H. J. Kuijf, G. J. Biessels, and M. A. Viergever (organizers). MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans, http://mrbrains13.isi.uu.nl. 2015.
14. O. Weber, Y. S. Devir, A. M. Bronstein, M. M. Bronstein, and R. Kimmel. "Parallel algorithms for approximation of distance maps on parametric surfaces". In: ACM Transactions on Graphics (2008).
15. Segmentation of Neuronal Structures in EM Stacks Challenge. IEEE International Symposium on Biomedical Imaging (ISBI), http://tinyurl.com/d2fgh7g. 2012.
16. S. M. Pizer, E. P. Amburn, J. D. Austin, R. Cromartie, A. Geselowitz, T. Greer, B. T. H. Romeny, and J. B. Zimmerman. "Adaptive Histogram Equalization and Its Variations". In: Comput. Vision Graph. Image Process. (1987).
17. T. Tieleman and G. Hinton. "Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude". In: COURSERA: Neural Networks for Machine Learning 4 (2012).
18. S. Hochreiter. Untersuchungen zu dynamischen neuronalen Netzen. Diploma thesis, Institut für Informatik, Lehrstuhl Prof. Brauer, Technische Universität München. Advisor: J. Schmidhuber. 1991.
19. S. Chetlur, C. Woolley, P. Vandermersch, J. Cohen, J. Tran, B. Catanzaro, and E. Shelhamer. "cuDNN: Efficient Primitives for Deep Learning". In: CoRR abs/1410.0759 (2014).
20. T. Liu, C. Jones, M. Seyedhosseini, and T. Tasdizen. "A modular hierarchical approach to 3D electron microscopy image segmentation". In: Journal of Neuroscience Methods (2014).
21. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov. "Dropout: A Simple Way to Prevent Neural Networks from Overfitting". In: Journal of Machine Learning Research (2014).
22. V. Pham, T. Bluche, C. Kermorvant, and J. Louradour. "Dropout improves recurrent neural networks for handwriting recognition". In: ICFHR. 2014.
23. D. C. Ciresan, U. Meier, J. Masci, and J. Schmidhuber. "A Committee of Neural Networks for Traffic Sign Classification". In: IJCNN. 2011.
24. A. Krizhevsky, I Sutskever, and G. E Hinton. "ImageNet Classification with Deep Convolutional Neural Networks". In: NIPS. 2012.
25. M. D. Zeiler and R. Fergus. Visualizing and Understanding Convolutional Networks. Tech. rep. arXiv:1311.2901 [cs. CV]. NYU, 2013.