Deep order statistic networks

2014 IEEE Workshop on Spoken Language Technology, SLT 2014 - Proceedings

Volumn , Issue , 2014, Pages 124-128

  Rennie, Steven J ^a   Goel, Vaibhava ^a   Thomas, Samuel ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Deep neural networks; Maxout networks; Multi layer perceptrons; Order statistic networks; Rectified linear units

Indexed keywords

ARTIFICIAL INTELLIGENCE; CHEMICAL ACTIVATION; ERROR STATISTICS; LEARNING SYSTEMS; SPEECH RECOGNITION; STATISTICS;

AUTOMATIC SPEECH RECOGNITION SYSTEM; DEEP NEURAL NETWORKS; LINEAR UNITS; MODEL AGGREGATIONS; MULTI-LAYER PERCEPTRONS; ORDER STATISTICS; STATE-OF-THE-ART PERFORMANCE; WORD ERROR RATE;

NETWORK LAYERS;

EID: 84946689407     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SLT.2014.7078561     Document Type: Conference Paper

References (18)

1. Ian J Goodfellow, David Warde-Farley, Mehdi Mirza, Aaron Courville, and Yoshua Bengio, "Maxout networks, " arXiv preprint arXiv:1302. 4389, 2013.
2. Yajie Miao, Florian Metze, and Shourabh Rawat, "Deep maxout networks for low-resource speech recognition, " in IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU). IEEE, 2013.
3. Xiaohui Zhang, Jan Trmal, Daniel Povey, and Sanjeev Khudanpur, "Improving deep neural network acoustic models using generalized maxout networks, " ICASSP, 2014.
4. George E Dahl, Tara N Sainath, and Geoffrey E Hinton, "Improving deep neural networks for LVCSR using rectified linear units and dropout, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 8609-8613.
5. Geoffrey E Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, and Ruslan R Salakhutdinov, "Improving neural networks by preventing co-adaptation of feature detectors, " arXiv preprint arXiv:1207. 0580, 2012.
6. Li Wan, Matthew Zeiler, Sixin Zhang, Yann L Cun, and Rob Fergus, "Regularization of neural networks using dropconnect, " in Proceedings of the 30th International Conference on Machine Learning (ICML-13), 2013, pp. 1058-1066.
7. Quoc V Le, "Building high-level features using large scale unsupervised learning, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 8595-8598.
8. Urs Köster and Aapo Hyvärinen, "A two-layer ICA-like model estimated by score matching, " in Artificial Neural Networks-ICANN 2007, pp. 798-807. Springer, 2007.
9. Aapo Hyvärinen, Jarmo Hurri, and Patrik O Hoyer, Natural Image Statistics: A Probabilistic Approach to Early Computational Vision, vol. 39, Springer, 2009.
10. Steven Rennie, Vaibhava Goel, and Samuel Thomas, "Annealed dropout training of deep networks, " in Spoken Language Technology (SLT), IEEE Workshop on. IEEE, 2014.
11. Arun Narayanan and DeLiang Wang, "Joint noise adaptive training for robust automatic speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2014.
12. N. Parihar and J. Picone, "Aurora working group: DSP frontend and LVCSR evaluation au/384/02, " Tech. Rep, Inst. for Signal and Information Processing, Mississippi State University, 2002.
13. Yann LeCun, Bernhard Boser, John S Denker, Donnie Henderson, Richard E Howard, Wayne Hubbard, and Lawrence D Jackel, "Backpropagation applied to handwritten zip code recognition, " Neural computation, vol. 1, no. 4, pp. 541-551, 1989.
14. Hagen Soltau, George Saon, and Brian Kingsbury, "The IBM Attila speech recognition toolkit, " in Spoken Language Technology Workshop (SLT), 2010 IEEE. IEEE, 2010, pp. 97-102.
15. Daniel Povey, Arnab Ghoshal, Gilles Boulianne, Lukas Burget, Ondrej Glembek, Nagendra Goel, Mirko Hannemann, Petr Motlicek, Yanmin Qian, Petr Schwarz, et al, "The kaldi speech recognition toolkit, " in Proc. ASRU, 2011, pp. 1-4.
16. Hagen Soltau, Hong-Kwang Kuo, Lidia Mangu, George Saon, and Tomás Beran, "Neural network acoustic models for the DARPA RATS program., " in INTERSPEECH, 2013, pp. 3092-3096.
17. Tara N Sainath, Abdel-rahman Mohamed, Brian Kingsbury, and Bhuvana Ramabhadran, "Deep convolutional neural networks for LVCSR, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 8614-8618.
18. Michael L Seltzer, Dong Yu, and YongqiangWang, "An investigation of deep neural networks for noise robust speech recognition, " in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 7398-7402.