Using representation learning and out-of-domain data for a paralinguistic speech task

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn 2015-January, Issue , 2015, Pages 904-908

  Milde, Benjamin ^a   Biemann, Chris ^a  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Computational paralinguistics; Data augmentation; Deep learning; Neural networks; Speech classification; Transfer learning

Indexed keywords

COMPUTATIONAL LINGUISTICS; LINGUISTICS; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS; SPEECH; SPEECH COMMUNICATION;

DATA AUGMENTATION; DEEP LEARNING; PARALINGUISTICS; SPEECH CLASSIFICATION; TRANSFER LEARNING;

CLASSIFICATION (OF INFORMATION);

EID: 84959157337     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. B. W. Schuller, "The Computational Paralinguistics Challenge [Social Sciences], " Signal Processing Magazine, IEEE, vol. 29, no. 4, pp. 97-101, 2012.
2. G. L. Trager, "Paralanguage: A first approximation, " Studies in linguistics, vol. 13, no. 1-2, pp. 1-12, 1958.
3. B. Schuller, S. Steidl, A. Batliner, F. Burkhardt, L. Devillers, C. Müller, and S. Narayanan, "The INTERSPEECH 2010 Paralinguistic Challenge, " Interspeech, pp. 2794-2797, 2010.
4. B. Schuller, S. Steidl, and A. Batliner, "The INTERSPEECH 2009 emotion challenge. " in Interspeech, 2009, pp. 312-315.
5. F. Schiel, "Perception of alcoholic intoxication in speech, " in Interspeech, 2011, pp. 3281-3284.
6. D. Bone, M. Black, M. Li, A. Metallinou, S. Lee, and S. S. Narayanan, "Intoxicated Speech Detection by Fusion of Speaker Normalized Hierarchical Features and GMM Supervectors. " in Interspeech, 2011, pp. 3217-3220.
7. G. E. Hinton, "To recognize shapes, first learn to generate images, " Progress in Brain Research, vol. 165, pp. 535-547, 2007.
8. B. Schuller, S. Steidl, A. Batliner, S. Hantke, F. Hönig, J. Orozco-Arroyave, E. Nöth, Y. Zhang, and F. Weniger, "The INTERSPEECH 2015 Computional Paralinguistics Challenge: Nativeness, Parkinson's and Eating Condition, " Interspeech, 2015.
9. S. Hantke, F. Weninger, R. Kurle, A. Batliner, and B. Schuller, "I hear you eat and speak: Automatic recognition of eating condition and food type, " (to appear), 2015.
10. R. Caruana, "Multitask Learning, " Machine Learning, vol. 28, pp. 41-75, 1997.
11. S. J. Pan and Q. Yang, "A survey on transfer learning, " IEEE Transactions on Knowledge and Data Engineering (KDE), vol. 22, pp. 1345-1359, 2010.
12. F. Eyben, "openSMILE The Munich Versatile and Fast Open-Source Audio Feature Extractor Categories and Subject Descriptors, " International conference on Multimedia (ACM), pp. 1459-1462, 2010.
13. F. Eyben, F. Weninger, F. Gross, and B. Schuller, "Recent developments in openSMILE, the munich open-source multimedia feature extractor, " in International conference on Multimedia (ACM), 2013, pp. 835-838.
14. I. Lopez-Moreno, J. Gonzalez-Dominguez, O. Plchot, D. Martinez, J. Gonzalez-Rodriguez, and P. Moreno, "Automatic language identification using deep neural networks, " in Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2014, pp. 5337-5341.
15. Y. LeCun and Y. Bengio, "Convolutional networks for images, speech, and time series, " The handbook of brain theory and neural networks, vol. 3361, pp. 255-258, 1995.
16. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition, " Proceedings of the IEEE, vol. 86, pp. 2278-2323, 1998.
17. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks, " Neural Information Processing Systems (NIPS), pp. 1-9, 2012.
18. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "DeepFace: Closing the Gap to Human-Level Performance in Face Verification, " in Conference on Computer Vision and Pattern Recognition (CVPR), 2014, pp. 1701-1708.
19. K. He, X. Zhang, S. Ren, and J. Sun, "Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification, " arXiv preprint, pp. 1-11, 2015.
20. T. D. Kulkarni, W. Whitney, P. Kohli, and J. B. Tenenbaum, "Deep convolutional inverse graphics network, " arXiv preprint, pp. 1-10, 2015.
21. T. N. Sainath, A. R. Mohamed, B. Kingsbury, and B. Ramabhadran, "Deep convolutional neural networks for LVCSR, " in Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 8614-8618.
22. H. Lee, P. Pham, Y. Largman, and A. Ng, "Unsupervised feature learning for audio classification using convolutional deep belief networks. " Neural Information Processing Systems (NIPS), pp. 1-9, 2009.
23. S. Dieleman and B. Schrauwen, "End-to-end learning for music audio, " in Acoustics, Speech and Signal Processing (ICASSP). ICASSP, 2014, pp. 6964-6968.
24. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " arXiv preprint, pp. 1-14, 2014.
25. A. E. Hoerl and R. W. Kennard, "Ridge regression: Biased estimation for nonorthogonal problems, " Technometrics, vol. 12, no. 1, pp. 55-67, 1970.
26. G. E. Hinton, N. Srivastava, A. Krizhevsky, I. Sutskever, and R. R. Salakhutdinov, "Improving neural networks by preventing coadaptation of feature detectors, " arXiv preprint, pp. 1-18, 2012.
27. P. Simard, D. Steinkraus, and J. Platt, "Best practices for convolutional neural networks applied to visual document analysis, " Seventh International Conference on Document Analysis and Recognition, p. 958, 2003.
28. L. Y. Pratt, J. Mostow, C. A. Kamm, and A. A. Kamm, "Direct Transfer of Learned Information Among Neural Networks, " in AAAI, vol. 91, 1991, pp. 584-589.
29. L. Y. Pratt, L. Y. Pratt, S. J. Hanson, C. L. Giles, and J. D. Cowan, "Discriminability-based transfer between neural networks, " in Neural Information Processing Systems (NIPS), 1993.
30. A. Sharif, R. Hossein, A. Josephine, S. Stefan, and K. T. H. Royal, "CNN Features off-the-shelf : An Astounding Baseline for Recognition, " in Computer Vision and Pattern Recognition Workshops (CVPRW), 2014, pp. 512-519.
31. H. Azizpour, A. S. Razavian, J. Sullivan, A. Maki, and S. Carlsson, "From generic to specific deep representations for visual recognition, " arXiv preprint, pp. 1-12, 2014.
32. Y. Nesterov, "A method of solving a convex programming problem with convergence rate O (1/k2), " Soviet Mathematics Doklady, vol. 27, pp. 372-376, 1983.
33. I. Sutskever, J. Martens, G. Dahl, and G. Hinton, "On the importance of initialization and momentum in deep learning, " International Conference on Machine Learning (ICML), vol. 28, pp. 1139-1147, 2013.
34. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay, "Scikit-learn: Machine Learning in Python, " The Journal of Machine Learning Research, vol. 12, pp. 2825-2830, 2012.
35. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio, "Theano: A CPU and GPU math compiler in Python, " in Python in Science Conference (SCIPY), 2010, pp. 1-7.