On the semi-supervised learning of multi-layered perceptrons

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2009, Pages 660-663

  Malkin, Jonathan ^a   Subramanya, Amarnag ^a   Bilmes, Jeff ^a  

^a University of Washington   (United States)

Author keywords

Neural networks; Phone classification; Semi supervised learning

Indexed keywords

CLASSIFICATION TASKS; GRAPH-BASED; MULTI-LAYERED; MULTILAYERED PERCEPTRONS; OBJECTIVE FUNCTIONS; PERCEPTRON; PHONE CLASSIFICATION; REGULARIZER; SEMI-SUPERVISED; SEMI-SUPERVISED LEARNING; TRAINING SETS;

NEURAL NETWORKS; PATTERN RECOGNITION SYSTEMS; SPEECH COMMUNICATION; SPEECH RECOGNITION; TELEPHONE CIRCUITS; TELEPHONE SETS;

SUPERVISED LEARNING;

EID: 70450196429     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. C. Bishop, Neural Networks for Pattern Recognition. Oxford University Press, 1995.
2. J. Zheng, "Combining discriminative feature, transform, and model training for large vocabulary speech recognition," in IEEE ICASSP, May 2007.
3. D. P. W. Ellis, R. Singh, and S. Sivadas, "Tandem acoustic modeling in large-vocabulary recognition," in IEEE ICASSP, May 2001, pp. I-517-520.
4. B. Schölkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
5. Y. LeCun, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," in Proceedings of the IEEE, 1998, pp. 2278-2324.
6. J. Tenenbaum, V. de Silva, and J. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, 2000.
7. J. Malkin and J. Bilmes, "Ratio semi-definite classifiers," in IEEE Int'l Conf. on Acous., Speech and Signal Processing, Las Vegas, NV, 2008.
8. -, "Multi-layer ratio semi-definite classifiers," in IEEE Int'l Conf. on Acous., Speech and Signal Processing, Taipei, Taiwan, 2009.
9. J. Weston, F. Ratle, and R. Collobert, "Deep learning via semi-supervised embedding," in Intl. Conf. on Machine Learning, 2008.
10. D. M. Kline and V. L. Berardi, "Revisiting squared-error and cross-entropy functions for training neural network classifiers," Neural Computing and Applications, vol. 14, no. 4, pp. 310-318, Dec. 2005.
11. M. Belkin, P. Niyogi, and V. Sindhwani, "On manifold regularization," in Proc. Int'l Workshop on Artificial Intelligence and Statistics, 2005.
12. X. Zhu and J. Lafferty, "Harmonic mixtures: combining mixture models and graph-based methods for inductive and scalable semi-supervised learning," in Int'l Conf. on Machine Learning, 2005.
13. K. Kilanski et al., "The Vocal Joystick data collection effort and vowel corpus," in Interspeech, Pittsburgh, PA, Sept. 2006.
14. J. Bilmes et al., "The Vocal Joystick: A voice-based human-computer interface for individuals with motor impairments," in HLT-EMNLP, 2005.
15. J. Garofolo et al., TIMIT Acoustic-Phonetic Continuous Speech Corpus. Philadelphia, PA: Linguistic Data Consortium, 1993.
16. K.-F. Lee and H.-W. Hon, "Speaker-independent phone recognition using hidden Markov models," IEEE Trans. on Acoustics, Speech and Signal Processing, vol. 37, no. 11, Nov. 1989.
17. P. Ladefoged and I. Maddieson, The Sounds of the World's Languages. Blackwell Publishers, 1996.
18. K. Johnson, Acoustic & Auditory Phonetics, 2nd ed. Blackwell Publishing, 2003.
19. X. Li, J. Bilmes, and J. Malkin, "Maximum margin learning and adaptation of MLP classifiers," in Interspeech, Lisbon, Portugal, 2005.
20. X. Li, "Regularized adaptation: Theory, algorithms and applications," Ph.D. dissertation, University of Washington, Seattle, WA, 2007, in preparation.
21. J. Malkin, A. Subramanya, and J. Bilmes, "A semi-supervised learning algorithm for multi-layered perceptrons," U. Washington Dept. of Electrical Engineering, Tech. Rep. UWEETR-2009-0003, 2009.
22. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2006.