Speech recognition with auxiliary information

IEEE Transactions on Speech and Audio Processing

Volumn 12, Issue 3, 2004, Pages 189-203

  Stephenson, Todd A ^a   Doss, Mathew Magimai ^a   Bourlard, Hervé ^a  

^a IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Artificial neural networks (ANNs); Automatic speech recognition (ASR); Auxiliary information; Dynamic Bayesian networks (DBNs); Energy; Hidden Markov models (HMMs); Pitch; Rate of speech (ROS)

Indexed keywords

ACOUSTIC INTENSITY; ACOUSTIC NOISE; AUTOMATION; DATABASE SYSTEMS; MARKOV PROCESSES; MATHEMATICAL MODELS; NEURAL NETWORKS;

ARTIFICIAL NEURAL NETWORKS (ANN); AUTOMATIC SPEECH RECOGNITION (ASR) SYSTEMS; AUXILIARY INFORMATION; DYNAMIC BAYESIAN NETWORKS (DBN); HIDDEN MARKOV MODELS (HMM); PITCH; RATE OF SPEECH (ROS);

SPEECH RECOGNITION;

EID: 2442598130     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2003.822631     Document Type: Article

References (49)

1. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, pp. 257-286, Feb. 1989.
2. J. A. Bilmes, "Natural Statistical Models for Automatic Speech Recognition," Ph.D. dissertation, Univ. California, Berkeley, 1999.
3. C. J. Wellekens, "Explicit time correlation in hidden Markov models for speech recognition," in Proc. 1987 IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-87), vol. 1, Dallas, TX, Apr. 1987, pp. 384-386.
4. Y. Konig and N. Morgan, "GDNN: A gender-dependent neural network for continuous speech recognition," in Proc. 1992 Int. Joint Conf. Neural Networks (IJCNN), Baltimore, MD, June 1992, pp. 332-337.
5. T. A. Stephenson, H. Bourlard, S. Bengio, and A. C. Morris, "Automatic speech recognition using dynamic Bayesian networks with both acoustic and articulatory variables," in Proc. 6th Int. Conf. Spoken Language Processing (ICSLP 2000), vol. 2, Beijing, China, Oct. 2000, pp. 951-954.
6. R. G. Cowell, A. P. Dawid, S. L. Lauritzen, and D. J. Spiegelhalter, Probabilistic Networks and Expert Systems. New York: Springer-Verlag, 1999.
7. T. Dean and K. Kanazawa, "Probabilistic temporal reasoning," in Proc. 7th National Conf. Artificial Intelligence (AAAI-88), St. Paul, MN, 1988, pp. 524-528.
8. S. L. Lauritzen, Graphical Models. Oxford, U.K.: Clarendon, 1996, vol. 17.
9. H. Bourlard and N. Morgan, Connectionist Speech Recognition: A Hybrid Approach. Boston, MA: Kluwer, 1993, vol. 247.
10. T. A. Stephenson, M. Mathew, and H. Bourlard, "Modeling auxiliary information in Bayesian network based ASR," in Proc. 7th Eur. Conf. Speech Communication and Technology (EUROSPEECH '01), vol. 4, Aalborg, Denmark, Sept. 2001, pp. 2765-2768.
11. S. L. Lauritzen and F. Jensen, "Stable local computations with conditional Gaussian distributions," Statist. Comput., vol. 11, no. 2, pp. 191-203, Apr. 2001.
12. F. V. Jensen, An Introduction to Bayesian Networks. London, U.K.: UCL, 1990.
13. K. P. Murphy, "Dynamic Bayesian Networks: Representation, Inference and Learning," Ph.D. dissertation, Univ. California, Berkeley, 2002.
14. D. Koller, U. Lerner, and D. Angelov, "A general algorithm for approximate inference and its application to hybrid Bayes nets," in Proc. 15th Conf. Uncertainty in Artificial Intelligence (UAI-99), San Francisco, CA, July 1999, pp. 324-333.
15. K. Fujinaga, M. Nakai, H. Shimodaira, and S. Sagayama, "Multiple-regression hidden Markov model," in Proc. 2001 IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-01), vol. 1, Salt Lake City, UT, May 2001, pp. 513-516.
16. B. J. Frey, Graphical Models for Machine Learning and Digital Communication. Cambridge, MA: MIT Press, 1998.
17. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. New York: Morgan Kaufmann, 1988.
18. G. G. Zweig, "Speech Recognition With Dynamic Bayesian Networks," Ph.D. dissertation, Univ. California, Berkeley, 1998.
19. L. E. Baum, "An equality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes," Inequalities, vol. 3, pp. 1-8, 1972.
20. U. Lerner and R. Parr, "Inference in hybrid networks: Theoretical limits and practical algorithms," in Proc. 17th Conf. Uncertainty in Artificial Intelligence (UAI-2001), San Francisco, CA, Aug. 2001, pp. 310-318.
21. X. Boyen and D. Koller, "Tractable inference for complex stochastic processes," in Proc. 14th Conf. Uncertainty in Artificial Intelligence (UAI-98), San Francisco, CA, July 1998, pp. 33-42.
22. R. D. Shachter, "Bayes-ball: The rational pastime (for determining irrelevance and requisite information in belief networks and influence diagrams)," in Proc. 14th Conf. Uncertainty in Artificial Intelligence (UAI-98), San Francisco, CA, July 1998, pp. 480-487.
23. J. R. Westbury, G. Turner, and J. Dembowski, X-ray Microbeam Speech Production Database User's Handbook, 1st ed. Madison: Univ. Wisconsin, Waisman Center on Mental Retardation & Human Development, 1994.
24. A. Wrench, "Multichannel/multispeaker articulatory database for continuous speech recognition research," in PHONUS. Saarbrücken, Germany: Saarland Univ., Institute of Phonetics, 2000.
25. F. Martínez, D. Tapias, and J.Álvarez, "Toward speech rate independence in large vocabulary continuous speech recognition," in Proc. 1998 IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-98), Seattle, WA, May 1998, pp. 725-728.
26. N. Morgan, E. Fosler, and N. Mirghafori, "Speech recognition using on-line estimation of speaking rate," in Proc. 5th Eur. Conf. Speech Communication and Technology (EUROSPEECH '97), vol. 4, Rhodes, Greece, September 1997, pp, 2079-2082.
27. S. Dupont, "Etude et Développement D'architectures Multi-Bandes et Multi-Modales Pour la Reconnaissance Robuste de la Parole," Ph.D. dissertation, Faculté Polytechnique de Mons, Mons, Belgium, 2000.
28. A. C. Morris, M. P. Cooke, and P. D. Green, "Some solutions to the missing feature problem in data classification, with application to noise robust ASR," in Proc. 1998 IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-98), vol. 2, Seattle, WA, May 1998, pp. 737-740.
29. R. A. Cole, M. Fanty, M. Noel, and T. Lander, "Telephone speech Corpus development at CSLU," in Proc. 3rd Int. Conf. Spoken Language Processing (ICSLP '94), Yokohama, Japan, Sept. 1994.
30. N. Mirghafori and N. Morgan, "Combining connectionist multi-band and full-band probability streams for speech recognition of natural numbers," in Proc. 5th Int. Conf. Spoken Language Processing (ICSLP '98), vol. 3, Sydney, Australia, November 1998, pp. 743-746.
31. T. A. Stephenson, M. Magimai-Doss, and H. Bourlard, "Speech recognition of spontaneous, noisy speech using auxiliary information in Bayesian networks," in Proc. 2003 IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-03), vol. 1, Hong Kong, April 2003, pp. 20-23.
32. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech," J. Acoust. Soc. Amer., vol. 87, no. 4, pp. 1738-1752, Apr. 1990.
33. J. D. Markel, "The SIFT algorithm for fundamental frequency estimation," IEEE Trans. Audio Electroacoust., vol. 20, no. 5, pp. 367-377, Dec. 1972.
34. F. Plante, G. F. Meyer, and W. A. Ainsworth, "A pitch extraction reference database," in Proc. 4th Eur. Conf. Speech Communication and Technology (EUROSPEECH '95), Madrid, Spain, Sept. 1995, pp. 837-840.
35. T. J. Hazen, "The Use of Speaker Correlation Information for Automatic Speech Recognition," Ph.D. dissertation, Mass. Inst. Technol., 1998.
36. H. Kuwabara, "Acoustic and perceptual properties of phonemes in continuous speech as a function of speaking rate," in 5th Eur. Conf. Speech Communication and Technology (EUROSPEECH '97), vol. 2, Rhodes, Greece, September 1997, pp. 1003-1006.
37. J. E. Fosler-Lussier, "Dynamic Pronunciation Models for Automatic Speech Recognition," Ph.D., Univ. California, Berkeley, 1999.
38. C. Wang and S. Seneff, "Lexical stress modeling for improved speech recognition of spontaneous telephone speech in the JUPITER domain," in Proc. 7th Eur. Conf. Speech Communication and Technology (EUROSPEECH '01), vol. 4, Aalborg, Denmark, September 2001, pp. 2761-2764.
39. T. Nagarajan, H. A. Murthy, and R. M. Hegde, "Segmentation of speech into syllable-like units," in Proc. 8th Eur. Conf. Speech Communication and Technology (EUROSPEECH '03), vol. 4, Geneva, Switzerland, Sept. 2003, pp. 2893-2896.
40. S. Ikbal, H. Misra, and H. Bourlard, "Phase autocorrelation (PAC) derived robust speech features," in Proc. 2003 IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-03), vol. 2, Hong Kong, Apr. 2003, pp. 133-136.
41. S. Ikbal, H. Hermansky, and H. Bourlard, "Nonlinear spectral transformations for robust speech recognition," in Proc. 2003 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU '03), St. Thomas, U.S. Virgin Islands, Nov. 2003, pp. 393-398.
42. G. Zweig and M. Padmanabhan, "Dependency modeling with Bayesian networks in a voicemail transcription system," in Proc. 6th Eur. Conf. Speech Communication and Technology (EUROSPEECH '99), vol. 3, Budapest, Hungary, Sept. 1999, pp. 1135-1138.
43. A. Varga, H. Steeneken, M. Tomlinson, and D. Jones, "The NOISEX-92 Study on the Effect of Additive Noise on Automatic Speech Recognition," DRA Speech Research Unit, Malvern, U.K., 1992.
44. H. Akashi and H. Kumamoto, "Random sampling approach to state estimation in switching environments," Automatica, vol. 13, pp. 429-434, July 1977.
45. Proc. 7th European Conference on Speech Communication and Technology (EUROSPEECH '01), Aalborg, Denmark, Sept. 2001.
46. Proc. 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP-03), Hong Kong, Apr. 2003.
47. Proc. 14th Conf. Uncertainty in Artificial Intelligence (UAI-98), San Francisco, CA, July 1998.
48. Proc. 5th Eur. Conf. Speech Communication and Technology (EUROSPEECH '97), Rhodes, Greece, Sept. 1997.
49. Proc. 1998 IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP-98), Seattle, WA, May 1998.