Approximately Independent Factors of Speech Using Nonlinear Symplectic Transformation

IEEE Transactions on Speech and Audio Processing

Volumn 11, Issue 6, 2003, Pages 660-671

  Omar, Mohamed Kamal ^a   Hasegawa Johnson, Mark ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Feature extraction; Independent components analysis (ICA); Mel cepstrum; Optimization; Speech recognition; Symplectic map; Volume preserving transform

Indexed keywords

APPROXIMATION THEORY; FEATURE EXTRACTION; MATHEMATICAL MODELS; MATHEMATICAL TRANSFORMATIONS; OPTIMIZATION; SIGNAL PROCESSING; SPEECH RECOGNITION; STATISTICAL METHODS; TIME DOMAIN ANALYSIS;

NONLINEAR SYMPLECTIC TRANSFORMATION;

SPEECH ANALYSIS;

EID: 0346707540     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2003.814457     Document Type: Article

References (58)

1. H. von Helmholtz, On the Sensation of Tone as a Physiological Basis for the Study of Music, 4th ed. New York: Dover, 1954. A. J. Ellis, trans..
2. C. E. Shannon, "A mathematical theory of communication," Bell Syst. Tech. J., vol. 27, pp. 379-423, July 1948.
3. F. Atteneave, "Information aspects of visual perception," Psychol. Rev., vol. 61, pp. 183-193, 1954.
4. H. B. Barlow, "Sensory mechanisms, The reduction of redundancy, and intelligence," in Proc. Nat. Phys. Lab. Symp. 10: The Mechanization of Thought Processes, 1959.
5. _, "Possible principle underlying the transformation of sensory messages," in Sens. Commun., W. Rosenblith, Ed. Cambridge, MA: MIT Press, 1961, pp. 217-234.
6. _, "Unsupervised learning," in Neural Computation. Cambridge, MA: MIT Press, 1989, vol. 1, pp. 295-311.
7. A. J. Bell and T. J. Sejnowski, "An information maximization approach to blind separation and blind deconvolution," Neural Comput., vol. 7, pp. 1129-1159, 1995.
8. _, "The 'independent components'of natural scenes are edge filters," Vis. Res., vol. 37, no. 23, pp. 3327-3338, 1997.
9. T. Irino and H. Kawahara, "Signal reconstruction from modified audiotry wavelet transform," IEEE Trans. Signal Processing, vol. 41, pp. 3549-3554, Dec. 1993.
10. P. F. Brown, "The acoustic-modeling problem in automatic speech recognition," IBM T. J. Watson Research Center, Tech. Rep. RC 12750, 1987.
11. S. Matsoukas, T. Colthurst, and O. Kimball, "The 2001 Byblos English large vocabulary conversational speech recognition system," in IEEE Proc. ICASSP, Orlando, FL, 2002, pp. 721-724.
12. M. Padamanabhan, G. Saon, J. Huang, B. Kingsbury, and L. Mangu, "Automatic speech recognition performance on a voicemail transcription task," IEEE Trans. Speech Audio Processing, vol. 10, pp. 433-442, Oct. 2002.
13. F. Jelinek, Statistical Methods for Speech Recognition. Cambridge, MA: MIT Press, 2001.
14. C.-H. Lee, F. K. Soong, and K. K. Paliwal, Eds., Automatic Speech and Speaker Recognition: Advanced Topics. Norwell, MA: Kluwer, 1996.
15. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York, NY: Wiley, 2000.
16. M. E. Tipping and C. Bishop, "Mixtures of principal component analysis," in Proc. IEEE 5th Int. Conf. Artificial Neural Networks, 1997.
17. S. Kajerekar, N. Malayath, and H. Hermansky, "Analysis of sources of variability in speech," in Proc. EUROSPEECH, 1999, pp. 343-346.
18. H. Hermansky and N. Malayath, "Spectral basis functions from discriminant analysis," in Proc. Int. Conf. Spoken Language Processing, 1998, pp. 1379-1382.
19. R. Hariharan, I. Kiss, and O. Viikki, "Noise robust speech parameterization using multiresolution feature extraction," IEEE Trans. Speech Audio Processing, vol. 9, pp. 856-865, Nov. 2001.
20. N. Kuraar, "Investigation of silicon-auditory models and generalization of linear discriminant analysis for improved speech recognition," Ph.D. dissertation, John Hopkins Univ., Baltimore, MD, 1997.
21. G. Saon, M. Padmanabhan, R. Gopinath, and S. Chen, "Maximum likelihood discriminant feature spaces," in IEEE Proc. ICASSP, Istanbul, Turkey, 2000.
22. R. A. Gopinath, "Maximum likelihood modeling with Gaussian distributions for classification," in IEEE Proc. ICASSP, Seattle, WA, 1998.
23. A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
24. T.-W. Lee, Independent Component Analysis. Norwell, MA: Kluwer, 1998.
25. T.-W. Lee, M. Girolami, A. J. Bell, and T. J. Sejnowski, "A unifying information-theoretic framework for independent component analysis," Comput. Math. Applicat., vol. 31, pp. 1-21, Mar. 2000.
26. S. Choi, H. Hong, H. Glotin, and F. Berthommier, "Multichannel signal separation for cocktail party speech recognition: A dynamic recurrent network," Neurocomput., vol. 49, no. 1-4, pp. 299-314, Dec. 2002.
27. T.-W. Lee, A. J. Bell, and R. Orglmeister, "Blind source separation of real world signals," in IEEE Int. Conf. Neural Networks, Houston, TX, 1997.
28. G.-J. Jang, T.-W. Lee, and Y.-H. Oh, "Learning statistically efficient features for speaker recognition," Neurocomput., vol. 49, no. 1-4, pp. 329-348, December 2002.
29. J.-H. Lee, H.-Y. Jung, and T.-W. Lee, "Speech feature extraction using independent component analysis," in IEEE Proc. ICASSP, vol. 3, Istanbul, Turkey, 2000, pp. 1631-1634.
30. I. Potamitis, N. Fakotakis, and G. Kokkinakis, "Independent component analysis applied to feature extraction for robust automatic speech recognition," Electron. Lett., vol. 36, no. 23, pp. 1977-1978, Nov. 2000.
31. _, "Spectral and cepstral projection bases constructed by independent component analysis," in Proc. Int. Conf, Spoken Language Processing, Beijing, China, 2000, pp. 63-66.
32. L. K. Saul and M. G. Rahim, "Maximum likelihood and minimum classification error factor analysis for automatic speech recognition," IEEE Trans. Speech Audio Processing, vol. 8, pp. 115-125, Mar. 2000.
33. T. F. Quateri, Discrete-Time Speech Signal Processing Principles and Practice. Upper Saddle River, NJ: Prentice-Hall, 2002.
34. T. M. Cover and J. A. Thomas, Elements of Information Theory, New York: Wiley, 1997.
35. A. Papoulis, Probability, Random Variables, and Stochastic Processes. New York: McGraw-Hill, 1991.
36. R. Abraham and J. E. Masden, Foundation of Mechanics. New York: Benjamin/Cummings, 1978.
37. L. Parra, G. Deco, and S. Miesbach, "Statistical independence and novelty detection with information preserving nonlinear maps," Neural Comput., vol. 8, pp. 260-269, 1996.
38. K. Hornik, M. Stinchcombe, and H. White, "Multilayer feed-forward neural networks are universal approximators," Neural Network, vol. 2, pp. 359-366, 1989.
39. A. Tikhonov and V. Arsenin, Solutions of Ill-Posed Problems. Washington, DC: Winston, 1977.
40. V. N. Vapnik and A. Y. Chervonenkis, "Necessary and sufficient conditions for consistency of the method of empirical risk minimization," PatternRecognit. Image Anal., vol. 1, no. 3, pp. 284-305, 1991.
41. T. Evgeniou, M. Pontil, and T. Poggio, "A unified framework for regularization networks and support vector machines," in Advances in Large Margin Classifiers. Cambridge, MA: MIT Press, 1999.
42. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
43. _, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 2000.
44. A. Smola, "Learning With Kernels," Ph.D. dissertation, Tech. Univ. Berlin, Berlin, Germany, 1998.
45. D. P. Bertsekas, Nonlinear Programming. Belmont, MA: Athena, 1999.
46. L. Rabiner and B.-H. Junag, Fundamentals of Speech Recognition. Upper Saddle River, NJ: Prentice-Hall, 1993.
47. T. K. Moon, "The expectation maximization algorithm," IEEE Signal Processing Mag., pp. 47-60, Nov. 1996.
48. F. Girosi, "An equivalence between sparse approximation and support vector machines," Neural Comput., vol. 10, no. 6, pp. 1455-1480, 1998.
49. J. P. Leblanc and P. L. De Leon, "Source separation of speech signal using kurtosis maximization," in IEEE Proc., ICASSP, Seattle, WA, 1998.
50. J. R. Deller, J. H. L. Hansen, and J. G. Proakis, Discrete-Time Processing of Speech Signals. New York: IEEE Press, 2000.
51. A. K. Halberstadt and J. R. Glass, "Heterogeneous measurements and multiple classifiers for speech recognition," in Proc. of Int. Conf. of Spoken Language Processing, Sydney, Australia, 1998, pp. 1379-1382.
52. S. Young, "The general use of tying in phoneme-based HMM speech recognition," in IEEE Proc. ICASSP, San Francisco, CA, 1992, pp. 569-572.
53. K.-F. Lee and H.-W. Hon, "Speaker independent phone recognition using hidden Markov models," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 1641-1648, Nov. 1989.
54. J. Glass, J. Chang, and M. McCandless, "A probabilistic framework for feature-based speech recognition," in Proc. Int. Conf. of Spoken Language Processing, Philadelphia, PA, 1996, pp. 2277-2280.
55. A. Robinson, "An application of recurrent nets to phone probability estimation," IEEE Trans. Neural Networks, vol. 5, pp. 298-305, Mar. 1994.
56. S. Young, "Large vocabulary continous speech recognition," IEEE Signal Processing Mag., vol. 13, no. 5, pp. 45-57, 1996.
57. S. Young and P. Woodland, "State clustering in hidden Markov model continous speech recognition," Comput., Speech, Lang., vol. 8, no. 4, pp. 369-383, Oct. 1994.
58. M. K. Omar and M. Hasegawa-Johnson, "Maximum mutual information based acoustic-features representation of phonological features for speech recognition," in IEEE Proc. FCASSP, Orlando, FL, 2002.