Nonlinear and noisy extension of independent component analysis: Theory and its application to a pitch sensation model

Neural Computation

Volumn 17, Issue 1, 2005, Pages 115-144

  Maeda, Shin Ichi ^a   Song, Wen Jie ^b   Ishii, Shin ^a  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b OSAKA UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFACT; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; HEARING; METHODOLOGY; MUSIC; NONLINEAR SYSTEM; PHYSIOLOGY; SIGNAL PROCESSING; SPEECH; STATISTICS;

ALGORITHMS; ARTIFACTS; ARTIFICIAL INTELLIGENCE; MUSIC; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PITCH PERCEPTION; SIGNAL PROCESSING, COMPUTER-ASSISTED; SPEECH ACOUSTICS; STATISTICS;

EID: 14544292009     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/0899766052530866     Document Type: Article

References (51)

1. Almeida, L. B. (2004). MISEP-linear and nonlinear ICA based on mutual information. Signal Processing, 84(2), 231-245.
2. Amari, S., & Cardoso, J. E (1997). Blind source separation- semiparametric statistical approach. IEEE Transaction on Signal Processing, 45(11), 2692-2700.
3. Amari, S., Chen, T.-R, & Cichocki, A. (1997). Stability analysis of learning algorithms for blind source separation. Neural Networks, 20(8), 1345-1351.
4. Amari, S., Cichocki, A., & Yang, H. H. (1996). A new learning algorithm for blind signal separation. In D. Touretzky, M. Mozer, & M. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 752-763). Cambridge, MA: MIT Press.
5. Atick, J. J. (1992). Could information theory provide an ecological theory of sensory processing? Network, 3, 213-251.
6. Attias, H. (1999). Independent factor analysis. Neural Computation, 21(4), 803-851.
7. Barlow, H. B. (1961). Sensory communication. Cambridge, MA: MIT Press.
8. Bell, A. J., & Sejnowski, T. J. (1995). An information maximization approach to blind separation and blind deconvolution. Neural Computation, 7(6), 1129-1159.
9. Bell, A. J., & Sejnowski, T. J. (1997). The "independent components" of natural scenes are edge filters. Vision Research, 37(23), 3327-3338.
10. Belouchrani, A., & Cardoso, J. F. (1995). Maximum likelihood source separation by the expectation-maximization technique: Deterministic and stochastic implementation. In Proceedings of NOLTA (pp. 49-53). Las Vegas, NV.
11. Bermond, O., & Cardoso, J. F. (1999). Approximate likelihood for noisy mixtures. In ICA '99 (pp. 325-330). Aussois, France.
12. Bregman, A. S., & Campbell, J. (1971). Primary auditory stream segregation and perception of order in rapid sequences of tones. Journal of Experimental Psychology, 89(2), 244-249.
13. Cardoso, J. F. (1997). Infomax and maximum likelihood for source separation. IEEE Trans. Auto. Contr. Sys., 4(4), 112-114.
14. Cardoso, J. F., & Souloumiac, A. (1993). Blind beamforming for non gaussian signals. In IEEE Proceedings-F, 240(6), 362-370.
15. Chang, E. E, & Merzenich, M. M. (2003). Environmental noise retards auditory cortical development. Science, 300, 498-502.
16. de Boer, E. (1956). Pitch of inharmonic signals. Nature, 178, 535-536.
17. de Boer, E. (1977). Psychophysics and physiology of hearing. San Diego, CA: Academic Press.
18. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statistical Society. Series B, Statistical Methodological, 39, 1-38.
19. Douglas, S. C., Cichocki, A., & Amari, S. (1998). Bias removal technique for blind source separation with noisy measurements. Electronics Letters, 34(14), 1379-1380.
20. Gaeta, M. & Lacoume, J. L. (1990). Source separation without a priori knowledge: the maximum likelihood solution. In EUSIPCO (Vol. 24, pp. 621-624). Berlin: Springer-Verlag.
21. Girolami, M. (2001). A variational method for learning sparse and overcomplete representations. Neural Computation, 13(11), 2517-2532.
22. Goldstein, J. L. (1973). An optimum processor theory for the central formation of the pitch of complex tones. J. Acoust. Soc. Am., 54, 1496-1516.
23. Helmholtz, H. L. F. (1863). Die Lehre von den Tonempfindungen als Physiologische Grundlage für die Theorie der Musik. Braunschweig.
24. Højen-Sørensen, P. A., Winther, O., & Hansen, L. K. (2002). Mean-field approaches to independent component analysis. Neural Computation, 14(4), 889-918.
25. Houtsma, A. J. M., & Goldstein, J. L. (1972). The central origin of the pitch of complex tones: Evidence from musical interval recognition. J. Acoust. Soc. Am., 51, 520-529.
26. Hyvärinen, A. (1998a). Independent component analysis in the presence of gaussian noise by maximizing joint likelihood. Neurocomputing, 22, 49-67.
27. Hyvärinen, A. (1998b). New approximations of differential entropy for independent component analysis and projection pursuit. In M. Kearns, M. Jordan, & S. Solla (Eds.), Advances in neural information processing systems, 10 (pp. 273-279). Cambridge, MA: MIT Press.
28. Hyvärinen, A. (1999). Gaussian moments for noisy independent component analysis. IEEE Signal Processing Letters, 6(6), 145-147.
29. Jutten, C, & Karhunen, J. (2003). Advances in nonlinear blind source separation. In Proceedins oflCA 2003 (pp. 245-256). Nara, Japan.
30. Kawanabe, M., & Murata, N. (2000). Independent component analysis in the presence of gaussian noise (Tech. Rep. 2000-03). Tokyo: University of Tokyo.
31. Lappalainen, H., & Honkela, A. (2000). Advances in independent component analysis. Berlin: Springer-Verlag.
32. Lee, T.-W., Koehler, B., & Orglmeister, R. (1997). Blind separation of nonlinear mixing models. In IEEE International Workshop on Neural Networks for Signal Processing (pp. 406-415).
33. Lewicki, M. S. (2002). Efficient coding of natural sounds. Nature Neuroscience, 5(4), 356-363.
34. Lewicki, M. S., & Sejnowski, T. J. (2000). Learning overcomplete representations. Neural Computation, 12, 337-365.
35. Lindsay, P. H., & Norman, D. A. (1977). Human information processing: An introduction to psychology. San Diego, CA: Academic Press.
36. Merzenich, M. M., Knight, P. L., & Roth, G. L. (1975). Representation of cochlea within primary auditory cortex in the cat. J. Neurophysiol, 38, 231-249.
37. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
38. Pantev, C., Hoke, M., Lutkenhoner, B., & Lehnertz, K. (1989). Tonotopic organization of the auditory cortex: Pitch versus frequency representation. Science, 246, 486-488.
39. Patterson, R. D. (1973). Physical variables determining residue pitch. J. Acoust. Soc. Am., 53, 1565-1572.
40. Rao, R. P., & Ballard, D. H. (1999). Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2(1), 79-87.
41. Reale, R. A., & Imig, T. J. (1980). Tonotopic orginization in auditory cortex of the cat. J. Comp. Neural, 192, 265-291.
42. Riquimaroux, H., & Hashikawa, T. (1994). Units in the primary auditory cortex of the Japanese monkey can demonstrate a conversion and place pitch in the central auditory system. Journal de physique IV, C5, 419-425.
43. Ritsma, R. J. (1962). Existence region of the tonal residue. I. J. Acoust. Soc. Am., 42(1), 191-198.
44. Schouten, J. F. (1940). The perception of pitch. Philips Technical Review, 5, 286-294.
45. Schouten, J. E, Ritsma, R. J., & Cardozo, B. L. (1962). Pitch of the residue. J. Acoust. Soc. Am., 34, 1418-1424.
46. Seebeck, A. (1843). Uber die siree. Ann. Phys. Chem., 60, 49-481.
47. Taleb, A. & Jutten, C. (1999). Source separation in post-nonlinear mixtures. IEEE Transaction on Signal Processing, 47(10), 2807-2820.
48. Terhardt, E. (1974). Pitch, consonance, and harmony. J. Acoust. Soc. Am., 55, 1061-1069.
49. Wightman, F. L. (1973). The pattern-transformation model of pitch. J. Acoust. Soc. Am., 54, 407-416.
50. Yoshioka, M. (1980). Mathematical relations between three pitch theories. In Spring Meeting of the Acoustical Society of Japan (pp. 683-684).
51. Zibulevsky, M., & Pearlmutter, B. A. (2001). Blind source separation by sparse decomposition in a signal dictionary. Neutral Computation, 13(4), 863-882.