A maximum-likelihood interpretation for slow feature analysis

Neural Computation

Volumn 19, Issue 4, 2007, Pages 1022-1038

  Turner, Richard ^a   Sahani, Maneesh ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34247248843     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2007.19.4.1022     Document Type: Article

References (29)

1. Attias, H. (1999). Independent factor analysis. Neural Comp., 11(4), 803-851.
2. Bell, A. J., & Sejnowski, T. J. (1997). The "independent components" of natural scenes are edge filters. Vision Research, 37(23), 3327-3338.
3. Berkes, P., & Wiskott, L. (2005). Slow feature analysis yields a rich repertoire of complex cell properties. Journal of Vision, 5(6), 579-602.
4. Blaschke, A. J., Berkes, P., & Wiskott, L. (2006). What is the relation between slow feature analysis and independent component analysis? Neural Computation, 18(10), 2495-2508.
5. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society Series B (Methodological), 39, 1-38.
6. Földiák, P. (1991). Learning invariance from transformation sequences. Neural Computation, 3(2), 194-200.
7. Ghahramani, Z., & Roweis, S. T. (1999). Learning nonlinear dynamical systems using an EM algorithm. In M. S. Kearns, S. A. Solla, & D. A. Cohn (Eds.), Advances in neural information processing systems, 11 (pp. 599-605). Cambridge, MA: MIT Press.
8. Grimes, D. B., & Rao, R. P. N. (2005). Bilinear sparse coding for invariant vision. Neural Comput., 17(1), 47-73.
9. Hinton, G. E. (1989). Connectionist learning procedures. Artificial Intelligence, 40(1-3), 185-234.
10. Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8), 1771-1800.
11. Hurri, J., & Hyvärinen, A. (2003). Temporal and spatiotemporal coherence in simple-cell responses: A generative model of natural image sequences. Network, 14(3), 527-551.
12. Hyvärinen, A., Hurri, J., & Vÿrynen, J. (2003). Bubbles: A unifying framework for low-level statistical properties of natural image sequences. Journal of the Optical Society of America. A, Optics, Image Science, and Vision, 20(7), 1237-1252.
13. Jordan, M. I., Ghahramani, Z., Jaakkola, T., & Saul, L. K. (1999). An introduction to variational methods for graphical models. Machine Learning, 37(2), 183-233.
14. Karklin, Y., & Lewicki, M. S. (2005). A hierarchical Bayesian model for learning non-linear statistical regularities in nonstationary natural signals. Neural Computation, 17(2), 397-423.
15. Kayser, C., Körding, K. P., & König, P. (2003). Learning the nonlinearity of neurons from natural visual stimuli. Neural Computation, 15(8), 1751-1759.
16. Körding, K. P., Kayser, C., Einhäuser, W., & König, P. (2004). How are complex cell properties adapted to the statistics of natural stimuli? Journal of Neurophysiology, 91(1), 206-212.
17. MacKay, D. J. C. (1999). Maximum likelihood and covariant algorithms for independent component analysis. Unpublished manuscript. Available online at ftp://wol.ra.phy.cam.ac.uk/pub/mackay/ica.ps.gz.
18. Miskin, J. (2000). Ensemble learning for independent components analysis. Unpublished doctoral dissertation, Cambridge University.
19. Mitchison, G. (1991). Removing time variation with the anti-Hebbian differential synapse. Neural Computation, 3, 312-320.
20. Neal, R. M., & Hinton, G. E. (1998). A view of the EM algorithm that justifies incremental, sparse, and other variants. In M. I. Jordan (Ed.), Learning in graphical models (pp. 355-370). Norwell, MA: Kluwer Academic Press.
21. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583), 607-609.
22. Osindero, S., Welling, M., & Hinton, G. E. (2006). Topographic product models applied to natural scene statistics. Neural Computation, 18(2), 381-414.
23. Pearlmutter, B., & Parra, L. (1997). Maximum likelihood blind source separation: A context-sensitive generalization of ICA. In M. C. Mozer, M. I. Jordan, & T. Petche (Eds.), Advances in neural information processing systems, 9 (pp. 613-619). Cambridge, MA: MIT Press.
24. Roweis, S., & Ghahramani, Z. (1999). A unifying review of linear gaussian models. Neural Computation, 21 (2), 305-345.
25. Särelä, J., & Valpola, H. (2005). Denoising source separation. J. Machine Learning Res., 6, 233-272.
26. Stone, J. V. (1996). Learning perceptually salient visual parameters using spatiotemporal smoothness constraints. Neural Computation, 8(7), 1463-1492.
27. Tenenbaum, J. B., & Freeman, W. T. (2000). Separating style and content with bilinear models. Neural Computation, 12(6), 1247-1283.
28. Tipping, M. E., & Bishop, C. M. (1999). Probabilistic principal components analysis. Journal of the Royal Statistical Society Series B (Methodological), 61(3), 611-622.
29. Wiskott, L., & Sejnowski, T. J. (2002). Slow feature analysis: Unsupervised learning of invariances. Neural Computation, 14(4), 715-770.