A variational method for learning sparse and overcomplete representations

Neural Computation

Volumn 13, Issue 11, 2001, Pages 2517-2532

  Girolami, Mark ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0038132749     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976601753196003     Document Type: Article

References (19)

1. Amari, S. I., Cichocki, A., & Yang, H. (1996). A new learning algorithm for blind signal separation. In D. Touretzky, M. Mozer, & M. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 757-763). Cambridge, MA: MIT Press.
2. Attias, H. (1999). Independent factor analysis. Neural Computation, 11(4), 803-851.
3. Bell, A., & Sejnowski, T. J. (1995). An information maximisation approach to blind separation and blind deconvolution. Neural Computation, 7, 1129-1159.
4. Bermond, O., & Cardoso, J. F. (1999). Approximate likelihood for noisy mixtures. In Proceedings of the First International Workshop on Independent Component Analysis and Signal Separation (pp. 325-330). Aussois, France.
5. Buhmann, J. M. (1998). Data clustering and data visualisation. In M. I. Jordan (Ed.), Learning in graphical models. Norwell, MA: Kluwer Academic.
6. Chen, S., Donoho, D. L., & Saunders, M. A. (1996). Atomic decomposition by basis pursuit (Tech. Rep.). Stanford, CA: Department of Statistics., Stanford University.
7. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B, 39, 1-38.
8. Jaakkola, T. S. (1997). Variational methods for inference and estimation in graphical models. Unpublished doctoral dissertation, MIT.
9. Jaakkola, T. S., & Jordan, M. I. (1997). Bayesian logistic regression: A variational approach. In Proceedings on the 1997 Conference on Artificial Intelligence and Statistics (pp. 283-294). Fort Lauderdale, FL.
10. Kreutz-Delgado, K., & Rao, B. D. (2000). FOCUSS-based dictionary learning algorithms. In Wavelet Applications in Signal and Image Processing VII: Proc. of SPIE (vol. 4119).
11. Lappalainen, H., & Honkela, A. (2000). Bayesian nonlinear independent component analysis by multi-layer perceptrons. In M. Girolami (Ed.), Advances in independent component analysis (pp. 93-120). Berlin: Springer-Verlag.
12. Lee, T. S. (1996). Image representation using 2-D Gabor wavelets. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(10), 959-971.
13. Lee, T. W., Lewicki, M., Girolami, M., & Sejnowski, T. (1999). Blind source separation of more sources than mixtures using overcomplete representations. IEEE Signal Processing Letters, 6, 87-90.
14. Lee, T. W., Lewicki, M., & Sejnowski, T. (2000). ICA mixture models for unsupervised classification of non-gaussian sources and automatic context switching in blind signal separation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10), 1-12.
15. Lewicki, M. S., & Olshausen, B. A. (1999). A probabilistic framework for the adaption and comparison of image codes. Journal of the Optical Society of America: Optics, Image Science, and Vision, 16(7), 1587-1601.
16. Lewicki, M. S., & Sejnowski, T. J. (2000). Learning overcomplete representations. Neural Computation, 12(2), 337-365.
17. Rockafellar, R. (1970). Convex analysis. Princeton, NJ: Princeton University Press.
18. Simoncelli, E. P., Freeman, W. T., Adelson, E. H., & Heeger, D. J. (1992). Shiftable multiscale transforms. IEEE Transactions on Information Theory, 38(2), 587-607.
19. Zibulevsky, M., & Pearlmutter, B. A. (2001). Blind source separation by sparse decomposition in a signal dictionary. Neural Computation, 13(4).