Developments of the generative topographic mapping

Neurocomputing

Volumn 21, Issue 1-3, 1998, Pages 203-224

  Bishop, Christopher M ^a   Svensén, Markus ^b   Williams, Christopher K I ^b  

^a MICROSOFT RESEARCH   (United Kingdom)

^b ASTON UNIVERSITY   (United Kingdom)

Author keywords

Bayesian inference; EM algorithm; Generative topographic mapping; Local subspace models; Semilinear models

Indexed keywords

ALGORITHMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; PATTERN RECOGNITION SYSTEMS; PROBABILITY;

BAYESIAN INFERENCE; GENERATIVE TOPOGRAPHIC MAPPING (GTM);

NEURAL NETWORKS;

ALGORITHM; ARTICLE; BAYES THEOREM; DATA ANALYSIS; LINEAR SYSTEM; MATHEMATICAL COMPUTING; NERVE CELL NETWORK; PARAMETER; PATTERN RECOGNITION; PRIORITY JOURNAL; PROBABILITY; STATISTICAL MODEL;

EID: 0344110441     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(98)00043-5     Document Type: Article

References (40)

1. Bell A.J., Sejnowski T.J. An information maximization approach to blind separation and blind deconvolution. Neural Comput. 7(6):1995;1129-1159.
2. J.O. Berger, Statistical Decision Theory and Bayesian Analysis, 2nd ed., Springer, New York, 1985.
3. Bishop C.M. Neural Networks for Pattern Recognition. 1995;Oxford University Press, Oxford.
4. C.M. Bishop G.E. Hinton, I.G.D. Strachan, GTM through time, Proc. IEE 5th Int. Conf. on Artificial Neural Networks, Cambridge, UK, 1997, pp. 111-116.
5. C.M. Bishop, M. Svensén, C.K.I. Williams, Magnification factors for the GTM algorithm, Proc. IEE 5th Int. Conf. on Artificial Neural Networks, Cambridge, UK, 1997a, pp. 64-69.
6. C.M. Bishop, M. Svensén, C.K.I. Williams, Magnification factors for the SOM and GTM algorithms, Proc. 1997 Workshop on Self-Organizing Maps, Helsinki University of Technology, Finland, 1997b, pp. 333-338.
7. Bishop C.M., Svensén M., Williams C.K.I. GTM. the generative topographic mapping Neural Comput. 10(1):1998;215-234.
8. Bishop C.M., Tipping M.E. A hierarchical latent variable model for data visualization. IEEE Trans. Pattern Anal. Mach. Intell. 20(3):1998;281-293.
9. P. Comon, Independent component analysis: a new concept? Signal Process. 36 (1994) 287-314.
10. Cox R.T. Probability, frequency and reasonable expectation. Amer. J. Phys. 14(1):1946;1-13.
11. Cressie N.A.C. Statistics for Spatial Data. 1993;Wiley, New York.
12. Dempster A.P., Laird N.M., Rublin D.B. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Statist. Soc. B. 39(1):1977;1-38.
13. Durbin R., Szeliski R., Yuille A. An analysis of the elastic net approach to the travelling salesman problem. Neural Comput. 1(3):1989;348-358.
14. Durbin R., Willshaw D. An analogue approach to the travelling salesman problem. Nature. 326:1987;689-691.
15. B.S. Everitt An Introduction to Latent Variable Models, Chapman & Hall, London, 1984.
16. M. Gibbs, D.J.C. MacKay, Efficient implementation of Gaussian processes, Draft manuscript. Available from http://wol.ra.phy.cam.ac.uk/mackay/homepage.html, 1997.
17. Hastie T., Stuetzle W. Principle curves. J. Amer. Statist. Assoc. 84(406):1989;502-516.
18. Jutten C., Herault J. Blind separation of sources. Signal Process. 24:1991;1-10.
19. Kohonen T. Self-organized formation of topologically correct feature maps. Biol. Cybernet. 43:1982;59-69.
20. Kohonen T. Self-organizing maps. 1995;Springer, Berlin.
21. D.J.C. MacKay, Bayesian interpolation, Neural Comput. 4 (3) (1992a) 415-447.
22. D.J.C. MacKay, A practical Bayesian framework for back-propagation networks, Neural Comput. 4 (3) (1992b) 448-472.
23. MacKay D.J.C. Bayesian neural networks and density networks. Nucl. Instrum. Methods Phys. Res. A. 354(1):1995;73-80.
24. D.J.C. MacKay Maximum likelihood and covariant algorithms for independent component analysis, Draft manuscript. Available from http://wol.ra.phy.cam.ac.uk/mackay/homepage.html, 1996.
25. P. McCullagh, J.A. Nelder, Generalized Linear Models, 2nd ed., Chapman & Hall, London, 1989.
26. Mulier F., Cherkassky V. Self-organization as an iterative kernel smoothing process. Neural Comput. 7(6):1995;1165-1177.
27. R.M. Neal, G.E. Hinton, A new view of the EM algorithm that justifies incremental and other variants, in: M.I. Jordan (Ed.), Learning in Graphical Models, Kluwer, Dordrecht, 1998.
28. P. Pajunen, J. Karhunen, A maximum likelihood approach to nonlinear blind source separation, Proc. 1997 Int. Conf. on Artificial Neural Networks, ICANN'97, Lausanne, Switzerland, 1997, pp. 541-546.
29. B.A. Pearlmutter, L.C. Parra, A context-sensitive generalization of ICA, Int. Conf. on Neural Information Processing, 1996.
30. Poggio T., Girosi F. Networks for approximation and learning. Proc. IEEE. 78(9):1990;1481-1497.
31. Samard T., Harp S.A. Self-organization with partial data. Network: Comput. Neural Systems. 3(2):1992;205-212.
32. Tibshirani R. Principal curves revisited. Statist. Comput. 2:1992;183-190.
33. M.E. Tipping, C.M. Bishop, Mixtures of principal component analysers. Proc. IEE 5th Int. Conf. on Artificial Neural Networks, Cambridge, UK, July 1997, pp. 13-18.
34. M.E. Tipping, C.M. Bishop, Mixtures of probabilistic principal component analysers, Technical Report NCRG/97/003, Neural Computing Research Group, Aston University, Birmingham, UK, Neural Comput. (1997) accepted for publication.
35. M.E. Tipping, C.M. Bishop, Probabilistic principal component analysis, Technical report, Neural Computing Research Group, Aston University, Birmingham, UK, The Roy. Statist. Soc. B. (1997) accepted for publication.
36. Utsugi A. Hyperparameter selection for self-organizing maps. Neural Comput. 9(3):1997;623-635.
37. Whittle P. Prediction and Regulation by Linear Least-square Methods. 1963;English Universities Press, London.
38. C.K.I. Williams C.E. Rasmussen, Gaussian processes for regression, in: D.S. Touretzky, M.C. Mozer, M.E. Hasselmo (Eds.), Advances in Neural Information Processing Systems, vol. 8, MIT Press, Cambridge, 1996, pp. 514-520.
39. C.K.I. Williams, M.D. Revow, G.E. Hinton, Hand-printed digit recognition using deformable models, in: L. Harris, M. Jenkin (Eds.), Spatial Vision in Humans and Robots, Cambridge University Press, Cambridge, 1993.
40. A.M. Yaglom, Correlation Theory of Stationary and Related Random Functions vol. I: Basic Results, Springer, Berlin, 1987.