Mixtures of probabilistic principal component analyzers

Neural Computation

Volumn 11, Issue 2, 1999, Pages 443-482

  Tipping, Michael E ^a   Bishop, Christopher M ^a  

^a MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; HANDWRITING; HUMAN; IMAGE PROCESSING; PATTERN RECOGNITION; PROBABILITY; STATISTICAL MODEL;

ALGORITHMS; HANDWRITING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED; PATTERN RECOGNITION, VISUAL; PROBABILITY;

EID: 0033556788     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976699300016728     Document Type: Article

References (34)

1. Anderson, T. W. (1963). Asymptotic theory for principal component analysis. Annals of Mathematical Statistics, 34, 122-148.
2. Anderson, T. W., & Rubin, H. (1956). Statistical inference in factor analysis. In J. Neyman (Ed.), Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability (Vol. 5, pp. 111-150). Berkeley: University of California, Berkeley.
3. Bartholomew, D. J. (1987). Latent variable models and factor analysis. London: Charles Griffin & Co. Ltd.
4. Basilevsky, A. (1994). Statistical factor analysis and related methods. New York: Wiley.
5. Bishop, C. M. (1995). Neural networks for pattern recognition. Oxford: Clarendon Press.
6. Bishop, C. M., Svensén, M., & Williams, C. K. I. (1998). GTM: The generative topographic mapping. Neural Computation, 10(1), 215-234.
7. Bishop, C. M., & Tipping, M. E. (1998). A hierarchical latent variable model for data visualization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3), 281-293.
8. Bregler, C., & Omohundro, S. M. (1995). Nonlinear image interpolation using manifold learning. In G. Tesauro, D. S. Touretzky, & T. K. Leen (Eds.), Advances in neural information processing systems, 7 (pp. 973-980). Cambridge, MA: MIT Press.
9. Broomhead, D. S., Indik, R., Newell, A. C., & Rand, D. A. (1991). Local adaptive Galerkin bases for large-dimensional dynamical systems. Nonlinearity, 4(1), 159-197.
10. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 839(1), 1-38.
11. Dony, R. D., & Haykin, S. (1995). Optimally adaptive transform coding. IEEE Transactions on Image Processing, 4(10), 1358-1370.
12. Hastie, T., & Stuetzle, W. (1989). Principal curves. Journal of the American Statistical Association, 84, 502-516.
13. Hinton, G. E., Dayan, P., & Revow, M. (1997). Modelling the manifolds of images of handwritten digits. IEEE Transactions on Neural Networks, 8(1), 65-74.
14. Hinton, G. E., Revow, M., & Dayan, P. (1995). Recognizing handwritten digits using mixtures of linear models. In G. Tesauro, D. S. Touretzky, & T. K. Leen (Eds.), Advances in neural information processing systems, 7 (pp. 1015-1022). Cambridge, MA: MIT Press.
15. Hotelling, H. (1933). Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology, 24, 417-441.
16. Hull, J. J. (1994). A database for handwritten text recognition research. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16, 550-554.
17. Japkowicz, N., Myers, C., & Gluck, M. (1995). A novelty detection approach to classification. In Proceedings of the Fourteenth International Conference on Artificial Intelligence (pp. 518-523).
18. Jolliffe, I. T. (1986). Principal component analysis. New York: Springer-Verlag.
19. Jordan, M. I., & Jacobs, R. A. (1994). Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6(2), 181-214.
20. Kambhatla, N. (1995). Local models and gaussian mixture models for statistical data processing. Unpublished doctoral dissertation, Oregon Graduate Institute, Center for Spoken Language Understanding.
21. Kambhatla, N., & Leen, T. K. (1997). Dimension reduction by local principal component analysis. Neural Computation, 9(7), 1493-1516.
22. Kramer, M. A. (1991). Nonlinear principal component analysis using autoassociative neural networks. AIChE Journal, 37(2), 233-243.
23. Krzanowski, W. J., & Marriott, F. H. C. (1994). Multivariate analysis part 2: Classification, Covariance structures and repeated measurements. London: Edward Arnold.
24. Lawley, D. N. (1953). A modified method of estimation in factor analysis and some large sample results. In Uppsala Symposium on Psychological Factor Analysis. Nordisk Psykologi Monograph Series (pp. 35-42). Uppsala: Almqvist and Wiksell.
25. Oja, E. (1983). Subspace methods of pattern recognition. New York: Wiley.
26. Ormoneit, D., & Tresp, V. (1996). Improved gaussian mixture density estimates using Bayesian penalty terms and network averaging. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 542-548). Cambridge, MA: MIT Press.
27. Pearson, K. (1901). On lines and planes of closest fit to systems of points in space. London, Edinburgh and Dublin Philosophical Magazine and Journal of Science, Sixth Series, 2, 559-572.
28. Petsche, T., Marcantonio, A., Darken, C., Hanson, S. J., Kuhn, G. M., & Santoso, I. (1996). A neural network autoassociator for induction motor failure prediction. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 924-930). Cambridge, MA: MIT Press.
29. Rao, C. R. (1955). Estimation and tests of significance in factor analysis. Psychometrika, 20, 93-111.
30. Rubin, D. B., & Thayer, D. T. (1982). EM algorithms for ML factor analysis. Psychometrika, 47(1), 69-76.
31. Tibshirani, R. (1992). Principal curves revisited. Statistics and Computing, 2, 183-190.
32. Tipping, M. E., & Bishop, C. M. (1997). Mixtures of principal component analysers. In Proceedings of the IEE Fifth International Conference on Artificial Neural Networks, Cambridge (pp. 13-18). London: IEE.
33. Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1985). The statistical analysis of finite mixture distributions. New York: Wiley.
34. Webb, A. R. (1996). An approach to nonlinear principal components analysis using radially symmetrical kernel functions. Statistics and Computing, 6(2), 159-168.