Local factor analysis with automatic model selection: A comparative study and digits recognition application

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4132 LNCS - II, Issue , 2006, Pages 260-269

  Shi, Lei ^a   Xu, Lei ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ACQUISITION; LEARNING ALGORITHMS; MATHEMATICAL MODELS; PROBLEM SOLVING; SET THEORY;

BAYESIAN YING-YANG (BYY); INCREMENTAL MIXTURE OF FACTOR ANALYSERS (IMOFA); LOCAL FACTOR ANALYSIS;

CHARACTER RECOGNITION;

EID: 33749857863     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11840930_27     Document Type: Conference Paper

References (17)

1. Redner, R.A. and Walker, H.F.: Mixture densities, maximum likelihood, and the EM algorithm. SIAM Review, vol.26, pp.195-239, 1984.
2. Kambhatla, N. and Leen, T.K.: Fast non-linear dimension reduction. Advances in NIPS 6, Morgan Kaufmann, San Francisco, 1994.
3. Hinton G.E., Revow, M. and Dayan, P.: Recognizing handwritten digits using mixtures of Linear models. Advances in NIPS 7, MIT Press, Cambridge, MA, 1995.
4. Akaike, H.: A new look at statistical model identification. IEEE Trans. Automatic Control, vol.19, pp.716-723, 1974.
5. Barron, A. and Rissanen, J.: The minimum description length priciple in coding and modeling, IEEE Trans. Information Theory, vol.44, pp.2743-2760, 1998.
6. Bozdogan, H.: Model selection and Akaike's information criterion (AIC): the general theory and its analytical extensions, Psychometrika, vol.52(3), pp.345-370, 1987.
7. Figueiredo, M.A.T, and Jain, A.K.: Unsupervised learning of finite mixture models, IEEE Trans. Pattern Analysis and Machine Intelligence, vol.24(3), pp.381-396, 2002.
8. Rubin, D. and Thayer, D.: EM algorithms for ML factor analysis. Psychometrika, vol.47(1), pp.69-76, 1982.
9. Schwarz, G.: Estimating the dimension of a model. The Annals of Statistics, vol.6(2), pp.461-464, 1978.
10. Ghahramani Z. and Beal M.: Variational inference for Bayesian mixture of factor analysers. Advances in NIPS, vol.12, pp.449-455, 2000.
11. Albert Ali Salah and Ethem Alpaydin: Incremental Mixtures of Factor Analysers. Proc. 17th Intl Conf. on Pattern Recognition, vol.1, 276-279, 2004.
12. LeCun, Y. et al.: Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE, vol.86(11), pp.2278-2324, 1998.
13. Xu, L, : Multisets Modeling Learning: An Unified Theory for Supervised and Unsupervised Learning, Invited Talk, Proc. IEEE ICNN94, June 26-July 2, 1994, Orlando, Florida, Vol.1, pp.315-320.
14. Xu, L.: Temporal BYY Encoding, Markovian State Spaces, and Space Dimension Determination. IEEE Trans. Neural Networks, vol.15(5), pp.1276-1295, 2004.
15. Xu, L: Advances on BYY harmony learning: information theoretic perspective, generalized projection geometry, and independent factor auto-determination, IEEE Trans on Neural Networks, Vol. 15, No. 4, pp885-902, 2004.
16. Xu, L.: A Unified Perspective and New Results on RHT Computing, Mixture Based Learning, and Multi-learner Based Problem Solving. To appear in a special issue of Pattern Recognition, 2006.
17. Xu, L.: Trends on Regularization and Model Selection in Statistical Learning: A Perspective from Bayesian Ying Yang Learning. Challenges to Computational Intelligence (in press), Duch, W., Mandziuk, J. and Zurada, J.M. eds, the Springers series - Studies in Computational Intelligence, Springer-Verlag, 2006.