Applying emphasized soft targets for Gaussian mixture model based classification

Proceedings of the International Multiconference on Computer Science and Information Technology, IMCSIT 2008

Volumn 3, Issue , 2008, Pages 131-136

  El Jelali, Soufiane ^a   Lyhyaoui, Abdelouahid ^a   Figueiras Vidal, Aníbal R ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

DESIGN PARAMETERS; GAUSSIAN MIXTURE MODEL; GENERATIVE MODEL; LOW SENSITIVITY; MISCLASSIFICATION RATES; MISSING VALUES; SIMULATION RESULT; SOFT TARGETS;

BLIND SOURCE SEPARATION; CLASSIFIERS; COMMUNICATION CHANNELS (INFORMATION THEORY); COMPUTER SCIENCE; COST FUNCTIONS; INFORMATION TECHNOLOGY; LEARNING SYSTEMS; OBJECT RECOGNITION;

TARGETS;

EID: 70349409315     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IMCSIT.2008.4747229     Document Type: Conference Paper

References (37)

1. R. A. Fisher, "The use of multiple measurements in taxonomic problems", Annals of Eugenics, 7, Pt. II, 179-188, 1936.
2. S. Y. Kung, J. S. Taur, "Decision-based neural networks with signal/image classification applications", IEEE Trans. Neural Networks, 6, 170-181, 1995.
3. B. A. Telfer, H. H. Szu, "Energy functions for minimizing misclassification error with minimum-complexity networks", Neural Networks, 7, 809-818, 1994.
4. F. Rosenblatt, "The Perceptron: A probabilistic model for information storage and organization in the brain", Psychological Review, 65, 386-408, 1958.
5. P. E. Hart, "The condensed nearest neighbor rule", IEEE Trans. Information Theory, 14, 515-516, 1968.
6. J. Sklansky, L. Michelotti, "Locally trained piecewise linear classifiers", IEEE Trans. Pattern Anal. Machine Intelligence, 2, 101-111, 1980.
7. M. Plutowski, H. White, "Selecting concise training sets from clean data", IEEE Trans. Neural Networks, 4, 305-318, 1993.
8. S. H. Choi, P. Rockett, "The training of neural classifiers with condensed datasets", IEEE Trans. Sys., Man, and Cybernetics, Pt. B, 32, 202-206, 2002.
9. P.W. Munro, "Repeat until bored: A pattern selection strategy", Adv. in Neural Inf. Proc. Sys. 4 (J. E. Moody et al., eds.), 1001-1008; San Mateo, CA: Morgan Kaufmann, 1992.
10. C. Cachin, "Pedagogical pattern selection strategies", Neural Networks, 7, 171-181, 1994.
11. Y. Freund, R. E. Schapire, "Experiments with a new boosting algorithm", Proc. 13th Intl. Conf. Machine Learning, 148-156; Bari (Italy), 1996.
12. Y. Freund, R. E. Schapire "Game theory, on-line prediction, and boosting", Proc. 9th Annual Conf. on Comput. Learning Theory, 325- 332; Desenzano di Garda (Italy), 1996.
13. R. E. Schapire, Y. Singer, "Improved boosting algorithms using confidence-rated predictions", Machine Learning, 37, 297-336, 1999.
14. V. Gómez-Verdejo, M. Ortega-Moral, J. Arenas-García, A. R. Figueiras- Vidal, "Boosting by weighting critical and erroneous samples", Neurocomputing, 69, 679-685, 2006.
15. V. Ǵomez-Verdejo, J. Arenas-Garćia, A. R. Figueiras-Vidal, "A dynamically adjusted mixed emphasis method for building boosting ensembles", IEEE Trans. Neural Networks, 19, 3-17, 2008.
16. B. E. Boser, I. Guyon, V. Vapnik, "A training algorithm for optimal margin classifiers", Proc. 5th Annual Workshop Comp. Learning Theory (D. Hassler, ed.), 144-152; Pittsburgh, PA: ACM Press, 1992.
17. C. Cortes, V. Vapnik, "Support Vector networks", Machine Learning, 20, 273-297, 1995.
18. K. R. Müller, S. Mika, G. Rätsch, K. Tsuda, B. Schölkopf "An introduction to kernel-based learning algorithms", IEEE Trans. Neural Networks, 12, 181-201, 2001.
19. L. Franco, S. A. Cannas, "Generalization and selection of examples in feed-forward neural networks", Neural Computation, 12, 2405-2426, 2000.
20. C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY: Springer, 2006.
21. C. E. Rasmussen, C. K. I. Williams, Gaussian Processes for Machine Learning. Cambridge, MA: The MIT Press, 2006.
22. R. Reed, S. Oh, and R. J. Marks, II, "Similarities of error regularization, sigmoid gain scaling, target smoothing, and training with jitter", IEEE Trans. Neural Networks, 6, 529-538, 1995.
23. D. Gorse, A. J. Shepperd, J. G. Taylor, "The new ERA in supervised learning", Neural Networks, 10, 343-352, 1997.
24. S. El Jelali, A. Lyhyaoui, A. R. Figueiras-Vidal, "An emphasized target smoothing procedure to improve MLP classifiers performance", Proc. 16th European Symp. Artificial Neural Networks, 499-504; Bruges (Belgium), 2008.
25. L. Breiman, "Combining predictors", in Combining Artificial Neural Nets.: Ensemble and Modular Multi-net Systems (A. J. C. Sharkey, ed.), 31-50; London, UK: Springer, 1999.
26. R. A. Jacobs, M. I. Jordan, "A competitive modular connectionist architecture", in Advances in Neural Info. Proc. Sys. 5 (D. Touretzky, ed.), 767-773; San Mateo, CA: Morgan Kaufmann, 1991.
27. M. I. Jordan, R. A. Jacobs, "Hierarchical Mixtures of Experts and the EM algorithm", Neural Computation, 6, 181-214, 1994.
28. L. Xu, M.I. Jordan, G. E. Hinton, "An alternative model for Mixtures of Experts", in Advances in Neural Information Processing Systems 7, 633-640. MIT Press, 1995.
29. J. T. Kwok, "Moderating the output of Support Vector classifiers", IEEE Trans. Neural Networks, 10, 1018-1031, 1999.
30. C. L. Blake, C. J. Merty: UCI Repository of Machine Learning Databases: www.ics.uci.edu/~mlearn
31. A. Ruiz, P. E. López-de-Teruel, "Nonlinear kernel-based statistical pattern analysis", IEEE Trans. Neural Networks, 12, 16-32, 2001.
32. C. Archambeau, J. A. Lee, M. Verleysen, "On convergence problems of the EM algorithm for finite mixture models", Proc. 11th European Symposium on Artificial Neural Networks, 99-106; Bruges (Belgium), 2003.
33. C. Archambeau, F. Vrins, M. Verleysen, "Flexible and robust Bayesian classification by finite mixture models", Proc. 12th European Symposium on Artificial Neural Networks, 75-80; Bruges (Belgium), 2004.
34. É. A. Nadaraya, "On estimating regression", Theory of Probability and Its Applications, 9, 141-412, 1964.
35. G. S. Watson, "Smooth regression analysis", Sankhyā: The Indian Journal of Statistics, Series A, 26, 259-279, 1964.
36. E. Parzen, "On estimation of a probability density function and mode", Annals of Math. Statistics, 33, 1065-1076, 1962.
37. F. Pérez-Cruz, "IRWLS Matlab toolbox to solve the SVM for pattern recognition and regression estimation", 2002. Available: http://www.tsc.uc3m.es/~fernando/