Loss functions for discriminative training of energy-based models

AISTATS 2005 - Proceedings of the 10th International Workshop on Artificial Intelligence and Statistics

Volumn , Issue , 2005, Pages 206-213

  Cun, Yann Le ^a   Huang, Fu Jie ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISCRIMINATIVE TRAINING; ENERGY-BASED MODELS; LOSS FUNCTIONS; LOW ENERGIES; PROBABILISTIC GRAPHICAL MODELS; SMALLEST ENERGIES; SUFFICIENT CONDITIONS;

OBJECT RECOGNITION; PROBABILITY DISTRIBUTIONS;

ARTIFICIAL INTELLIGENCE;

EID: 84862617580     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Yasemin Altun, Mark Johnson, and Thomas Hofmann. Loss functions and optimization methods for discriminative learning of label sequences. In Proc. EMNLP, 2003.
2. Y. Bengio, R. De Mori, G. Flammia, and R. Kompe. Global optimization of a neural network-hidden Markov model hybrid. IEEE Transaction on Neural Networks, 3(2):252-259, 1992.
3. Y. Bengio, R. Ducharme, P. Vincent, and C. Jauvin. A neural probabilistic language model. Journal of Machine Learning Research, 3:1137-1155, February 2003.
4. L. Bottou. Une Approche théorique de l'Apprentissage Connexionniste: Applications à la Reconnaissance de la Parole. PhD thesis, Université de Paris XI, 91405 Orsay cedex, France, 1991.
5. Michael Collins. Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. In Proc. EMNLP, 2002.
6. J. S. Denker and C. J. Burges. Image segmentation and recognition. In The Mathematics of Induction. Addison Wesley, 1995.
7. X. Driancourt and L. Bottou. MLP, LVQ and DP: Comparison & cooperation. In Proceedings of the International Joint Conference on Neural Networks, volume 2, pages 815-819, Seattle, 1991.
8. P. Haffner. Connectionist speech recognition with a global MMI algorithm. In Eurospeech'93, Berlin, September 1993.
9. John Lafferty, Andrew McCallum, and Fernando Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. International Conference on Machine Learning (ICML), 2001.
10. Yann LeCun, Leon Bottou, Yoshua Bengio, and Patrick Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, November 1998.
11. Yann LeCun, Fu-Jie Huang, and Leon Bottou. Learning methods for generic object recognition with invariance to pose and lighting. In Proc. CVPR, 2004.
12. M. Osadchy, M. Miller, and Y. LeCun. Synergistic face detection and pose estimation. In Proc. NIPS, 2004.
13. Kschischang F. R., B. J. Frey, and H.-A. Loeliger. Factor graphs and the sum-product algorithm. IEEE Trans. Information Theory, 47(2):498-519, February 2001.
14. Ben Taskar, Carlos Guestrin, and Daphne Koller. Max-margin markov networks. In Proc. NIPS, 2003.
15. Y. W. Teh, M. Welling, S. Osindero, and Hinton G. E. Energy-based models for sparse overcomplete representations. Journal of Machine Learning Research, 4:1235-1260, 2003.