Joint optimization of hidden conditional random fields and non linear feature extraction

Proceedings of the International Conference on Document Analysis and Recognition, ICDAR

Volumn , Issue , 2011, Pages 513-517

  Vinel, Antoine ^a   Do, Trinh Minh Tri ^b   Artières, Thierry ^a  

^a SORBONNE UNIVERSITÉ   (France)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Conditional Random Fields; Deep Neural Networks; Handwriting recognition

Indexed keywords

CONDITIONAL RANDOM FIELD; HANDWRITING RECOGNITION; HIDDEN CONDITIONAL RANDOM FIELDS; HIDDEN STATE; HYBRID MODEL; JOINT OPTIMIZATION; MULTI-STEP; NONCONVEX OPTIMIZATION; NONLINEAR FEATURE EXTRACTION; NONLINEAR FEATURES;

CHARACTER RECOGNITION; CONTENT BASED RETRIEVAL; CONVEX OPTIMIZATION; FEATURE EXTRACTION; NEURAL NETWORKS; OPTIMIZATION;

RANDOM PROCESSES;

EID: 82355186407     PISSN: 15205363     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDAR.2011.109     Document Type: Conference Paper

References (28)

1. B. Juang and S. Katagiri, "Discriminative learning for minimum error classification," in IEEE Trans. Signal Processing, Vol.40, No.12, 1992.
2. M. Collins, "Discriminative training methods for hidden markov models: theory and experiments with perceptron algorithms," in EMNLP, 2002.
3. P. Woodland and D. Povey, "Large scale discriminative training of hidden markov models for speech recognition,"Computer Speech and Language, 2002.
4. F. Sha and L. K. Saul, "Large margin hidden markov models for automatic speech recognition," in NIPS 19, B. Schölkopf, J. Platt, and T. Hoffman, Eds. MIT Press, 2007.
5. T.-M.-T. Do and T. Artières, "Large margin training for hidden Markov models with partially observed states," in ICML, 2009.
6. J. Lafferty, A. McCallum, and F. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data," in Machine Learning-Ineternational Workshop then conference, 2001.
7. A. Gunawardana, M. Mahajan, A. Acero, and J. C. Platt, "Hidden conditional random fields for phone classification,"in in Proceedings of Interspeech, 2005, pp. 1117-1120.
8. T.-M.-T. Do and T. Artières, "Conditional Random Fields for Online Handwriting Recognition," in Tenth International Workshop on Frontiers in Handwriting Recognition, 2006.
9. A. Quattoni, M. Collins, and T. Darrel, "Conditional random fields for object recognition," in Advances in Neural Information Processing Systems (NIPS 2004), no. 17, 2005.
10. L.-P. Morency, A. Quattoni, and T. Darrell, "Latent-dynamic discriminative models for continuous gesture recognition," in CVPR, 2007.
11. Y. Altun, M. Johnson, and T. Hofmann, "Investigating loss functions and optimization methods for discriminative learning of label sequences," in Empirical methods in natural language processing, 2003.
12. K. Sato and Y. Sakakibara, "Rna secondary structural alignment with conditional random fields," in ECCB/JBI, 2005.
13. B. Taskar, C. Guestrin, and D. Koller, "Max-margin markov networks," in NIPS 16, S. Thrun, L. Saul, and B. Schölkopf, Eds. Cambridge, MA: MIT Press, 2004.
14. J. Lafferty, X. Zhu, and Y. Liu, "Kernel conditional random fields: representation and clique selection," in ICML, 2004.
15. S. Reiter, B. Schuller, and G. Rigoll, "Hidden conditional random fields for meeting segmentation," in ICME, 2007.
16. G. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural computation, 2006.
17. H. Larochelle and Y. Bengio, "Classification using discriminative restricted boltzmann machines," ICML, 2008.
18. T. Schmah, G. Hinton, R. Zemel, S. Small, and S. Strother, "Generative versus discriminative training of rbms for classification of fmri images," in NIPS, 2008.
19. Y. L. L. Bottou, Y. Bengio, "Global training of document processing systems using graph transformer networks," in Computer Vision and Pattern Recognition, 1997.
20. R. Collobert and J. Weston, "A unified architecture for natural language processing: Deep neural networks with multitask learning," in ICML, 2008.
21. T.-M.-T. Do and T. Artières, "Neural conditional random fields," in AISTAT, 2010.
22. J. Morris and E. Fosler-Lussier, "Conditional random fields for integrating local discriminative classifiers," in EMNLP, 2008.
23. J. Peng, L. Bo, and J. Xu, "Conditional neural fields," NIPS, 2009.
24. J. Liu, K. Yu, Y. Zhang, and Y. Huang, "Training conditional random fields using transfer learning for gesture recognition,"ICDM, 2010.
25. G. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Computation, 2002.
26. T. Do and T. Artieres, "Maximum margin training of gaussian hmms for handwriting recognition," in ICDAR, 2009.
27. U. Marti and H. Bunke, "A full english sentence database for off-line handwriting recognition," in ICDAR, 2002.
28. U.-V. Marti and H. Bunke, "Using a statistical language model to improve the performance of an hmm-based cursive handwriting recognition system," IJPRAI, 2001.