Latent structured perceptrons for large-scale learning with hidden information

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 9, 2013, Pages 2063-2075

  Sun, Xu ^a   Matsuzaki, Takuya ^b   Li, Wenjie ^c  

^a PEKING UNIVERSITY   (China)

^b NATIONAL INSTITUTE OF INFORMATICS   (Japan)

^c HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Convergence analysis; Hidden information; Large scale learning; Latent variable; Structured perceptron

Indexed keywords

CONVERGENCE ANALYSIS; HIDDEN INFORMATION; LARGE-SCALE LEARNING; LATENT VARIABLE; PERCEPTRON;

CYBERNETICS; EQUIVALENCE CLASSES; EXPERIMENTS; RANDOM PROCESSES;

CLASSIFICATION (OF INFORMATION);

EID: 84881050414     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.129     Document Type: Article

References (31)

1. L. Bao and S.S. Intille, "Activity Recognition from User-Annotated Acceleration Data," Proc. Int'l Conf. Pervasive Computing, pp. 1-17, 2004.
2. N. Ravi, N. Dandekar, P. Mysore, and M.L. Littman, "Activity Recognition from Accelerometer Data," Proc. 17th Conf. Innovative Applications of Artificial Intelligence (IAAI '05), pp. 1541-1546, 2005. (Pubitemid 43006650)
3. T. Huynh, M. Fritz, and B. Schiele, "Discovery of Activity Patterns Using Topic Models," Proc. 10th Int'l Conf. Ubiquitous Computing, pp. 10-19, 2008.
4. A. Quattoni, M. Collins, and T. Darrell, "Conditional Random Fields for Object Recognition," Proc. Advances in Neural Information Processing Systems (NIPS '04), 2004.
5. L.-P. Morency, A. Quattoni, and T. Darrell, "Latent-Dynamic Discriminative Models for Continuous Gesture Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '07), pp. 1-8, 2007.
6. X. Sun, L.-P. Morency, D. Okanohara, and J. Tsujii, "Modeling Latent-Dynamic in Shallow Parsing: A Latent Conditional Model with Improved Inference," Proc. Int'l Conf. Computational Linguistics (COLING '08), pp. 841-848, 2008.
7. X. Sun, N. Okazaki, and J. Tsujii, "Robust Approach to Abbreviating Terms: A Discriminative Latent Variable Model with Global Information," Proc. Ann. Meeting Assoc. Computational Linguistics (ACL '09), pp. 905-913, Aug. 2009.
8. D. Yu, L. Deng, and A. Acero, "Hidden Conditional Random Field with Distribution Constraints for Phone Classification," Proc. Conf. Int'l Speech Comm. Assoc. (InterSpeech '09), 2009.
9. Y. Wang and G. Mori, "Max-Margin Hidden Conditional Random Fields for Human Action Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '09), 2009.
10. S. Petrov, "Products of Random Latent Variable Grammars," Proc. Ann. Conf. North Am. Chapter Assoc. Computational Linguistics (NAACL '10), 2010.
11. S. Petrov and D. Klein, "Discriminative Log-Linear Grammars with Latent Variables," Proc. Advances in Neural Information Processing Systems (NIPS), pp. 1153-1160, 2008.
12. S.B. Wang, A. Quattoni, L.-P. Morency, D. Demirdjian, and T. Darrell, "Hidden Conditional Random Fields for Gesture Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '06), pp. 1521-1527, 2006. (Pubitemid 44931500)
13. A. Quattoni, S. Wang, L.-P. Morency, M. Collins, and T. Darrell, "Hidden Conditional Random Fields," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 10, pp. 1848-1852, Oct. 2007.
14. F. Rosenblatt, "The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain," Psychological Rev., vol. 65, pp. 386-408, 1958.
15. Y. LeCun, S. Chopra, R. Hadsell, R. Marc'Aurelio, and F.-J. Huang, "A Tutorial on Energy-Based Learning," Predicting Structured Data, MIT Press, 2006.
16. Y. Freund and R. Schapire, "Large Margin Classification using the Perceptron Algorithm," Machine Learning, vol. 37, no. 3, pp. 277- 296, 1999. (Pubitemid 32210619)
17. M. Collins, "Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms," Proc. Conf. Empirical Methods in Natural Language Processing (EMNLP '02), pp. 1-8, 2002.
18. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer, "Online Passive-Aggressive Algorithms," J. Machine Learning Research, vol. 7, pp. 551-585, 2006. (Pubitemid 43668115)
19. P.F. Felzenszwalb, R.B. Girshick, D.A. McAllester, and D. Ramanan, "Object Detection with Discriminatively Trained Part- Based Models," IEEE Trans. Pattern Analysis Machine Intelligence, vol. 32, no. 9, pp. 1627-1645, Sept. 2010.
20. C. Cherry and C. Quirk, "Discriminative, Syntactic Language Modeling through Latent SVMs," Proc. Assoc. Machine Translation Am. (AMTA '08), N. Calzolari, C. Cardie, and P. Isabelle, eds., 2008.
21. C.-N.J. Yu and T. Joachims, "Learning Structural SVMs with Latent Variables," Proc. Int'l Conf. Machine Learning (ICML '09), p. 147, 2009.
22. J. Lafferty, A. McCallum, and F. Pereira, "Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data," Proc. 18th Int'l Conf. Machine Learning (ICML '01), pp. 282-289, 2001.
23. F. Sha and F. Pereira, "Shallow Parsing with Conditional Random Fields," NAACL '03: Proc. Conf. North Am. Chapter Assoc. Computational Linguistics Human Language Technology, pp. 134- 141, 2003.
24. P. Liang, A. Bouchard-Coté, D. Klein, and B. Taskar, "An End-to- End Discriminative Approach to Machine Translation," Proc. Ann. Meeting Assoc. Computational Linguistics (ACL '06), N. Calzolari, C. Cardie, and P. Isabelle, eds., 2006.
25. X. Sun, H. Kashima, T. Matsuzaki, and N. Ueda, "Averaged Stochastic Gradient Descent with Feedback: An Accurate, Robust, and Fast Training Method," Proc. Int'l Conf. Data Mining (ICDM '10), pp. 1067-1072, 2010.
26. S. Vishwanathan, N.N. Schraudolph, M.W. Schmidt, and K.P. Murphy, "Accelerated Training of Conditional Random Fields with Stochastic Meta-Descent," Proc. Int'l Conf. Machine Learning (ICML '06), pp. 969-976, 2006.
27. L. Bottou, "Stochastic Learning," Advanced Lectures on Machine Learning, pp. 146-168, Springer, 2004. (Pubitemid 39741631)
28. S. Shalev-Shwartz, Y. Singer, and N. Srebro, "Pegasos: Primal Estimated Sub-Gradient Solver for SVM," Proc. Int'l Conf. Machine Learning (ICML '07), 2007.
29. Y. Hattori, M. Takemori, S. Inoue, G. Hirakawa, and O. Sudo, "Operation and Baseline Assessment of Large Scale Activity Gathering System by Mobile Device," Proc. Multimedia, Distributed, Cooperative, and Mobile Symposium (DICOMO '10), 2010.
30. J.-D. Kim, T. Ohta, Y. Tsuruoka, and Y. Tateisi, "Introduction to the Bio-Entity Recognition Task at JNLPBA," Proc. Int'l Joint Workshop NLP Biomedicine and Its Applications (BioNLP '04), pp. 70- 75, 2004.
31. X. Sun, T. Matsuzaki, D. Okanohara, and J. Tsujii, "Latent Variable Perceptron Algorithm for Structured Classification," Proc. 21st Int'l Joint Conf. Artificial Intelligence (IJCAI '09), pp. 1236-1242, 2009.