Training Conditional Random Fields using transfer learning for gesture recognition

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2010, Pages 314-323

  Jie, Liu ^a   Kai, Yu ^b   Yi, Zhang ^c   Yalou, Huang ^a  

^a NANKAI UNIVERSITY   (China)

^b NEC LABORATORIES AMERICA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Conditional Random Fields; Gesture recognition; Semi supervised learning; Transfer learning

Indexed keywords

BASELINE MODELS; CONDITIONAL RANDOM FIELD; DATA SETS; HIDDEN LAYERS; HIGH-LEVEL FEATURES; LABELED AND UNLABELED DATA; LABELED DATA; MAIN TASKS; OVERFITTING; SEMI-SUPERVISED LEARNING; SEQUENCE LABELING; TRANSFER LEARNING;

DATA MINING; DATA PROCESSING; KNOWLEDGE REPRESENTATION; NEURAL NETWORKS; SUPERVISED LEARNING;

GESTURE RECOGNITION;

EID: 79951731724     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2010.31     Document Type: Conference Paper

References (36)

1. Louis-Philippe Morency, Ariadna Quattoni, and Trevor Darrell. Latent-dynamic discriminative models for continuous gesture recognition. In CVPR, pages 1-8, 2007.
2. John Lafferty, Andrew Mccallum, and Fernando Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML, pages 282-289, 2001.
3. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504-507, July 2006. (Pubitemid 44148451)
4. Yoshua Bengio, Pascal Lamblin, Dan Popovici, and Hugo Larochelle. Greedy layer-wise training of deep networks. In NIPS, 2007.
5. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
6. Jian Peng, Liefeng Bo, and Jinbo Xu. Conditional neural fields. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, and A. Culotta, editors, Advances in Neural Information Processing Systems 22, pages 1419-1427. 2009.
7. Trinh-Minh-Tri Do and Thierry Artieres. Neural conditional random fields. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, volume 9, pages 177-184. JMLR: W&CP, May 2010.
8. Sebastian Thrun. Lifelong learning: A case study. Technical report, 1995.
9. Sebastian Thrun and L. Pratt. Learning to learn: Introduction and overview, 1998.
10. Wenyuan Dai, Qiang Yang, Guirong Xue, and Yong Yu. Boosting for transfer learning. In 22rd AAAI Conference on Artificial Intelligence, pages 193-200, Vancouver, British Columbia, Canada, July 2007.
11. Charles Sutton and Andrew McCallum. Composition of conditional random fields for transfer learning. In Proceedings of HLT/EMNLP, pages 748-754, Vancouver, British Columbia, Canada, October 2005. Association for Computational Linguistics.
12. R. Caruana. Multitask learning. Machine Learning, 28:41-75, 1997. (Pubitemid 127507169)
13. S. Z. Li. Markov random field models in computer vision. In ECCV '94: Proceedings of the third European conference on Computer Vision (Vol. II), pages 361-370, Secaucus, NJ, USA, 1994. Springer-Verlag New York, Inc.
14. Julian Besag. Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society. Series B (Methodological), 36(2):192-236, 1974.
15. Dimitri P. Bertsekas. Nonlinear Programming. Athena Scientific, September 1999.
16. Judea Pearl. Probabilistic Reasoning in Intelligent Systems:Networks of Plausible Inference. Morgan Kaufmann, 1988.
17. Ben Tasker, Abbeel Pieter, and Daphne Koller. Discriminative probabilistic models for relational data. In Proceedings of the 18th Annual Conference on Uncertainty in Artificial Intelligence (UAI-02), pages 485-49. Morgan Kaufmann, 2002.
18. Fuchun Peng and Andrew Mccallum. Information extraction from research papers using conditional random fields. Information Processing & Management, 42(4):963-979, July 2006. (Pubitemid 41828296)
19. Burr Settles. Abner: an open source tool for automatically tagging genes, proteins, and other entity names in text. Bioinformatics, April 2005.
20. F. Sha and F. Pereira. Shallow parsing with conditional random fields, 2003.
21. Kengo Sato and Yasubumi Sakakibara. RNA secondary structural alignment with conditional random fields. Bioinformatics, 21(Suppl. 2):ii237-ii242, 2005. (Pubitemid 41535455)
22. Yan Liu, Jaime Carbonell, Peter Weigele, and Vanathi Gopalakrishnan. Segmentation conditional random fields (scrfs): A new approach for protein fold recognition.
23. Xuming He, R. S. Zemel, and M. A. Carreira-Perpinan. Multiscale conditional random fields for image labeling. volume 2, pages II-695-II-702 Vol.2, 2004.
24. S. Kumar and M. Hebert. Discriminative fields for modeling spatial dependencies in natural images, 2003.
25. Ariadna Quattoni, Michael Collins, and Trevor Darrell. Conditional random fields for object recognition. In Lawrence K. Saul, Yair Weiss, and Leon Bottou, editors, Advances in Neural Information Processing Systems 17, pages 1097-1104, Cambridge, MA, 2005. MIT Press.
26. Sy B. Wang, Ariadna Quattoni, Louis P. Morency, and David Demirdjian. Hidden conditional random fields for gesture recognition. In CVPR, pages 1521-1527, Washington, DC, USA, 2006. IEEE Computer Society. (Pubitemid 44931500)
27. John Lafferty, Xiaojin Zhu, and Yan Liu. Kernel conditional random fields: representation and clique selection. In ICML, 2004.
28. Andrew Arnold, Ramesh Nallapati, and William W. Cohen. Exploiting feature hierarchy for transfer learning in named entity recognition. In In ACL:HLT 08, 2008.
29. A. Blum and T. Mitchell. Combining labeled and unlabeled data with co-training. In Proceedings of the 11th Annual Conference on Computational Learning Theory, pages 92-100, Madison, WI, 1998.
30. Dengyong Zhou, Jiayuan Huang, and Bernhard Schölkopf. Learning from labeled and unlabeled data on a directed graph. In ICML '05: Proceedings of the 22nd international conference on Machine learning, pages 1036-1043, New York, NY, USA, 2005. ACM.
31. Yves Grandvalet and Yoshua Bengio. Semi-supervised learning by entropy minimization. In Lawrence K. Saul, Yair Weiss, and Léon Bottou, editors, Advances in Neural Information Processing Systems 17, pages 529-536, Cambridge, MA, 2005. MIT Press.
32. Feng Jiao, Shaojun Wang, Chi-Hoon Lee, Russell Greiner, and Dale Schuurmans. Semi-supervised conditional random fields for improved sequence segmentation and labeling. In ACL '06: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL, pages 209-216, Morristown, NJ, USA, 2006. Association for Computational Linguistics.
33. Kai Yu, Wei Xu, and Yihong Gong. Deep learning with kernel regularization for visual recognition. In Daphne Koller, Dale Schuurmans, Yoshua Bengio, Léon Bottou, Daphne Koller, Dale Schuurmans, Yoshua Bengio, and Léon Bottou, editors, NIPS, pages 1889-1896. MIT Press, 2008.
34. J. Weston, F. Ratle, and R. Collobert. Deep learning via semi-supervised embedding. In Andrew Mccallum and Sam Roweis, editors, ICML, pages 1168-1175. Omnipress, 2008.
35. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. J. Lang. Phoneme recognition using time-delay neural networks. IEEE Transactions on Acoustics, Speech and Signal Processing, 37(3):328-339, August 1989. (Pubitemid 19065785)
36. Hossein Mobahi, Ronan Collobert, and Jason Weston. Deep learning from temporal coherence in video. In ICML, pages 737-744, June 2009.