A boosted co-training algorithm for human action recognition

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 9, 2011, Pages 1203-1213

  Liu, Chang ^a   Yuen, Pong C ^a  

^a HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

Author keywords

Co training; human action recognition; semi supervised learning

Indexed keywords

CO-TRAINING; CO-TRAINING ALGORITHM; CONFIDENCE MEASURE; DATA INCONSISTENCIES; HUMAN ACTIONS; HUMAN-ACTION RECOGNITION; LABELED DATA; MUTUAL INFORMATIONS; RECOGNITION ACCURACY; SALIENCY FEATURES; SEMI-SUPERVISED LEARNING; UNLABELED DATA;

GESTURE RECOGNITION; LEARNING ALGORITHMS; SUPERVISED LEARNING;

MOTION ESTIMATION;

EID: 80051619455     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2130270     Document Type: Article

References (37)

1. W. Hu, T. Tan, L. Wang, and S. Maybank, "A survey on visual surveillance of object motion and behaviors," IEEE Trans. Syst., Man, Cybern., Part C: Applicat. Rev., vol. 34, no. 3, pp. 334-352, Aug. 2004.
2. T. B. Moeslund, A. Hilton, and V. Kruger, "A survey of advances in vision based human motion capture and analysis," Comput. Vision Image Understand., vol. 104, no. 2, pp. 90-126, 2006. (Pubitemid 44573873)
3. R. Poppe, "Vision-based human motion analysis: An overview," Comput. Vision Image Understand., vol. 108, no. 2, pp. 4-18, 2007. (Pubitemid 47333391)
4. P. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea, "Machine recognition of human activities: A survey," IEEE Trans. Circuits Syst. Video Technology, vol. 18, no. 11, pp. 1473-1488, Nov. 2008.
5. T. Xiang and S. Gong, "Beyond tracking: Modeling activity and understanding behavior," Int. J. Comput. Vision, vol. 67, no. 1, pp. 21-51, 2006.
6. J. C. Niebles and F.-F. Li, "A hierarchical model of shape and appearance for human action classification," in Proc. IEEE Int. Conf. Comput. Vision Patt. Recog., Jun. 2007, pp. 1-8.
7. X. Zhu, "Semi-supervised learning literature survey," Dept. Comput. Sci., Univ. Wisconsin-Madison, Madison, Tech. Rep. 1530, 2008.
8. Y. Bengio, O. Dellalleau, and N. L. Roux, "Label propagation and quadratic criterion," in Semi-Supervised Learning, O. Chapelle, B. Schlkopf, and A. Zien, Eds. Cambridge, MA: MIT Press, 2006, pp. 193-216.
9. A. Blum and S. Chawla, "Learning from labeled and unlabeled data using graph mincuts," in Proc. Int. Conf. Mach. Learn., 2001, pp. 19-26.
10. T. Joachims, "Transductive learning via spectral graph partitioning," in Proc. Int. Conf. Mach. Learn., 2003, pp. 290-297.
11. L. Xu and D. Schuurmans, "Unsupervised and semi-supervised multi-class support vector machines," in Proc. Nat. Conf. Artif. Intell., 2005, pp. 904-910. (Pubitemid 43006723)
12. G. Fung and O. L. Mangasarian, "Semi-supervised support vector machines for unlabeled data classification," Optimiz. Methods Software, vol. 15, no. 1, pp. 29-44, 2001. (Pubitemid 33817502)
13. N. D. Lawrence and M. I. Jordan, "Semi-supervised learning via Gaussian processes," in Proc. Adv. Neural Inform. Process. Syst., 2005, pp. 753-760.
14. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. Annu. Conf. Computat. Learn. Theory, 1998, pp. 92-100.
15. S. Dasgupta, M. L. Littman, and D. Mcallester, "PAC generalization bounds for co-training," in Proc. Adv. Neural Inform. Process. Syst., 2002, pp. 375-382.
16. M.-F. Balcan, A. Blum, and K. Yang, "Co-training and expansion: Towards bridging theory and practice," in Proc. Adv. Neural Inform. Process. Syst., 2005, pp. 89-96.
17. S. Yu, B. Krishnapuram, R. Rosales, H. Steck, and R. B. Rao, "Bayesian co-training," in Proc. Adv. Neural Inform. Process. Syst., 2008, pp. 1665-1672.
18. C. M. Christhoudias, R. Urtasun, A. Kapoor, and T. Darrell, "Co-training with noisy perceptual observations," in Proc. IEEE Int. Conf. Comput. Vision Patt. Recog., Jun. 2009, pp. 2844-2851.
19. E. Shechtman and M. Irani, "Space-time behavior based correlation," IEEE Trans. Patt. Anal. Mach. Intell., vol. 29, no. 11, pp. 2045-2056, Nov. 2007.
20. A. Yilmaz and M. Shah, "Actions sketch: A novel action representation," in Proc. IEEE Int. Conf. Comput. Vision Patt. Recog., Jun. 2005, pp. 984-989. (Pubitemid 43897299)
21. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri, "Actions as space-time shapes," IEEE Trans. Patt. Anal. Mach. Intell., vol. 29, no. 12, pp. 2247-2053, Dec. 2007.
22. J. Liu, S. Ali, and M. Shah, "Recognizing human actions using multiple features," in Proc. IEEE Int. Conf. Comput. Vision Patt. Recog., Jun. 2008, pp. 1-8.
23. A. Basharat, Y. Zhai, and M. Shah, "Content based video matching using spatiotemporal volumes," Comput. Vision Image Understand., vol. 110, no. 3, pp. 360-377, 2008.
24. I. Laptev, "On space-time interest points," Int. J. Comput. Vision, vol. 64, nos. 2-3, pp. 107-123, 2005. (Pubitemid 41314645)
25. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior recognition via sparse spatio-temporal features," in Proc. IEEE Int. Workshop Vis. Surveillance Performance Eval. Track. Surveillance, Oct. 2005, pp. 65-72. (Pubitemid 46178025)
26. A. Oikonomopoulos, I. Patras, and M. Pantic, "Spatiotemporal salient points for visual recognition of human actions," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 36, no. 3, pp. 710-719, Jun. 2006. (Pubitemid 43811326)
27. S.-F. Wong and R. Cipolla, "Extracting spatiotemporal interest points using global information," in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2007, pp. 1-8.
28. J. C. Niebles, H. Wang, and L. Fei-Fei, "Unsupervised learning of human action categories using spatial-temporal words," Int. J. Comput. Vision, vol. 79, no. 3, pp. 299-318, 2008.
29. S. Yang, L. Goncalves, and P. Perona, "Unsupervised learning of human motion," IEEE Trans. Patt. Anal. Mach. Intell., vol. 25, no. 7, pp. 814-827, Jul. 2003.
30. Y. Wang, H. Jiang, M. S. Drew, Z.-N. Li, and G. Mori, "Unsupervised discovery of action classes," in Proc. IEEE Int. Conf. Comput. Vision Patt. Recog., Oct. 2006, pp. 1654-1661. (Pubitemid 44931517)
31. D. Guan, W. Yuan, Y.-K. Lee, A. Gavrilov, and S. Lee, "Activity recognition based on semi-supervised learning," in Proc. Int. Conf. Embedded Real-Time Comput. Syst. Applicat., 2007, pp. 469-475.
32. S. Gupta, J. Kim, K. Grauman, and R. Mooney, "Watch, listen and learn: Co-training on captioned images and videos," in Proc. Eur. Conf. Mach. Learn. Principles Practice Knowledge Discovery Databases, 2008, pp. 457-472.
33. C. M. Christoudias, R. Urtasun, and T. Darrell, "Multi-view learning in the presence of view disagreement," in Proc. Conf. Uncertainty Artif. Intell., 2008, pp. 375-382.
34. C. Liu, P. C. Yuen, and G. Qiu, "Object motion detection using information theoretic spatio-temporal saliency," Patt. Recog., vol. 42, no. 11, pp. 2897-2906, 2009.
35. P. K. Mallapragada, R. Jin, A. K. Jain, and Y. Liu, "Semiboost: Boosting for semi-supervised learning," IEEE Trans. Patt. Anal. Mach. Intell., vol. 31, no. 11, pp. 2000-2014, Nov. 2009.
36. C. Liu and P. C. Yuen, "Human action recognition using boosted eigenactions," Image Vision Comput., vol. 28, no. 5, pp. 825-835, 2010.
37. C. Schuldt, I. Laptev, and B. Caputo, "Recognizing human actions: A local SVM approach," in Proc. Int. Conf. Patt. Recog., 2004, pp. 32-36