Unsupervised random forest manifold alignment for lipreading

Proceedings of the IEEE International Conference on Computer Vision

Volumn , Issue , 2013, Pages 129-136

  Pei, Yuru ^a   Kim, Tae Kyun ^b   Zha, Hongbin ^a  

^a PEKING UNIVERSITY   (China)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Lipreading; Manifold Alignment; RFMA; Unsupervised Random Forest

Indexed keywords

VIDEO CAMERAS;

GRAPH-BASED ALGORITHMS; HIERARCHICAL STRUCTURES; LIPREADING; MANIFOLD ALIGNMENTS; NODE-SPLITTING; RANDOM FORESTS; RFMA; VISUAL CHANNELS;

DECISION TREES;

EID: 84898802245     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2013.23     Document Type: Conference Paper

References (26)

1. M. Aharon and R. Kimmel. Representation analysis and synthesis of lip images using dimensionality reduction. IJCV, 67(3):297-312, 2006.
2. L. Breiman. Random forests. Machine learning, 45(1):5-32, 2001.
3. J. Chen, H.-r. Fang, and Y. Saad. Fast approximate k nn graph construction for high dimensional data via recursive lanczos bisection. The Journal of Machine Learning Research, 10:1989-2012, 2009.
4. T. Cootes, G. Edwards, and C. Taylor. Active appearance models. IEEE Trans. on PAMI, 23(6):681-685, 2001.
5. S. Cox, R. Harvey, Y. Lan, J. Newman, and B. Theobald. The challenge of multispeaker lip-reading. In International Conference on Auditory-Visual Speech Processing, pages 179-184, 2008.
6. A. Criminisi. Decision forests: A unified framework for classification, regression, density estimation, manifold learning and semi-supervised learning. Foundations and Trends R-in Computer Graphics and Vision, 7(2-3):81-227, 2011.
7. N. Dalal and B. Triggs. Histograms of oriented gradients for human detection. In CVPR, volume 1, pages 886-893, 2005.
8. W. Dong, C. Moses, and K. Li. Efficient k-nearest neighbor graph construction for generic similarity measures. In Proceedings of the 20th international conference on World wide web, pages 577-586. ACM, 2011.
9. J. Gall, A. Yao, N. Razavi, L. Van Gool, and V. Lempitsky. Hough forests for object detection, tracking, and action recognition. IEEE Trans. on PAMI, 33(11):2188-2202, 2011.
10. K. Gray, P. Aljabar, R. Heckemann, A. Hammers, and D. Rueckert. Random forest-based manifold learning for classification of imaging data in dementia. Machine Learning in Medical Imaging, pages 159-166, 2011.
11. J. Ham, D. Lee, and L. Saul. Semisupervised Alignment of Manifolds. In Proc. of the Tenth Int'l Workshop on Artificial Intelligence and Statistics, pages 120-127, 2005.
12. S. Lafon, Y. Keller, and R. Coifman. Data Fusion and Multicue Data Matching by Diffusion Maps. IEEE Trans. on PAMI, 28(11):1784-1797, 2006.
13. I. Matthews, T. F. Cootes, J. A. Bangham, S. Cox, and R. Harvey. Extraction of visual features for lipreading. IEEE Trans. on PAMI, 24(2):198-213, 2002.
14. F. Moosmann, B. Triggs, F. Jurie, et al. Fast discriminative visual codebooks using randomized clustering forests. In NIPS'06, pages 985-992, 2006.
15. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng. Multimodal deep learning. In ICML, pages 689-696, 2011.
16. T. Ojala, M. Pietik̈ainen, and D. Harwood. A comparative study of texture measures with classification based on featured distributions. Pattern recognition, 29(1):51-59, 1996.
17. Y. Pei, F. Huang, F. Shi, and H. Zha. Unsupervised image matching based on manifold alignment. IEEE Trans. on PAMI, 34(8):1658-1664, 2012.
18. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A. Senior. Recent advances in the automatic recognition of audiovisual speech. Proc. the IEEE, 91(9):1306-1326, 2003.
19. K. Saenko, K. Livescu, M. Siracusa, K.Wilson, J. Glass, and T. Darrell. Visual speech recognition with loosely synchronized feature streams. In ICCV, pages 1424-1431, 2005.
20. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, and A. Blake. Real-time human pose recognition in parts from single depth images. In IEEE Conf. on CVPR, volume 2, page 7, 2011.
21. R. Sim and N. Roy. Global a-optimal robot exploration in slam. In IEEE Conf. on ICRA, pages 661-666, 2005.
22. C. Wang and S. Mahadevan. Manifold Alignment without Correspondence. In Proc. Int'l Joint Conf. Artificial Intelligence (IJCAI), pages 1273-1278, 2009.
23. G. Yu, J. Yuan, and Z. Liu. Unsupervised random forest indexing for fast action search. In IEEE Conf. on CVPR, pages 865-872, 2011.
24. G. Zhao, M. Barnard, and M. Pietikainen. Lipreading with local spatiotemporal descriptors. IEEE Transactions on Multimedia, 11(7):1254-1265, 2009.
25. Z. Zhou, G. Zhao, and M. Pietikainen. Lipreading: a graph embedding approach. In ICPR, pages 523-526, 2010.
26. Z. Zhou, G. Zhao, and M. Pietikainen. Towards a practical lipreading system. In IEEE Conf. on CVPR, pages 137-144, 2011.