Robust multi-speaker tracking via dictionary learning and identity modeling

IEEE Transactions on Multimedia

Volumn 16, Issue 3, 2014, Pages 864-880

  Barnard, Mark ^a   Koniusz, Peter ^b   Wang, Wenwu ^a   Kittler, Josef ^a   Naqvi, Syed Mohsen ^c   Chambers, Jonathon ^c  

^a UNIVERSITY OF SURREY   (United Kingdom)

^b LEAR Group INRIA   (France)

^c LOUGHBOROUGH UNIVERSITY   (United Kingdom)

Author keywords

Dictionary Learning; Particle Filters; Visual Tracking

Indexed keywords

ALGORITHMS; CAMERAS; COMPUTATIONAL EFFICIENCY; DIRECTION OF ARRIVAL; GRAPHIC METHODS; MONTE CARLO METHODS; SIGNAL FILTERING AND PREDICTION; SUPPORT VECTOR MACHINES; TRACKING (POSITION);

AUTOMATIC INITIALIZATION; COMPUTATIONALLY EFFICIENT; DICTIONARY LEARNING; LEARNED DICTIONARIES; MAXIMUM A POSTERIORI; PARTICLE FILTER; SPATIAL RELATIONSHIPS; VISUAL TRACKING;

STATISTICAL METHODS;

EID: 84896930380     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2301977     Document Type: Article

References (56)

1. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking, " Int. J. Comput. Vision, vol. 77, pp. 125-141, May 2008. (Pubitemid 351294740)
2. K. Nummiaro, E. Koller-Meier, and L. J. V. Gool, "An adaptive color-based particle filter, " Image Vision Comput., vol. 21, no. 1, pp. 99-110, 2003.
3. A. Adam, E. Rivlin, and I. Shimshoni, "Robust fragments-based tracking using the integral histogram, " in Proc. Conf. Computer Vision and Pattern Recognition, 2006, pp. 798-805. (Pubitemid 44931406)
4. D. Comaniciu, V. Ramesh, and P. Meer, "Real-time tracking of non-rigid objects using mean shift, " in Proc. Conf. Computer Vision and Pattern Recognition, 2000, pp. 142-149.
5. M. Ozuysal, V. Lepetit, F. Fleuret, and P. Fua, "Feature harvesting for tracking-by-detection., " in Proc. Eur. Conf. Computer Vision, 2006, pp. 592-605. (Pubitemid 44029708)
6. B. Liu, J. Huang, L. Yang, and C. A. Kulikowski, "Robust tracking using local sparse appearance model and k-selection, " in Proc. Conf. Computer Vision and Pattern Recognition, 2011, pp. 1313-1320.
7. B. Babenko, M.-H. Yang, and S. Belongie, "Visual tracking with online multiple instance learning, " in Proc. Conf. Computer Vision and Pattern Recognition, 2009, pp. 983-990.
8. J. Wang, X. Chen, and W. Gao, "Online selecting discriminative tracking features using particle filter, " in Proc. Conf. Computer Vision and Pattern Recognition, 2005, pp. 1037-1042.
9. J. Sivic and A. Zisserman, "Video Google: A text retrieval approach to object matching in videos, " in Proc. IEEE Int. Conf. Computer Vision, 2003, vol. 2, p. 1470.
10. M. A. Tahir, J. Kittler, K. Mikolajczyk, F. Yan, K. Sande, and T. Gevers, "Visual category recognition using spectral regression and kernel discriminant analysis, " in Proc. Subspace Workshop in Conjunction with Int. Conf. Computer Vision, 2009.
11. M. A. Tahir, F. Yan, M. Barnard, M. Awais, K. Mikolajczyk, and J. Kittler, "The University of Surrey visual concept detection system at imageclef 2010: Working notes, " in Proc. Int. Conf. Pattern Recogni tion, 2010.
12. P. Koniusz, F. Yan, and K. Mikolajczyk, "Comparison of mid-level feature coding approaches and pooling strategies in visual concept detection, " Comput. Vision Image Understand., vol. 117, no. 5, pp. 479-492, 2013.
13. J. Yang, K. Yu, Y. Gong, and T. S. Huang, "Linear spatial pyramid matching using sparse coding for image classification, " in Proc. Conf. Computer Vision and Pattern Recognition, 2009, pp. 1794-1801.
14. N. Cristianini and J. Shawe-Taylor, An introduction to Support Vector Machines. Cambridge, U.K.: Cambridge Univ. Press, Mar. 2000.
15. D. Gatica-Perez, G. Lathoud, J.-M. Odobez, and I. McCowan, "Audio-visual probabilistic tracking of multiple speakers in meetings, " IEEE Trans. Audio, Speech, Lang. Process., vol. 15, pp. 601-616, Feb. 2007.
16. K. Bernardin and R. Stiefelhagen, "Audio-visual multi-person tracking and identification for smart environments, " in Proc. ACM Multimedia, 2007, pp. 661-670.
17. T. Chang, S. Gong, and E. Ong, "Tracking multiple people under occlusion using multiple cameras, " in Proc. British Machine Vision Conf., 2000.
18. J. Czyz, B. Ristic, and B. M. Macq, "A particle filter for joint detection and tracking of color objects, " Image Vision Comput., vol. 25, no. 8, pp. 1271-1281, 2007. (Pubitemid 46779018)
19. Y. Li, H. Ai, T. Yamashita, S. Lao, and M. Kawade, "Tracking in low frame rate video: A cascade particle filter with discriminative observers of different life spans, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 10, pp. 1728-1740, 2008.
20. P. A. Viola and M. J. Jones, "Robust real-time face detection, " Int. J. Comput. Vision, vol. 57, no. 2, pp. 137-154, 2004.
21. J. L. Gauvain and C. Lee, "Maximum a posteriori estimation for multi-variate Gaussian mixture observations of Markov chains, " IEEE Trans. Speech Audio Process., vol. 2, pp. 291-298, 1994.
22. C. Wang and Z. Li, "A new face tracking algorithm based on local binary pattern and skin color information, " in Proc. Int. Symp. Computer Science and Computational Technology, 2008, pp. 657-660.
23. J. Ning, L. Zhang, D. Zhang, and C. Wu, "Robust object tracking using joint color-texture histogram, " Int. J. Pattern Recognit. Artif. Intell., vol. 23, no. 7, pp. 1245-1263, 2009.
24. J. Ye, Z. Liu, and J. Zhang, "A face tracking algorithm based on LBP histograms and particle filtering, " in Proc. Int. Conf. Natural Computation, 2010, pp. 3550-3553.
25. C. Shan, Y. Wei, T. Tan, and F. Ojardias, "Real time hand tracking by combining particle filtering and mean shift, " in Proc. IEEE Int. Conf. Automatic Face and Gesture Recognition, 2004, pp. 669-674.
26. H. Zhou, Y. Yuan, and C. Shi, "Object tracking using sift features and mean shift, " Comput. Vision Image Understand., vol. 113, no. 3, pp. 345-352, 2009.
27. Y. Tong, Y. Wang, Z. Zhu, and Q. Ji, "Robust facial feature tracking under varying face pose and facial expression, " Pattern Recognit., vol. 40, no. 11, pp. 3195-3208, Nov. 2007. (Pubitemid 46990444)
28. D. N. Zotkin, R. Duraiswami, and L. S. Davis, "Joint audio-visual tracking using particle filters, " EURASIP J. Appl. Signal Process., vol. 2002, no. 1, pp. 1154-1164, Jan. 2002.
29. Q. Cai and J. K. Aggarwal, "Tracking human motion using multiple cameras, " in Proc. Int. Conf. Pattern Recognition, 1996, vol. 3, pp. 68-72.
30. S. M. Naqvi, M. Yu, and J. A. Chambers, "A multimodal approach to blind source separation of moving sources, " IEEE J. Select. Topics Signal Process., pp. 895-910, 2010.
31. D. G. Lowe, "Distinctive image features from scale-invariant key-points, " Int. J. Comput. Vision, vol. 60, pp. 91-110, 2004.
32. K. Mikolajczyk and C. Schmid, "Comparison of affine-invariant local detectors and descriptors, " in Proc. Eur. Signal Processing Conf., 2004, pp. 1729-1732.
33. J. Bilmes, A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models, Int. Comput. Sci. Inst., Berkeley, CA, USA, 1998, Tech. Rep.
34. R. Duda and P. Hart, Pattern Classification and Scene Analysis. New York, NY, USA: Wiley, 1973.
35. J. C. van Gemert, C. J. Veenman, A. W. M. Smeulders, and J. M. Geuse-broek, "Visual word ambiguity, " IEEE Trans. Pattern Anal. Mach. In-tell., vol. 32, no. 7, pp. 1271-1283, 2010.
36. P. Koniusz and K. Mikolajczyk, "Soft assignment of visual words as linear coordinate coding and optimisation of its reconstruction error, " in Proc. Int. Conf. Image Processing, 2011, pp. 2413-2416.
37. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms, " in Proc. Conf. Neural Information Processing Systems, 2007, pp. 801-808.
38. J. Yang, K. Yu, Y. Gong, and T. S. Huang, "Linear spatial pyramid matching using sparse coding for image classification, " in Proc. Conf. Computer Vision and Pattern Recognition, 2009, pp. 1794-1801.
39. J. Wang, J. Yang, K. Yu, F. Lu, T. Huang, and Y. Gong, "Locality-constrained linear coding for image classification, " in Proc. Conf. Computer Vision and Pattern Recognition, 2010, pp. 3360-3367.
40. K. Yu, T. Zhang, and Y. Gong, "Nonlinear learning using local coordinate coding, " in Proc. Conf. Neural Information Processing Systems, 2009, pp. 2223-2231.
41. S. Gao, I. W. Tsang, L. Chia, and P. Zhao, "Local features are not lonely-Laplacian sparse coding for image classification, " in Proc. Conf. Computer Vision and Pattern Recognition, 2010, pp. 3555-3561.
42. X. Zhou, K. Yu, T. Zhang, and T. S. Huang, "Image classification using super-vector coding of local image descriptors, " in Proc. Eur. Conf. Computer Vision, 2010, pp. 141-154.
43. L. Lingqiao, L. Wang, and X. Liu, "In defence of soft-assignment coding, " in Proc. Int. Conf. Computer Vision, 2011, pp. 2486-2493.
44. T. Liu, A. W. Moore, A. Gray, and K. Yang, "An investigation of practical approximate nearest neighbor algorithms, " in Proc. Conf. Neural Information Processing Systems, 2004, pp. 825-832.
45. G. Lathoud and M. Magimai-Doss, "A sector-based, frequency domain approach to detection and localization of multiple speakers, " in Proc. Int. Conf. Acoustics, Speech and Signal Processing, 2005, vol. 3, pp. 265-268.
46. G. Lathoud, J. Bourgeois, and J. Freudenberger, "Sector-based detection for hands-free speech enhancement in cars, " EURASIP J. Appl. Signal Process., vol. 2006, pp. 169-184, 2006.
47. J. DiBiase, H. Silverman, and M. Brandstein, "Robust localization in reverberant rooms, " in Microphone Arrays: Signal Processing Techniques and Applications, M. Brandstein and D. B. Ward, Eds. New York, NY, USA: Springer Verlag, 2001.
48. A. Kong, J. S. Liu, and W. H. Wong, "Sequential imputations and Bayesian missing data problems, " J. Amer. Statist. Assoc., vol. 89, no. 425, 1994.
49. J. Mariéthoz and S. Bengio, "A comparative study of adaptation methods for speaker verification, " in Proc. Int. Conf. Spoken Language Processing, 2002, pp. 581-584.
50. G. Lathoud, J. M. Odobez, and D. Gatica-Perez, "AV16.3: an audiovisual corpus for speaker localization and tracking, " in Proc. Machine Learning for Multi-modal Interaction, 2004, pp. 182-195. (Pubitemid 41228887)
51. J. Berclaz, F. Fleuret, E. Turetken, and P. Fua, "Multiple object tracking using K-shortest paths optimization, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1806-1819, 2011.
52. "The spring 2006clear evaluation and workshop, " [Online]. Available: http://www.clearevaluation.org/.
53. N. T. Pham, W. Huang, and S. H. Ong, "Probability hypothesis density approach for multi-camera multi-object tracking, " in Proc. Asian Conf. Computer Vision, 2007, pp. 875-884.
54. M. Khan, J. Ahmed, A. Ali, and A. Masood, "Robust edge-enhanced fragment based normalized correlation tracking in cluttered and occluded imagery, " Int. J. Adv. Sci. Technol., vol. 12, pp. 25-34, 2009.
55. G. Bradski, "The OpenCV library, " Dr. Dobb's J. Softw. Tools, 2000.
56. H. Rowley, S. Baluja, and T. Kanade, "Neural network-based face detection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 1, pp. 23-38, 1998. (Pubitemid 128741305)