Adaptive appearance modeling for video tracking: Survey and evaluation

IEEE Transactions on Image Processing

Volumn 21, Issue 10, 2012, Pages 4334-4348

  Salti, Samuele ^a,b   Cavallaro, Andrea ^a   Di Stefano, Luigi ^b  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b UNIVERSITY OF BOLOGNA   (Italy)

Author keywords

Adaptive appearance models; tracking evaluation methodology; video tracking

Indexed keywords

ADAPTIVE APPEARANCE MODELS; APPEARANCE MODELING; APPEARANCE MODELS; CONCEPTUAL FRAMEWORKS; EVALUATION METHODOLOGIES; EXPERIMENTAL ANALYSIS; EXPERIMENTAL COMPARISON; INTERNAL REPRESENTATION; REAL-WORLD SCENARIO; RESEARCH CHALLENGES; SIMULTANEOUS ANALYSIS; TRACKING ACCURACY; TRACKING EVALUATION; VIDEO TRACKING;

IMAGE PROCESSING; MATHEMATICAL MODELS;

VIDEO RECORDING;

EID: 84866615156     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2206035     Document Type: Review

References (48)

1. E. Maggio and A. Cavallaro, Video Tracking: Theory and Practice. New York: Wiley, 2011.
2. M. Isard and A. Blake, "CONDENSATION: Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, 1998. (Pubitemid 128523364)
3. M. Isard and J. MacCormick, "BraMBLe: A Bayesian multiple-blob tracker," in Proc. Int. Conf. Comput. Vis., vol. 2. Vancouver, BC, Canada, Jul. 2001, pp. 34-41. (Pubitemid 32795038)
4. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-575, May 2003.
5. P. Pérez, C. Hue, J. Vermaak, and M. Gangnet, "Color-based probabilistic tracking," in Proc. Eur. Conf. Comput. Vis., Copenhagen, Denmark, 2002, pp. 661-675.
6. R. T. Collins, A. J. Lipton, and T. Kanade, "A system for video surveillance and monitoring," Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-00-12, 1999.
7. I. Haritaoglu, D. Harwood, and L. S. Davis, "W4: Real-time surveillance of people and their activities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 809-830, Aug. 2000.
8. A. D. Jepson, D. J. Fleet, and T. F. El-Maraghi, "Robust online appearance models for visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1296-1311, Oct. 2003.
9. I. Matthews, T. Ishikawa, and S. Baker, "The template update problem," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 6, pp. 810-815, Jun. 2004.
10. R. T. Collins, Y. Liu, and M. Leordeanu, "Online selection of discriminative tracking features," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1631-1643, Oct. 2005. (Pubitemid 41555407)
11. S. Avidan, "Ensemble tracking," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2. San Diego, CA, 2005, pp. 494-501.
12. F. Tang, S. Brennan, Q. Zhao, and H. Tao, "Co-tracking using semisupervised support vector machines," in Proc. Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, 2007, pp. 1-8.
13. H. Grabner and H. Bischof, "On-line boosting and vision," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. 2006, pp. 260-267. (Pubitemid 44931339)
14. B. Babenko, M.-H. Yang, and S. Belongie, "Robust object tracking with online multiple instance learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1619-1632, Aug. 2011.
15. Z. Kalal, J. Matas, and K. Mikolajczyk, "Online learning of robust object detectors during unstable tracking," in Proc. Int. Conf. Comput. Vis. Workshop On-Line Learn. Comput. Vis., Kyoto, Japan, 2009, pp. 1417-1424.
16. S. Hare, A. Saffari, and P. Torr, "STRUCK: Structured output tracking with kernels," in Proc. Int. Conf. Comput. Vis., Barcelona, Spain, 2011, pp. 263-270.
17. S. Grossberg, Competitive Learning: From Interactive Activation to Adaptive Resonance. Norwood, NJ: Ablex Publishing, 1988, pp. 243-283.
18. H. Grabner, C. Leistner, and H. Bischof, "Semi-supervised on-line boosting for robust tracking," in Proc. Eur. Conf. Comput. Vis., Marseille, France, 2008, pp. 234-247.
19. A. Adam, E. Rivlin, and I. Shimshoni, "Robust fragments-based tracking using the integral histogram," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. 2006, pp. 798-805. (Pubitemid 44931406)
20. L. Lu and G. D. Hager, "A nonparametric treatment for location/ segmentation based visual tracking," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Minneapolis, MN, 2007, pp. 1-8.
21. J. Kwon and K. M. Lee, "Visual tracking decomposition," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, 2010, pp. 1269-1276.
22. J. Kwon and K. M. Lee, "Tracking of a non-rigid object via patch-based dynamic appearance modeling and adaptive Basin hopping Monte Carlo sampling," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Miami, FL, 2009, pp. 1208-1215.
23. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking," Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 125-141, 2008. (Pubitemid 351294740)
24. E. E. Zelniker, T. M. Hospedales, S. Gong, and T. Xiang, "A unified approach for adaptive multiple feature tracking for surveillance applications," in Proc. British Mach. Vis. Conf., London, U.K., 2009, pp. 1-11.
25. J. Fan, X. Shen, and Y. Wu, "Closed-loop adaptation for robust tracking," in Proc. 11th Eur. Conf. Comput. Vis., Hersonissos, Greece, 2010, pp. 411-424.
26. A. Yilmaz, O. Javed, and M. Shah, "Object tracking: A survey," ACM Comput. Surveys, vol. 38, no. 4, pp. 1-45, Dec. 2006.
27. K.-C. Lee and D. Kriegman, "Online learning of probabilistic appearance manifolds for video-based recognition and tracking," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 1. San Diego, CA, 2005, pp. 852-859. (Pubitemid 43897282)
28. S. K. Zhou, R. Chellappa, and B. Moghaddam, "Visual tracking and recognition using appearance-adaptive models in particle filters," IEEE Trans. Image Process., vol. 13, no. 11, pp. 1491-1506, Nov. 2004.
29. S. Stalder, H. Grabner, and L. van Gool, "Beyond semi-supervised tracking: Tracking should be as simple as detection, but not simpler than recognition," in Proc. Int. Conf. Comput. Vis., Workshop On-Line Learn. Comput. Vis., Kyoto, Japan, 2009, pp.1409-1416.
30. M. Yang, Z. Fan, J. Fan, and Y. Wu, "Tracking nonstationary visual appearances by data-driven adaptation," IEEE Trans. Image Process., vol. 18, no. 7, pp. 1633-1644, Jul. 2009.
31. X. Song, J. Cui, H. Zha, and H. Zhao, "Vision-based multiple interacting targets tracking via on-line supervised learning," in Proc. Eur. Conf. Comput. Vis., Marseille, France, 2008, pp. 642-655.
32. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. 11th Annu. Conf. Comput. Learn. Theory, Madison, WI, 1998, pp. 92-100.
33. Q. Yu, T. B. Dinh, and G. Medioni, "Online tracking and reacquisition using co-trained generative and discriminative trackers," in Proc. 10th Eur. Conf. Comput. Vis., Marseille, France, 2008, pp. 678-691.
34. M. Yang, L. Fengjun, X. Wei, and G. Yihong, "Detection driven adaptive multi-cue integration for multiple human tracking," in Proc. Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 1554-1561.
35. B. Han and L. Davis, "On-line density-based appearance modeling for object tracking," in Proc. Int. Conf. Comput. Vis., Beijing, China, 2005, pp. 1492-1499. (Pubitemid 44042354)
36. J. Santner, C. Leistner, A. Saffari, T. Pock, and H. Bischof, "PROST: Parallel robust online simple tracking," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., San Francisco, CA, 2010, pp. 1-8.
37. W. T. Freeman and E. H. Adelson, "The design and use of steerable filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, no. 9, pp. 891-906, Sep. 1991.
38. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 871-987, Jul. 2002.
39. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., San Diego, CA, 2005, pp. 886-893. (Pubitemid 43897286)
40. B. Leibe, A. Leonardis, and B. Schiele, "Robust object detection with interleaved categorization and segmentation," Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 259-289, May 2008.
41. M. D. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L. van Gool, "Robust tracking-by-detection using a detector confidence particle filter," in Proc. Int. Conf. Comput. Vis., Kyoto, Japan, 2009, pp. 1515-1522.
42. A. Bordes, L. Bottou, P. Gallinari, and J. Weston, "Solving multiclass support vector machines with LaRank," in Proc. Int. Conf. Mach. Learn., Corvallis, OR, 2007, pp. 1-8.
43. P. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, pp. 137-154, May 2004.
44. N. C. Oza, "Online ensemble learning," Ph.D. dissertation, Dept. Comput. Sci., Univ. California, Berkeley, Sep. 2001.
45. B. Stenger, T. Woodley, and R. Cipolla, "Learning to track with multiple observers," in Proc. Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Miami, FL, 2009, pp. 2647-2654.
46. A. Nghiem, F. Bremond, M. Thonnat, and V. Valentin, "Etiseo, performance evaluation for video surveillance systems," in Proc. IEEE Conf. Adv. Video Signal Based Surveill., London, U.K., Sep. 2007, pp. 476-481.
47. T. D'Orazio, M. Leo, N. Mosca, P. Spagnolo, and P. L. Mazzeo, "A semiautomatic system for ground truth generation of soccer video sequences," in Proc. IEEE Conf. Adv. Video Signal Based Surveill., Genova, Italy, Sep. 2009, pp. 559-564.
48. J. SanMiguel, A. Cavallaro, and J. Martinez, "Adaptive online performance evaluation of video trackers," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2812-2823, May 2012.