Visual Object Tracking Performance Measures Revisited

IEEE Transactions on Image Processing

Volumn 25, Issue 3, 2016, Pages 1261-1274

  Čehovin, Luka ^a   Leonardis, Aleš ^a,b   Kristan, Matej ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

Author keywords

experimental evaluation; performance evaluation; performance measures; visual object tracking

Indexed keywords

IMAGE PROCESSING; MATHEMATICAL MODELS;

EVALUATION METHODOLOGIES; EXPERIMENTAL EVALUATION; PERFORMANCE EVALUATION; PERFORMANCE MEASURE; TRACKER PERFORMANCE; VISUAL OBJECT TRACKING; VISUAL TRACKING;

TRACKING (POSITION);

EID: 84962781218     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2520370     Document Type: Article

References (53)

1. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The Pascal visual object classes (VOC) challenge, " Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, Sep. 2009.
2. S. Baker, D. Scharstein, J. P. Lewis, S. Roth, M. J. Black, and R. Szeliski, "A database and evaluation methodology for optical flow, " Int. J. Comput. Vis., vol. 92, no. 1, pp. 1-31, Nov. 2010.
3. S. Alpert, M. Galun, R. Basri, and A. Brandt, "Image segmentation by probabilistic bottom-up aggregation and cue integration, " in Proc. IEEE CVPR, Jun. 2007, pp. 1-8.
4. Q. Wang, F. Chen, W. Xu, and M.-H. Yang, "An experimental comparison of online object-tracking algorithms, " Proc. SPIE, vol. 8138, pp. 81381A-1-81381A-11, Sep. 2011.
5. Y. Wu, J. Lim, and M.-H. Yang, "Online object tracking: A benchmark, " in Proc. CVPR, 2013, pp. 2411-2418.
6. T. Nawaz and A. Cavallaro, "A protocol for evaluating video trackers under real-world conditions, " IEEE Trans. Image Process., vol. 22, no. 4, pp. 1354-1361, Apr. 2013.
7. A. W. M. Smeulders, D. M. Chu, R. Cucchiara, S. Calderara, A. Dehghan, and M. Shah, "Visual tracking: An experimental survey, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 7, pp. 1442-1468, Jul. 2014.
8. Z. Kalal, J. Matas, and K. Mikolajczyk, "P-N learning: Bootstrapping binary classifiers by structural constraints, " in Proc. CVPR, San Francisco, CA, USA, Jun. 2010, pp. 49-56.
9. C. Ma, X. Yang, C. Zhang, and M.-H. Yang, "Long-term correlation tracking, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 5388-5396.
10. Z. Hong, Z. Chen, C. Wang, X. Mei, D. Prokhorov, and D. Tao, "MUltistore tracker (MUSTer): A cognitive psychology inspired approach to object tracking, " in Proc. CVPR, Jun. 2015, pp. 749-758.
11. R. Kasturi et al., "Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 313-336, Feb. 2009.
12. P. Carvalho, J. S. Cardoso, and L. Corte-Real, "Filling the gap in quality assessment of video object tracking, " Image Vis. Comput., vol. 30, no. 9, pp. 630-640, Sep. 2012.
13. M. Kristan et al., "The visual object tracking VOT2013 challenge results, " in Proc. ICCVW, 2013, pp. 98-111.
14. M. Kristan et al., "The visual object tracking VOT2014 challenge results, " in Proc. ECCV, 2014, pp. 191-217.
15. K. Smith, D. Gatica-Perez, J. Odobez, and S. Ba, "Evaluating multiobject tracking, " in Proc. CVPRW, vol. 3. Jun. 2005, p. 36.
16. J. Black, T. Ellis, and P. Rosin, "A novel method for video tracking performance evaluation, " in Proc. VS-PETS, 2003, pp. 125-132.
17. L. M. Brown et al., "Performance evaluation of surveillance systems under varying conditions, " in Proc. PETS, 2005, pp. 1-8.
18. K. K. Edward, P. D. Matthew, and B. H. Michael, "An information theoretic approach for tracker performance evaluation, " in Proc. CVPR, Sep. 2009, pp. 1523-1529.
19. V. Manohar, P. Soundararajan, H. Raju, D. Goldgof, R. Kasturi, and J. Garofolo, "Performance evaluation of object detection and tracking in video, " in Proc. ACCV, vol. 3852. Jan. 2006, pp. 151-161.
20. F. Bashir and F. Porikli, "Performance evaluation of object detection and tracking systems, " in Proc. PETS, 2006, pp. 7-14.
21. I. Leichter and E. Krupka, "Monotonicity and error type differentiability in performance measures for target detection and tracking in video, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 10, pp. 2553-2560, Oct. 2013.
22. C. Jaynes, S. Webb, R. Steele, and Q. Xiong, "An open development environment for evaluation of video surveillance systems, " in Proc. PETS, 2002, pp. 32-39.
23. Z. Khan, T. Balch, and F. Dellaert, "MCMC-based particle filtering for tracking a variable number of interacting targets, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 11, pp. 1805-1819, Nov. 2005.
24. M. Kristan, J. Perš, M. Perše, and S. Kova?ci?c, "Closed-world tracking of multiple interacting targets for indoor-sports applications, " Comput. Vis. Image Understand., vol. 113, no. 5, pp. 598-611, May 2009.
25. H. Wu, A. C. Sankaranarayanan, and R. Chellappa, "Online empirical evaluation of tracking algorithms, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 8, pp. 1443-1458, Aug. 2010.
26. J. C. SanMiguel, A. Cavallaro, and J. M. Martínez, "Adaptive online performance evaluation of video trackers, " IEEE Trans. Image Process., vol. 21, no. 5, pp. 2812-2823, May 2012.
27. Y. Pang and H. Ling, "Finding the best from the second bests-Inhibiting subjective bias in evaluation of visual tracking algorithms, " in Proc. ICCV, 2013, pp. 2784-2791.
28. L. ? Cehovin, M. Kristan, and A. Leonardis, "Is my new tracker really better than yours?" in Proc. WACV, 2014, pp. 540-547.
29. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking, " Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 125-141, May 2008.
30. B. Babenko, M.-H. Yang, and S. Belongie, "Robust object tracking with online multiple instance learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1619-1632, Aug. 2011.
31. A. Adam, E. Rivlin, and I. Shimshoni, "Robust fragments-based tracking using the integral histogram, " in Proc. IEEE Comput. Soc. CVPR, vol. 1. Jun. 2006, pp. 798-805.
32. J. Kwon and K. M. Lee, "Visual tracking decomposition, " in Proc. CVPR, Jun. 2010, pp. 1269-1276.
33. D. Wang, H. Lu, and M.-H. Yang, "Online object tracking with sparse prototypes, " IEEE Trans. Image Process., vol. 22, no. 1, pp. 314-325, Jan. 2013.
34. F. Yang, H. Lu, and M.-H. Yang, "Robust superpixel tracking, " IEEE Trans. Image Process., vol. 23, no. 4, pp. 1639-1651, Apr. 2014.
35. C. Bao, Y. Wu, H. Ling, and H. Ji, "Real time robust L1 tracker using accelerated proximal gradient approach, " in Proc. CVPR, Jun. 2012, pp. 1830-1837.
36. K. Zhang, L. Zhang, and M.-H. Yang, "Real-time compressive tracking, " in Proc. ECCV, 2012, pp. 864-877.
37. M. Godec, P. M. Roth, and H. Bischof, "Hough-based tracking of nonrigid objects, " in Proc. ICCV, Nov. 2011, pp. 81-88.
38. J. Kwon and K. M. Lee, "Tracking of a non-rigid object via patch-based dynamic appearance modeling and adaptive Basin Hopping Monte Carlo sampling, " in Proc. CVPR, 2009, pp. 1208-1215.
39. M. Kristan, S. Kova?ci?c, A. Leonardis, and J. Perš, "A two-stage dynamic model for visual tracking, " IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 6, pp. 1505-1520, Dec. 2010.
40. L. C? ehovin, M. Kristan, and A. Leonardis, "An adaptive coupled-layer visual model for robust visual tracking, " in Proc. ICCV, Barcelona, Spain, 2011, pp. 1363-1370.
41. L. ? Cehovin, M. Kristan, and A. Leonardis, "Robust visual tracking using an adaptive coupled-layer visual model, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 4, pp. 941-953, Apr. 2013.
42. C. E. Shannon and W. Weaver, The Mathematical Theory of Communication. Urbana, IL, USA: Univ. of Illinois Press, Jan. 1949.
43. T. Fawcett, "An introduction to ROC analysis, " Pattern Recognit. Lett., vol. 27, no. 8, pp. 861-874, Jun. 2006.
44. P. Pérez, C. Hue, J. Vermaak, and M. Gangnet, "Color-based probabilistic tracking, " in Proc. ECCV, vol. 1. 2002, pp. 661-675.
45. H. Grabner, M. Grabner, and H. Bischof, "Real-time tracking via on-line boosting, " in Proc. BMVC, 2006, pp. 47-56.
46. M. Kölsch and M. Turk, "Fast 2D hand tracking with flocks of features and multi-cue integration, " in Proc. CVPRW, vol. 10. Washington, DC, USA, 2004, p. 158.
47. S. M. S. Nejhum, J. Ho, and M.-H. Yang, "Online visual tracking with histograms and articulating blocks, " Comput. Vis. Image Understand., vol. 114, no. 8, pp. 901-914, Aug. 2010.
48. S. Hare, A. Saffari, and P. H. S. Torr, "Struck: Structured output tracking with kernels, " in Proc. ICCV, Nov. 2011, pp. 263-270.
49. J. F. Henriques, R. Caseiro, P. Martins, and J. Batista, "High-speed tracking with kernelized correlation filters, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 3, pp. 583-596, Mar. 2014.
50. K. Zhang, L. Zhang, Q. Liu, D. Zhang, and M.-H. Yang, "Fast visual tracking via dense spatio-temporal context learning, " in Proc. ECCV, vol. 8693, 2014, pp. 127-141.
51. B. J. Frey and D. Dueck, "Clustering by passing messages between data points, " Science, vol. 315, no. 5814, pp. 972-976, 2007.
52. L. ? Cehovin, "TraX: Visual tracking exchange protocol, " Tech. Rep., Apr. 2014. [Online]. Available: http: //prints. vicos. si/publications/311/
53. B. Stenger, T. Woodley, and R. Cipolla, "Learning to track with multiple observers, " in Proc. CVPR, Jun. 2009, pp. 2647-2654.