A protocol for evaluating video trackers under real-world conditions

IEEE Transactions on Image Processing

Volumn 22, Issue 4, 2013, Pages 1354-1361

  Nawaz, Tahir ^a   Cavallaro, Andrea ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Evaluation measure; performance evaluation; protocol; trials; video trackers

Indexed keywords

BACKGROUND CLUTTER; EVALUATION MEASURES; EVALUATION RESULTS; NEW RESULTS; PERFORMANCE ASSESSMENT; PERFORMANCE EVALUATION; PERFORMANCE EVALUATION FRAMEWORKS; REAL-WORLD; TEST SCENARIO; TRACKING ACCURACY; TRIALS; VIDEO TRACKERS;

MATHEMATICAL MODELS; NETWORK PROTOCOLS;

IMAGE PROCESSING;

ALGORITHM; ANALYSIS OF VARIANCE; ARTICLE; CAR; COMPUTER PROGRAM; FACTUAL DATABASE; HEAD; HISTOLOGY; HUMAN; IMAGE PROCESSING; METHODOLOGY; REPRODUCIBILITY; THEORETICAL MODEL; VIDEORECORDING;

ALGORITHMS; ANALYSIS OF VARIANCE; AUTOMOBILES; DATABASES, FACTUAL; HEAD; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MODELS, THEORETICAL; REPRODUCIBILITY OF RESULTS; SOFTWARE; VIDEO RECORDING;

MLCS; MLOWN;

EID: 84873688822     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2228497     Document Type: Article

References (29)

1. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense twoframe stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, no. 3, pp. 7-42, 2002. (Pubitemid 34428419)
2. S. Baker, D. Scharstein, J. Lewis, S. Roth, M. J. Black, and R. Szeliski, "A database and evaluation methodology for optical flow," Int. J. Comput. Vis., vol. 92, no. 1, pp. 1-31, Mar. 2011.
3. Objective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference. Int. Telecom. Union, (2011) [Online]. Available: http://www.itu.int/rec/T-REC-J.341-201101-I/ en
4. J. Black, T. Ellis, and P. Rosin, "A novel method for video tracking performance evaluation," in Proc. Int. Workshop Vis. Surveill.-Perf. Eval. Track. Surveil., 2003, pp. 125-132.
5. L. M. Brown, A. W. Senior, Y.-L. Tian, J. Connell, A. Hampapur, C. F. Shu, H. Merkl, and M. Lu, "Performance evaluation of surveillance systems under varying conditions," in Proc. IEEE Int. Workshop Vis. Surveill.-Perf. Eval. Track. Surveil., 2005, pp. 1-8.
6. F. Bashir and F. Porikli, "Performance evaluation of object detection and tracking systems," in Proc. IEEE Int. Work. Perform. Eval. Track. Surveill., Jun. 2006, pp. 7-14.
7. R. Kasturi, D. Goldgof, P. Soundararajan, V. Manohar, J. Garofolo, R. Bowers, M. Boonstra, V. Korzhova, and J. Zhang, "Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 319-336, Feb. 2009.
8. H. Li, C. Shen, and Q. Shi, "Real-time visual tracking using compressive sensing," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1305-1312.
9. A. Senior, A. Hampapur, Y. Tian, L. Brown, S. Pankanti, and R. Bolle, "Appearance models for occlusion handling," in Proc. Int. Workshop Perf. Eval. Track. Surveill., 2001, pp. 1318-1324.
10. B. Ristic, B.-N. Vo, D. Clark, and B.-T. Vo, "A metric for performance evaluation of multi-target tracking algorithms," IEEE Trans. Signal Process., vol. 59, no. 7, pp. 3452-3457, Jul. 2011.
11. X. Mei, H. Ling, Y. Wu, E. Blasch, and L. Bai, "Minimum error bounded efficient l1 tracker with occlusion detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 1257-1264.
12. T. Nawaz and A. Cavallaro, "PFT: A protocol for evaluating video trackers," in Proc. IEEE 18th Int. Conf. Image Process., Sep. 2011, pp. 2325-2328.
13. P. Pan, F. Porikli, and D. Schonfeld, "Recurrent tracking using multifold consistency," in Proc. Int. Workshop Perf. Eval. Track. Surveill. Conf., 2009, pp. 1-10.
14. F. Yin, D. Makris, and S. A. Velastin, "Performance evaluation of object tracking algorithms," in Proc. Int. Workshop Perf. Eval. Track. Surveill., 2007, pp. 1-8.
15. E. Maggio and A. Cavallaro, Video Tracking: Theory and Practice. New York: Wiley, 2011.
16. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-577, May 2003.
17. H. Grabner and H. Bischof, "On-line boosting and vision," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 260-267. (Pubitemid 44931339)
18. [Online]. Available: http://www.eecs.qmul.ac.uk/~andrea/spevi.html
19. [Online]. Available: ftp://ftp.cs.rdg.ac.uk/pub/PETS2000/
20. [Online]. Available: http://www.eecs.qmul.ac.uk/~andrea/avss2007-d. html
21. [Online]. Available: http://www.cvg.rdg.ac.uk/PETS2010/a.html#s2l1
22. [Online]. Available: http://groups.inf.ed.ac.uk/vision/CAVIAR/CAVIAR DATA1/
23. A. Adam, E. Rivlin, and I. Shimshoni, "Robust fragments-based tracking using the integral histogram," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2006, pp. 798-805. (Pubitemid 44931406)
24. P. Perez, C. Hue, J. Vermaak, and M. Gangnet, "Color-based probabilistic tracking," in Proc. Eur. Conf. Comput. Vis., 2002, pp. 661-675.
25. H. Grabner, C. Leistner, and H. Bischof, "Semi-supervised on-line boosting for robust tracking," in Proc. Eur. Conf. Comput. Vis., 2008, pp. 234-247.
26. S. Stalder, H. Grabner, and L. van Gool, "Beyond semi-supervised tracking: Tracking should be as simple as detection, but not simpler than recognition," in Proc. Int. Conf. Comput. Vis. Workshops, 2009, pp. 1409-1416.
27. B. L. Welch, "On the comparison of several mean values: An alternative approach," Biometrika, vol. 38, no. 4, pp. 330-336, 1951.
28. R. A. Fisher, "The logic of inductive inference," J. Royal Statist. Soc., vol. 98, pp. 39-82, Dec. 1935.
29. K. Moder, "Alternatives to F-test in one way anova in case of heterogeneity of variances (a simulation study)," Psychol. Test Assess. Model, vol. 52, no. 4, pp. 343-353, 2010.