Performance evaluation in visual surveillance using the F-measure

Proceedings of the ACM International Multimedia Conference and Exhibition

Volumn , Issue , 2006, Pages 45-52

  Lazarevic Mcmanus, N ^a   Renno, J ^a   Jones, G A ^a  

^a KINGSTON UNIVERSITY   (United Kingdom)

Author keywords

F measure; Motion detection; Performance evaluation; ROC analysis; Visual surveillance

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER VISION; MOTION ESTIMATION; OPTIMIZATION; PROBLEM SOLVING;

MOTION DETECTION; PERFORMANCE EVALUATION; VISUAL SURVEILLANCE;

ALGORITHMS;

EID: 34547466772     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1178782.1178790     Document Type: Conference Paper

References (23)

1. J. Aguilera, H. Wildernauer, M. Kampel, M. Borg, D. Thirde, and J. Ferryman. Evaluation of Motion Segmentation Quality for Aircraft Activity Surveillance. In Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, Beijing, October 15-16 2005.
2. J. Black, T. Ellis, and P. Rosin. "A Novel Method for Video Tracking Performance Evaluation". In IEEE Workshop on Performance Analysis of Video Surveillance and Tracking (PETS'2003), pages 125-132, October 2003.
3. A. Cavallaro, E. Gelasce, and T. Ebrahimi. Objective Evaluation of Segmentation Quality using Spatio-Temporal Context. In IEEE International Conference on Image Processing, page 301304, September 2002.
4. P. Correia and F. Pereira. "Objective Evaluation of Relative Segmentation Quality". In IEEE International Conference on Image Processing, pages 308-311, Vancouver, Canada, September 10-13 2000.
5. C. Erdem and B. Sankur. "Performance Evaluation Metrics for Object-Based Video Segmentation". In X European Signal Processing Conference (EUSIPCO), September 4-8 2000.
6. C. Erdem, A. Tekalp, and B. Sankur. "Metrics for performance evaluation of video object segmentation and tracking without ground-truth". In IEEE International Conference on Image Processing (ICIP), October 7-10 2004.
7. R. Fisher. Caviar - context aware vision using image-based active recognition. In http://homepages.inf.ed.ac.uk/rbf/CAVIAR.
8. X. Gao, T. Boult, F. Coetzee, and V. Ramesh. "Error analysis of background Adaption". In IEEE Conference on Computer Vision and Pattern Recognition, pages 503-510, 2000.
9. E. Gelasca, T. Ebrahimi, M. Farias, M. Carli, and S. Mitra. "Towards Perceptually Driven Segmentation Evaluation Metrics". In CVPR 2004 Workshop (Perceptual Organization in Computer Vision), page 52, June 2004.
10. B. Georis, F. Bremond, M. Thonnat, and B. Macq. "Use of an Evaluation and Diagnosis Method to Improve Tracking Performances". In IASTED 3rd International Conference on Visualization, Imaging and Image Processing, September 8-10th 2003.
11. D. Hall, J. Nascimento, P. Ribeiro, E. Andrade, and P. Moreno. Comparison of target detection algorithms using adaptive background models. In Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, Beijing, October 15-16 2005.
12. C. Jaynes, S. Webb, M. Steele, and Q. Xiong. "An Open Development Environment for Evaluation of Video Surveillance Systems". In IEEE Workshop on Performance Analysis of Video Surveillance and Tracking (PETS'2002), June 2002.
13. T. List, J. Bins, J. Vazquez, and R. B. Fisher. "Performance Evaluating the Evaluator". In IEEE Joint Workshop on Visual Surveillance and Performance Analysis of Video Surveillance and Tracking (VS-PETS 2005), 15-16th October 2005.
14. V. Y. Mariano, J. Min, J.-H. Park, R. Kasturi, D. Mihalcik, H. Li, D. S. Doermann, and T. Drayer. "Performance Evaluation of Object Detection Algorithms". In 16th International Conference on Pattern Recognition (ICPR), volume 2, pages 965-969, 2002.
15. J. Nascimento and J. S. Marques. "New Performance Evaluation Metrics for Object Detection Algorithms". In IEEE Workshop on Performance Analysis of Video Surveillance and Tracking (PETS'2004), May 2004.
16. J. Renno, N. Lazarevic-McManus, D. Makris, and G. Jones. "Evaluating Motion Detection Algorithms: Issues and Results". In IEEE International Workshop on Visual Surveillance, pages 97-104, Graz, Austria, May 13 2006.
17. T. Schlogl, C. Beleznai, M. Winter, and H. Bischof. "Performance evaluation metrics for motion detection and tracking". In 17th International Conference on Pattern Recognition (ICPR), volume 4, pages 519-522, August 23-26 2004.
18. C. Stauffer and W. Grimson. "Adaptive background mixture models for real-time tracking.". In IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR'2000), pages 246-252, Fort Collins, Colorado, June 23-25 1999.
19. L. D. Stefano, G. Neri, and E. Viarani. "Analysis of Pixel-Level Algorithms for Video Surveillance Applications". In 11th International Conference on Image Analysis and Processing, ICIAP2001, pages 542-546, September 26-28 2001.
20. C. J. Van Rijsbergen. Information Retrieval, 2nd edition. Dept. of Computer Science, University of Glasgow, 1979.
21. P. Villegas and X. Marichal. "Perceptually Weighted Evaluation Criteria, for Segmentation Masks in Video Sequences". IEEE Transactions on Image Processing, 13(8):1092-1103, August 2004.
22. P. Villegas, X. Marichal, and A. Salcedo. "Objective Evaluation of Segmentation Masks in Video Sequences". In Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS'99), pages 85-88, May 1999.
23. H. Wu and Q. Zheng. "Self-evaluation for video tracking systems". In Proceedings of the 24th Army Science Conference, November 2004.