Evaluation of video activity localizations integrating quality and quantity measurements

Computer Vision and Image Understanding

Volumn 127, Issue , 2014, Pages 14-30

  Wolf, Christian ^a,b   Lombardi, Eric ^a,c   Mille, Julien ^a,c   Celiktutan, Oya ^a,b,d   Jiu, Mingyuan ^a,b   Dogan, Emre ^b,e   Eren, Gonen ^e   Baccouche, Moez ^a,b   Dellandréa, Emmanuel ^a,b   Bichot, Charles Edmond ^a,b   Garcia, Christophe ^a,b   Sankur, Bülent ^d  

^a UNIVERSITÉ DE LYON   (France)

^b CNRS   (France)

^c UNIVERSITÉ LYON 1   (France)

^d BOGAZICI UNIVERSITY   (Turkey)

^e GALATASARAY UNIVERSITY   (Turkey)

Author keywords

Activity recognition and localization; Competition; Performance evaluation; Performance metrics

Indexed keywords

COMPETITION; COMPUTER VISION;

ACTIVITY RECOGNITION; CLASSIFICATION ERRORS; COMPUTER VISION ALGORITHMS; PERFORMANCE EVALUATION; PERFORMANCE METRICES; PERFORMANCE METRICS; RECALL AND PRECISION; RECOGNITION ALGORITHM;

ALGORITHMS;

EID: 84906312774     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2014.06.014     Document Type: Article

References (61)

1. C. Schuldt, I. Laptev, B. Caputo, Recognizing human actions: a local svm approach, in: International Conference on Pattern Recognition, vol. 3, 2004, pp. 32-36.
2. L. Zelnik-Manor, M. Irani, Weizmann Event-Based Analysis of Video, 2013. < http://www.wisdom.weizmann.ac.il/vision/VideoAnalysis/Demos/EventDetection/ EventDetection.html >.
3. I. Laptev, Irisa Download Data/Software, 2013. < http://www.irisa.fr/ vista/Equipe/People/Laptev/download.html >.
4. I. Laptev, Hollywood2: Human Actions and Scenes Dataset, 2013. < http://www.irisa.fr/vista/actions/hollywood2/ >.
5. S. University, Olympic Sports Dataset, 2013. < http://vision.stanford. edu/Datasets/OlympicSports/ >.
6. R. Kasturi, D. Goldgof, P. Soundararajan, V. Manohar, M. Boonstra, V. Korzhova, Performance Evaluation Protocol for Text, Face, Hands, Person and Vehicle Detection & Tracking in Video Analysis and Content Extraction (VACE-II), Technical Report, University of South Florida, Tampa, FL, USA, 2005.
7. R. Collins, X. Zhou, S. Teh, An open source tracking testbed and evaluation web site, in: International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), Beijing, China, 2005, pp. 17-24.
8. R. Kasturi, D. Goldgof, P. Soundararajan, V. Manohar, J. Garofolo, R. Bowers, M. Boonstra, V. Korzhova, and J. Zhang Framework for performance evaluation of face, text, and vehicle detection and tracking in video: data, metrics, and protocol IEEE Trans. Pattern Anal. Mach. Intell. 31 2009 319 336
9. A. Smeaton, P. Over, W. Kraaij, Evaluation campaigns and trecvid, in: International Workshop on Multimedia Information Retrieval, Santa Barbara, CA, USA, 2006, pp. 321-330. (Pubitemid 47168230)
10. D. Mostefa, N. Moreau, K. Choukri, G. Potamianos, S. Chu, A. Tyagi, J. Casas, J. Turmo, L. Cristoforetti, F. Tobia, A. Pnevmatikakis, V. Mylonakis, F. Talantzis, S. Burger, R. Stiefelhagen, K. Bernardin, and C. Rochet The chil audiovisual corpus for lecture and meeting analysis inside smart rooms Lang. Resour. Eval. 41 2007 389 407
11. X. Xu, J. Tang, X. Zhang, X. Liu, H. Zhang, and Y. Qiu Exploring techniques for vision based human activity recognition: methods, systems, and evaluation Sensors 13 2 2013 1635 1650
12. O. Kliper-Gross, T. Hassner, and L. Wolf The action similarity labeling challenge IEEE Trans. Pattern Anal. Mach. Intell. 34 2012 615 621
13. J.A.Ward, P. Lukowicz, G. Tröster, Evaluating performance in continuous context recognition using event-driven error characterisation, in: Location- and Context-Awareness, LNCS, vol. 3987, 2006, pp. 239-255.
14. J. Ward, P. Lukowicz, G. Troster, and T. Starner Activity recognition of assembly tasks using body-worn microphones and accelerometers IEEE Trans. Pattern Anal. Mach. Intell. 28 2006 1553 1567
15. J.A. Ward, P. Lukowicz, and H.W. Gellersen Performance metrics for activity recognition ACM Trans. Intell. Syst. Technol. 2 2011 6:1 6:23
16. D. Minnen, T. Westeyn, T. Starne, J. Ward, and P. Lukowicz Performance metrics and evaluation issues for continuous activity recognition Perform. Metrics Intell. Syst. 2006
17. H.A.T.L.M. van Kasteren, C. Ersoy, Effective performance metrics for evaluating activity recognition methods, in: ARCS Workshop on Context-Systems Design, Evaluation and Optimisation, 2011.
18. J.M. Chaquet, E.J. Carmona, and A. Fernández-Caballero A survey of video datasets for human action and activity recognition Comput. Vis. Image Und. 117 6 2013 633 659
19. Caviar: Context Aware Vision Using Image-Based Active Recognition, 2013. < http://homepages.inf.ed.ac.uk/rbf/CAVIAR/caviar.htm >.
20. INRIA, Etiseo Video Understanding Evaluation, 2013. < http://www-sop.inria.fr/orion/ETISEO/index.htm >.
21. D. Tran, A. Sorokin, D. Forsyth, Human Activity Recognition with Metric Learning, 2013. < http://vision.cs.uiuc.edu/projects/activity/ >.
22. J. Yuan, Z. Liu, Y. Wu, Discriminative Video Pattern Search for Efficient Action Detection, 2013. < http://users.eecs.northwestern.edu/jyu410/index- files/actiondetection.html >.
23. R. Fisher, Behave: Computer-Assisted Prescreening of Video Streams for Unusual Activities, 2013. < http://homepages.inf.ed.ac.uk/rbf/BEHAVE/ >.
24. C. for Biometrics, S. Research, Casia Action Database for Recognition, 2013. < http://www.cbsr.ia.ac.cn/english/Action%20Databases%20EN.asp >.
25. U. of Surrey, CERTH-ITI, i3dpost Multi-View Human Action Datasets, 2013. < http://kahlan.eps.surrey.ac.uk/i3dpost-action/ >.
26. V.G. Group, Tv Human Interactions Dataset, 2013. < http://www.robots.ox.ac.uk/vgg/data/tv-human-interactions/index.html >.
27. M.S. Ryoo, J.K. Aggarwal, Ut-Interaction Dataset, icpr Contest on Semantic Description of Human Activities (sdha), 2013. < http://cvrc.ece. utexas.edu/SDHA2010/Human-Interaction.html >.
28. V.C. Group, Videoweb Dataset, 2013. < http://www.ee.ucr.edu/amitrc/ vwdata.php >.
29. S. o. S.E. Reading University Computational Vision Group, Pets 2009 Benchmark Data, 2013. < http://www.cvg.rdg.ac.uk/PETS2009/a.html >.
30. S.S.W. Choi, K. Shahid, What are they doing? Collective activity classification using spatio-temporal relationship among people., in: International ICCV Workshop on Visual Surveillance, 2009.
31. R. Messing, C. Pal, H. Kautz, Activity recognition using the velocity histories of tracked keypoints, in: International Conference on Computer Vision, 2009.
32. M. Tenorth, J. Bandouch, M. Beetz, The tum kitchen data set of everyday manipulation activities for motion tracking and action recognition, in: International ICCV Workshop on Tracking Humans for the Evaluation of their Motion in Image Sequences, 2009.
33. INRIA, Inria xmas Motion Acquisition Sequences (ixmas), 2013. < http://4drepository.inrialpes.fr/public/viewgroup/6 >.
34. K. University, Muhavi: Multicamera Human Action Video Data, 2013. < http://dipersec.king.ac.uk/MuHAVi-MAS/ >.
35. U. of Central Florida, Ucf Aerial Camera, Rooftop Camera and Ground Camera Dataset, 2013. < http://vision.eecs.ucf.edu/data/UCF-ARG.html >.
36. E. Auvinet, C. Rougier, J. Meunier, A. St-Arnaud, J. Rousseau, Multiple Cameras Fall Dataset, Technical Report 1350, DIRO-Université de Montréal, 2010.
37. U. of Central Florida, Ucf Aerial Action Dataset, 2013. < http://server.cs.ucf.edu/vision/aerial/index.html >.
38. S. Lab., Hmdb: A Large Video Database for Human Motion Recognition, 2013. < http://serre-lab.clps.brown.edu/resources/HMDB/ >.
39. U. of Central Florida, Ucf youtube Action Dataset, 2013. < http://www.cs.ucf.edu/liujg/YouTube-Action-dataset.html >.
40. U. of Central Florida, Ucf Sports Action Dataset, 2013. < http://crcv.ucf.edu/data/UCF-Sports-Action.php >.
41. A.R.Z.K. Soomro, M. Shah, A dataset of 101 human action classes from videos in the wild, in: THUMOS: The First International Workshop on Action Recognition with a Large Number of Classes, in conjunction with ICCV 2013, 2013. < http://crcv.ucf.edu/ICCV13-Action-Workshop/ >.
42. Microsoft, Msr Action Recognition Datasets and Codes, 2013. < http://research.microsoft.com/en-us/um/people/zliu/actionrecorsrc/default.htm >.
43. S. Fothergill, H.M. Mentis, P. Kohli, S. Nowozin, Instructing people for training gestural interactive systems, in: J.A. Konstan, E.H. Chi, K. Höök (Eds.), ACM Conference on Computer-Human Interaction, 2012, pp. 1737-1746.
44. C. ChaLearn, Chalearn Gesture Dataset (cgd2011), 2013. < http://gesture.chalearn.org/data >.
45. F. Ofli, R. Chaudhry, G. Kurillo, R. Vidal, R. Bajcsy, Berkeley mhad: A comprehensive multimodal human action database, in: International Workshop on Applications on Computer Vision, 2013.
46. L. Seidenari, V. Varano, S. Berretti, A.D. Bimbo, P. Pala, Recognizing actions from depth cameras as weakly aligned multi-part bag-of-poses, in: 3rd International Workshop on Human Activity Understanding from 3D data (HAU3D-CVPRW), in conjunction with CVPR, 2013. < http://www.micc.unifi.it/ vim/datasets/3dactions/ >.
47. J. Sung, H. Koppula, B. Selman, A. Saxena, Cornell activity datasets: Cad-60 & cad-120, 2013. < http://pr.cs.cornell.edu/humanactivities/data. php >.
48. B. Ni, G. Wang, P. Moulin, Rgbd-hudaact: A color-depth video database for human daily activity recognition, in: International ICCV Workshop on Consumer Depth Cameras for Computer Vision, 2011. < http://www.adsc.illinois.edu/ demos.html >.
49. K. Yun, J. Honorio, D. Chattopadhyay, T.L. Berg, D. Samaras, in: 3rd International Workshop on Human Activity Understanding from 3D Data (HAU3D-CVPRW), in: Conjunction with CVPR, 2013. < http://www.cs.stonybrook. edu/kyun/research/kinect-interaction/index.html >.
50. A. Kläser, M. Marszałek, C. Schmid, A. Zisserman, Human focused action localization in video, in: International Workshop on Sign, Gesture, and Activity (SGA) in Conjunction with ECCV, 2010. < http://lear.inrialpes.fr/pubs/2010/KMSZ10 >.
51. I. Laptev, P. Perez, Retrieving Actions in Movies, in: ICCV, 2007.
52. C. Wolf, and J.-M. Jolion Object count/area graphs for the evaluation of object detection and segmentation algorithms Int. J. Doc. Anal. Recognit. 8 2006 280 296 (Pubitemid 44251802)
53. C. van Rijsbergen Information Retrieval second ed. 1979 Butterworths London
54. B. Ni, Y. Pei, P. Moulin, Integrating multi stage depth induced contextual information for human action recognition and localization, in: International Conference on Automatic Face and Gesture Recognition, 2013.
55. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: CVPR, vol. 1, 2005, pp. 886-893. (Pubitemid 43897286)
56. J. Yuan, Z. Liu, Y. Wu, Discriminative subvolume search for efficient action detection, in: International Conference on Computer Vision and Pattern Recognition, 2009.
57. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: International Conference on Computer Vision and Pattern Recognition (CVPR), 2008, pp. 1-8.
58. S. Mukherjee, S. Biswas, and D. Mukherjee Recognizing human action at a distance in video by key poses IEEE Trans. Circ. Syst. Video Technol. 21 2011 1228 1241
59. A. Kläser, M. Marszalek, C. Schmid, A spatio-temporal descriptor based on 3D-gradients, in: BMVC 2008, 2008.
60. B. Ni, P. Yong, P. Moulin, and S. Yan Multi-level depth and image fusion for human activity detection IEEE Trans. Syst. Man Cybern. (B) 43 2013 1383 1394
61. P. Felzenszwalb, R. Girshick, D. McAllester, and D. Ramanan Object detection with discriminatively trained part based models IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 32 2010 1627 1645