Learning temporal regularity in video sequences

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 733-742

  Hasan, Mahmudul ^a   Choi, Jonghyun ^b   Neumann, Jan ^b   Roy Chowdhury, Amit K ^a   Davis, Larry S ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b Comcast Labs ^*  (United States)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; LEARNING SYSTEMS; VIDEO RECORDING;

ANOMALY DETECTION; COMPETITIVE PERFORMANCE; GENERATIVE MODEL; LEARNING FRAMEWORKS; MULTIPLE DATA SETS; MULTIPLE SOURCE; SPATIO TEMPORAL; VIDEO SEQUENCES;

PATTERN RECOGNITION;

EID: 84986265779     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.86     Document Type: Conference Paper

References (61)

1. M. Sun, A. Farhadi, and S. Seitz, "Ranking Domain-specific Highlights by Analyzing Edited Videos, " in ECCV, 2014.
2. C. Vondrick, D. Patterson, and D. Ramanan, "Efficiently scaling up crowdsourced video annotation, " International Journal of Computer Vision, vol. 101, no. 1, pp. 184-204, 2013.
3. Y. Song, J. Vallmitjana, A. Stent, and A. Jaimes, "TVSum: Summarizing Web Videos Using Titles, " in CVPR, 2015.
4. W.-S. Chu, Y. Song, and A. Jaimes, "Video Cosummarization: Video Summarization by Visual Cooccurrence, " in CVPR, 2015.
5. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies, " in CVPR, 2008.
6. O. Popoola and K. Wang, "Video-based abnormal human behavior recognition; a review, " Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, pp. 865-878, 2012.
7. A. Karpathy, G. Toderici, S. Shetty, T. Leung, R. Sukthankar, and L. Fei-Fei, "Large-scale Video Classification with Convolutional Neural Networks, " in CVPR, 2014.
8. C. Lu, J. Shi, and J. Jia, "Abnormal event detection at 150 fps in matlab, " in ICCV, 2013, pp. 2720-2727.
9. B. Zhao, L. Fei-Fei, and E. P. Xing, "Online detection of unusual events in videos via dynamic sparse coding, " in CVPR, 2011, pp. 3313-3320.
10. Y. Cong, J. Yuan, and J. Liu, "Sparse Reconstruction Cost for Abnormal Event Detection, " in CVPR, 2011.
11. A. Adam, E. Rivlin, I. Shimshoni, and D. Reinitz, "Robust real-time unusual event detection using multiple fixedlocation monitors, " Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 30, no. 3, pp. 555-560, 2008.
12. V. Mahadevan, W. Li, V. Bhalodia, and N. Vasconcelos, "Anomaly detection in crowded scenes, " in CVPR, 2010, pp. 1975-1981.
13. A. Torralba and A. A. Efros, "Unbiased Look at Dataset Bias, " in CVPR, 2011.
14. Q. V. Le, W. Y. Zou, S. Y. Yeung, and A. Y. Ng, "Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis, " in CVPR, 2011.
15. H. Jhuang, T. Serre, L. Wolf, and T. Poggio, "A biologically inspired system for action recognition, " in ICCV, 2007.
16. G. W. Taylor, R. Fergus, Y. LeCun, and C. Bregler, "Convolutional learning of spatiotemporal features, " in ECCV, 2010.
17. R. Goroshin, J. Bruna, J. Tompson, D. Eigen, and Y. LeCun, "Unsupervised Feature Learning From Temporal Data, " in ICLR Workshop, 2015.
18. V. Ramanathan, K. Tang, G. Mori, and L. Fei-Fei, "Learning Temporal Embeddings for Complex Video Analysis, " arXiv preprint arXiv: 1505. 00315, 2015.
19. A. Graves, A.-R. Mohamed, and G. Hinton, "Speech recognition with deep recurrent neural networks, " in ICASSP, 2013.
20. J. Donahue, L. A. Hendricks, S. Guadarrama, M. Rohrbach, S. Venugopalan, K. Saenko, and T. Darrell, "Long-term recurrent convolutional networks for visual recognition and description, " in CVPR, 2015.
21. Y. Du, W. Wang, and L. Wang, "Hierarchical recurrent neural network for skeleton based action recognition, " in CVPR, 2015.
22. M. Ranzato, A. Szlam, J. Bruna, M. Mathieu, R. Collobert, and S. Chopra, "Video (language) modeling: A baseline for generative models of natural videos, " Arxiv: 1412. 6604, 2014.
23. J. Kim and K. Grauman, "Observe locally, infer globally: A space-time mrf for detecting abnormal activities with incremental updates, " in CVPR, 2009, pp. 2921-2928.
24. K.-W. Cheng, Y.-T. Chen, and W.-H. Fang, "Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression, " in CVPR, 2015, pp. 2909-2917.
25. T. Xiao, C. Zhang, and H. Zha, "Learning to detect anomalies in surveillance video, " Signal Processing Letters, IEEE, vol. 22, no. 9, pp. 1477-1481, 2015.
26. Y. Zhu, N. M. Nayak, and A. K. Roy-Chowdhury, "Contextaware activity recognition and anomaly detection in video, " Selected Topics in Signal Processing, IEEE Journal of, vol. 7, no. 1, pp. 91-101, 2013.
27. M. Sabokrou, M. Fathy, M. Hoseini, and R. Klette, "Realtime anomaly detection and localization in crowded scenes, " in CVPRW, 2015.
28. M. J. Roshtkhari and M. D. Levine, "Online dominant and anomalous behavior detection in videos, " in CVPR, 2013.
29. N. Vaswani, A. K. Roy-Chowdhury, and R. Chellappa, ""shape activity": A continuous-state hmm for moving/deforming shapes with application to abnormal activity detection, " Image Processing, IEEE Transactions on, vol. 14, no. 10, pp. 1603-1616, 2005.
30. D. Xu, E. Ricci, Y. Yan, J. Song, and N. Sebe, "Learning deep representations of appearance and motion for anomalous event detection, " in BMVC, 2015.
31. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks, " in NIPS, 2012.
32. A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, "CNN features off-the-shelf: An astounding baseline for recognition, " in CVPR, 2014.
33. K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition, " CoRR, vol. Abs/1409. 1556, 2014.
34. T. Dean, M. Ruzon, M. Segal, J. Shleps, S. Vijayanarasimhan, and J. Yagnik, "Fast, accurate detection of 100, 000 object classes on a single machine, " in CVPR, 2013.
35. S. Ren, A. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks, " in NIPS, 2015.
36. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "Deepface: Closing the gap to human-level performance in face verification, " in CVPR, 2014.
37. A. Frome, G. S. Corrado, J. Shlens, S. Bengio, J. Dean, M. A. Ranzato, and T. Mikolov, "DeViSE: A Deep Visual-Semantic Embedding Model, " in NIPS, 2013.
38. A. Karpathy and L. Fei-Fei, "Deep visual-semantic alignments for generating image descriptions, " in CVPR, 2014.
39. J. Y. Ng, M. Hausknecht, S. Vijayanarasimhan, O. Vinyals, R. Monga, and G. Toderici, "Beyond Short Snippets: Deep Networks for Video Classification, " in CVPR, 2015.
40. Z. Xu, Y. Yang, and A. G. Hauptmann, "A discriminative cnn video representation for event detection, " in CVPR, 2015.
41. L. Wang, Y. Qiao, and X. Tang, "Action recognition with trajectory-pooled deep-convolutional descriptors, " in CVPR, 2015.
42. J. Zhao, M. Mathieu, R. Goroshin, and Y. LeCun, "Stacked What-Where Auto-encoders, " arXiv preprint arXiv: 1506. 02351, 2015.
43. H. Noh, S. Hong, and B. Han, "Learning Deconvolution Network for Semantic Segmentation, " in ICCV, 2015.
44. H. Wang and C. Schmid, "Action recognition with improved trajectories, " in ICCV, 2013.
45. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks, " Science, vol. 313, no. 5786, pp. 504-507, 2006.
46. M. Hasan and A. K. Roy-Chowdhury, "Continuous Learning of Human Activity Models Using Deep Nets, " in ECCV, 2014.
47. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection, " in CVPR, 2005.
48. N. Dalal, B. Triggs, and C. Schmid, "Human detection using oriented histograms of flow and appearance, " in ECCV, 2006.
49. U. Gaur, Y. Zhu, B. Song, and A. Roy-Chowdhury, "A "String of Feature Graphs" Model for Recognition of Complex Activities in Natural Videos, " in ICCV, 2011.
50. H. Wang, A. Klaser, C. Schmid, and L. Cheng-Lin, "Action Recognition by Dense Trajectories, " in IEEE CVPR, 2011.
51. I. Sutskever, J. Martens, G. Dahl, and G. Hinton, "On the importance of initialization and momentum in deep learning, " in ICML, 2013.
52. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation, " in CVPR, 2015.
53. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks, " in ECCV, 2014.
54. M. D. Zeiler, G. W. Taylor, and R. Fergus, "Adaptive deconvolutional networks for mid and high level feature learning, " in ICCV, 2011.
55. J. Duchi, E. Hazan, and Y. Singer, "Adaptive subgradient methods for online learning and stochastic optimization, " The Journal of Machine Learning Research, vol. 12, pp. 2121-2159, 2011.
56. D. Kingma and J. Ba, "Adam: A Method for Stochastic Optimization, " arXiv: 1412. 6980, 2015.
57. T. Tieleman and G. Hinton, "Lecture 6. 5-rmsprop: Divide the gradient by a running average of its recent magnitude, " in COURSERA: Neural Networks for Machine Learning, 2012.
58. X. Glorot and Y. Bengio, "Understanding the difficulty of training deep feedforward neural networks, " in AISTAT, 2010.
59. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: An open source convolutional architecture for fast feature embedding, " http: //caffe. berkeleyvision. org/, 2014.
60. V. Saligrama and Z. Chen, "Video Anomaly Detection Based on Local Statistical Aggregates, " in CVPR, 2012.
61. Y. Kozlov and T. Weinkauf, "Persistence1D: Extracting and filtering minima and maxima of 1d functions, " http: //people. mpi-inf. mpg. de/?weinkauf/notes/persistence1d. html, accessed: 2015-11-01.