Fast Exact Hyper-graph Matching with Dynamic Programming for Spatio-temporal Data

Journal of Mathematical Imaging and Vision

Volumn 51, Issue 1, 2015, Pages 1-21

  Çeliktutan, Oya ^a   Wolf, Christian ^b   Sankur, Bülent ^a   Lombardi, Eric ^b  

^a BOGAZICI UNIVERSITY   (Turkey)

^b UNIVERSITÉ DE LYON   (France)

Author keywords

Action recognition; Dynamic programming; Hyper graph matching

Indexed keywords

PATTERN MATCHING; VIDEO RECORDING;

ACTION RECOGNITION; CORRESPONDENCE PROBLEMS; GRAPHICAL STRUCTURES; HYPER GRAPH; MINIMIZATION PROBLEMS; ONE-TO-ONE MAPPINGS; SPATIO-TEMPORAL DATA; SPECTRAL TECHNIQUES;

DYNAMIC PROGRAMMING;

EID: 84895177463     PISSN: 09249907     EISSN: 15737683     Source Type: Journal    
DOI: 10.1007/s10851-014-0503-6     Document Type: Article

References (60)

1. Albarelli, A., Bergamasco, F., Rossi, L., Vascon, S. and Torsello, A.: A stable graph-based representation for object recognition through high-order matching. In: International Conference on Pattern Recognition, pp. 3341–3344 (2012)
2. Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., Baskurt, A.: Spatio-temporal convolutional sparse auto-encoder for sequence classification. In: British Machine Vision Conference (BMVC), pp. 124.1–124.1 (2012)
3. Belongie, S., Malik, J., Puzicha, J.: Matching shapes. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, pp. 454–461 (2001)
4. Berg, A.C., Berg, T.L., Malik, J.: Shape matching and object recognition using low distortion correspondences. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 26–33 (2005)
5. Bergtholdt, M., Kappes, J., Schmidt, S., Schnörr, C.: A study of parts-based object class detection using complete graphs. Int. J. Comput. Vis. 87(1–2), 93–117 (2010)
6. Bilinski, P., Bremond, F.: Statistics of pairwise co-occurring local spatio-temporal features for human action recognition. In: Proceedings of the 4th International Workshop on Video Event Categorization, Tagging and Retrieval, in Conjunction with 12th European Conference on Computer Vision, vol. 7583, pp. 311–320 (2012)
7. Borzeshi, E.Z., Piccardi, M., Xu, R.Y.D.: A discriminative prototype selection approach for graph embedding in human action recognition. In: IEEE International Conference on, Computer Vision Workshops, pp. 1295–1301 (2011)
8. Bourdev, L., Malik, J.: Poselets: body part detectors trained using 3d human pose annotations. In: IEEE 12th International Conference on Computer Vision, pp. 1365–1372 (2009)
9. Bregonzio, M., Gong, S., Xiang, T.: Recognising action as clouds of space–time interest points. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1948–1955 (2009)
10. Brendel, W., Todorovic, S.: Learning spatiotemporal graphs of human activities. In: IEEE International Conference on Computer Vision (2011)
11. Caetano, T.S., Caelli, T., Schuurmans, D., Barone, D.A.C.: Graphical models and point pattern matching. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1646–1663 (2006)
12. Çeliktutan, O., Akgül, C.B., Wolf, C., Sankur, B.: Graph-based analysis of physical exercise actions. In: ACM Multimedia Workshop on Multimedia Indexing and Information Retrieval for Healthcare, pp. 23–32 (2013)
13. Dollár, P., Rabaud, V., Cottrell, G., Belongie, S.: Behavior recognition via sparse spatio-temporal features. In: VS-PETS Workshop at the IEEE International Conference on Computer Vision (2005)
14. Duchenne, O., Bach, F.R., Kweon, I.-S., Ponce, J.: A tensor-based algorithm for high-order graph matching. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1980–1987 (2009)
15. Duchenne, O., Joulin, A., Ponce, J.: A graph-matching kernel for object categorization. In: IEEE International Conference on Computer Vision (2011)
16. Felzenszwalb, P.F., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)
17. Felzenszwalb, P.F., Huttenlocher, D.P.: Pictorial structures for object recognition. Int. J. Comput. Vis. 61(1), 55–79 (2005)
18. Gao, Z., Chen, M.Y., Hauptmann, A., Cai, A.: Comparing evaluation protocols on the kth dataset. Hum. Behav. Underst. LNCS 6219, 88–100 (2010)
19. Garey, M.R., Johnson, D.S.: Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman, San Francisco (1979)
20. Gaur, U., Zhu, Y., Song, B., Roy-Chowdhury, A.: A string of feature graphs model for recognition of complex activities in natural videos. In: IEEE International Conference on Computer Vision, pp. 2595–2602 (2011)
21. Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference (1988)
22. Jiang, Z., Lin, Z., Davis, L.: Recognizing human actions by learning and matching shape-motion prototype trees. IEEE Trans. Pattern Anal. Mach. Intell. 34(3), 533–547 (2012)
23. Knight, P.A.: The sinkhorn-knopp algorithm: convergence and applications. SIAM J. Matrix Anal. Appl. 30(1), 261–275 (2008)
24. KTH. Recognition of human actions. http://www.nada.kth.se/cvap/actions/. Accessed July 2013
25. Laptev, I.: On space–time interest points. Int. J. Comput. Vis. 64(2–3), 107–123 (2005)
26. Laptev, I., Marszalek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
27. Lauritzen, S.L., Spiegelhalter, D.J.: Local computations with probabilities on graphical structures and their application to expert systems. J. R. Stat. Soc. Ser. B (Methodological) 50(2), 157–224 (1988)
28. Lee, J., Cho, M., Lee, K.M.: Hyper-graph matching via reweighted random walks. In: IEEE Conference on Computer Vision and Pattern Recognition (2011)
29. Lee, J.K., Oh, J., Hwang, S.: Clustering of video objects by graph matching. In: IEEE International Conference on Multimedia and Expo, pp. 394–397 (2005)
30. Leordeanu, M., Hebert, M.: A spectral technique for correspondence problems using pairwise constraints. In: IEEE International Conference on Computer Vision, pp. 1482–1489 (2005)
31. Leordeanu, M., Zanfir, A., Sminchisescu, C.: Semi-supervised learning and optimization for hypergraph matching. In: IEEE International Conference on Computer Vision (2011)
32. Li, W.Q., Zhang, Z.Y., Liu, Z.C.: Action recognition based on a bag of 3d points. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 9–14 (2010)
33. Lin, L., Zeng, K., Liu, X., Zhu, S.C.: Layered graph matching by composite cluster sampling with collaborative and competitive interactions. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1351–1358 (2009)
34. Liu, J., Ali, S., Shah, M.: Recognizing human actions using multiple features. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
35. Lowe, D.: Distinctive image features from scale-invariant features. Int. J. Comput. Vis. 60(2), 91–110 (2004)
36. Lv, F., Nevatia, R.: Single view human action recognition using key pose matching and viterbi path searching. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
37. Microsoft. Introducing kinect for xbox 360. http://www.xbox.com/en-US/kinect. Accessed July 2013
38. Mikolajczyk, K., Uemura, H.: Action recognition with appearance motion features and fast search trees. Comput. Visi. Image Underst. 115(3), 426–438 (2011)
39. Negin, F., Özdemir, F., Akgül, C.B., Yüksel, K.A., Erçil, A.: A decision forest based feature selection framework for action recognition from rgb-depth cameras. In: Kamel, M., Campilho, A. (eds.) Image Analysis and Recognition. Lecture Notes in Computer Science, vol. 7950, pp. 648–657. Springer, Berlin, Heidelberg (2013). doi:10.1007/978-3-642-39094-4_74
40. Pudil, P., Ferri, F.J., Novovicov, J., Kittler, J.: Floating search methods for feature selection with nonmonotonic criterion functions. In: International Conference on Pattern Recognition, vol. 2, pp. 279–283 (1994)
41. Raja, K., Laptev, I., Perez, P., Oisel, L.: Joint pose estimation and action recognition in image graphs. In: IEEE International Conference on Image Processing, pp. 25–28 (2011)
42. Ryoo, M.S., Aggarwal, J.K.: Spatio-temporal relationship match: video structure comparison for recognition of complex human activities. In: IEEE 12th International Conference on Computer Vision, pp. 1593–1600 (2009)
43. Savarese, S., Delpozo, A., Niebles, J., Fei-Fei, L.: Spatial–temporal correlations for unsupervised action classification. In: IEEE Workshop on Motion and Video Computing (2008)
44. Schuldt, C., Laptev, I., Caputo, B.: Recognizing human actions: A local svm approach. In: International Conference on Pattern Recognition, pp. 32–36 (2004)
45. Scovanner, P., Ali, S., Shah, M.: A 3d sift descriptor and its application to action recognition. In: International Conference on ACM Multimedia, pp. 357–360 (2007)
46. Sharma, J.C.A., Horaud, R., Boyer, E.: Topologically robust 3d shape matching based on diffusion geometry and seed growing. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2481–2488 (2011)
47. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Blake, A.: Real-time human pose recognition in parts from single depth images. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1297–1304 (2011)
48. Ta, A.P., Wolf, C., Lavoue, G., Başkurt, A.: Recognizing and localizing individual activities through graph matching. In: 7th IEEE International Conference on Advanced Video and Signal Based Surveillance, pp. 196–203 (2010)
49. Ta, A.P., Wolf, C., Lavoue, G., Başkurt, A., Jolion, J.M.: Pairwise features for human action recognition. In; International Conference on Pattern Recognition, pp. 3224–3227 (2010)
50. Taylor, C.J.: Reconstruction of articulated objects from point correspondences in a single uncalibrated image. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 677–684, (2000)
51. Thome, N., Merad, D., Miguet, S.: Human body labeling and tracking using graph matching theory. In: IEEE International Conference on Video and Signal Based Surveillance (2006)
52. Torresani, L., Kolmogorov, V., Rother, C.: Feature correspondence via graph matching: models and global optimization. In: Proceedings of the European Conference of Computer Vision, pp. 596–609 (2008)
53. Venkataraman, V., Turaga, P., Lehrer, N., Baran, M., Rikakis, T., Wolf, S.L.: Attractor-shape for dynamical analysis of human movement: applications in stroke rehabilitation and action recognition. In: International Workshop on Human Activity Understanding from 3D data (2013)
54. Wang, J., Liu, Z., Wu, Y., Yuan, J.: Mining actionlet ensemble for action recognition with depth cameras. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1290–1297 (2012)
55. Yao, B., Fei-Fei, L.: Action recognition with exemplar based 2.5d graph matching. In: Proceedings of the European Conference on Computer Vision (2012)
56. Yi, S., Pavlovic, V.: Sparse granger causality graphs for human action classification. In: International Conference on Pattern Recognition, pp. 3374–3377 (2012)
57. Yuan, Y., Zheng, H., Li, Z., Zhang, D.: Video action recognition with spatio-temporal graph embedding and spline modeling. In: IEEE International Conference on Acoustics Speech and Signal Processing, pp. 2422–2425 (2010)
58. Zaslavskiy, M., Bach, F., Vert, J.P.: A path following algorithm for the graph matching problem. IEEE Trans. Pattern Anal. Mach. Intell. 31(12), 2227–2242 (2009)
59. Zass, R., Shashua, A.: Probabilistic graph and hypergraph matching. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
60. Zheng, D., Xiong, H., Zheng, Y. F.: A structured learning-based graph matching for dynamic multiple object tracking. In: IEEE International Conference on Image Processing, pp. 2333–2336 (2011)