Shape similarity for 3D video sequences of people

International Journal of Computer Vision

Volumn 89, Issue 2-3, 2010, Pages 362-381

  Huang, Peng ^a   Hilton, Adrian ^a   Starck, Jonathan ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

3D video; Human motion; Surface motion capture; Temporal shape similarity

Indexed keywords

3D VIDEO; COMPLEX MOTION; COMPUTATIONAL COSTS; DESCRIPTORS; HUMAN MOTIONS; LINEAR MOTION; MOTION SEQUENCES; MULTI-FRAME; OPTIMAL PARAMETER SETTINGS; PERFORMANCE EVALUATION; RECEIVER OPERATOR CHARACTERISTICS; SHAPE DESCRIPTORS; SHAPE DISTRIBUTION; SHAPE SIMILARITY; SIMILARITY MEASURE; SPHERICAL HARMONICS; SPIN IMAGES; SURFACE MOTIONS; TEMPORAL SHAPE; WINDOW SIZE;

GRAPHIC METHODS; HARMONIC ANALYSIS; IMAGE RETRIEVAL; STATISTICAL METHODS; VIDEO RECORDING;

THREE DIMENSIONAL;

EID: 77953285038     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-010-0319-9     Document Type: Article

References (50)

1. E. Aguiar C. Stoll C. Theobalt N. Ahmed H. P. Seidel S. Thrun 2008 Performance capture from sparse multi-view video ACM Transactions on Graphics 27 3 1 10 10.1145/1360612.1360697
2. Ankerst, M., Kastenmüller, G., Kriegel, H. P., & Seidl, T. (1999). 3D shape histograms for similarity search and classification in spatial databases. In SSD '99: proceedings of the 6th international symposium on advances in spatial databases (pp. 207-226). London: Springer.
3. O. Arikan D. A. Forsyth J. F. O'Brien 2003 Motion synthesis from annotations ACM Transactions on Graphics 22 3 402 408 10.1145/882262.882284
4. S. Belongie J. Malik J. Puzicha 2002 Shape matching and object recognition using shape contexts IEEE Transactions on Pattern Analysis & Machine Intelligence 24 4 509 522 10.1109/34.993558 (Pubitemid 34448769)
5. A. F. Bobick J. W. Davis 2001 The recognition of human movement using temporal templates IEEE Transactions on Pattern Analysis & Machine Intelligence 23 3 257 267 10.1109/34.910878 (Pubitemid 32286632)
6. B. Bustos D. Keim D. Saupe T. Schreck 2007 Content-based 3D object retrieval. Computer Graphics and Applications IEEE 27 4 22 27
7. J. Carranza C. Theobalt M. A. Magnor H. P. Seidel 2003 Free-viewpoint video of human actors ACM Transactions on Graphics 22 3 569 577 10.1145/882262.882309
8. D. Y. Chen M. Ouhyoung X. P. Tian Y. T. Shen 2003 On visual similarity based 3D model retrieval Computer Graphics Forum (EUROGRAPHICS'03) 22 3 223 232 10.1111/1467-8659.00669
9. C. S. Chua R. Jarvis 1997 Point signatures: a new representation for 3D object recognition International Journal of Computer Vision 25 1 63 85 10.1023/A:1007981719186
10. J. Corney H. Rea D. Clark J. Pritchard M. Breaks R. Macleod 2002 Coarse filters for shape matching Computer Graphics and Applications, IEEE 22 3 65 74 10.1109/MCG.2002.999789 (Pubitemid 34550483)
11. R. Cutler L. S. Davis 2000 Robust real-time periodic motion detection, analysis, and applications IEEE Transactions on Pattern Analysis & Machine Intelligence 22 8 781 796 10.1109/34.868681
12. A. Del Bimbo P. Pala 2006 Content-based retrieval of 3D models ACM Transactions on Multimedia Computing, Communications, and Applications 2 1 20 43 10.1145/1126004.1126006
13. Efros, A. A., Berg, A. C., Mori, G., & Malik, J. (2003). Recognizing action at a distance. In ICCV '03: Proceedings of the ninth IEEE international conference on computer vision. Washington: IEEE Computer Society.
14. M. El-Mehalawi 2003 A database system of mechanical components based on geometric and topological similarity. part ii: indexing, retrieval, matching, and similarity assessment Computer-Aided Design 35 1 95 105 10.1016/S0010- 4485(01)00178-6 (Pubitemid 34946893)
15. A. Elad R. Kimmel 2003 On bending invariant signatures for surfaces IEEE Transactions on Pattern Analysis & Machine Intelligence 25 10 1285 1295 10.1109/TPAMI.2003.1233902
16. M. Gleicher H. Joon S. Lucas K. A. Jepsen 2003 Snap-together motion: assembling run-time animation ACM Transactions on Graphics 22 181 188 10.1145/882262.882333
17. L. Gorelick M. Blank E. Shechtman M. Irani R. Basri 2007 Actions as space-time shapes IEEE Transactions on Pattern Analysis & Machine Intelligence 29 12 2247 2253 10.1109/TPAMI.2007.70711 (Pubitemid 350124072)
18. Hilaga, M., Shinagawa, Y., Kohmura, T., & Kunii, T. L. (2001). Topology matching for fully automatic similarity estimation of 3D shapes. In SIGGRAPH '01: Proceedings of the 28th annual conference on computer graphics and interactive techniques (pp. 203-212). New York: ACM Press.
19. Huang, P., & Hilton, A. (2009). Human motion synthesis from 3D video. In Proceedings of the 2009 conference on computer vision and pattern recognition (CVPR'09) (pp. 1478-1485).
20. Huang, P., Starck, J., & Hilton, A. (2007a). A study of shape similarity for temporal surface sequences of people. In 3DIM '07: Proceedings of the sixth international conference on 3D digital imaging and modeling (pp. 408-418). Washington: IEEE Computer Society.
21. Huang, P., Starck, J., & Hilton, A. (2007b). Temporal 3D shape matching. In The fourth European conference on visual media production (CVMP'07) (pp. 1-10).
22. N. Iyer S. Jayanti K. Lou Y. Kalyanaraman K. Ramani 2005 Three-dimensional shape searching: state-of-the-art review and future trends Computer-Aided Design 37 5 509 530 10.1016/j.cad.2004.07.002 (Pubitemid 40415193)
23. V. Jain H. Zhang 2007 A spectral approach to shape-based retrieval of articulated 3D models Computer-Aided Design 39 5 398 407 10.1016/j.cad.2007.02. 009 (Pubitemid 46726287)
24. A. E. Johnson M. Hebert 1999 Using spin images for efficient object recognition in cluttered 3D scenes IEEE Transactions on Pattern Analysis & Machine Intelligence 21 5 433 449 10.1109/34.765655
25. T. Kanade P. Rander P. J. Narayanan 1997 Virtualized reality: Constructing virtual worlds from real scenes IEEE MultiMedia 4 1 34 47 10.1109/93.580394
26. Kazhdan, M., Chazelle, B., Dobkin, D. P., Finkelstein, A., & Funkhouser, T. A. (2002). A reflective symmetry descriptor. In ECCV (Vol. 2, pp. 642-656).
27. Kazhdan, M., Funkhouser, T., & Rusinkiewicz, S. (2003). Rotation invariant spherical harmonic representation of 3D shape descriptors. In SGP '03: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on geometry processing (pp. 156-164).
28. Körtgen, M., Park, G. J., Novotni, M., & Klein, R. (2003). 3D shape matching with 3D shape contexts. In The 7th central European seminar on computer graphics.
29. Kovar, L., Gleicher, M., & Pighin, F. (2002). Motion graphs. In SIGGRAPH '02: Proceedings of the 29th annual conference on computer graphics and interactive techniques (Vol. 21, pp. 473-482). New York: ACM Press.
30. V. Krüger D. Kragic A. Ude C. Geib 2007 The meaning of action: A review on action recognition and mapping Advanced Robotics 21 13 1473 1501
31. J. Lee J. Chai P. S. A. Reitsma J. K. Hodgins N. S. Pollard 2002 Interactive control of avatars animated with human motion data ACM Transactions on Graphics 21 3 491 500
32. D. Mcwherter M. Peabody W. C. Regli A. Shokoufandeh 2001 Solid model databases: Techniques and empirical results Journal of Computing and Information Science in Engineering 1 4 300 310 10.1115/1.1430233
33. Novotni, M., & Klein, R. (2003). 3D Zernike descriptors for content based shape retrieval. In SM '03: Proceedings of the eighth ACM symposium on solid modeling and applications (pp. 216-225). New York: ACM Press.
34. Ohbuchi, R., Minamitani, T., & Takei, T. (2003). Shape-similarity search of 3D models by using enhanced shape functions. In Theory and practice of computer graphics, 2003 proceedings (pp. 97-104).
35. R. Osada T. Funkhouser B. Chazelle D. Dobkin 2002 Shape distributions ACM Transactions on Graphics 21 4 807 832 10.1145/571647.571648
36. E. Paquet 2000 Description of shape information for 2D and 3D objects Signal Processing: Image Communication 16 103 122 10.1016/S0923-5965(00)00020-5
37. Schödl, A., Szeliski, R., Salesin, D. H., & Essa, I. (2000). Video textures. In SIGGRAPH '00: Proceedings of the 27th annual conference on computer graphics and interactive techniques (pp. 489-498). New York: ACM Press/Addison-Wesley.
38. Shum, H. Y., Hebert, M., & Ikeuchi, K. (1996). On 3D shape similarity. In Proceedings of the 1996 conference on computer vision and pattern recognition (CVPR '96) (pp. 526-531).
39. Starck, J., & Hilton, A. (2003). Model-based multiple view reconstruction of people. In ICCV '03: Proceedings of the ninth international conference on computer vision (pp. 915-922).
40. J. Starck A. Hilton 2007 Surface capture for performance-based animation IEEE Computer Graphics and Applications 27 3 21 31 10.1109/MCG.2007.68 (Pubitemid 46767722)
41. Starck, J., Miller, G., & Hilton, A. (2005). Video-based character animation. In SCA '05: Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on computer animation (pp. 49-58). New York: ACM Press.
42. Sundar, H., Silver, D., Gagvani, N., & Dickinson, S. (2003). Skeleton based shape matching and retrieval. In SMI '03: Proceedings of the shape modeling international 2003 (p. 130).
43. Tangelder, J. W. H., & Veltkamp, R. C. (2004). A survey of content based 3D shape retrieval methods. In SMI '04: Proceedings of the shape modeling international 2004 (pp. 145-156). Washington: IEEE Computer Society.
44. C. Theobalt N. Ahmed H. Lensch M. Magnor H. P. Seidel 2007 Seeing people in different light-joint shape, motion, and reflectance capture IEEE Transactions on Visualization and Computer Graphics 13 4 663 674 10.1109/TVCG.2007.1006 (Pubitemid 47289543)
45. D. Vlasic I. Baran W. Matusik J. Popović 2008 Articulated mesh animation from multi-view silhouettes ACM Transactions on Graphics 27 3 1 9 10.1145/1360612.1360696
46. D. Weinland R. Ronfard E. Boyer 2006 Free viewpoint action recognition using motion history volumes Computer Vision and Image Understanding 104 2 249 257 10.1016/j.cviu.2006.07.013 (Pubitemid 44573869)
47. Xu, J., Yamasaki, T., & Aizawa, K. (2006). Motion editing in 3D video database. In 3DPVT '06: Proceedings of the third international symposium on 3D data processing, visualization, and transmission (pp. 472-479). Washington: IEEE Computer Society.
48. Zaharia, T., & Preteux, F. (2001). Three-dimensional shape-based retrieval within the mpeg-7 framework. In Proceedings SPIE conference on nonlinear image processing and pattern analysis XII (Vol. 4304, pp. 133-145). (Pubitemid 32807345)
49. Zhang, C., & Chen, T. (2001). Efficient feature extraction for 2D/3D objects in mesh representation. In Image processing, 2001 proceedings 2001 international conference (Vol. 3, pp. 935-938).
50. C. L. Zitnick S. B. Kang M. Uyttendaele S. Winder R. Szeliski 2004 High-quality video view interpolation using a layered representation ACM Transactions on Graphics 23 3 600 608 10.1145/1015706.1015766 (Pubitemid 40163756)