Depth-color fusion strategy for 3-D scene modeling with kinect

IEEE Transactions on Cybernetics

Volumn 43, Issue 6, 2013, Pages 1560-1571

  Camplani, Massimo ^a   Mantecón, Tomás ^a   Salgado, Luis ^a,b  

^a UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^b UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

3 D scene modeling; Adaptive bilateral filter; Data fusion; Depth map filtering; Kinect; Mixture of Gaussians

Indexed keywords

BILATERAL FILTERS; DEPTH MAP; KINECT; MIXTURE OF GAUSSIANS; SCENE MODEL;

COLOR; DATA FUSION; DETECTOR CIRCUITS; UNCERTAINTY ANALYSIS;

THREE DIMENSIONAL;

ARTICLE; COLOR; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; COMPUTER SIMULATION; IMAGE SUBTRACTION; METHODOLOGY; RECREATION; THEORETICAL MODEL; THREE DIMENSIONAL IMAGING;

COLOR; COMPUTER GRAPHICS; COMPUTER SIMULATION; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MODELS, THEORETICAL; SUBTRACTION TECHNIQUE; USER-COMPUTER INTERFACE; VIDEO GAMES;

EID: 84890041518     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2271112     Document Type: Article

References (23)

1. Microsoft Corporation. Kinect for Xbox 360 [Online]. Available: http: //www.xbox.com/en-US/kinect/default.htm
2. X. Suau, J. Ruiz-Hidalgo, and J. R. Casas, "Real-time head and hand tracking based on 2.5-D data," IEEE Trans. Multimedia, vol. 14, no. 3, pp. 575-585, May 2012.
3. J. Shotton, R. Girshick, A. Fitzgibbon, T. Sharp, M. Cook, M. Finocchio, R. Moore, P. Kohli, A. Criminisi, A. Kipman, and A. Blake, "Efficient human pose estimation from single depth images," IEEE Trans. Pattern Anal. Mach. Intell., vol. PP, no. 99, p. 1, Nov. 2012.
4. OpenNI Orgaization. OpenNI User Guide [Online]. Available: http:// www.openni.org/
5. A. Maimone, J. Bidwell, K. Peng, and H. Fuchs, "Enhanced personal autostereoscopic telepresence system using commodity depth cameras," Comput. Graphics, vol. 36, no. 7, pp. 791-807, 2012.
6. L. Chen, H. Wei, and J. Ferryman, "A survey of human motion analysis using depth imagery," Pattern Recognit. Lett., 2013.
7. D. Wu, F. Zhu, and L. Shao, "One shot learning gesture recognition from RGBD images," in Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit. Workshops, Oct. 2012, pp. 7-12.
8. K. Khoshelham and S. O. Elberink, "Accuracy and resolution of kinect depth data for indoor mapping applications," Sensors, vol. 12, no. 2, pp. 1437-1454, 2012.
9. F. Menna, F. Remondino, R. Battisti, and E. Nocerino, "Geometric investigation of a gaming active device," in Proc. SPIE, vol. 8085, 2011, p. 80850G.
10. M. Camplani, T. Mantecon, and L. Salgado, "Accurate depth-color scene modeling for 3-D contents generation with low cost depth cameras," in Proc. 19th IEEE Int. Conf. Image Process., Sep.-Oct. 2012, pp. 1741-1744.
11. M. Camplani and L. Salgado, "Efficient spatio-temporal hole filling strategy for Kinect depth maps," in Proc. Three-Dimensional Image Process. Applicat. II, vol. 8290, no. 1. 2012, p. 82900E.
12. S. Matyunin, D. Vatolin, Y. Berdnikov, and M. Smirnov, "Temporal filtering for depth maps generated by Kinect depth camera," in Proc. 3DTV Conf.: True Vision Capture Transmission Display 3-D Video, May 2011, pp. 1-4.
13. J. Wasza, S. Bauer, and J. Hornegger, "Real-time preprocessing for dense 3-D range imaging on the GPU: Defect interpolation, bilateral temporal averaging and guided filtering," in Proc. IEEE Int. Conf. Comput. Vision Workshops, Nov. 2011, pp. 1221-1227.
14. K. Lai, L. Bo, and X. Ren, "A large-scale hierarchical multi-view RGBD object dataset," in Proc. Int. Conf. Robot. Autom., 2011, pp. 1817-1824.
15. F. Qi, J. Han, P. Wang, G. Shi, and F. Li, "Structure guided fusion for depth map inpainting," Pattern Recognit. Lett., vol. 34, no. 1, pp. 70-76, Jun. 2013.
16. A. Telea, "An image inpainting technique based on the fast marching method," J. Graphics Tools, vol. 9, no. 1, pp. 23-34, 2004.
17. G. Petschnigg, R. Szeliski, M. Agrawala, M. Cohen, H. Hoppe, and K. Toyama, "Digital photography with flash and no-flash image pairs," ACM Trans. Graphics, vol. 23, no. 3, pp. 664-672, 2004.
18. C. Stauffer and W. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Aug. 1999, pp. 246-252.
19. P. Kaewtrakulpong and R. Bowden, "An improved adaptive background mixture model for real-time tracking with shadow detection," in Proc. 2nd Eur. Workshop Adv. Video-Based Surveillance Syst., 2002, pp. 135-144.
20. M. Cristani, M. Farenzena, and D. Bloisi, and V. Murino, "Background subtraction for automated multisensor surveillance: A comprehensive review," EURASIP J. Adv. Signal Process., article no. 43, pp. 1-24, 2010.
21. G. Gordon, T. Darrell, M. Harville, and J. Woodfill, "Background estimation and removal based on range and color," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., vol. 2. Jun. 1999, pp. 2459-2464.
22. J. Leens, O. Barnich, S. Piérard, M. Droogenbroeck, and J.-M. Wagner, "Combining color, depth, and motion for video segmentation," in Computer Vision Systems, vol. 5815. Berlin, Germany: Springer, 2009, pp. 104-113.
23. L. Li, W. Huang, I. Y.-H. Gu, and Q. Tian, "Statistical modeling of complex backgrounds for foreground object detection," IEEE Trans. Image Process., vol. 13, no. 11, pp. 1459-1472, Nov. 2004.