Towards joint attention for a domestic service robot - Person awareness and gesture recognition using time-of-flight cameras

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2011, Pages 1205-1210

  Droeschel, David ^a   Stückler, Jörg ^a   Holz, Dirk ^a   Behnke, Sven ^a  

^a UNIVERSITY OF BONN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION PARTNERS; DOMESTIC SERVICES; HUMAN USERS; JOINT ATTENTION; MOBILE MANIPULATION; PRE-DEFINED POSITION; ROBOCUP; STEREO-BASED; TIME-OF-FLIGHT CAMERAS;

CAMERAS; GESTURE RECOGNITION; MOBILE ROBOTS;

ROBOTICS;

EID: 84855401849     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2011.5980067     Document Type: Conference Paper

References (28)

1. L. Kopp and P. Gärdenfors. Attention as a Minimal Criterion of Intentionality in Robots, Volume 89 of Cognitive Studies. Lund University.
2. F. Kaplan and V. Hafner. The challenges of joint attention. Interaction Studies, 7(2):135-169, 2006.
3. F. Faber, M. Bennewitz, C. Eppner, A. Görög, C. Gonsior, D. Joho, M. Schreiber, and S. Behnke. The humanoid museum tour guide Robotinho. In Proc. of IEEE Humanoids, 2009.
4. S. Mitra and T. Acharya. Gesture recognition: A survey. IEEE Tram, on Systems, Man and Cybernetis - Part C, 37(3):311-324, 2007.
5. V. V. Hafner and F. Kaplan. Learning to interpret pointing gestures: experiments with four-legged autonomous robots, Volume 3575 of LNCS. Springer, 2005.
6. D. Schulz, W. Burgard, D. Fox, and A.B. Cremers. People tracking with a mobile robot using sample-based joint probabilistic data association filters. International Journal of Robotics Research, 22, 2003.
7. K. Arras, S. Grzonka, M. Luber, and W. Burgard. Efficient people tracking in laser range data using a multi-hypothesis leg-tracker with adaptive occlusion probabilities. In Proc. ICRA, 2008.
8. D.B. Reid. An algorithm for tracking multiple targets. IEEE Transactions on Automatic Control, 24(6), 1979.
9. J. Berclaz, F. Fleuret, and P. Fua. Robust People Tracking with Global Trajectory Optimization. In Proc. of CVPR, pages 744-750, 2006.
10. O. Lanz. Approximate bayesian multibody tracking. IEEE Trans. Pattern Anal. Mach. Intell., 28(9):1436-1449, 2006.
11. D.M. Gavrila and S. Münder. Multi-cue pedestrian detection and tracking from a moving vehicle. Int. Journal of Computer Vision, 73(1):41-59, 2007.
12. A. Ess, B. Leibe, K. Schindler, and L. van Gool. A mobile vision system for robust multi-person tracking. In Proc. of CVPR, 2008.
13. K. Okuma, A. Taleghani, N. de Freitas, J.J. Little, and D.G. Lowe. A boosted particle filter: Multitarget detection and tracking. In Springer, LNCS 3021, 2004.
14. K. Nickel and R. Stiefelhagen. Visual recognition of pointing gestures for humanrobot interaction. Image and Vision Computing, 25(12):1875-1884, 2007.
15. T. Axenbeck, M. Bennewitz, S. Behnke, and W. Burgard. Recognizing complex, parameterized gestures from monocular image sequences. In Proc. of IEEE Humanoids, 2008.
16. E. Kollorz, J. Hornegger, and A. Barke. Gesture recognition with a time-of-flight camera. In Proc. of Dynamic 3D Imaging DAGM Workshop, 2007.
17. P. Breuer, C. Eckes, and S. Müller. Hand gesture recognition with a novel ir time-of-flight range camera a pilot study. In Proc. of Mirage 2007, Computer Vision / Computer Graphics Collaboration Techniques and Applications, 2007.
18. M. Haker, M. Böhme, T. Martinetz, and E. Barth. Self-organizing maps for pose estimation with a time-of-flight camera. In Proc. of the DAGM 2009 Workshop on Dynamic 3D Imaging, 2009.
19. P. McGuire, J. Fritsch, J. J. Steil, F. Rthling, G. A. Fink, S. Wachsmuth, G Sagerer, and H. Ritter. Multi-modal human-machine communication for instructing robot grasping tasks. In Proc. of IROS, 2002.
20. C. Martin, F.-F. Steege, and H.-M. Gross. Estimation of pointing poses for visual instructing mobile robots under real world conditions. In Proceedings of 3rd European Conference on Mobile Robots (ECMR), Freiburg, 2007.
21. H. Sumioka, K. Hosoda, Y. Yoshikawa, and M. Asada. Acquisition of joint attention through natural interaction utilizing motion cues. Advanced Robotics, 21(9), 2007.
22. C. Goerick, H. Wersing, I. Mikhailova, and M. Dunn. Peripersonal space and object recognition for humanoids. In Proc. of IEEE Humanoids, 2005.
23. H.W. Kuhn. The Hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2(1):83-97, 1955.
24. P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. In Proc. of CVPR, 2001.
25. N. Dalai and B. Triggs. Histograms of oriented gradients for human detection. In Prof, of CVPR, Volume 2, pages 886-893, 2005.
26. J. Stückler and S. Behnke. Integrating Indoor Mobility, Object Manipulation, and Intuitive Interaction for Domestic Service Tasks. In Proc. of IEEE Humanoids, 2009.
27. S. May, D. Droeschel, D. Holz, S. Fuchs, E. Malis, A. Nuchter, and J. Hertzberg. Three-dimensional mapping with time-of-flight cameras. Journal of Field Robotics, Special Issue on Three-Dimensional Mapping, Part 2, 26(11-12):934-965, 2009.
28. Institut für Informatik VI, Rheinische Friedrich-Wilhelms- Universität Bonn. NimbRo@Home. http://www.nimbro.net/@Home/.