Real-time multiple human perception with color-depth cameras on a mobile robot

IEEE Transactions on Cybernetics

Volumn 43, Issue 5, 2013, Pages 1429-1441

  Zhang, Hao ^a   Reardon, Christopher ^a   Parker, Lynne E ^a  

^a University of Tennessee   (United States)

Author keywords

3 D vision; Depth of interest; Human detection and tracking; Human perception; RGB D camera application

Indexed keywords

3-D VISION; DEPTH OF INTEREST; HUMAN DETECTION AND TRACKING; HUMAN PERCEPTION; RGB-D CAMERAS;

COLOR; HUMAN COMPUTER INTERACTION; MOBILE ROBOTS;

CAMERAS;

ACTIMETRY; ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COLOR; COLORIMETRY; COMPUTER; COMPUTER SIMULATION; COMPUTER SYSTEM; EQUIPMENT; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; MOTION; RECREATION; ROBOTICS; THREE DIMENSIONAL IMAGING; TRANSDUCER; WHOLE BODY IMAGING; DEVICES; PROCEDURES;

ACTIGRAPHY; ALGORITHMS; ARTIFICIAL INTELLIGENCE; COLOR; COLORIMETRY; COMPUTER PERIPHERALS; COMPUTER SIMULATION; COMPUTER SYSTEMS; HUMANS; IMAGE ENHANCEMENT; IMAGING, THREE-DIMENSIONAL; MOTION; PATTERN RECOGNITION, AUTOMATED; ROBOTICS; TRANSDUCERS; VIDEO GAMES; WHOLE BODY IMAGING;

EID: 84890372203     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2275291     Document Type: Article

References (44)

1. M. M. Loper, N. P. Koenig, S. H. Chernova, C. V. Jones, and O. C. Jenkins, "Mobile human-robot teaming with environmental tolerance," in Proc. ACM/IEEE Int. Conf. Human-Robot Interact., 2009, pp. 157-164.
2. B. Leibe, E. Seemann, and B. Schiele, "Pedestrian detection in crowded scenes," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2005, pp. 878-885.
3. P. Viola, M. J. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," Int. J. Comput. Vision, vol. 63, no. 2, pp. 153-161, Jul. 2005.
4. P. Dollár, S. Belongie, and P. Perona, "The fastest pedestrian detector in the West," in Proc. Brit. Mach. Vision Conf., 2010, pp. 1-11.
5. J. T. Eckner, J. S. Kutcher, and J. K. Richardson, "Pilot evaluation of a novel clinical test of reaction time in National Collegiate Athletic Association Division I football players," J. Athlet. Train., vol. 45, no. 4, pp. 327-332, 2010.
6. P. Dollár, C. Wojek, B. Schiele, and P. Perona, "Pedestrian detection: An evaluation of the state of the art," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 743-761, Apr. 2012.
7. J. Han, L. Shao, D. Xu, and J. Shotton, "Enhanced computer vision with Microsoft Kinect sensor: A review," IEEE Trans. Cybern., vol. 43, no. 5, pp. 1318-1334, Oct. 2013.
8. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, Nov. 2004.
9. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2005, pp. 886-893.
10. B. Wu and R. Nevatia, "Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors," Int. J. Comput. Vision, vol. 75, no. 2, pp. 247-266, Nov. 2007.
11. L. Bourdev and J. Malik, "Poselets: Body part detectors trained using 3-D human pose annotations," in Proc. Int. Conf. Comput. Vision, 2009, pp. 1365-1372.
12. N. Dalal, B. Triggs, and C. Schmid, "Human detection using oriented histograms of flow and appearance," in Proc. Eur. Conf. Comput. Vision, 2006, pp. 428-441.
13. O. Lanz, "Approximate Bayesian multibody tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1436-1449, Sep. 2006.
14. C. Stauffer and W. E. L. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 1999, pp. 246-252.
15. M. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, and L. Van Gool, "Online multiperson tracking-by-detection from a single, uncalibrated camera," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1820-1833, Sep. 2011.
16. Y. Cheng, "Mean shift, mode seeking, and clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, no. 8, pp. 790-799, Aug. 1995.
17. D. Koller and N. Friedman, Probabilistic Graphical Models: Principles and Techniques, 1st ed. Boston, MA, USA: The MIT Press, 2009.
18. R. E. Kalman, "A new approach to linear filtering and prediction problems," J. Basic Eng., vol. 82, pp. 35-45, 1960.
19. M. S. Arulampalam, S. Maskell, and N. Gordon, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002.
20. K. Okuma, A. Taleghani, N. de Freitas, J. J. Little, and D. G. Lowe, "A boosted particle filter: Multitarget detection and tracking," in Proc. Eur. Conf. Comput. Vision, 2004, pp. 28-39.
21. Y. Cai and C. Y. Cai, "Robust visual tracking for multiple targets," in Proc. Eur. Conf. Comput. Vision, 2006, pp. 107-118.
22. L. Zhang, Y. Li, and R. Nevatia, "Global data association for multiobject tracking using network flows," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2008, pp. 1-8.
23. A. Ess, B. Leibe, K. Schindler, and L. van Gool, "Robust multiperson tracking from a mobile platform," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 10, pp. 1831-1846, Oct. 2009.
24. D. Reid, "An algorithm for tracking multiple targets," IEEE Trans. Automat. Control, vol. 24, no. 6, pp. 843-854, Dec. 1979.
25. T. Fortmann, Y. Bar-Shalom, and M. Scheffe, "Sonar tracking of multiple targets using joint probabilistic data association," IEEE J. Ocean. Eng., vol. 8, no. 3, pp. 173-184, Jul. 1983.
26. G. Shu, A. Dehghan, O. Oreifej, E. Hand, and M. Shah, "Part-based multiple-person tracking with partial occlusion handling," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2012, pp. 1815-1821.
27. R. Kaucic, A. Amitha Perera, G. Brooksby, J. Kaufhold, and A. Hoogs, "A unified framework for tracking through occlusions and across sensor gaps," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2005, pp. 990-997.
28. N. Papadakis and A. Bugeau, "Tracking with occlusions via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 1, pp. 144-157, Jan. 2011.
29. L. Spinello, K. Arras, R. Triebel, and R. Siegwart, "A layered approach to people detection in 3-D range data," in Proc. AAAI Conf. Artif. Intell., 2010.
30. C. Keller, M. Enzweiler, M. Rohrbach, D. Llorca, C. Schnorr, and D. Gavrila, "The benefits of dense stereo for pedestrian detection," IEEE Trans. Intell. Transport. Syst., vol. 12, no. 4, pp. 1096-1106, Dec. 2011.
31. R. Muñoz Salinas, E. Aguirre, and M. García-Silvente, "People detection and tracking using stereo vision and color," J. Image Vision Comput., vol. 25, no. 6, pp. 995-1007, Jun. 2007.
32. S. Ikemura and H. Fujiyoshi, "Real-time human detection using relational depth similarity features," in Proc. Asian Conf. Comput. vision, 2011, pp. 25-38.
33. F. Xu and K. Fujimura, "Human detection using depth and gray images," in Proc. IEEE Conf. Adv. Video Signal Based Surveillance, 2003, pp. 115-121.
34. J. Salas and C. Tomasi, "People detection using color and depth images," in Proc. Mex. Conf. Pattern Recognit., 2011, pp. 127-135.
35. L. Xia, C.-C. Chen, and J. Aggarwal, "Human detection using depth information by Kinect," in Proc. IEEE Conf. Comput. Vision Pattern Recognit. Workshops, 2011, pp. 15-22.
36. M. Luber, L. Spinello, and K. O. Arras, "People tracking in RGB-D data with on-line boosted target models," in Proc. IEEE Int. Conf. Intell. Robots Syst., 2011, pp. 3844-3849.
37. W. Choi, C. Pantofaru, and S. Savarese, "Detecting and tracking people using an RGB-D camera via multiple detector fusion," in Proc. IEEE Int. Conf. Comput. Vision Workshops, 2011, pp. 1076-1083.
38. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981.
39. G. Kim and A. Torralba, "Unsupervised detection of regions of interest using iterative link analysis," in Proc. Neural Inform. Process. Syst., 2009, pp. 961-969.
40. E. Parzen, "On estimation of a probability density function and mode," Ann. Math. Statist., vol. 33, no. 3, pp. 1065-1076, 1962.
41. H. Grabner and H. Bischof, "On-line boosting and vision," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., 2006, pp. 260-267.
42. G. Einicke and L. White, "Robust extended Kalman filtering," IEEE Trans. Signal Process., vol. 47, no. 9, pp. 2596-2599, Sep. 1999.
43. R. Rusu and S. Cousins, "3-D is here: Point cloud library (PCL)," in Proc. IEEE Int. Conf. Robot. Automat., 2011, pp. 1-4.
44. K. Bernardin and R. Stiefelhagen, "Evaluating multiple object tracking performance: The CLEAR MOT metrics," J. Image Video Process., vol. 2008, pp. 1:1-1:10, Feb. 2008.