Hand tracking in a natural conversational environment by the interacting multiple model and probabilistic data association (IMM-PDA) algorithm

Pattern Recognition

Volumn 38, Issue 11, 2005, Pages 2143-2158

  Wu, Shunguang ^a   Hong, Lang ^a  

^a Wright State University   (United States)

Author keywords

Gesture; Human hand tracking; Interacting multiple model; Kalman filter; Probabilistic data association

Indexed keywords

ALGORITHMS; CLUTTER (INFORMATION THEORY); DATA REDUCTION; GESTURE RECOGNITION; KALMAN FILTERING; MANEUVERABILITY;

GESTURE; HUMAN HAND TRACKING; INTERACTING MULTIPLE MODELS; PROBABILISTIC DATA ASSOCIATION;

IMAGE ANALYSIS;

EID: 24044526503     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2005.01.020     Document Type: Article

References (70)

1. J.K. Aggarwal, and Q. Cai Human motion analysis: A review Comput. Vision Image Understand. 73 3 1999 428 440
2. D.M. Gavrila The visual analysis of human movement: A survey Comput. Vision Image Understand. 73 1 1999 82 98
3. T. Moeslund, and E. Granum A survey of computer vision-based human motion capture Comput. Vision Image Understand. 81 3 2001 231 268
4. L. Wang, W. Hu, and T. Tan Recent developments in human motion analysis Pattern Recognition 36 1 2003 585 601
5. D. McNeill Hand and Mind - What Gesture Reveals about Thought 1992 The University of Chicago Press Chicago and London
6. L. Valbonesi, R. Ansari, D. McNeill, F. Quek, S. Duncan, K. McCullough, R. Bryll, Analysis of speech and estures: Gesture frequency during fluent and hesitant phases in speech, Proceedings of the Sixth Multi Conference on Systemics, Cybernetics and Informatics (SCI), vol. IX, Orlando, FL, July 14-18, 2002, pp. 567-570.
7. F. Quek, R. Bryll, M. Harper, L. Chen, and L. Ramig Toward vision and gesture based evaluation of Parkinson's disease from discourse video Proceedings of the IEEE International Symposium of Bio-Informatics and Bio-Engineering Manchester, UK 2001 246 253
8. F. Quek, M. Harper, Y. Haciahmetoglu, L. Chen, L. Ramig, Speech pauses and gestural holds in Parkinson's disease, Proceedings of the Seventh International Conference on Spoken Language Processing, vol. 4, Denver, CO, 2002, pp. 2485-2488.
9. F. Quek Toward a vision-based hand gesture interface Proceedings of Virtual Reality Software and Technology Conference Singapore 1994 17 29
10. R. Kalman A new approach to linear filtering and prediction problems ASME J. Basic Eng. 82 1960 34 45
11. J.F. Bellantoni, and K.W. Dodge A square root formulation of the Kalman-Schmidt filter AIAA J. 5 1967 1309 1314
12. S. Julier, J. Uhlmann, and H. Durrant-Whyte A new method for the nonlinear transformation of means and covariance in filters and estimators IEEE Trans. Automatic Control 45 3 2000 477 482
13. K. Ito, and K. Xiong Gaussian filters for nonlinear filtering problems IEEE Trans. Automatic Control 45 5 2000 910 927
14. D. Fox Adapting the Sample Size in Particle Filters Through KLD-Sampling Int. J. Robotics Res. 22 10/11 2003 985 1004
15. A. Doucet, N. Freitas, and N. Gordon Sequential Monte Carlo Methods in Practice 2001 Springer Berlin
16. D. Ballard Generalizing the Hough transform to detect arbitrary shape Pattern Recognition 13 1981 111 122
17. D. Keren, D. Cooper, and J. Subrahmonia Describing complicated objects by implicit polynomials IEEE Trans. Pattern Anal. Mach. Intell. 16 1994 38 53
18. H. Moon, R. Chellappa, and A. Rosenfeld Optimal edge-based shape detection IEEE Trans. Image Process. 11 2002 1209 1227
19. J. Shi, and C. Tomasi Good features to track IEEE Conference on Computer Vision and Pattern Recognition (CVPR'94) Seattle, WA 1994 593 600
20. F.H. Parry, A. Marshall, K. Markham, Region template correlation for FLIR target tracking, Proceedings of the BMVC, Malvern, Worls, 1996 (http://www.bmva.ac.uk/bmvc/1996 ).
21. M. Gleicher, Projective registration with difference decomposition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR'97), vol. 1, Puerto Rico, 1997, pp. 331-337.
22. G. Hager, and P.N. Belhumeur Efficient region tracking with parametric models of geometry and illumination IEEE Trans. Pattern Anal. Mach. Intell. 20 10 1998 1025 1039
23. H. Nguyen, M. Worring, Multifeature object tracking using a model-free approach, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2000 (CVPR'00), vol. 1, SC, 2000, pp. 145-150.
24. Y. Huang, T.S. Huang, H. Niemann, A region-based method for model-free object tracking, Proceedings of the 16th International Conference on Pattern Recognition (ICPR'02), vol. 1, Quebec City, QC, Canada, August 11-15, 2002, pp. 10592-10595.
25. Y. Wu, Q. Liu, T.S. Huang, Robust real-time human hand localization by self-organizing color segmentation, International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Corfu, Greece, September 26-27, 1999, pp. 161-166.
26. K. Imagawa, S. Lu, and S. Igi Color-based hands tracking system for sign language recognition Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition Nara, Japan 1998 161 166
27. R. Kjeldsen, and J. Kender Finding skin in color images Proceedings of the Second International Conference on Automatic Face and Gesture Recognition Killington, VT October 1996 312 317
28. V. Pavlovic, G. Berry, and T. Huang Fusion of audio/visual information for human-computer interaction Proceedings of the Workshop on percentual user interfaces PUI Banff, Alberta, Canada October 1997 69 71
29. C. Wren, A. Azarbayejani, T. Darrel, and A. Pentland Pfinder: real-time tracking of human body IEEE Trans. Pattern Anal. Mach. Intell. 19 7 1997 780 785
30. Y. Wu, and T. Huang Human hand modeling analysis and animation in the context of HCL Proceedings of the IEEE International Conference on Image Processing Kobe, Japan 1999 69 71
31. Y. Azoz, L. Devi, and R. Sharma Tracking hand dynamics in unconstrained environments Proceedings of the International Conference on Face and Gesture Recognition Nara, Japan April 1998 274 279
32. R. Vaillant, and D. Darmon Vision based hand pose estimation Proceedings of the International Workshop on Automatic Face and Gesture Recognition Zurich, Switzerland 1995 356 361
33. Q. Delamarre, and O. Faugeras Finding pose of hand in video images a stereo-based approach Proceedings of the International Workshop on Automatic Face and Gesture Recognition Nara, Japan 1998 585 590
34. A. Utsumi, and J. Ohya Multiple-hand-gesture tracking using multiple cameras IEEE Proceedings of CVPR99 Fort Collins, CO 1999 473 478
35. Y. Azoz, L. Devi, and R. Sharma Reliable tracking of human arm dynamics by multiple cue integration and constraint fusion Proceedings of the IEEE Confernece on Computer Vision and Pattern Recognition Santa Barbara, CA 1998 905 910
36. C. Wren, and A. Pentland Dynamic models of human motion Proceedings of the International Conference on Face and Gesture Recognition Nara, Japan 1998 22 27
37. C. Bregler Learning and recognizing human dynamics in video sequences Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition San Juan, Puerto Rico June 1997 568 574
38. S. Mckenna, S. Gong, Tracking face, Proceedings of the International Conference on Automatic Face and Gesture Recognition, 1996, pp. 271-276.
39. J. Jebura, and A. Pentland Parametrized structure from motion of 3D adaptive feedback tracking of faces Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition San Juan, Puerto Rico 1997 144 150
40. N. Oliver, A. Pentland, and F. Bernard Lafter: a real time face and lips tracker with facial expression recognition Pattern Recognition 33 2000 1369 1382
41. A. Haro, M. Hickner, and I. Essa Detecting and tracking eyes by using their physiological properties Proceedings of the IEEE CVPR00 Hilton Head Island, SC 2000 163 168
42. M. Isard, and A. Blake Condensation - conditional density propagation for visual tracking Int. J. Comput. Vision 29 1 1998 5 28
43. M. Worring, A.W.M. Smeulders, L.H. Staib, and J.S. Duncan Parameterized feasible boundaries in gradient vector-fields Image Understanding 63 1 1996 135 144
44. N. Peterfreund Robust tracking of position and velocity with Kalman snakes IEEE Trans. Pattern Anal. Mach. Intell. 21 1999 564 569
45. J.P. Mammen, S. Chaudhuri, and T. Agrawal Simultaneous tracking of both hands by estimation of erroneous Proceedings of BMVC Manchester, UK September 2001 83 92
46. P. Li, and T. Zhang Visual contour tracking based on particle filters Proceedings of the Workshop on Generative Model-Based Vision, in Conjunction with ECCV02 Copenhagen, Denmark 2002 61 70
47. N.K. Paragios, R. Deriche, A PDE-based level set approach for detection and tracking of moving objects, Proceedings of the International Conference on Computer Vision, 1998, pp. 1139-1145.
48. C. Gu, Multivalued morphology and segmentation-based coding, Ph.D. Dissertation, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland, 1995.
49. H.T. Nguyen, M. Worring, R. van den Boomgaard, and A.W.M. Smeulders Tracking nonparameterized object contours IEEE Trans. Image Process. 11 9 2002 1081 1091
50. J. Rehg, T. Kanade, Model-based tracking of self-occluding articulated objects, Proceedings of the IEEE International Conference on Computer Vision, 1995, pp. 612-617.
51. J. Lee, and T. Kunii Model-based analysis of hand posture IEEE Comput. Graph. Appl. 15 1995 77 86
52. Y. Wu, T.S. Huang, Capturing articulated human hand motion: a divide-and-conquer approach, Proceedings of the IEEE International Conference on Computer Vision, vol. 1, Corfu, Greece, 1999, pp. 606-611.
53. V. Pavlovic, G. Berry, T. Huang, A multimodal human-computer interface for control of a virtual environment, American Association for Artificial Intelligence 1998 Spring Symposium on Intelligent Environments, 1998 (http://citeseer.ist.psu.edu/berry98multimodal.html )
54. T. Starner, J. Weaver, and A. Pentland A wearable computer based American sign language recognizer First IEEE International Symposium on Wearable Computing Cambridge, MA October 1997 130 137
55. N. Shimada Hand gesture estimation and model refinement using monocular camera - ambiguity limitation by inequality constraints Proceedings of the Third Conference on Face and Gesture Recognition Nara, Japan 1998 268 273
56. J. Segen, S. Kumar, Shadow gesture: 3d hand pose estimation using a single camera, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1999, pp. 479-485.
57. S. Lu, G. Huang, D. Samaras, and D. Metax Model-based integration of visual cues for hand tracking Proceedings of the Workshop on Motion and Video Computing (MOTION'02) Orlando, FL December 2002 118 124
58. R. Rosales, S. Sclaroff, Inferring body pose without tracking body parts, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, 2000, pp. 721-727.
59. Y. Wu, T.S. Huang, View-independent recognition of hand postures, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, Hilton Head Island, SC, 2000, pp. 88-94.
60. X. Li, and V. Jilkov Survey of maneuvering target tracking - part I: Dynamic models IEEE T. Aero. Elec. Sys. 39 4 2003 1333 1364
61. X. Li, V. Jilkov, Overview of multiple-model methods for maneuvering target tracking, in: Proceedings of the SPIE Conference on Signal and Data Processing of Small Targets, vol. 5204, San Diego, CA, 2003, pp. 200-210.
62. Y. Bar-Shalom, and T.E. Fortmann Tracking and Data Association 1988 Academic Press San Diego, CA
63. R. Bryll, A robust agent-based tracking system, Ph.D. Dissertation, Wright State University, Dayton, OH, 2003.
64. F. Quek, R. Bryll, Vector coherence mapping: A parallelizable approach to image flow computation, Proceedings of the IEEE International Conference on Computer Vision, vol. 2, Hong Kong, 1998, pp. 591-598.
65. S. Wu, Y. Shi, R.T. Rose, R. Bryll, F. Quek, VCM-cluster-fixer: a software to visualize, check and verify VCM results, Technical Report VISLab-03-01, VisLab, Wright State U., 2003.
66. S.S. Blackman Multiple Target Tracking with Radar Applications 1986 Artech House Norwood, MA
67. R. Hegger, H. Kantz, and T. Schreiber Practical implementation of nonlinear time series methods: The TISEAN package CHAOS 9 1999 413 424
68. H. Blom, and Y. Bar-Shalom The interacting multiple model algorithm for systems with Markovian switching coefficients IEEE Trans. Automatic Control AC-33 8 1988 780 783
69. L. Hong, and N. Cui An interacting multipattern probabilistic data association (IMP-PDA) algorithm for target tracking IEEE Trans. Automatic Control AC-46 2001 1223 1236
70. Y. Bar-Shalom, and X. Li Multitarget-Multi Sensor Tracking: Principles and Techniques 1995 YBS Publishing Artech House, CT