Agent-based gesture tracking

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 35, Issue 6, 2005, Pages 795-810

  Bryll, Robert ^a   Rose, R Travis ^b   Quek, Francis ^b  

^a WA 98034   (United States)

^b VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

Author keywords

Agent based systems; Computer vision; Data fusion; Gesture analysis; Gesture tracking; Object tracking; Path coherence

Indexed keywords

ALGORITHMS; COHERENT LIGHT; COMPUTER VISION; FEATURE EXTRACTION; MULTI AGENT SYSTEMS; OBJECT RECOGNITION; OPTICAL FLOWS; SENSOR DATA FUSION; TRACKING (POSITION); VECTORS;

AGENT-BASED SYSTEMS; GESTURE ANALYSIS; GESTURE TRACKING; OBJECT TRACKING; PATH COHERENCE;

GESTURE RECOGNITION;

EID: 27744462733     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2005.851260     Document Type: Article

References (55)

1. D. Gavrila, "The visual analysis of human movement: A survey," Comput. Vis. Image Underst., vol.73, no. 1, pp. 82-98, 1999.
2. R. Ansari, Y. Dai, J. Lou, D. McNeill, and F. Quek, "Representation of prosodic structure in speech using nonlinear methods," in Proc. Workshop Nonlinear Signal and Image Processing, Antalya, Turkey, 1999, pp. 471-475.
3. D. McNeill, F. Quek, K.-E. McCullough, S. Duncan, N. Furuyama, R. Bryll, and R. Ansari, "Catchments, prosody and discourse," in Oralité et Gestualité, ORAGE (Speech and Gesture), C. Cavé, I. Guaïtella, and S. Santi, Eds. Aix-en-Provence, France, 2001, pp. 474-481.
4. F. Quek, R. Bryll, H. Arslan, C. Kirbas, and D. McNeill, "A multimedia database system for temporally situated perceptual psycholinguistic analysis," Multimed. Tools Appl., vol. 18, no. 2, pp. 91-113, 2002.
5. F. Quek, D. McNeill,. R. Ansari, X. Ma, R. Bryll, S. Duncan, and K.-E. McCullough, "Gesture cues for conversational interaction in monocular video," in Proc. Int. Conf. Computer Vision (ICCV) Int. Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Coffu, Greece, Sep. 26-27, 1999, pp. 64-69.
6. F. Quek, X. Ma, and R Bryll, "A parallel algorithm for dynamic gesture tracking," in Proc. Int. Conf. Computer Vision (ICCV) Int. Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Corfu, Greece, Sep. 26-27, 1999, pp. 119-126.
7. D. McNeill, Hand and Mind: What Gestures Reveal About Thought. Chicago, IL: Univ. Chicago Press, 1992.
8. F. K. H. Quek and R. K. Bryll, "Vector coherence mapping: A parallelizable approach to image flow computation," in Proc. Asian Conf. Computer Vision, Hong Kong, Jan. 8-10, 1998, vol. II, pp. 591-598.
9. R. Bryll and F. Quek) (2002, Jun.). Accurate tracking by vector coherence mapping and vector-centroid fusion. Vision Interfaces and Syst. Laboratory, CSE Dept., Wright State Univ., Blacksburg, VA, Tech. Rep. VISLab-02-10. [Online]. Available: http://vislab.cs.vt.edu/ Publications/2002/BryQ02.html
10. R. Tsai, "A versatile camera calibration technique for high accuracy 3-D machine vision metrology using off-the-shelf TV cameras and lenses," IEEE J. Robot. Autom., vol. RA-3, no. 4, pp. 323-344, 1987.
11. J. Aggarwal and Q. Cai, "Human motion analysis: A review," Comput. Vis. Image Underst., vol. 73, no. 3, pp. 428440, Mar. 1999.
12. J. Aggarwal, Q. Cai, W. Liao, and B. Sabata, "Nonrigid motion analysis: Articulated and elastic motion," Comput. Vis. Image Underst., vol. 70, no. 2, pp. 142-156, May 1998.
13. P. Stone and M. Veloso, "Multiagent systems: A survey from a machine learning perspective," Auton. Robots, vol. 8, no. 3, pp. 345-383, 2000.
14. M. Woolridge and N. R. Jennings, "Intelligent agents: Theory and practice," Knowl. Eng. Rev., vol. 10, no. 2, pp. 115-152, 1995.
15. N. R. Jennings, K. Sycara, and M. Woolridge, "A roadmap of agent research and development," Auton. Agents Multi-Agent Syst., vol. 1, no. 1, pp. 7-38, 1998.
16. G.Weiss, Multiagent Systems. A Modern Approach to Distributed Artificial Intelligence. Cambridge, MA: MIT Press, 1999.
17. W. Brenner, R. Zarnekow, and H. Wittig, Intelligent Software Agents. Foundations and Applications. Berlin, Germany: Springer-Verlag, 1998.
18. M. Woolridge, "Intelligent agents," in Multiagent Systems. A Modern Approach to Distributed Artificial Intelligence, G. Weiss, Ed. Cambridge, MA: MIT Press, 1999, pp. 27-77.
19. Proceedings of the International Workshop on Robot Vision, R. Klette, S. Peleg, and G. Sommer, Eds. New York: Springer, Feb. 2001.
20. T. K. Cheng, L. Kitchen, Z.-Q. Liu, and J. Cooper, "An agent-based approach for robot vision system," in Proc. Int. Computer Science Cong (ICSC), Hong Kong, 1995, pp. 489-490.
21. Y. Shang and H. Shi, "A web-based multi-agent system for interpreting medical images," World Wide Web, vol. 2, no. 4, pp. 209-218, 1999.
22. M. Saptharishi, J. B. Hampshire, II, and P. K. Khosla, "Agent-based moving object correspondence using differential discriminative diagnosis," in Proc. Computer Vision and Pattern Recognition (CVPR), Hilton Head, SC, 2000, vol. 2 pp. 2652-2658.
23. S. Stavroulakis, V. Callaghan, and L. Spacek, "A multiagent approach to machine vision," in EXPO: Shaping the Future, Hanover, Germany, Jul. 11-13, 2000.
24. I. Infantino, M. Cossentino, and A. Chella, "An agent based multi-level architecture for robotics vision systems," in Proc. Artificial Intelligence and Information Analysis (AIIA), Siena, Italy, Sep. 10-13, 2002, pp. 386-390.
25. M. Lückenhaus and W. Eckstein, "A multi-agent based system for parallel image processing," in Proc. Int. Society Optical Engineering (SPIE), Parallel and Distributed Methods Image Processing (SPIE's Annu. Meeting), San Diego, CA, Aug. 28-29, 1997, vol. 3166, pp. 21-30.
26. M. Lückenhaus, "A multi-agent system for parallelizing image analysis task," in 5th Int. Conf. Intelligent Autonomous Systems (IAS-5). Sapporo, Japan: AAAI Press, Jun. 1-4 1998, pp. 579-586.
27. F. Arcelli, M. De Santo, and S. Di Salvo, "Software agents for computer vision: A preliminary discussion," in Proc. 31st Annu. Hawaii Int. Conf. on System Sciences, Kohala Coast, HI, Jan. 1998, pp. 9-17.
28. A. Soto and P. Khosla, "Probabilistic adaptive agent-based system for dynamic state estimation using multiple visual cues," in Proc. 10th Int. Symp. Robotics Research (ISSR), Lorne, Vic., Australia, Nov. 9-12, 2001.
29. P. Remagnino, T. Tan, and K. Baker, "Multi-agent visual surveillance of dynamic scenes," Image Vis. Comput., vol. 16, no. 8, pp. 529-532, 1998.
30. L. C. Tan, C. M. Pang, and W. N. Martin, "Transputer implementation of a multiple agent model for object tracking," Pattern Recogn. Lett., vol. 16, no. 11, pp. 1197-1203, 1995.
31. D. Reid, "An algorithm for tracking multiple targets," IEEE Trans. Automat. Contr., vol. AC-24, no. 6, pp. 843-854, Dec. 1979.
32. I. J. Cox and S. L. Hingorani, "An efficient implementation and evaluation of Reid's multiple hypothesis tracking algorithm for visual tracking," in Proc. Int. Conf. Pattern Recognition (ICPR), Jerusalem, Israel, 1994, vol. A, pp. 437-442.
33. I. J. Cox and S. L. Hingorani, "An efficient implementation of Reid's multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 2, pp. 138-150, Feb. 1996.
34. E. Polat, M. Yeasin, and R. Sharma, "A tracking framework for collaborative human computer interaction," in Proc. IEEE Int. Conf. Multimodal Interaction, Pittsburg, PA, Oct. 14-16, 2002, pp. 27-32.
35. I. Sethi and R. Jain, "Finding trajectories of feature points in a monocular image sequence," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-9, no. 1, pp. 56-73, Jan. 1987.
36. R. Jain, R. Kasturi, and B. G. Schunck, Machine Vision. New York: McGraw-Hill, 1995.
37. V. Salari and I. Sethi, "Feature point correspondence in the presence of occlusion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 87-91, Jan. 1990.
38. D. L. Hall, Mathematical Techniques in Multisensor Data Fusion. Norwood, MA: Artech House, 1992.
39. P. Young, Recursive Estimation and Time-Series Analysis. New York: Springer-Verlag, 1984.
40. Y. Shirai, R. Okada, and T. Yamane, "Robust visual tracking by integrating various cues," in Robust Vision for Vision-Based Control of Motion, M. Vinche and G. D. Hager, Eds. Piscataway, NJ: IEEE Press, 2000.
41. D. Kragió and H. I. Christensen, "Cue integration for manipulation," in Robust Vision for Vision-Based Control of Motion, M. Vinche and G. D. Hager, Eds. Piscataway, NJ: IEEE Press, 2000.
42. M.-H. Yang and N. Ahuja, "Extraction and classification of visual motion patterns for hand gesture recognition," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, Santa Barbara, CA, Jun. 23-25, 1998, pp. 892-897.
43. C. Rasmussen and G. D. Hager, "Probabilistic data association methods for tracking complex visual objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 560-576, Jun. 2001.
44. J. Sherrah and S. Gong, "Fusion of perceptual cues for robust tracking of head pose and position," Pattern Recogn., vol. 34, no. 8, pp. 1565-1572, 2001.
45. K. Toyama and G. D. Hager, "Incremental focus of attention for robust vision-based tracking," Int. J. Comput. Vis., vol. 35, no. 1, pp. 45-63, 1999.
46. A. Pinz, M. Prantl, H. Ganster, and H. Kopp-Borotschnik, "Active fusion - A new method applied to remote sensing image interpretation," Pattern Recogn. Lett., vol. 17, no. 13, pp. 1349-1359, 1996.
47. H. Kopp-Borotschnik and A. Pinz, "A new concept for active fusion in image understanding applying fuzzy set theory," in Proc. 5th IEEE Int. Conf. Fuzzy Systems (FUZZ-IEEE), New Orleans, LA, 1996, pp. 793-799.
48. M. Prantl, H. Borotschnik, H. Ganster, D. Sinclair, and A. Pinz, "Object recognition by active fusion," in Proc. of Int. Society Optical Engineering (SPIE), Boston, MA, 1996, vol. 2904, pp. 320-330.
49. H. Borotschnik, L. Paletta, M. Prantl, and A. Pinz, "A comparison of probabilistic, possibilistic and evidence theoretic schemes for active object recognition," Computing, vol. 62, no. 62, pp. 293-319, 1999.
50. H. Borotschnik, "Uncertain information fusion in active object recognition," Ph.D. dissertation, Inst. Comput. Graph. Vision, Tech. Univ. Graz, Austria, 1999.
51. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, 1994.
52. R. Bryll. "A robust agent-based gesture tracking system," Ph.D. dissertation, Comput. Sci. Eng. Dept., Wright State Univ., Dayton, OH, 2003 [Online] Available: http://vislab.cs.vt.edu/~rbryll/PAPERS/ Bryll-PhD-Dissert.pdf
53. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Defense Advanced Research Project Agency (DARPA) Image Understanding (IU) Workshop, 1981, pp. 121-130.
54. D. J. Fleet and A. D. Jepson, "Computation of component image velocity from local phase information," in Int. J. Comput. Vis., vol. 5, no. 1, pp. 77-104, 1990.
55. B. Lucas, "Generalized image matching by the method of differences," Ph.D. dissertation, Dept. Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, 1984.