On the use of graph parsing for recognition of isolated hand postures of Polish Sign Language

Pattern Recognition

Volumn 43, Issue 6, 2010, Pages 2249-2264

  Flasiński, Mariusz ^a   Myśliński, Szymon ^a  

^a JAGIELLONIAN UNIVERSITY   (Poland)

Author keywords

Graph grammar parsing; Hand posture recognition; Sign language; Syntactic pattern recognition

Indexed keywords

GRAPH GRAMMAR; GRAPH PARSING; HAND POSTURE; HAND POSTURE RECOGNITION; NOVEL METHODS; SIGN LANGUAGE; SYNTACTIC PATTERN RECOGNITION;

CONTEXT SENSITIVE GRAMMARS; GRAPH THEORY; LINGUISTICS; PATTERN RECOGNITION; SYNTACTICS;

FORMAL LANGUAGES;

EID: 76749112431     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2010.01.004     Document Type: Article

References (65)

1. Cui Y.T., and Weng J.J.Y. Appearance-based hand sign recognition from intensity image sequences. Comput. Vision Image Understand 78 (2000) 157-176
2. Derpanis K.G., Wildes R.P., and Tsotsos J.K. Definition and recovery of kinematic features for recognition of American sign language movements. Image Vision Comput. 26 (2008)
3. Ong S.C.W., Ranganath S., and Venkatesh Y.V. Understanding gestures with systematic variations in movement dynamics. Pattern Recognition 39 (2006) 1633-1648
4. Starner T.E., Weaver J., and Pentland A.P. Real-time American Sign Language recognition using desk and wearable computer based video. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-20 (1998) 1371-1375
5. Vogler C., and Metaxas D. A framework for recognizing the simultaneous aspects of American Sign Language. Comput. Vision Image Understand 81 (2001) 358-384
6. Yang H.D., Sclaroff S., and Lee S.W. Sign language spotting with a threshold model based on conditional random fields. IEEE Trans. Pattern Analysis Mach. Intell. PAMI-31 (2009) 1264-1277
7. Yang M., Ahuja N., and Tabb M. Extraction of 2D motion trajectories and its application to hand gesture recognition. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-24 (2002) 1061-1074
8. Yang R., and Sarkar S. Coupled grouping and matching for sign and gesture recognition. Comput. Vision Image Understand 113 (2009) 663-681
9. Al-Jarrah O., and Halawani A. Recognition of gestures in Arabic sign language using neuro-fuzzy systems. Artif. Intell. 133 (2001) 117-138
10. Shanableh T., Assaleh K., and Al-Rousan M. Spatio-temporal feature-extraction techniques for isolated Gesture recognition in arabic sign language. IEEE Trans. Systems. Man Cybernet. SMC-B 37 (2007) 641-650
11. Holden E.J., Lee G., and Owens R.A. Australian sign language recognition. Mach. Vision Appl. 16 (2005) 312-320
12. R. Bowden, et al., A linguistic feature vector for the visual interpretation of sign language, in: Proceedings of the Eighth European Conference on Computer Vision, May 2004, pp. 391-401.
13. Kong W.W., and Ranganath S. Signing exact english (SEE): modeling and recognition. Pattern Recognition 41 (2008) 1655-1669
14. Gao W., Fang G.L., Zhao D.B., and Chen Y.Q.A. A Chinese sign language recognition system based on SOFM/SRN/HMM. Pattern Recognition 37 (2004) 2389-2402
15. Lichtenauer J.F., Hendriks E.A., and Reinders M.J.T. Sign language recognition by combining statistical DTW and independent classification. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-30 (2008) 2040-2046
16. Aran O., Burger T., Caplier A., and Akarun L. A belief-based sequential fusion approach for fusing manual signs and non-manual signals. Pattern Recognition 42 (2009) 812-822
17. B. Bauer, K.F. Kraiss, Video-based sign recognition using self-organizing subunits, in: Proceedings of the 16th International Conference on Pattern Recognition, August 2002, pp. 434-437.
18. P. Dreuw, D. Keysers, T. Deselaers, H. Ney, Gesture recognition using image comparison methods, in: S. Gibet, N. Courty, J.-F. Kamp (Eds.), Gesture and Sign Language in Human-Computer Interaction and Simulation, Lecture Notes in Artificial Intelligence, vol. 3881, Springer, Berlin, 2006, pp. 124-128.
19. M. Fröhlich, I. Wachsmuth, Gesture recognition of the upper limbs-from signal to symbol, in: I. Wachsmuth, M. Fröhlich (Eds.), Gesture and Sign Language in Human-Computer Interaction, Lecture Notes in Artificial Intelligence, vol. 1371, Springer, Berlin, 1998, pp. 173-184.
20. Han J.W., Awad G., and Sutherland A. Modelling and segmenting subunits for sign language recognition based on hand motion analysis. Pattern Recognition Lett. 30 (2009) 623-633
21. Infantino I., Rizzo R., and Gaglio S. A framework for sign language sentence recognition by commonsense context. IEEE Trans. Systems Man Cybernet. SMC-C 37 (2005) 1034-1039
22. Tamura S., and Kawasaki S. Recognition of sign language motion images. Pattern Recognition 21 (1988) 345-353
23. Kim J.S., Jang W., and Bien Z.N. A dynamic gesture recognition system for the Korean Sign Language (KSL). IEEE Trans. Systems Man Cybernet. SMC-B 26 (1996) 354-359
24. M. Zobl, M. Geiger, B. Schuller, M. Lang, G. Rigoll, A realtime system for hand-gesture controlled operation of in-car devices, in: Proceedings of the International Conference on Multimedia and Expo 2003, Baltimore, MD, USA, 2003, pp. 541-544.
25. S. Reifinger, F. Wallhoff, M. Ablaßmeier, T. Poitschke, G. Rigoll, Static and dynamic hand-gesture recognition for augmented reality applications, in: Proceedings of the 12th International Conference on Human-Computer Interaction, Beijing, China, 2007, pp. 728-737.
26. T. Sowa, I. Wachsmuth, Interpretation of shape-related iconic gestures in virtual environments, in: I. Wachsmuth, T. Sowa (Eds.), Gesture and Sign Language in Human-Computer Interaction, Lecture Notes in Artificial Intelligence, vol. 2298, Springer, Berlin, 2002, pp. 21-33.
27. S. Kopp, T. Sowa, I. Wachsmuth, Imitation games with an artificial agent: from mimicking to understanding shape-related iconic gestures, in: A. Camurri, G. Volpe (Eds.), Gesture-Based Communication in Human-Computer Interaction, Lecture Notes in Artificial Intelligence, vol. 2915, Springer, Berlin, 2004, pp. 436-447.
28. C. Fröhlich, P. Biermann, M.E. Latoschik, I. Wachsmuth, Processing iconic gestures in a multimodal virtual construction environment, in: M. Dias, S. Gibet, M.M. Wanderley, R. Bastos (Eds.), Gesture-based Human-Computer Interaction and Simulation, Lecture Notes in Artificial Intelligence, vol. 5085, Springer, Berlin, 2009, pp. 187-192.
29. Crowley J., and Sanderson A. Multiple resolution representation and probabilistic matching of 2-d gray-scale shape. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-9 (1987) 113-121
30. Lindeberg T. Detecting salient blob-like structures and their scales with a scale-space primal sketch: a method for focus-of attention. Int. J. Comput. Vision 11 (1993) 283-318
31. J. Triesch, C.v.d. Malsburg, Robust classification of hand postures against complex background, in: Proceedings of the Second International Conference on Automatic Face Gesture Recognition, Killington, Vermont, 1996, pp. 170-175.
32. Shokoufandeh A., Marsic I., and Dickinson S. View-based object recognition using saliency maps. Image Vision Comput. 17 (1999) 445-460
33. L. Bretzner, T. Lindeberg, Qualitative multi-scale feature hierarchies for object tracking, in: Proceedings of the Second International Conference on Scale-Space Theories Computer Vision, Corfu, Greece, 1999, pp. 117-128.
34. Triesch J., and Malsburg C.v.d. A system for person-independent hand posture recognition against complex backgrounds. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-23 (2001) 1449-1453
35. Triesch J., and Malsburg C.v.d. Classification of hand postures against complex backgrounds using elastic graph matching. Image Vision Comput. 20 (2002) 937-943
36. Shokoufandeh A., Bretzner L., Macrini D., Fatih Demirci M., Jonssön C., and Dickinson S. The representation and matching of categorical shape. Comput. Vision Image Understand 103 (2006) 139-154
37. Freeman H. On the encoding of arbitrary geometric configurations. Trans. Electron. Comput. EC-10 (1961) 260-268
38. Ledley R.S. Programming and Utilizing Digital Computers (1962), McGraw-Hill, New York
39. Fu K.S. Syntactic Pattern Recognition and Applications (1982), Prentice-Hall, Englewood Cliffs
40. Tanaka E. Theoretical aspects of syntactic pattern recognition. Pattern Recognition 28 (1995) 1053-1061
41. Janssens D., and Rozenberg G. On the structure of node-label-controlled graph languages. Inf. Sci. 20 (1980) 191-216
42. Janssens D., Rozenberg G., and Verraedt R. On sequential and parallel node-rewriting graph grammars. Comput. Graphics Image Process. 18 (1982) 279-304
43. D. Janssens, G. Rozenberg, Graph grammars with node-label controlled rewriting and embedding, in: Lecture Notes in Computer Science, vol. 153, Springer, Berlin, 1983, pp. 186-205.
44. Flasiński M. Parsing of edNLC-graph grammars for scene analysis. Pattern Recognition 21 (1988) 623-629
45. Flasiński M. Characteristics of edNLC-graph grammars for syntactic pattern recognition. Comput. Vision Graphics Image Process. CGIP-47 (1989) 1-21
46. Flasiński M. Distorted pattern analysis with the help of Nodel Label Controlled graph languages. Pattern Recognition 23 (1990) 765-774
47. Flasiński M. Some notes on a problem of constructing the best matched graph. Pattern Recognition 24 (1991) 1223-1224
48. Flasiński M. On the parsing of deterministic graph languages for syntactic pattern recognition. Pattern Recognition 26 (1993) 1-16
49. Flasiński M. Power properties of NLC graph grammars with a polynomial membership problem. Theoretical Computer Science 201 (1998) 189-231
50. Flasiński M. Inference of parsable graph grammars for syntactic pattern recognition. Fund. Inf. 80 (2007) 379-413
51. Pratt W.K. Digital Image Processing (2001), Wiley, New York
52. Serra J. Image Analysis and Mathematical Morphology (1982), Academic Press, London
53. Wang J.G., and Sung E. Frontal-view face detection and facial feature extraction using color and morphological operators. Pattern Recognition Lett. 20 10 (1999) 1053-1068
54. Wang Y., and Yuan B. A novel approach for human face detection from color images under complex background. J. Pattern Recognition 34 (2001) 1983-1992
55. Kurozumi Y., and Davis W.A. Polygonal approximation by the minimax method. Comput. Graph. Image Process. 19 (1982) 248-264
56. Lewis II P.M., and Stearns R.E. Syntax-directed transduction. J. ACM 15 (1968) 464-488
57. Rosenkrantz D.J., and Stearns R.E. Properties of deterministic top-down grammars. Inf. Control. 17 (1970) 226-256
58. Robling A.G., and Ubelaker D.H. Sex determination from metatarsals. J. Forensic Sci. 42 (1997) 1062-1069
59. Flasiński M., and Kotulski L. On the use of graph grammars for the control of a distributed software allocation. Comput. J. 35 (1992) A165-A175
60. Flasiński M. Use of graph grammars for the description of mechanical parts. Comput. Aided Des. 27 (1995) 403-433
61. M. Flasiński, R. Schaefer, W. Toporkiewicz, Optimal stochastic scaling of CAE parallel computations, in: Lecture Notes in Computer Science, vol. 1424, Springer, Berlin, 1998, pp. 557-564.
62. Flasiński M., and Jurek J. Dynamically programmed automata for quasi context sensitive languages as a tool for inference support in pattern recognition-based real-time control expert systems. Pattern Recognition 32 (1999) 671-690
63. M. Flasiński, Automata-based multi-agent model as a tool for constructing real-time intelligent control systems, in: Lecture Notes in Computer Science-Lecture Notes in Artificial Intelligence, vol. 2296, 2002, pp. 103-110.
64. H.O. Bunke, Programmed graph grammars, in: Lecture Notes in Computer Science, vol. 73, Springer, Berlin, 1979, pp. 155-166.
65. Bunke H.O. Attributed programmed graph grammars and their application to schematic diagram interpretation. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-4 (1982) 574-582