Two gesture recognition systems for immersive math education of the Deaf

ImmersCom 2007 - Proceedings of the 1st International Conference on Immersive Telecommunications

Volumn , Issue , 2007, Pages

  Adamo Villani, Nicoletta ^a   Heisler, Justin ^b   Arns, Laura ^c  

^a PURDUE UNIVERSITY   (United States)

^b Vicarious Visions   (United States)

^c PURDUE UNIVERSITY   (United States)

Author keywords

Deaf education; HCI; Sign language recognition; Virtual Environments

Indexed keywords

E-LEARNING; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION;

AMERICAN SIGN LANGUAGE; DATA GLOVE; DEAF EDUCATIONS; GESTURE RECOGNITION SYSTEM; HAND GESTURE; IMMERSIVE; IMMERSIVE VIRTUAL ENVIRONMENTS; INTUITIVE INTERFACES; NATURAL INTERFACES; SIGN LANGUAGE RECOGNITION;

VIRTUAL REALITY;

EID: 84874723546     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.4108/ICST.IMMERSCOM2007.2081     Document Type: Conference Paper

References (31)

1. J. A Holt, C.B. Traxler, T.E. Allen, Interpreting the Scores: A User’s Guide to the 9th Edition Stanford Achievement Test for Educators of Deaf and Hard-of-Hearing Students, Gallaudet Research Institute, Washington, D.C., 1997
2. National Science Task Force on Mathematics and Science Achievement. Preparing our children: math and science education in the national interest. National Science Foundation, Washington, D.C., 1999
3. Adamo-Villani, N., Carpenter, E., & Arns, L. An immersive virtual environment for learning sign language mathematics. In Proc. of Siggraph 2006 – Educators (Boston, 30 July - 3 August, 2006). ACM Digital Library. ACM Press, New York, NY, 2006.
4. Adamo-Villani, N., and Wright, K. (2007). SMILE: an immersive learning game for deaf and hearing children. In Proc. of Siggraph 2007- Educators (San Diego, 5-10 August, 2007) (accepted). ACM Digital Library. ACM Press, New York, NY, 2007.
5. Fakespace Systems, FLEX http://www.fakespace.com/flexReflex.htm
6. Arangarasan, R., Arns, L., and Bertoline, G. A Portable Passive Stereoscopic System for Teaching Engineering Design Graphics. In Proc. of ASEE Engineering Design Graphics Division 58th Annual Midyear Meeting, Scottsdale, AZ, 99-116.
7. Immersion Cybergloves. http://www.immersion.com/3d/products/cyber glove.php
8. InterSense IS-900 Precision Motion Tracker. http://www.intersense.com/products/prec/is900/
9. Metamotion Motion Captor. http://www.metamotion.com/captor/motion-captor.htm
10. Youngblut, C. Educational Uses of Virtual Reality Technology. VR in the Schools- coe.ecu.edu, 3, 1, 1997.
11. NCAC (National Center on Accessing the General Curriculum). Virtual Reality/Computer Simulations. Curriculum Enhancement. U.S. Office of Special Education Programs, 2003.
12. Bricken, M. and Byrne, C. Students in virtual reality: A pilot study. In Alen Wexelblat (Ed.) Virtual Reality: Applications and Explorations. Academic Press, San Diego, 1993, 199-217.
13. Darrow, M.S. Virtual Reality's Increasing Potential for Meeting Needs of Persons with Disabilities: What About Cognitive Impairments? In Proc. of the Annual International Conference on Virtual Reality and Disabilities. California State Center on Disabilities, Northridge, CA, 1995.
14. J. Cromby, P. Standen & D. Brown, Using Virtual Environments in Special Education. VR in the Schools, - coe.ecu.edu, 1,3, 1995.
15. Edge, R. VREAL: Virtual Reality Education for Assisted Learning. In Proc. of Instructional Technology and Education of the Deaf: an International Symposium, NTIDRIT, Rochester, NY, 2001.
16. Huang, T. and Pavlovic, V. Hand gesture modeling, analysis, and synthesis. In Proc. of the International Workshop on Automatic Face and Gesture Recognition, Zurich, 1995.
17. Geer, D. Will gesture-recognition technology point the way? Computer, 37, 2004, 20–23.
18. Yi, B., Jr., F.C.H., Wang, L., Yan, Y. Real-time natural hand gestures. Computing in Science and Engineering, 7, 2005, 92–96, c3.
19. Sturman, D.J. Whole-Hand Input. PhD thesis, Massachusetts Institute of Technology, Cambridge, MA, USA, 1992.
20. Culver, V.R. A hybrid sign language recognition system. In Proc. of the 8th International Symposium on Wearable Computers (ISWC04). IEEE Computer Society, Los Alamitos, CA, USA, 2004, 30–33.
21. Vamplew, P. Recognition of sign language gestures using neural networks. In Proc. of 1st Euro. Conf. Disability, Virtual Reality Assoc. Tech., Maidenhead, UK, 1996, 27–33
22. Starner, T., Pentland, A. Real-time american sign language recognition from video using hidden markov models. Technical Report MIT TR-375, Media Lab, MIT, 1996.
23. Avils-Arriaga, H., Sucar, L.E. Dynamic bayesian networks for visual recognition of dynamic gestures. Journal of Intelligent and Fuzzy Systems, 12, (2002), 243–250.
24. Gabbard, J.L. A Taxonomy of Usability Characteristics in Virtual Environments. Master’s thesis, Virginia Polytechnic Institute and State University, Blacksburg, VA, 1998.
25. Guiard, Y. Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. The Journal of motor behavior, (1987), 486-517.
26. Mapes, D.P. and Moshell, J. M. A two-handed interface for object manipulation in virtual environments. Presence: Teleoperators and Virtual Environments, 4, 4 (1995), 403-416.
27. Nissen, S. Fast artificial neural network library. http://leenissen.dk/fann/, 2000.
28. VRJuggler. http://www.vrjuggler.org
29. Kuroda, T., Tabata, Y., Goto, A., Ikuta, H., Murakami, M.: Consumer price data-glove for sign language recognition. In Proc. of 5th Intl Conf. Disability, Virtual Reality Assoc. Tech., Oxford, UK, 2004, 253–258.
30. Ong, S., Ranganath, S.Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27 (2005), 873–891.
31. Valli, C. and Lucas, C. Linguistics of American Sign Language: a Resource Text for ASL Users. Gallaudet University Press, Washington D.C., 2002.