Using EMG to anticipate head motion for virtual-environment applications

IEEE Transactions on Biomedical Engineering

Volumn 52, Issue 6, 2005, Pages 1078-1093

  Barniv, Yair ^a,d   Aguilar, Mario ^b   Hasanbelliu, Erion ^c,e  

^a NASA HEADQUARTERS   (United States)

^b Rockwell Scientific Company   (United States)

^c JACKSONVILLE STATE UNIVERSITY   (United States)

^d NASA AMES RESEARCH CENTER   (United States)

^e JSU   (United States)

Author keywords

Electromyogram; Head mounted display (HMD); Neural networks; Pattern recognition; Virtual environment (VE)

Indexed keywords

HEAD-MOUNTED DISPLAYS; MYOELECTRIC SIGNALS; TELEROBOTICS; VIRTUAL IMAGES;

COMPUTER SIMULATION; DEGREES OF FREEDOM (MECHANICS); DISPLAY DEVICES; IMAGE ANALYSIS; MUSCLE; NEURAL NETWORKS; PROSTHETICS; ROBOTICS; SIGNAL PROCESSING; TELEMEDICINE;

VIRTUAL REALITY;

ACCELERATION; ADULT; ARTICLE; ARTIFICIAL NEURAL NETWORK; CLINICAL PROTOCOL; COMPUTER SIMULATION; CONTROLLED STUDY; ELECTROMYOGRAM; FEMALE; HEAD MOUNTED DISPLAY; HEAD MOVEMENT; HELMET; HUMAN; HUMAN EXPERIMENT; IMAGING; IMAGING SYSTEM; LATENT PERIOD; MALE; MYOELECTRICITY; NECK MUSCLE; NORMAL HUMAN; PATTERN RECOGNITION; ROBOTICS; SIGNAL PROCESSING; VIRTUAL ENVIRONMENT; VIRTUAL REALITY;

ADULT; ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DIAGNOSIS, COMPUTER-ASSISTED; ELECTROMYOGRAPHY; ENVIRONMENT; FEMALE; HEAD MOVEMENTS; HUMANS; MALE; MODELS, NEUROLOGICAL; NECK MUSCLES; USER-COMPUTER INTERFACE;

EID: 20444508007     PISSN: 00189294     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBME.2005.848378     Document Type: Article

References (42)

1. T. B. Sheridan and W. R. Ferrell, "Remote manipulative control with transmission delay," IEEE Trans. Hum. Fact, Elect., vol. HFE-4, no. 1, pp. 25-29, Sep. 1963.
2. R. Held, A. Efsathiou, and M. Greene, "Adaptation to displaced and delayed visual feedback from the hand.," Exp. Psychol., vol. 72, no. 6, pp. 887-891, 1966.
3. S. R. Ellis, B. D. Adelstein, S. Baumeler, G. J. Jense, and R. H. Jacoby, "Sensor spatial distortion, visual latency, and update rate effects on 3-D tracking in virtual environments," in Proc. IEEE Virtual Reality, Houston, TX, 1999, pp. 218-221.
4. A. Liu, G. Tharp, L. French, S. Lai, and L. Stark, "Some of what one needs to know about using head mounted displays to improve teleoperator performance," IEEE Trans. Robot. Autom., vol. 9. no. 5, pp. 638-648, Oct. 1993.
5. R. B. Welch, T. T. Blackman, A. Liu, B. A. Mellers, and L. W. Stark, "The effects of pictorial realism, delay of visual feedback, and observer interactivity on the subjective sense of presence," Presence, vol. S, no. 3, pp. 263-273, 1996.
6. R. Azuma and G. Bishop, "Improving static and dynamic registration in an optical see-through HMD," in Proc. SIGGRAPH, Orlando, FL, July 24-29, 1994, pp. 197-204.
7. R. H. Y. So and M. J. Griffin, "Experimental studies of the use of phase lead filters to compensate lags in head-coupled visual displays," IEEE Trans. Sys., Man, Cybernetics, vol. 26, no. 4, pp. 445-454, 1996.
8. A. Kiruluta, M. Eizenman, and S. Pasupathy, "Predictive head movement tracking using a Kalman filter," IEEE Trans. Syst., Man, Cybern., vol. 27, no. 2, pp. 326-331, Apr. 1997.
9. Y. Akatsuka and G. A. Bekey, "Compensation for end-to-end delays in a VR system," in Proc. IEEE Virtual Reality Annual International Symp., Atlanta, GA, Mar. 14-18, 1998, pp. 156-159.
10. J. Y. Jung, B. D. Adelstein, and S. R. Ellis, "Predictive compensator optimization for head tracking lag in virtual environments," in Proc. IMAGE, Scottsdale, AZ, Jul. 10-14, 2000, pp. 123-132.
11. -, "Discriminability of prediction artifacts in a time-delayed virtual environment," presented at the 44th Annu. Meeting Human Factors Ergonomics Soc., 2000.
12. A. Garrett, M. Aguilar, and Y. Barniv, "A recurrent neural network approach to virtual environment latency reduction," presented at the Int. Joint Conf. Neural Networks, Honolulu, HI, 2002.
13. M. Aguilar, Y Barniv, and A. Garrett, "Prediction of Pitch and Yaw head movements via recurrent neural networks," presented at the Int. Joint Conf. Neural Networks, Portland, OR, 2003.
14. W. H. Zangetneiser, S. Lehman, and L. Stark, "Sensitivity analysis and optimization for a head movement model," Biol Cybern., vol. 41, pp. 33-45, 1981.
15. -, "Simulation of head movement trajectories: Model and fit to main sequence," Biol. Cybern., vol. 41, pp. 19-32, 1981.
16. M. I. Hill and B. D. Adelstein, "Achieving minimum latency in virtual environment applications," presented at the IMAGE Soc. Annu. Conf., Scottsdale. AZ, Jul. 12-16, 2004.
17. B. D. Adelstein, T. G. Lee, and S. R. Ellis, "Head tracking latency in virtual environments: Psychophysics and a model," in Proc. 47th Annu. Meeting Human Factors Ergonomics Soc., 2003, pp. 2083-2087.
18. Ph.D. dissertation, Mass. Inst. Technol., Cambridge, MA, 1977.
19. E. A. Keshner and B. W. Peterson, "Mechanisms controlling human head stabilization. I: Head-neck dynamics during random rotations in the horizontal plane, II: Head-neck characteristics during random rotations in the vertical plane," J. Neurophysiol., vol. 73, pp. 2293-2312, 1995.
20. T. D'Allessio, "Some results on the optimization of a digital processor for surface-EMG signals," Electromyogr. Clin. Neurophysiol., vol. 24, pp. 625-643, 1984.
21. -, "Analysis of a digital EMG signal processor in dynamic conditions," IEEE Trans. Biomed. Eng., vol. BME-32, pp. 78-82, Jan. 1985.
22. E. Park and S. G. Meek, "Adaptive filter of the EMG signal for prosthetic control and force estimation," IEEE Trans. Biomed. Eng., vol. BME-42, no. 10, pp. 1048-1052, Oct. 1995.
23. E. A. Clancy, "Electromyogram amplitude estimation with adaptive smoothing window length," IEEE Trans. Biomed. Eng., vol. 46. no. 6, pp. 717-729, Jun. 1999.
24. A. J. Pellionisz and B. W. Peterson, A Tensorial Model of Neck Motor Activation. Control of Head Movement, B. Peterson and F. Richmond, Eds. Oxford, U.K.: Oxford Univ. Press, 1988.
25. A. J. Pellionisz, B. W. Peterson, and D. L. Tomko, "Vestibular head-eye coordination: A geometrical sensorimotor neurocomputer paradigm," presented at the Neurocomputing Sensorimotor Systems, Dusseldorf, Germany, Mar. 1990.
26. A. N. Vasavada, S. Li, and S. L. Delp, "Influence of muscle morphometry and moment arms on the moment-generating capacity of human neck muscles," Spine, vol. 23, pp. 412-422, 1998.
27. J. L. Elman, "Finding structure in time," Cognitive Science, vol. 14, pp. 179-211, 1990.
28. B. D. Ripley, Pattern Recognition and Neural Networks. Cambridge, MA: Cambridge University Press, 1996.
29. J. F. Kolem and S. C. Kremer, A Field Guide to Dynamical Recurrent Networks. New York: IEEE Press, 2001.
30. S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, pp. 1735-1780, 1997.
31. C. J. De Luca, "The use of surface electromyography in biomechanics," J. Appl Biomech., vol. 13, pp. 135-163, 1997.
32. J. R. Cram and G. S. Kasman, Introduction to Surface Electromyography. Gaithersburg, MD: Aspen, 1998.
33. H. Huang and C. Chen, "Development of a myoelectric discrimination system for a multidegree prosthetic head," in Proc. 1999 Conf. IEEE Robotics and Automation Society, vol. 3, Detroit, MI, 1999.
34. P. J. Sparto, M. Parnianpour, E. A. Barria, and J. M. Jagadeesh, "Wavelet and short-time Fourier transform analysis of electromyography for detection of back muscle fatigue," IEEE Trans. Rehab. Eng., vol. 8, no. 3, pp. 433-436, Sep. 2000.
35. K. Englehart, B. Hudgins, P. Parker, and M. Stevenson, "Time-frequency representation for classification of the transient myoelectric signal," in Proc. 20th Annu. Int. Conf. IEEE Engineering in Medicine and Biology Soc., Hong Kong, Oct. 29, 1998, pp. 2627-2630.
36. I. T. Jolliffe. Principal Component Analysis. New York: Springer-Verlag, 1986.
37. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
38. H. Gävert, J. Hum, J. Särelä, and A. Hyvärinen. (2001) FASTICA-Fast Independent Component Analysis [Online]. Available: http://www.cis.hut.fi/projects/ica/fastica
39. E. Hasanbelliu, "Using EMG to anticipate head motion for virtual environments," Master's thesis, Jacksonville State Univ., Jacksonville, AL, 2004.
40. J. H. Kim and S. B. Cho, "An HMM/MLP architecture for sequence recognition" Neural Computation, vol. 7, no. 2, pp. 358-369, Mar. 1995.
41. J. E. Dennis and R. B. Schnabel, Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Englewood Cliffs, NJ: Prentice-Hall, 1983.
42. D. Nguyen and B. Widrow, "The truck backer-upper: An example of self-learning in neural networks," in Proc. Int. Joint Conf. Neural Networks, vol. 2, 1989. pp. 357-363.