Auditory display as a prosthetic hand biofeedback

Journal of Medical Imaging and Health Informatics

Volumn 1, Issue 4, 2011, Pages 325-333

  Gonzalez, Jose ^a   Soma, Hirokazu ^a   Sekine, Masashi ^a   Yu, Wenwei ^a  

^a CHIBA UNIVERSITY   (Japan)

Author keywords

Auditory display; Biofeedback; Prostheses; Psychophysiology; Robot hand; Sensory substitution system

Indexed keywords

EID: 84870835698     PISSN: 21567018     EISSN: 21567026     Source Type: Journal    
DOI: 10.1166/jmihi.2011.1051     Document Type: Article

References (34)

1. D. Childress, Closed-loop control in prosthetic systems: Historical perspective. Annals of Biomedical Engineering 8, 293 (1980).
2. P. Herberts and L. Körner, Ideas on sensory feedback in hand prostheses. Prosthet Orthot Int 3, 157 (1979).
3. A. H. Arieta, R. Kato, W. Yu, and H. Yokoi, The Man-Machine Interaction: The Influence of Artificial Intelligence on Rehabilitation Robotics, in 50 Years of Artificial Intelligence, Edited Max Lungarella, Fumiya Iida, Josh Bongard, Rolf Pfeifer, Springer Berlin/Heidelberg (2007), pp. 221-231. (Pubitemid 350262729)
4. G. S. Dhillon, S. M. Lawrence, D. T. Hutchinson, and K. W. Horch, Residual function in pheripheral nerve stumps of amputees. The Journal of Hand Surgery 29, 605 (2004).
5. A. Y. J. Szeto and F. A. Saunders, Electrocutaneous stimulation for sensory communication in rehabilitation engineering. J. Biomedical Engineering, IEEE 29, 300 (1982).
6. C. Stepp and Y. Matsuoka, Relative to direct haptic feedback, remote vibrotactile feedback improves but slows object manipulation, Proceedings of the EMBC conference, IEEE, Buenos Aires Argentina, August-September (2010), pp. 2089-2092.
7. G. Lundborg, B. Rosén, and S. Lindberg, Hearing as substitution for sensation: A new principle for artificial sensibility. The Journal of hand surgery 24, 219 (1999).
8. A. Effenberg, Movement sonification: Effects on perception and action. J. Multimedia, IEEE 12, 53 (2005).
9. S. Kousidou, N. G. Tsagarakis, C. Smith, and D. G. Caldwell, Task-orientated biofeedback system for the rehabilitation of the upper Limb, Proceedings of the IEEE Conference on Rehab, Robotics (2007), p. 376.
10. C. Ghez, T. Rikakis, R. L. Dubois, and P. R. Cook, An auditory display system for aiding interjoint coordination, Proceedings of the International Conference of Auditory Display, ICAD (2000).
11. H. Huang, S. Wolf, and J. He, Recent developments in biofeedback for neuromotor rehabilitation. J. NeuroEng. and Rehab. 3 (2006).
12. K. Vought, D. Pirro, I. Kobenz, R. Holdrich, and G. Eckel, PhysioSonic -Evaluated Movement Sonification as Auditory Feedback in Physiotherapy, edited by S. Ystad et al., Auditory Display, Springer Berlin/Heidelberg (2010), pp. 103-120.
13. M. Dozza, L. Chiari, and F. B. Horak, A portable audio-biofeedback system to improve postural control, Proceedings of the EMBS conference, IEEE (2004), Vol. 7, pp. 779-802.
14. E. Haapalainen, S. Kim, J. F. Forlizzi, and A. Dey, Psycho- hysiologPsychophysiological measures for assessing cognitive load. Ubiquitous Computing/Handheld and Ubiquitous Computing 301 (2010).
15. A. Effenberg, J. Melzer, A. Weber, and A. Zinke, MotionLab sonify: A framework for the sonification of human motion data. Information Visualization, IEEE 17 (2005).
16. T. Hermann and A. Hunt, Introduction: An introduction to interactive sonification, IEEE Multimedia 12, 20 (2005).
17. J. González, W. Yu, and A. H. Arieta, Multichannel audio biofeedback for dynamical coupling between prosthetic hands and their users. Industrial Robot: An International Journal 37, 148 (2010).
18. P. Richard, G. Burdea, D. Gomez, and P. Coiffet, A comparison of haptic, visual and auditive force feedback for deformable virtual objects, Proceeding on the International Conference on Artificial Reality and Telexistence, ICAT (1994), pp. 49-62.
19. S. H. Fairclough and K. Ewing, The effect of an extrinsic incentive on psychophysiological measures of mental effort and motivational disposition when task demand is varied. Human Factors and Ergonomics Society 259 (2010).
20. C. L. Bethel, K. Salomon, R. R. Murphy, and J. L. Burke, Survey of psychophysiology measurements applied to human-robot interaction. Robot and Human interactive Communication, IEEE 732 (2007).
21. D. Kulic and E. Croft, Anxiety detection during human-robot interaction, Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems (2005), pp. 616-621.
22. S. G. Hart, NASA-Task load index (NASA-TLX); 20 years later. Human Factors and Ergonomics Society 50, 904 (2006
23. T. Baumgartner, M. Esslen, and L. Jooncke, From emotion perception to emotion experience: Emotions evoked by pictures and classical music. International Journal of Psychophysiology 60, 34 (2006).
24. R. S. Huang, L. L. Tsai, and C. J. Kuo, Selection of valid and reliable EEG features for predicting auditory and visual alertness levels. Proc. Natl. Sci. Counc. Repub. China B 25, 17 (2001
25. K. Ryu and R. Myung, Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. International Journal of Industrial Ergonomics 35, 991 (2005).
26. L. R. Fournier, G. F. Wilson, and C. R. Swain, Electrophysiological, behavioral, and subjective indexes of workload when performing multiple tasks: Manipulations of task difficulty and training. International Journal of Psychophysiology 31, 129 (1999).
27. J. Vroomen and B. Gelder, Sound enhances visual perception: Cross-modal effects of auditory organization on vision. J. Exp. Psychol Hum Percept Perform 26, 1583 (2000).
28. T. S. Andersen and P. Mamassian, Audiovisual integration of stimulus transients. Vision Res 48, 2537 (2000).
29. S. Miyake, Multivariate workload evaluation combining physiological and subjective measures. International Journal of Psychophysiology 40, 233 (2001).
30. A. Kramer, Physiological Metrics of Mental Workload: A Review of Recent Progress, Multiple Task Performance, edited by D. Damos, London: Taylor and Francis (1991), pp. 279-328.
31. V. D. Pascalis, R. J. Barry, and A. Sparita, Decelerative changes in heart rate during recognition of visual stimuli: Effects of psychological stress. Int J Psychophysiol 20, 21 (1995).
32. C. W. Robinson and V. M. Sloutsky, Attention and cross-modal processing: Evidence from heart rate analyses, edited by S. Ohlsson and R. Catrambone, Proceedings of the 32nd Annual Conference of the Cognitive Science Society Austin, TX: Cognitive Science Society (2010), pp. 2639-2643.
33. M. A. Schier, Changes in EEG alpha power during simulated driving: A demonstration, Int. J. Psychophysiol. 37, 155 (2000).
34. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology: Heart rate variability: Standards of measurement, physiological interpretation and clinical. European Heart Journal 17, 354 (1996).