Psycho-physiological assessment of a prosthetic hand sensory feedback system based on an auditory display: A preliminary study

Journal of NeuroEngineering and Rehabilitation

Volumn 9, Issue 1, 2012, Pages

  Gonzalez, Jose ^a   Soma, Hirokazu ^a   Sekine, Masashi ^a   Yu, Wenwei ^a  

^a CHIBA UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BREATHING RATE; COGNITION; ELECTROCARDIOGRAPHY; ELECTRODERMAL RESPONSE; ELECTROENCEPHALOGRAPHY; FEASIBILITY STUDY; HAND; HAND STRENGTH; HEART RATE; HUMAN; LIMB PROSTHESIS; MALE; MENTAL FUNCTION; METHODOLOGY; PHYSIOLOGY; PROSTHESIS; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSIOLOGY; QUESTIONNAIRE; ROBOTICS; SELF EVALUATION; SENSORY FEEDBACK;

ACOUSTIC STIMULATION; ADULT; ARTIFICIAL LIMBS; COGNITION; ELECTROCARDIOGRAPHY; ELECTROENCEPHALOGRAPHY; FEASIBILITY STUDIES; FEEDBACK, SENSORY; GALVANIC SKIN RESPONSE; HAND; HAND STRENGTH; HEART RATE; HUMANS; MALE; MENTAL PROCESSES; PROSTHESIS DESIGN; PSYCHOMOTOR PERFORMANCE; PSYCHOPHYSIOLOGY; QUESTIONNAIRES; RESPIRATORY RATE; ROBOTICS; SELF-ASSESSMENT; YOUNG ADULT;

EID: 84861949460     PISSN: None     EISSN: 17430003     Source Type: Journal    
DOI: 10.1186/1743-0003-9-33     Document Type: Article

References (59)

1. Closed-loop control in prosthetic systems: historical perspective. Childress D, Ann Biomed Eng 1980 8 293 303 [ http://dx.doi.org/10.1007/ BF02363433 ]. [10.1007/BF02363433] 10.1007/BF02363433 7027836 (Pubitemid 11064542)
2. Ideas on sensory feedback in hand prostheses. Herberts P, Korner L, Prosthetics and Orthotics Int 1979 3 157 162 (Pubitemid 10218164)
3. An fMRI study on the effects of electrical stimulation as biofeedback. Hernandez A, Kato R, Yokoi H, Arai T, Ohnishi T, International Conference on Intelligent Robots and Systems 2006 4336 4342 (Pubitemid 46928607)
4. Residual function in peripheral nerve stumps of amputees: implications for neural control of artificial limbs. Dhillon G, Lawrence S, Hutchinson D, Horch K, J Hand Surgery 2004 29 4 605 615 [ http://www.sciencedirect.com/ science/article/pii/S0363502304002035 ] 10.1016/j.jhsa.2004.02.006 (Pubitemid 38916703)
5. Direct neural sensory feedback and control of a prosthetic arm. Dhillon GS, Horch KW, IEEE Trans Neural Syst Rehabilitation Eng 2005 13 4 468 472 10.1109/TNSRE.2005.856072 (Pubitemid 43019184)
6. Electrocutaneous stimulation for sensory communication in rehabilitation engineering. Szeto AY, Saunders FA, IEEE Trans Biomed Eng 1982 29 4 300 308 7068167
7. Intermittent stimulation delays adaptation to electrocutaneous sensory feedback. Buma DG, Buitenweg JR, Veltink PH, IEEE Trans Neural Syst Rehabilitation Eng 2007 15 3 435 441 (Pubitemid 47460413)
8. Electrotactile and vibrotactile displays for sensory substitution systems. Kaczmarek KA, Webster JG, Rita PB, Tompkins WJ, IEEE Trans Biomed Eng 1991 38 1 16 [ http://dx.doi.org/10.1109/10.68204 ] 10.1109/10.68204 2026426
9. Relative to direct haptic feedback, remote vibrotactile feedback improves but slows object manipulation. Stepp C, Matsuoka Y, Proceedings of the IEEE International Conference of the Engineering in Medicine and Biology Society (EMBC) 2010 2089 2092
10. SmartHand tactile display: a new concept for providing sensory feedback in hand prostheses. Antfolk C, Balkenius C, Rosén B, Lundborg G, Sebelius F, J Plast Surgery Hand Surgery 2010 44 50 53 [ http://dx.doi.org/10.3109/ 02844310903259090 ] 10.3109/02844310903259090
11. A miniature vibrotactile sensory substitution device for multi-fingered hand prosthetics. Cipriani C, DAlonzo M, Carrozza MC, IEEE Trans Biomed Eng 2012 59 2 408
12. Vibrotactile sensory substitution in multi-fingered hand prostheses: Evaluation studies. DAlonzo M, Cipriani C, Carrozza MC, Proceeding of the IEEE International Conferences on Rehabilitation Robotics (ICORR) 2011 1 6
13. Testing a prosthetic haptic feedback simulator with an interactive force matching task. Chatterjee A, Chaubey P, Martin J, Thakor N, J Prosthetics and Orthotics 2008 20 2 27 34 [ http://content.wkhealth.com/linkback/openurl?sid= WKPTLP:landingpage&an=00008526-200804000-00001 ] 10.1097/01.JPO.0000311041. 61628.be
14. On the design of miniature haptic devices for upper extremity prosthetics. Kim K, Colgate JE, Santos-Munne JJ, Makhlin A, Peshkin MA, IEEE Trans on Mechatronics 2010 15 27 39
15. Redirection of cutaneous sensation from the hand to the chest skin of human amputees with targeted reinnervation. Kuiken TA, Marasco PD, Lock BA, Harden RN, Dewald JPA, Proc Nat Acad Sci 2007 104 50 20061 20066 [ http://dx.doi.org/10.1073/pnas.0706525104 ] 10.1073/pnas.0706525104 18048339
16. Robotic touch shifts perception of embodiment to a prosthesis in targeted reinnervation amputees. Marasco P, Kim K, JE C, Peshkin M, Kuiken T, Brain 2011 134 3 747 758 [ http://dx.doi.org/10.1093/brain/awq361 ] 10.1093/brain/awq361 21252109
17. Extended physiologic taction: design and evaluation of a proportional force feedback system. Meek SG, Jacobsen SC, Goulding PP, J Rehabilitation Res Dev 1989 26 3 53 62 (Pubitemid 19189051)
18. Design and evaluation of a low-cost force feedback system for myoelectric prosthetic hands. Pylatiuk C, Kargov A, Schulz S, J Prosthetics And Orthotics 2006 18 57 61 10.1097/00008526-200604000-00007 (Pubitemid 44510417)
19. Hearing as substitution for sensation: a new principle for artificial sensibility. Lundborg G, Rosén B, Lindberg S, J Hand Surgery 1999 24 2 219 224 [ http://www.ncbi.nlm.nih.gov/pubmed/10194002 ] 10.1053/jhsu.1999.0219 (Pubitemid 29149168)
20. Artificial sensibility of the hand based on cortical audiotactile interaction: a study using functional magnetic resonance imaging. Lundborg G, Bjorkman A, Hansson T, Nylander L, Nyman T, Rosen B, J Plast Surgery Hand Surgery 2005 39 370 372 (Pubitemid 43028248)
21. Audio aided electro-tactile perception training for finger posture biofeedback. Gonzalez J, Yu W, Proceedings of the International Conference on Engineering in Medicine and Biology Society (EMBC) 2008 4230 4233
22. Classification of upper limb motions from around-shoulder muscle activities: hand biofeedback. Gonzalez J, Horiuchi Y, Yu W, Open Med Inf J 2010 4 74 80
23. NASA-Task Load Index (NASA-TLX); 20 Years Later. Hart S, Human Factors and Ergonomics Soc Ann Meeting Proc 2006 50 9 904 908 [ http://www. ingentaconnect.com/content/hfes/hfproc/2006/00000050/00000009/art00009 ] 10.1177/154193120605000909 (Pubitemid 351741837)
24. The effect of an extrinsic incentive on psychophysiological measures of mental effort and motivational disposition when task demand is varied. Fairclough S, Ewing K, Proceedings of the Annual Meeting of the Human Factors and Ergonomics Society 2010 259 263
25. Sowden P, Barrett P, Psycho-physiological Methods Sage, London 2006
26. Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. Ryu K, Myung R, Int J Ind Ergonomics 2005 35 11 991 1009 [ http://linkinghub. elsevier.com/retrieve/pii/S0169814105000806 ] 10.1016/j.ergon.2005.04.005 (Pubitemid 41765829)
27. Cardiac responses induced during thought-based control of a virtual environment. Pfurtscheller G, Leeb R, Slater M, Int J Psychophysiology 2006 62 134 140 [ http://dx.doi.org/10.1016/j.ijpsycho.2006.03.001 ] 10.1016/j.ijpsycho.2006.03.001 (Pubitemid 44307373)
28. Psycho-physiological measures for assessing cognitive load. Haapalainen E, Kim S, Forlizzi J, Dey A, Ubiquitous Computing/Handheld and Ubiquitous Computing 2010 301 310
29. Physiological metrics of mental workload: a review of recent progress. Kramer A, Defense Technical Information Center 1990 [ http://books.google.co.jp/ books?id=zE1VNwAACAAJ ]
30. Using psychophysiological techniques to measure user experience with entertainment technologies. Mandryk R, Inkpen K, Calvert T, Behav Inf Technol 2006 25 2 141 158 [ http://www.informaworld.com/openurl?genre=article&doi= 10.1080/01449290500331156&magic=crossref ] 10.1080/01449290500331156 (Pubitemid 43065344)
31. Survey of Psychophysiology Measurements Applied to Human-Robot Interaction. Bethel C, Salomon K, Murphy R, Burke J, Proceedings of the IEEE International Symposium on Robot and Human interactive Communication (RO-MAN) 2007 732 737
32. Anxiety detection during human-robot interaction. Kulic D, Croft E, Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS) 2005 616 621
33. Movement sonification: effects on perception and action. Effenberg A, IEEE Multimedia 2005 12 2 53 59 10.1109/MMUL.2005.31 (Pubitemid 40784316)
34. Guest Editors introduction: an introduction to interactive sonification. Hermann T, Hunt A, IEEE Multimedia 2005 12 2 20 24 10.1109/MMUL.2005.26 (Pubitemid 40784312)
35. From emotion perception to emotion experience: emotions evoked by pictures and classical music. Baumgartner T, Esslen M, Jancke L, Int J Psychophysiology 2006 60 34 43 [ http://www.sciencedirect.com/science/article/ pii/S0167876005001327 ] 10.1016/j.ijpsycho.2005.04.007
36. Selection of valid and reliable EEG features for predicting auditory and visual alertness levels. Huang RS, Tsai LL, Kuo CJ, Proc Natl Sci Counc Repub China B 2001 25 17 25 11254168
37. Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology the North American Society of Pacing Electrophysiology, Eur Heart J 1996 7 5 354 381 [ http://circ.ahajournals.org/cgi/content/abstract/93/5/1043 ]
38. Task-Orientated Biofeedback System for the Rehabilitation of the Upper Limb. Kousidou S, Tsagarakis NG, Smith C, Caldwell DG, Proceedings of the IEEE International Conference on Rehabilitation Robotics (ICORR) 2007 376 384
39. An Auditory Display System for Aiding Interjoint Coordination. Ghez C, Rikakis T, Dubois R, Cook P, Proceeding of the International Conference on Auditory Displays (ICAD) 2000
40. Sound enhances visual perception: cross-modal effects of auditory organization on vision. Vroomen J, de Gelder B, J Exp Psychology: Human Perception and Perform 2000 26 5 1583 1590
41. Recent developments in biofeedback for neuromotor rehabilitation. Huang H, Wolf SL, He J, J Neuroeng Rehabil 2006 3 11 [ http://dx.doi.org/10.1186/1743- 0003-3-11 ] 10.1186/1743-0003-3-11 16790060
42. Physiosonic-movement sonification as auditory feedback. Voght K, David P, Ingo K, Robert H, Gerhard E, Proceedings of the International Conference on Auditory Display (ICAD) Jensen K, Copenhagen. Denmark, Aramaki M, Kronland-Martinet R, Ystad S, 2009 [ http://www.icad.org/Proceedings/2009/ VogtPirro2009.pdf ]
43. Audiovisual integration of stimulus transients. Andersen T, Mamassian P, Vision Res 2008 48 25 2537 2544 [ http://dx.doi.org/10.1016/j.visres.2008.08.018 ] 10.1016/j.visres.2008.08.018 18801382
44. A Comparison of Haptic, Visual and Auditive Force Feedback for Deformable Virtual Objects. Richard P, Proceedings of the Internation Conference on Automation Technology (ICAT) 1994 49 62
45. Decelerative changes in heart rate during recognition of visual stimuli: effects of psychological stress. Pascalis VD, Barry RJ, Sparita A, Int J Psychophysiology 1995 20 21 31 10.1016/0167-8760(95)00023-L
46. Attention and cross-modal processing: Evidence from heart rate analyses. Robinson CW, Sloutsky VM, Proceedings of the Conference of the Cognitive Science Society 2010 2639 2643
47. Crossmodal attention. Driver J, Spence C, Curr Opin Neurobiology 1998 8 2 245 253 10.1016/S0959-4388(98)80147-5 (Pubitemid 28247807)
48. EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. Ray WJ, Cole HW, Science 1985 228 750 752 10.1126/science.3992243 3992243 (Pubitemid 15063684)
49. Changes in EEG alpha power during simulated driving: a demonstration. Schier MA, Int J Psychophysiology 2000 37 155 162 10.1016/S0167-8760(00)00079-9 (Pubitemid 30314615)
50. Electrophysiological, behavioral, and subjective indexes of workload when performing multiple tasks: manipulations of task difficulty and training. Fournier L, Wilson G, Swain C, Int J Psychophysiology 1999 31 2 129 145 [ http://www.sciencedirect.com/science/article/pii/S016787609800049X ] 10.1016/S0167-8760(98)00049-X (Pubitemid 29049405)
51. EEG differences in children between eyes-closed and eyes-open resting conditions. Barry R, Clarke A, Johnstone S, Brown C, Clin Neurophysiology 2009 120 1806 1811 10.1016/j.clinph.2009.08.006
52. Psychophysiological investigation of vigilance decrement: boredom or cognitive fatigue? Pattyn N, Neyt X, Henderickx D, Soetens E, Physiol Behav 2008 93 1-2 369 378 [ http://dx.doi.org/10.1016/j.physbeh.2007.09.016 ] 10.1016/j.physbeh.2007.09.016 17999934
53. Respiratory responses during affective picture viewing. Gomez P, Stahel W, Danuser B, Biol Psychology 2004 67 3 359 373 [ http://dx.doi.org/10.1016/j. biopsycho.2004.03.013 ] 10.1016/j.biopsycho.2004.03.013 (Pubitemid 39036497)
54. Contextual cues in selective listening. Treisman AM, Q J Exp Psychology 1960 12 242 248 10.1080/17470216008416732
55. Attention: some theoretical considerations. Deutsch J, Deutsch D, Psychological Rev 1963 70 80 90 [ http://www.sciencedirect.com/science/article/ pii/S0033295X07605192 ]
56. A comparison of visual and auditory motion processing in human cerebral cortex. Lewis JW, Beauchamp MS, DeYoe EA, Cerebral Cortex 2000 10 9 873 888 10.1093/cercor/10.9.873 10982748
57. Specificity of auditory-guided visual perceptual learning suggests crossmodal plasticity in early visual cortex. Beer A, Watanabe T, Exp Brain Res 2009 198 2-3 353 361 [ http://dx.doi.org/10.1007/s00221-009-1769-6 ] 10.1007/s00221-009-1769-6 19306091
58. Multisensory integration: methodological approaches and emerging principles in the human brain. Calvert G, Thesen T, J Physiol Paris 2004 98 1-3 191 205 [ http://dx.doi.org/10.1016/j.jphysparis.2004.03.018 ] 10.1016/j.jphysparis.2004.03.018 15477032 (Pubitemid 39345371)
59. Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions. Lee J, Spence C, Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction (BCS-HCI) British Computer Society 2008 185 192 [ http://dl.acm.org/citation.cfm?id=1531514.1531540 ]