Effects of vibrotactile feedback on human learning of arm motions

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Volumn 23, Issue 1, 2015, Pages 51-63

  Bark, Karlin ^a   Hyman, Emily ^a   Tan, Frank ^a   Cha, Elizabeth ^a   Jax, Steven A ^b   Buxbaum, Laurel J ^b   Kuchenbecker, Katherine J ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b MOSS REHABILITATION RESEARCH INSTITUTE   (United States)

Author keywords

Haptic interfaces; motion guidance; rehabilitation robotics; user interfaces; vibration

Indexed keywords

ERGONOMICS; HAPTIC INTERFACES; ROBOTICS; USER INTERFACES; VISUAL COMMUNICATION; VISUAL SERVOING;

DESIRED TRAJECTORIES; IMMEDIATE FEEDBACKS; MOTION GUIDANCES; REHABILITATION ROBOTICS; ROOT MEAN SQUARE; VIBRATION; VIBRATION FEEDBACK; VIBRO-TACTILE FEEDBACKS;

FEEDBACK;

ADAPTIVE BEHAVIOR; ALGORITHM; ARM; HUMAN; LEARNING; MEMORY; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PROCEDURES; REHABILITATION; ROBOTICS; SENSORY FEEDBACK; TOUCH; VIBRATION;

ALGORITHMS; ARM; FEEDBACK, PSYCHOLOGICAL; FEEDBACK, SENSORY; HUMANS; LEARNING; MEMORY; MOVEMENT; PRACTICE (PSYCHOLOGY); REHABILITATION; ROBOTICS; TOUCH; VIBRATION;

EID: 84920931541     PISSN: 15344320     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNSRE.2014.2327229     Document Type: Article

References (45)

1. D. Spelmezan, A. Schanowski, and J. Borchers, "Wearable automatic feedback devices for physical activities," in Proc. Int. Conf. Body Area Netw., 2009, pp. 1:1-1:8.
2. E. Ruffaldi, A. Filippeschi, C. A. Avizzano, B. Bardy, D. Gopher, and M. Bergamasco, "Feedback, affordances, accelerators for training sports in virtual environments," Presence-Teleop Virt, vol. 20, no. 1, pp. 33-46, 2011.
3. J. B. F. van Erp, I. Saturday, and C. Jansen, "Application of tactile displays in sports: Where to, howand when to move," in Proc. Eurohapt., Mar. 2006, pp. 105-109.
4. E. Ruffaldi, A. Filippeschi, A. Frisoli, O. Sandoval, C. Avizzano, and M. Bergamasco, "Vibrotactile perception assessment for a rowing training system," in Proc. IEEE World Haptics Conf., 2009, pp. 350-355.
5. T. Pakkanen, J. Lylykangas, J. Raisamo, R. Raisamo, K. Salminen, J. Rantala, and V. Surakka, "Perception of low-amplitude haptic stimuli when biking," in Proc. Int. Conf. Multimodal Interfaces, 2008, pp. 281-284.
6. L. Marchal-Crespo, M. Raai, G. Rauter, P. Wolf, and R. Riener, "The effect of haptic guidance and visual feedback on learning a complex tennis task," Exp. Brain Res., pp. 1-15, 2013.
7. R. Sigrist, G. Rauter, R. Riener, and P. Wolf, "Terminal feedback outperforms concurrent visual, auditory, haptic feedback in learning a complex rowing-type task," J. Motor Behav., vol. 45, no. 6, pp. 455-472, 2013.
8. D. Drobny and J. Borchers, "Learning basic dance choreographies with different augmented feedback modalities," in Proc. ACM Conf. Human Factors Comput. Syst., 2010, pp. 3793-3798.
9. J. van der Linden, E. Schoonderwaldt, J. Bird, and R. Johnson, "Musicjacket - Combining motion capture and vibrotactile feedback to teach violin bowing," IEEE Trans. Instrum. Meas., vol. 60, no. 1, pp. 104-113, Jan. 2011.
10. P. Shull, K. Lurie, M. Shin, T. Besier, and M. Cutkosky, "Haptic gait retraining for knee osteoarthritis treatment," in Proc. IEEE Haptics Symp., 2010, pp. 409-416.
11. M. Rotella, K. Guerin, X. He, and A. M. Okamura, "HAPI bands: A haptic augmented posture interface," in Proc. IEEE Haptics Symp., 2012, pp. 163-170.
12. A. Alahakone and S. Senanayake, "A real-time system with assistive feedback for postural control in rehabilitation," IEEE/ASME Trans. Mechatron., vol. 15, no. 2, pp. 226-233, Apr. 2010.
13. C.Wall and E. Kentala, "Effect of displacement, velocity, combined vibrotactile tilt feedback on postural control of vestibulopathic subjects," J. Vestibul. Res-Equil., vol. 20, no. 1, pp. 61-69, Jan. 2010.
14. K. Sienko, M. Balkwill, L. Oddsson, and C. Wall, "Effects of multidirectional vibrotactile feedback on vestibular-deficient postural performance during continuous multi-directional support surface perturbations," J. Vestibul. Res-Equil., vol. 18, no. 5/6, pp. 273-285, Jan. 2008.
15. M. D'Alonzo, S. Dosen, C. Cipriani, and D. Farina, "HyVE: Hybrid vibro-electrotactile stimulation for sensory feedback and substitution in rehabilitation," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 22, no. 2, pp. 290-301, Mar. 2014.
16. K. Sienko, M. Balkwill, L. I. Oddsson, and C. Wall, "The effect of vibrotactile feedback on postural sway during locomotor activities," J. NeuroEng. Rehabil., vol. 10, no. 1, p. 93, 2013.
17. B.-C. Lee, S. Chen, and K. Sienko, "A wearable device for real-time motion error detection and vibrotactile instructional cuing," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 4, pp. 374-381, Aug. 2011.
18. J. Klein, S. J. Spencer, and D. J. Reinkensmeyer, "Breaking it down is better: Haptic decomposition of complex movements aids in robotassisted motor learning," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 20, no. 3, pp. 268-275, May 2012.
19. E. Akdogan, K. Shima, H. Kataoka, M. Hasegawa, A. Otsuka, and T. Tsuji, "The cybernetic rehabilitation aid: Preliminary results for wrist and elbow motions in healthy subjects," IEEE Trans. Neural Syst. Rehabil. Eng., vol. 20, no. 5, pp. 697-707, Sep. 2012.
20. S. Schátzle, T. Ende, T. Wústhoff, and C. Preusche, "Vibrotac: An ergonomic and versatile usable vibrotactile feedback device," in Proc. IEEE RO-MAN, 2010, pp. 670-675.
21. C. Schönauer, K. Fukushi, A. Olwal, H. Kaufmann, and R. Raskar, "Multimodal motion guidance: Techniques for adaptive and dynamic feedback," in Proc. ACM Int. Conf. Multimodal Interact., Jan. 2012, pp. 133-140.
22. M. Prewett, L. Elliott, A.Walvoord, andM. Coovert, "A meta-analysis of vibrotactile and visual information displays for improving task performance," IEEE Trans. Syst., Man, Cybern., Syst, Part C: Appl. Rev., vol. 42, no. 1, pp. 123-132, Jan. 2012.
23. C. Cipriani, M. D'Alonzo, and M. Carrozza, "A miniature vibrotactile sensory substitution device for multifingered hand prosthetics," IEEE Trans. Biomed. Eng., vol. 59, no. 2, pp. 400-408, Feb. 2012.
24. C. E. Stepp, Q. An, and Y. Matsuoka, "Repeated training with augmentative vibrotactile feedback increases object manipulation performance," PLoS ONE, vol. 7, no. 2, p. e32743, 2012.
25. D. Spelmezan, M. Jacobs, A. Hilgers, and J. Borchers, "Tactile motion instructions for physical activities," in Proc. Int. Conf. Human Factors Comput. Syst., Apr. 2009, pp. 2243-2252.
26. T. McDaniel, M. Goldberg, D. Villanueva, L. N. Viswanathan, and S. Panchanathan, "Motor learning using a kinematic-vibrotactilemapping targeting fundamental movements," in Proc. ACM Int. Conf. Multimedia, 2011, pp. 543-552.
27. J. Lieberman and C. Breazeal, "TIKL: Development of a wearable vibrotactile feedback suit for improved human motor learning," IEEE Trans. Robot., vol. 23, no. 5, pp. 919-926, Oct. 2007.
28. A. A. Stanley and K. J. Kuchenbecker, "Evaluation of tactile feedback methods for wrist rotation guidance," IEEE Trans. Haptics, vol. 5, no. 3, pp. 240-251, Jul.-Sep. 2012.
29. R. Sigrist, G. Rauter, R. Riener, and P. Wolf, "Augmented visual, auditory, haptic, multimodal feedback in motor learning: A review," J. Motor Behav., vol. 20, no. 1, pp. 21-53, 2013.
30. H. Poizner, M. Clark, A. S. Merians, B. Macauley, L. J. G. Rothi, and K. M. Heilman, "Joint coordination deficits in limb apraxia," Brain, vol. 118, no. 1, pp. 227-242, 1995.
31. K. Bark, P. Khanna, R. Irwin, P. Kapur, S. A. Jax, L. J. Buxbaum, and K. J. Kuchenbecker, "Lessons in using vibrotactile feedback to guide fast arm motions," in Proc. IEEE World Haptics Conf., Jun. 2011, pp. 355-360.
32. OpenKinect [Online]. Available: http://openkinect.org/wiki/Protocol-Documentation
33. PrimeSense, Primesense 3-D sensors [Online]. Available: http://www. primesense.com/wp-content/uploads/2013/02/PrimeSense-3-Dsens
34. B. C. Lee and K. Sienko, "Effects of attractive versus repulsive vibrotactile instructional cues duringmotion replication tasks," in Proc. 33rd Annu. Int. Conf. IEEE EMBC, 2011, pp. 3533-3536.
35. H. Levitt, "Transformed up and down methods in psychoacoustics," J. Acoust. Soc. Am., vol. 49, no. 2B, pp. 467-477, Feb. 1971.
36. J. Jung and S. Choi, "Perceived magnitude and power consumption of vibration feedback in mobile devices," in Human-Computer Interaction. Interaction Platforms and Techniques, J. Jacko, Ed. Berlin, Germany: Springer, vol. 4551, LNCS, pp. 354-363.
37. M. Rothenberg, R. T. Verrillo, S. A. Zahorian, M. L. Brachman, and J. S. J. Bolanowski, "Vibrotactile frequency for encoding a speech parameter," J. Acoust. Soc. Am., vol. 62, no. 4, pp. 1003-1012, 1977.
38. S. G. Hart and L. E. Staveland, "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research," Human Mental Workload, vol. 1, no. 3, pp. 139-183, 1988.
39. S. G. Hill, H. P. Iavecchia, J. C. Byers, A. C. Bittner, A. L. Zaklade, and R. E. Christ, "Comparison of four subjective workload rating scales," Hum. Factors, vol. 34, no. 4, pp. 429-439, 1992.
40. Y. Xiao, Z. Wang, M. Wang, and Y. Lan, "The appraisal of reliability and validity of subjectiveworkload assessment technique and nasa-task load index," Chin. J. Indust. Hygiene Occupat. Diseases, vol. 23, no. 3, pp. 178-181, 2005.
41. S. Rubio, E. Daz, J. Martn, and J. M. Puente, "Evaluation of subjective mental workload: A comparison of swat, nasa-tlx, workload profile methods," Appl. Psychol., vol. 53, no. 1, pp. 61-86, 2004.
42. M. Pomplun and M. J. Mataric, "Evaluation metrics and results of human arm movement imitation," in Proc. IEEE-RAS Int Conf. Humanoid Robot., 2000, pp. 1-9.
43. J. Metrot, J. Froger, I. Hauret, D. Mottet, L. van Dokkum, and I. Laffont, "Motor recovery of the ipsilesional upper limb in subacute stroke," Arch. Phys. Med. Rehabil., vol. 94, no. 11, pp. 2283-2290, 2013.
44. S. Y. Schaefer, K. Y. Haaland, and R. L. Sainburg, "Hemispheric specialization and functional impact of ipsilesional deficits in movement coordination and accuracy," Neuropsychologia, vol. 47, no. 13, pp. 2953-2966, 2009.
45. S. Jax, L. Buxbaum, and A. Moll, "Deficits in movement planning and intrinsic coordinate control in ideomotor apraxia," J. Cognitive Neurosci., vol. 18, no. 12, pp. 2063-2076, 2006.