Evaluation of wearable haptic systems for the fingers in augmented reality applications

IEEE Transactions on Haptics

Volumn 10, Issue 4, 2017, Pages 511-522

  Maisto, Maurizio ^a   Pacchierotti, Claudio ^b   Chinello, Francesco ^c   Salvietti, Gionata ^d,e   De Luca, Alessandro ^a   Prattichizzo, Domenico ^d,e  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b CAMPUS DE BEAULIEU   (France)

^c AARHUS UNIVERSITY   (Denmark)

^d ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^e UNIVERSITY OF SIENA   (Italy)

Author keywords

AR; Augmented reality; Cutaneous feedback; Fingertip haptics; Tactile feedback; Wearable haptics

Indexed keywords

ARGON; AUGMENTED REALITY; LIMESTONE; WEARABLE COMPUTERS;

AUGMENTED REALITY APPLICATIONS; CUTANEOUS FEEDBACKS; EXPERIMENTAL EVALUATION; HAPTICS; INTERACTION FORCES; SIGN INTERPRETATION; TACTILE FEEDBACK; TECHNOLOGICAL REVOLUTION;

HAPTIC INTERFACES;

ARGON; CALCIUM CARBONATE; COMPUTERS; EVALUATION; FEEDBACK; PAPER BOARDS; SYSTEMS; WEIGHT;

ADULT; COMPUTER INTERFACE; ELECTRONIC DEVICE; EQUIPMENT DESIGN; EVALUATION STUDY; FEEDBACK SYSTEM; FEMALE; FINGER; HUMAN; MALE; MOTOR ACTIVITY; TOUCH; VIRTUAL REALITY; WRITING; YOUNG ADULT;

ADULT; EQUIPMENT DESIGN; FEEDBACK; FEMALE; FINGERS; HUMANS; MALE; MOTOR ACTIVITY; TOUCH; USER-COMPUTER INTERFACE; VIRTUAL REALITY; WEARABLE ELECTRONIC DEVICES; WRITING; YOUNG ADULT;

EID: 85045042856     PISSN: 19391412     EISSN: 23294051     Source Type: Journal    
DOI: 10.1109/TOH.2017.2691328     Document Type: Article

References (39)

1. I. E. Sutherland, “A head-mounted three dimensional display,” in Proc. ACM Dec. 9–11 Fall Joint Comput. Conf., 1968, pp. 757–764.
2. D. Etherington, “Techcruch: Pokemon GO estimated at over 75m downloads worldwide,” 2016. [Online]. Available: https://techcrunch.com/2016/07/25/pokemon-go-75m-downloads/
3. H. Taylor, “CNBC: Why apple is pouring money into virtual and augmented reality,” 2016. [Online]. Available: http://www.cnbc.com/2016/08/10/why-apple-is-pouring-money-into-virtual-and-augmented-reality.html
4. C. Newton, “The Verge: Facebook 2026,” 2016. [Online]. Available: http://www.theverge.com/a/mark-zuckerberg-future-of-facebook
5. A. Liptak, “The Verge: Google reportedly working on headset that mixes augmented and virtual reality,” 2016. [Online]. Available: http://www.theverge.com/2016/7/17/12209108/google-headset-augmented-virtual-reality
6. N. Healey, “CNET: Microsoft’s mixed reality vision: 80 million devices by 2020,” 2016. [Online]. Available: https://www.cnet.com/news/microsofts-mixed-reality-vision-80-million-vr-and-ar-devices-by-2020/
7. M. Solazzi, A. Frisoli, and M. Bergamasco, “Design of a cutaneous fingertip display for improving haptic exploration of virtual objects,” in Proc. IEEE Int. Symp. Robots Human Interactive Commun., 2010, pp. 1–6.
8. M. Gabardi, M. Solazzi, D. Leonardis, and A. Frisoli, “A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features,” in Proc. IEEE Haptics Symp., 2016, pp. 140–146.
9. D. Prattichizzo, F. Chinello, C. Pacchierotti, and M. Malvezzi, “Towards wearability in fingertip haptics: A 3-DoF wearable device for cutaneous force feedback,” IEEE Trans. Haptics, vol. 6, no. 4, pp. 506–516, Oct.–Dec. 2013.
10. I. M. Koo, K. Jung, J. C. Koo, J.-D. Nam, Y. K. Lee, and H. R. Choi, “Development of soft-actuator-based wearable tactile display,” IEEE Trans. Robot., vol. 24, no. 3, pp. 549–558, Jun. 2008.
11. G. Frediani, D. Mazzei, D. E. De Rossi, and F. Carpi, “Wearable wireless tactile display for virtual interactions with soft bodies,” Frontiers Bioengineering Biotechnol., vol. 2, 2014, Art. no. 31.
12. D. Leonardis, M. Solazzi, I. Bortone, and A. Frisoli, “A wearable fingertip haptic device with 3 DoF asymmetric 3-RSR kinematics,” in Proc. World Haptics Conf., 2015, pp. 388–393.
13. D. Leonardis, M. Solazzi, I. Bortone, and A. Frisoli, “A 3-RSR haptic wearable device for rendering fingertip contact forces,” IEEE Trans. Haptics, to be published, doi: 10.1109/TOH.2016.2640291.
14. A. Girard, M. Marchal, F. Gosselin, A. Chabrier, F. Louveau, and A. Lecuyer, “HapTip: Displaying haptic shear forces at the fingertips for multi-finger interaction in virtual environments,” Frontiers ICT, vol. 3, 2016, Art. no. 6.
15. I. Choi, E. W. Hawkes, D. L. Christensen, C. J. Ploch, and S. Follmer, “Wolverine: A wearable haptic interface for grasping in virtual reality,” in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2016, pp. 986–993.
16. L. Meli, S. Scheggi, C. Pacchierotti, and D. Prattichizzo, “Wearable haptics and hand tracking via an RGB-D camera for immersive tactile experiences,” in Proc. ACM Special Interest Group Comput. Graph. Interactive Techn. Conf., 2014, Art. no. 56.
17. H. Benko, C. Holz, M. Sinclair, and E. Ofek, “Normaltouch and texturetouch: High-fidelity 3D haptic shape rendering on hand-held virtual reality controllers,” in Proc. 29th Annu. Symp. User Interface Softw. Technol., 2016, pp. 717–728.
18. S. B. Schorr and A. Okamura, “Three-dimensional skin deformation as force substitution: Wearable device design and performance during haptic exploration of virtual environments,” IEEE Trans. Haptics, to be published, doi: 10.1109/TOH.2017.2672969.
19. J. Arata, K. Ohmoto, R. Gassert, O. Lambercy, H. Fujimoto, and I. Wada, “A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism,” in Proc. IEEE Int. Conf. Robot. Autom., 2013, pp. 3902–3907.
20. C. J. Nycz, T. Butzer, € O. Lambercy, J. Arata, G. S. Fischer, and R. Gassert, “Design and characterization of a lightweight and fully portable remote actuation system for use with a hand exoskeleton,” IEEE Robot. Autom. Lett., vol. 1, no. 2, pp. 976–983, Jul. 2016.
21. H. Uchiyama, M. A. Covington, and W. D. Potter, “Vibrotactile glove guidance for semi-autonomous wheelchair operations,” in Proc. Annu. Southeast Regional Conf., 2008, pp. 336–339.
22. L. Hayes, “Vibrotactile feedback-assisted performance,” in Proc. New Interfaces Musical Expression, 2011, pp. 72–75.
23. A. Hein and M. Brell, “Contact-a vibrotactile display for computer aided surgery,” in Proc. World Haptics, 2007, pp. 531–536.
24. J. S. Zelek, S. Bromley, D. Asmar, and D. Thompson, “A haptic glove as a tactile-vision sensory substitution for wayfinding,” J. Visual Impairment Blindness, vol. 97, no. 10, pp. 1–24, 2003.
25. E. Giannopoulos, A. Pomes, and M. Slater, “Touching the void: Exploring virtual objects through a vibrotactile glove,” Int. J. Virtual Reality, vol. 11, pp. 19–24, 2012.
26. J. Foottit, D. Brown, S. Marks, and A. M. Connor, “An intuitive tangible game controller,” in Proc. Conf. Interactive Entertainment, 2014, pp. 1–7.
27. A. Mazzoni and N. Bryan-Kinns, “Mood glove: A haptic wearable prototype system to enhance mood music in film,” Entertainment Comput., vol. 17, pp. 9–17, 2016.
28. C. Pacchierotti, S. Sinclair, M. Solazzi, A. Frisoli, V. Hayward, and D. Prattichizzo, “Wearable haptic systems for the fingertip and the hand: Taxonomy, review, and perspectives,” IEEE Trans. Haptics., 2017.
29. S. Scheggi, G. Salvietti, and D. Prattichizzo, “Shape and weight rendering for haptic augmented reality,” in Proc. 19th Int. Symp. Robot Human Interactive Commun., 2010, pp. 44–49.
30. F. Chinello, M. Malvezzi, C. Pacchierotti, and D. Prattichizzo, “Design and development of a 3RRS wearable fingertip cutaneous device,” in Proc. IEEE/ASME Int. Conf. Adv. Intell. Mechatronics, 2015, pp. 293–298.
31. C. Pacchierotti, G. Salvietti, I. Hussain, L. Meli, and D. Prattichizzo, “The hRing: A wearable haptic device to avoid occlusions in hand tracking,” in Proc. IEEE Haptics Symp., 2016, pp. 134–139.
32. K. H. Park, B. H. Kim, and S. Hirai, “Development of a soft-fingertip and its modeling based on force distribution,” in Proc. IEEE Int. Conf. Robot. Autom., 2003, pp. 3169–3174.
33. C. Pacchierotti, Cutaneous Haptic Feedback in Robotic Teleoperation. Berlin, Germany: Springer, 2015.
34. K. Minamizawa, S. Fukamachi, H. Kajimoto, N. Kawakami, and S. Tachi, “Gravity grabber: Wearable haptic display to present virtual mass sensation,” in Proc. ACM Special Interest Group Comput. Graph. Interactive Techn. Conf., 2007, Art. no. 8.
35. K. Minamizawa, H. Kajimoto, N. Kawakami, and S. Tachi, “A wearable haptic display to present the gravity sensation-preliminary observations and device design,” in Proc. World Haptics, 2007, pp. 133–138.
36. C. B. Zilles and J. K. Salisbury, “A constraint-based god-object method for haptic display,” in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 1995, pp. 146–151.
37. L. Meli, C. Pacchierotti, and D. Prattichizzo, “Sensory subtraction in robot-assisted surgery: Fingertip skin deformation feedback to ensure safety and improve transparency in bimanual haptic interaction,” IEEE Trans. Biomed. Eng., vol. 61, no. 4, pp. 1318–1327, Apr. 2014.
38. C. Pacchierotti, L. Meli, F. Chinello, M. Malvezzi, and D. Prattichizzo, “Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems,” Int. J. Robot. Res., vol. 34, no. 14, pp. 1773–1787, 2015.
39. D. Prattichizzo, C. Pacchierotti, and G. Rosati, “Cutaneous force feedback as a sensory subtraction technique in haptics,” IEEE Trans. Haptics, vol. 5, no. 4, pp. 289–300, Oct.–Dec. 2012.