Haptic feedback for microrobotics applications: A review

Frontiers Robotics AI

Volumn 3, Issue AUG, 2016, Pages

  Pacchierotti, Claudio ^a   Scheggi, Stefano ^b   Prattichizzo, Domenico ^a,c   Misra, Sarthak ^b,d  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c UNIVERSITY OF SIENA   (Italy)

^d UNIVERSITY MEDICAL CENTER GRONINGEN   (Netherlands)

Author keywords

Haptics; Micromanipulation; Micropositioning; Microrobotics; Microsurgery; Robotics; Teleoperation

Indexed keywords

EID: 85028015881     PISSN: None     EISSN: 22969144     Source Type: Journal    
DOI: 10.3389/frobt.2016.00053     Document Type: Short Survey

References (74)

1. Ammi, M., and Ferreira, A. (2005). "Realistic visual and haptic rendering for biological-cell injection," in Proc. IEEE International Conference on Robotics and Automation (Barcelona), 918-923
2. Ang, Q.-Z., Horan, B., Abdi, H., and Nahavandi, S. (2015). Multipoint haptic guidance for micrograsping systems. IEEE Syst. J. 9, 1388-1395. doi: 10.1109/JSYST.2014.2314737
3. Asgari, M., Ghanbari, A., and Nahavandi, S. (2011). "3d particle-based cell modelling for haptic microrobotic cell injection," in Proc. International Conference on Mechatronics Technology: Precision Mechatronics for Advanced Manufacturing, Service, and Medical Sectors (Melbourne), 1-6
4. Balasubramanian, S., Kagan, D., Hu, C. M., Campuzano, S., Lobo-Castañon, M. J., Lim, N., et al. (2011). Micromachine-enabled capture and isolation of cancer cells in complex media. Angew. Chem. Int. Ed. 50, 4161-4164. doi:10.1002/anie.201102193
5. Basdogan, C., Kiraz, A., Bukusoglu, I., Varol, A., and Doganay, S. (2007). Haptic guidance for improved task performance in steering microparticles with optical tweezers. Opt. Express 15, 11616-11621. doi:10.1364/OE.15.011616
6. Bhatti, A., Khan, B., Nahavandi, S., Hanoun, S., and Gao, D. (2015). "Intuitive haptics interface with accurate force estimation and reflection at nanoscale," in Advances in Global Optimization (Springer International Publishing), 507-514
7. Binnig, G., Quate, C. F., and Gerber, C. (1986). Atomic force microscope. Phys. Rev. Lett. 56, 930. doi:10.1103/PhysRevLett.56.930
8. Bolopion, A., and Régnier, S. (2013). A review of haptic feedback teleoperation systems for micromanipulation and microassembly. IEEE Trans. Autom. Sci. Eng. 10, 496-502. doi:10.1109/TASE.2013.2245122
9. Bolopion, A., Stolle, C., Tunnell, R., Haliyo, S., Régnier, S., and Fatikow, S. (2011). "Remote microscale teleoperation through virtual reality and haptic feedback," in Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (San Francisco), 894-900
10. Bolopion, A., Xie, H., Haliyo, D. S., and Régnier, S. (2012). Haptic teleoperation for 3-d microassembly of spherical objects. IEEE/ASME Trans. Mechatron. 17, 116-127. doi:10.1109/TMECH.2010.2090892
11. Boukhnifer, M., and Ferreira, A. (2013). Fault tolerant control of a teleoperated piezoelectric microgripper. Asian J. Control 15, 888-900. doi:10.1002/asjc.593
12. Fahlbusch, S., Shirinov, A., and Fatikow, S. (2002). "Afm-based micro force sensor and haptic interface for a nanohandling robot," in Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. 2. (Lausanne), 1772-1777
13. Faroque, S., Horan, B., Adam, H., Pangestu, M., and Thomas, S. (2015). "Haptic virtual reality training environment for micro-robotic cell injection," in Haptic Interaction, Vol. 277. (Springer), 245-249
14. Ferreira, A., Cassier, C., Haddab, Y., Rougeot, P., and Chaillet, N. (2001). "Development of a teleoperated micromanipulation system with visual and haptic feedback," in Intelligent Systems and Advanced Manufacturing, 112-123
15. Ghanbari, A., Abdi, H., Horan, B., Nahavandi, S., Chen, X., and Wang, W. (2010). "Haptic guidance for microrobotic intracellular injection," in Proc. IEEE RAS and EMBS International Conference on Biomedical Robotics and Biomechatronics (Tokyo), 162-167
16. Ghanbari, A., Horan, B., Nahavandi, S., Chen, X., and Wang, W. (2014). Haptic microrobotic cell injection system. IEEE Syst. J. 8, 371-383. doi:10.1109/JSYST.2012.2206440
17. Grange, S., Conti, F., Helmer, P., Rouiller, P., and Baur, C. (2001). "Delta haptic device as a nanomanipulator," in Intelligent Systems and Advanced Manufacturing, 100-111
18. Gultepe, E., Randhawa, J. S., Kadam, S., Yamanaka, S., Selaru, F. M., Shin, E. J., et al. (2013). Biopsy with thermally-responsive untethered microtools. Adv. Mater. Weinheim 25, 514-519. doi:10.1002/adma.201203348
19. Hollis, R., Salcudean, S., and Abraham, D. (1990). "Toward a tele-nanorobotic manipulation system with atomic scale force feedback and motion resolution," in Proc. IEEE Micro Electro Mechanical Systems (Napa Valley), 115-119
20. Horan, B., Ghanbari, A., Nahavandi, S., Chen, X., and Wang, W. (2009). "Towards haptic microrobotic intracellular injection," in Proc. ASME 2009 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (San Diego), 135-142
21. Iwata, F., Mizuguchi, Y., Ko, H., and Ushiki, T. (2013). A compact nano manipulator based on an atomic force microscope coupling with a scanning electron microscope or an inverted optical microscope. J. MicroBio Rob. 8, 25-32. doi:10.1007/s12213-013-0063-7
22. Jakopec, M., Rodriguez Baena, F., Harris, S. J., Gomes, P., Cobb, J., and Davies, B. L. (2003). The hands-on orthopaedic robot acrobot: early clinical trials of total knee replacement surgery. IEEE Trans. Rob. Autom. 19, 902-911. doi:10.1109/TRA.2003.817510
23. Khalil, I. S. M., Magdanz, V., Sanchez, S., Schmidt, O. G., and Misra, S. (2014a). The control of self-propelled microjets inside a microchannel with time-varying flow rates. IEEE Trans. Robot. 30, 49-58. doi:10.1109/TRO.2013.2281557
24. Khalil, I. S. M., Magdanz, V., Sanchez, S., Schmidt, O. G., and Misra, S. (2014b). Wireless magnetic-based closed-loop control of self-propelled microjets. PLoS ONE 9:e83053. doi:10.1371/journal.pone.0083053
25. Kim, D.-N., Kim, K., Kim, K.-Y., and Cha, S.-M. (2001). "Dexterous teleoperation for micro parts handling based on haptic/visual interface," in Proc. IEEE Micromechatronics and Human Science (Kawasaki), 211-217
26. Kim, J., Ladjal, H., Folio, D., Ferreira, A., and Kim, J. (2012). Evaluation of telerobotic shared control strategy for efficient single-cell manipulation. IEEE Trans. Autom. Sci. Eng. 9, 402-406. doi:10.1109/TASE.2011.2174357
27. Kim, J., Sharifi, F. J., and Kim, J. (2008). "A physically-based haptic rendering for telemanipulation with visual information: macro and micro applications," in Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (Nice), 3489-3494
28. Kim, S.-G., and Sitti, M. (2006). Task-based and stable telenanomanipulation in a nanoscale virtual environment. IEEE Trans. Autom. Sci. Eng. 3, 240-247. doi:10.1109/TASE.2006.876909
29. Ladjal, H., Hanus, J.-L., and Ferreira, A. (2011). "Microrobotic simulator for assisted biological cell injection," in Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (San Francisco), 1315-1320
30. Ladjal, H., Hanus, J.-L., and Ferreira, A. (2013). Micro-to-nano biomechanical modeling for assisted biological cell injection. IEEE Trans. Biomed. Eng. 60, 2461-2471. doi:10.1109/TBME.2013.2258155
31. Massimino, M. J., and Sheridan, T. B. (1994). Teleoperator performance with varying force and visual feedback. Hum. Factors 36, 145-157
32. Matteucci, M., Casella, M., Bedoni, M., Donetti, E., Fanetti, M., De Angelis, F., et al. (2008). A compact and disposable transdermal drug delivery system. Microelectron. Eng. 85, 1066-1073. doi:10.1016/j.mee.2007.12.067
33. Mehrtash, M., and Khamesee, M. B. (2013). Micro-domain force estimation using hall-effect sensors for a magnetic microrobotic station. J. Adv. Mech. Des. Syst. Manuf. 7, 2-14. doi:10.1299/jamdsm.7.2
34. Mehrtash, M., Khamesee, M. B., Tarao, S., Tsuda, N., and Chang, J.-Y. (2012). Human-assisted virtual reality for a magnetic-haptic micromanipulation platform. Microsyst. Technol. 18, 1407-1415. doi:10.1007/s00542-012-1560-7
35. Mehrtash, M., Zhang, X., and Khamesee, M. (2015). Bilateral magnetic micromanipulation using off-board force sensor. IEEE/ASME Trans. Mechatron. 20, 3223-3231. doi:10.1109/TMECH.2015.2417116
36. Menciassi, A., Eisinberg, A., Carrozza, M. C., and Dario, P. (2003). Force sensing microinstrument for measuring tissue properties and pulse in microsurgery. IEEE/ASME Trans. Mechatron. 8, 10-17. doi:10.1109/TMECH.2003.809153
37. Mohand Ousaid, A., Bolopion, A., Haliyo, S., Régnier, S., Hayward, V. (2014). "Stability and transparency analysis of a teleoperation chain for microscale interaction," in Proc. IEEE International Conference on Robotics and Automation (ICRA) (Hong Kong: IEEE), 5946-5951
38. Mohand Ousaid, A., Haliyo, D., Regnier, S., and Hayward, V. (2015). A stable and transparent microscale force feedback teleoperation system. IEEE/ASME Trans. Mechatron. 20, 2593-2603. doi:10.1109/TMECH.2015.2423092
39. Mohand Ousaid, A., Millet, G., Régnier, S., Haliyo, S., and Hayward, V. (2012). Haptic interface transparency achieved through viscous coupling. Int. J. Rob. Res. 31, 319-329. doi:10.1177/0278364911430421
40. Ni, Z., Bolopion, A., Agnus, J., Benosman, R., and Régnier, S. (2012). Asynchronous event-based visual shape tracking for stable haptic feedback in microrobotics. IEEE Trans. Robot. 28, 1081-1089. doi:10.1109/TRO.2012.2198930
41. Ni, Z., Pacoret, C., Benosman, R., and Régnier, S. (2013). "2d high speed force feedback teleoperation of optical tweezers," in Proc. IEEE International Conference on Robotics and Automation (Karlsruhe), 1700-1705
42. Ni, Z., Yin, M., Pacoret, C., Benosman, R., and Régnier, S. (2014). "First high speed simultaneous force feedback for multi-trap optical tweezers," in Advanced Intelligent Mechatronics (AIM), 2014 IEEE/ASME International Conference on (Besançon), 7-12
43. Okamura, A. M. (2004). Methods for haptic feedback in teleoperated robot-assisted surgery. Ind. Rob. 31, 499-508. doi:10.1108/01439910410566362
44. Pacchierotti, C. (2015). "Cutaneous haptic feedback in robotic teleoperation," in Springer Series on Touch and Haptic Systems (Springer International Publishing)
45. Pacchierotti, C., Magdanz, V., Medina-Sanchez, M., Schmidt, O. G., Prattichizzo, D., and Misra, S. (2015a). Intuitive control of self-propelled microjets with haptic feedback. J. MicroBio Rob. 10, 37-53. doi:10.1007/s12213-015-0082-7
46. Pacchierotti, C., Meli, L., Chinello, F., Malvezzi, M., and Prattichizzo, D. (2015b). Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems. Int. J. Rob. Res. 34, 1773-1787. doi:10.1177/0278364915603135
47. Pacchierotti, C., Tirmizi, A., Bianchini, G., and Prattichizzo, D. (2015c). Enhancing the performance of passive teleoperation systems via cutaneous feedback. IEEE Trans. Haptics 8, 397-409. doi:10.1109/TOH.2015.2457927
48. Pacchierotti, C., Prattichizzo, D., and Kuchenbecker, K. J. (2016). Cutaneous feedback of fingertip deformation and vibration for palpation in robotic surgery. IEEE Trans. Biomed. Eng. 63, 278-287. doi:10.1109/TBME.2015.2455932
49. Payne, C. J., Latt, W. T., and Yang, G.-Z. (2012). "A new hand-held force-amplifying device for micromanipulation," in Proc. IEEE International Conference on Robotics and Automation (St. Paul), 1583-1588
50. Pillarisetti, A., Anjum, W., Desai, J. P., Friedman, G., and Brooks, A. D. (2005). "Force feedback interface for cell injection," in Proc. World Haptics (Pisa), 391-400
51. Probst, M., Hürzeler, C., Borer, R., and Nelson, B. J. (2009). A microassembly system for the flexible assembly of hybrid robotic mems devices. Int. J. Optomechatronics 3, 69-90. doi:10.1080/15599610902894592
52. Salcudean, S. E., Wong, N., and Hollis, R. L. (1995). Design and control of a force-reflecting teleoperation system with magnetically levitated master and wrist. IEEE Trans. Rob. Autom. 11, 844-858. doi:10.1109/70.478431
53. Sanchez, S., Solovev, A. A., Schulze, S., and Schmidt, O. G. (2011). Controlled manipulation of multiple cells using catalytic microbots. Chem. Commun. 47, 698-700. doi:10.1039/c0cc04126b
54. Santos-Carreras, L., Leuenberger, K., Beira, R., and Bleuler, H. (2010). "Araknes haptic interface: user-centered design approach," in pHealth (Berlin), 2010
55. Seifabadi, R., Rezaei, S. M., Ghidary, S. S., and Zareinejad, M. (2013). A teleoperation system for micro positioning with haptic feedback. Int. J. Control Autom. Syst. 11, 768-775. doi:10.1007/s12555-012-0139-5
56. Shirinov, A., and Fatikow, S. (2003). "Haptic interface for a microrobot cell," in Proc. EuroHaptics (Dublin), 6-9
57. Sieber, A., Valdastri, P., Houston, K., Eder, C., Tonet, O., Menciassi, A., et al. (2008). A novel haptic platform for real time bilateral biomanipulation with a mems sensor for triaxial force feedback. Sens. Actuators A Phys. 142, 19-27. doi:10.1016/j.sna.2007.03.018
58. Sitti, M., Aruk, B., Shintani, H., and Hashimoto, H. (2003). Scaled teleoperation system for nano-scale interaction and manipulation. Adv. Robot. 17, 275-291. doi:10.1163/156855303764018503
59. Sitti, M., Horighuchi, S., and Hashimoto, H. (1999). "Tele-touch feedback of surfaces at the micro/nano scale: modeling and experiments," in Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems, Vol. 2 (Kyongju), 882-888
60. Soler, L., Magdanz, V., Fomin, V. M., Sanchez, S. O., and Schmidt, O. G. (2013). Self-propelled micromotors for cleaning polluted water. ACS Nano 7, 9611-9620. doi:10.1021/nn405075d
61. Solovev, A. A., Mei, Y., Urena, E. B., Huang, G., and Schmidt, O. G. (2009). Catalytic microtubular jet engines self-propelled by accumulated gas bubbles. Small 5, 1688-1692. doi:10.1002/smll.200900021
62. Solovev, A. A., Sanchez, S., Pumera, M., Mei, Y. F., and Schmidt, O. G. (2010). Magnetic control of tubular catalytic microbots for the transport, assembly, and delivery of micro-objects. Adv. Funct. Mater. 20, 2430-2435. doi:10.1002/adfm.201090064
63. Solovev, A. A., Xi, W., Gracias, D. H., Harazim, S. M., Deneke, S. M., Sanchez, S., et al. (2012). Self-propelled nanotools. ACS Nano 6, 1751-1756. doi:10.1021/nn204762w
64. Troccaz, J., and Delnondedieu, Y. (1996). Semi-active guiding systems in surgery. a two-dof prototype of the passive arm with dynamic constraints (PADyC). Mechatronics 6, 399-421. doi:10.1016/0957-4158(96)00003-7
65. Venture, G., Haliyo, D. S., Régnier, S., and Micaelli, A. (2005). "Force-feedback micromanipulation with unconditionally stable coupling," in Proc. International Conference on IEEE/RSJ Intelligent Robots and Systems (Edmonton), 1923-1928
66. Vijayasai, A. P., Sivakumar, G., Mulsow, M., Lacouture, S., Holness, A., and Dallas, T. E. (2010). Haptic controlled three-axis mems gripper system. Rev. Sci. Instrum. 81, 105114. doi:10.1063/1.3499243
67. Vijayasai, A. P., Sivakumar, G., Mulsow, M., Lacouture, S., Holness, A., Dallas, T. E., et al. (2012). Haptic controlled three degree-of-freedom microgripper system for assembly of detachable surface-micromachined mems. Sens. Actuators A Phys. 179, 328-336. doi:10.1016/j.sna.2012.03.035
68. Vlachos, K., and Papadopoulos, E. (2014). "Design and experimental validation of a hybrid micro tele-manipulation system," in 8th Hellenic Conference on Artificial Intelligence (Ioannina: Springer International Publishing), 164-177
69. Vlachos, K., Vartholomeos, P., and Papadopoulos, E. (2007). "A haptic tele-manipulation environment for a vibration-driven micromechatronic device," in Proc. IEEE/ASME International Conference on Advanced Intelligent Mechatronics (Zurich), 1-6
70. Vogl, W., Ma, B. K.-L., and Sitti, M. (2006). Augmented reality user interface for an atomic force microscope-based nanorobotic system. IEEE Trans. Nanotechnol. 5, 397-406. doi:10.1109/TNANO.2006.877421
71. Wagner, C. R., Howe, R. D., and Stylopoulos, N. (2002). "The role of force feedback in surgery: analysis of blunt dissection," in Proc. International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (Orlando), 354-355
72. Woods, S. P., and Constandinou, T. G. (2011). "Towards a micropositioning system for targeted drug delivery in wireless capsule endoscopy," in Proc. International Conference of the IEEE Engineering in Medicine and Biology Society (Boston), 7372-7375
73. Xi, W., Solovev, A. A., Ananth, A. N., Gracias, D. H., Sanchez, S., and Schmidt, O. G. (2013). Rolled-up magnetic microdrillers: towards remotely controlled minimally invasive surgery. Nanoscale 5, 1294-1297. doi:10.1039/c2nr32798h
74. Zhang, L., Petit, T., Peyer, K. E., and Nelson, B. J. (2012). Targeted cargo delivery using a rotating nickel nanowire. Nanomedicine 8, 1074-1080. doi:10.1016/j.nano.2012.03.002