A review of haptic feedback teleoperation systems for micromanipulation and microassembly

IEEE Transactions on Automation Science and Engineering

Volumn 10, Issue 3, 2013, Pages 496-502

  Bolopion, Aude ^a   Régnier, Steṕhane ^b  

^a FEMTO ST INSTITUTE   (France)

^b UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

Haptic feedback; Microassembly; Micromanipulation; Teleoperation

Indexed keywords

FLEXIBLE MANIPULATIONS; HAPTIC FEEDBACKS; INDUSTRIAL PROJECTS; MANIPULATION TASK; MANUAL OPERATIONS; MICRO ASSEMBLY; MICRO MANIPULATION; MICROASSEMBLY SYSTEM;

MICROMANIPULATORS; MICROMETERS; THREE DIMENSIONAL; TOOLS; VIRTUAL REALITY;

REMOTE CONTROL;

EID: 84892616975     PISSN: 15455955     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASE.2013.2245122     Document Type: Review

References (59)

1. M. Gauthier and S. Régnier, Robotic Micro-Assembly. New York, NY, USA: Wiley, 2010.
2. S. Régnier and N. Chaillet, Microrobotics for Micromanipulation. New York, NY, USA: Wiley, 2010.
3. H. Xie, C. D. Onal, S. Régnier, and M. Sitti, Atomic Force Microscopy Based Nanorobotics, ser. Tracts in Advanced Robotics. New York, NY, USA: Springer, 2011, vol. 71, Modelling, simulation, setup building and experiments.
4. T. C. Duc, G. Lau, J. F. Creemer, and P. M. Sarro, "Electrothermal microgripper with large jaw displacement and integrated force sensors," J. Microelectromech. Syst., vol. 17, no. 6, pp. 1546-1555, 2008.
5. L. Wang, L. Ren, J. Mills, and W. Cleghorn, "Automated 3-D micrograsping tasks performed by vision-based control," IEEE Trans. Autom. Sci. Eng., vol. 7, no. 3, pp. 417-426, Jul. 2010.
6. C. Onal and M. Sitti, "Visual servoing-based autonomous 2-D manipulation of microparticles using a nanoprobe," IEEE Trans. Control Syst. Technol., vol. 15, no. 5, pp. 842-852, Sep. 2007.
7. S. Bargiel, K. Rabenorosoa, C. Clévy, C. Gorecki, and P. Lutz, "Towards micro-assembly of hybrid MOEMS components on reconfigurable silicon free-space micro-optical bench," J. Micromechan. Microeng., vol. 20, no. 4, p. 20, 2010.
8. A. Ferreira and C. Mavroidis, "Virtual reality and haptics for nanorobotics," IEEE Robot. Autom. Mag., vol. 13, no. 3, pp. 78-92, Sep. 2006.
9. J. E. Colgate, "Robust impedance shaping telemanipulation," IEEE Trans. Robot. Autom., vol. 9, no. 4, pp. 374-384, Aug. 1993.
10. Y. Yokokohji, N. Hosotani, and T. Yoshikawa, "Analysis of maneuverability and stability of micro-teleoperation systems," in IEEE Int. Conf. Robot. Autom., 1994, pp. 237-243.
11. Q. Zhou, P. Kallio, and H. N. Koivo, "Fuzzy control system for microtelemanipulation," Intelligent Automation and Control: Recent Trends in Development and Applications, pp. 817-822, 1996.
12. F. Fukuda, K. Tanie, and T. Mitsuoka, "A new method of master-slave type of teleoperation for a micro-manipulator system," in IEEE Micro Robot. Teleoper. Workshop, 1987, pp. 204-208.
13. S. E. Salcudean and J. Yan, "Towards a force-reflecting motion-scaling system for microsurgery," in IEEE Int. Conf. Robot. Autom., 1994, pp. 2296-2301.
14. P. Kallio and H. N. Koivo, "A 1 d.o.f. mini-telemanipulator: Design and control," in Int. Conf. Robot. Manuf., 1995, pp. 192-198.
15. Y. Hatamura and H. Morishita, "Direct coupling system between nanometer world and human world," in IEEE Int. Conf. Micro Electro Mechan. Syst., 1990, pp. 203-208.
16. R. Hollis, S. Salcudean, and D. Abraham, "Toward a tele-nanorobotic manipulation system with atomic scale force feedback and motion resolution," in IEEE Int. Conf. Micro Electro Mechan. Syst., 1990, pp. 115-119.
17. M. Sitti and H. Hashimoto, "Macro to nano tele-manipulation through nanoelectromechanical systems," IEEE Ind. Electron. Soc., pp. 98-103, 1998.
18. M. Sitti and H. Hashimoto, "Teleoperated touch feedback from the surfaces at the nanoscale: Modeling and experiments," IEEE/ASME Trans. Mechatronics, vol. 8, no. 2, pp. 287-298, Jun. 2003.
19. G. Venture, D. S. Haliyo, A. Micaelli, and S. Régnier, "Force-feedback micromanipulation with inconditionally stable coupling," Int. J. Micromechatron., Special Issue on Micro-Handling, vol. 3, no. 3, pp. 307-327, 2006.
20. M. Sitti and H. Hashimoto, "Tele-nanorobotics using atomic force microscope," in IEEE/RSJ Int. Conf. Intell. Robot. Syst., 1998, vol. 3, pp. 1739-1746.
21. A. Bolopion, B. Cagneau, S. Haliyo, and S. Régnier, "Analysis of stability and transparency for nanoscale force feedback in bilateral coupling," J. Micro - Nano Mechatronics, no. 4, pp. 145-158, 2009.
22. F. Llewellyn, "Some fundamental properties of transmission systems," IRE, vol. 40, no. 3, pp. 271-283, 1952.
23. S.-G. Kim and M. Sitti, "Task-based and stable telenanomanipulation in a nanoscale virtual environment," IEEE Trans. Autom. Sci. Eng., vol. 3, no. 3, pp. 240-247, Jul. 2006.
24. C. D. Onal and M. Sitti, "A scaled bilateral control system for experimental one-dimensional teleoperated nanomanipulation," Int. J. Robot. Res., vol. 28, no. 4, pp. 484-497, 2009.
25. M. Boukhnifer and A. Ferreira, "Wave-based passive control for transparent micro-teleoperation system," Robot. Autonomous Syst., vol. 54, no. 7, pp. 601-615, 2006.
26. ∞ loop shaping bilateral controller for a two-fingered telemicromanipulation system," IEEE Trans. Control Syst. Technol., vol. 15, no. 5, pp. 891-905, 2007.
27. S. Fahlbusch and S. Fatikow, "Force sensing in microrobotic systems - An overview," in Int. Conf. Electron., Circuits Syst., 1998, vol. 3, pp. 259-262, vol. 3.
28. F. Beyeler, S. Muntwyler, and B. J. Nelson, "A six-axis MEMS force torque sensor with micro-newton and nano-newtonmeter resolution," J. Microelectromech. Syst., vol. 18, no. 2, pp. 433-441, 2009.
29. J. Zhang, G. Li, and N. Xi, "Modeling and control of active end effector for the AFM based nano robotic manipulators," in IEEE Int. Conf. Robot. Autom., 2005, pp. 163-168.
30. L. Liu, N. Jiao,X. Tian, Z.Dong,N. Xi,W. Li, andY. Wang, "Development of a haptic user interface for surface sensing and nanomanipulation based on atomic force microscope," in IEEE Int. Conf. Nano/Micro Engi. Molecular Syst., 2006, pp. 900-904.
31. C. D. Onal and M. Sitti, "Teleoperated 3-D force feedback from the nanoscale with an atomic force microscope," IEEE Trans. Nanotechnol., vol. 9, no. 1, pp. 46-54, Jan. 2010.
32. K. Kim, X. Liu, Y. Zhang, and Y. Sun, "Micronewton force-controlled manipulation of biomaterials using a monolithic MEMS microgripper with two-axis force feedback," in IEEE Int. Conf. Robot. Autom., 2008, pp. 3100-3105.
33. [Online]. Available: http://www.femtotools.com
34. B. Lopez-Walle, M. Gauthier, and N. Chaillet, "Principle of a submerged freeze gripper for microassembly," IEEE Trans. Robot., vol. 24, no. 4, pp. 897-902, Aug. 2008.
35. K. N. Andersen, D. H. Petersen, K. Carlson, K. Molhave, O. Sardan, A. Horsewell, V. Eichhorn, S. Fatikow, and P. Boggild, "Multimodal electrothermal silicon microgrippers for nanotube manipulation," IEEE Trans. Nanotechnol., vol. 8, no. 1, pp. 76-85, Jan. 2009.
36. Y. Zhou, B. Nelson, and B. Vikramaditya, "Fusing force and vision feedback for micromanipulation," in IEEE Int. Conf. Robot. Autom., 1998, vol. 2, pp. 1220-1225.
37. M. Greminger and B. Nelson, "Vision-based force measurement," IEEE Trans. Pattern Anal. Machine Intell., vol. 26, no. 3, pp. 290-298, Mar. 2004.
38. A. N. Reddy, D. K. Sahu, N. Maheswari, and G. K. Ananthasuresh, "Miniature compliant grippers with vision-based force-sensing," IEEE Trans. Robot., vol. 26, no. 5, pp. 867-877, Oct. 2010.
39. M. Greminger, G. Yang, and B. Nelson, "Sensing nanonewton level forces by visually tracking structural deformations," in IEEE Int. Conf. Robot. Autom., 2002, vol. 2, pp. 1943-1948.
40. D. Cappelleri, G. Piazza, and V. Kumar, "A two dimensional vision-based force sensor for microrobotic applications," Sens. Actuators: A. Phys., vol. 171, no. 2, pp. 340-351, 2011.
41. D. Haliyo, S. Régnier, and J. Guinot, "[mu] mad, the adhesion based dynamic micro-manipulator," Eur. J. Mech.-A/Solids, vol. 22, no. 6, pp. 903-916, 2003.
42. M. Ammi and A. Ferreira, "Robotic assisted micromanipulation system using virtual fixtures andmetaphors," in IEEE Int.Conf. Robot. Autom., 2007, pp. 454-460.
43. A. Bolopion, B. Cagneau, and S. Régnier, "2D micro teleoperation with force feedback," in IEEE/RSJ Int. Conf. Intell. Robot. Syst., 2009, pp. 3265-3270.
44. A. Bolopion, H. Xie, S. Haliyo, and S. Régnier, "Haptic teleoperation for 3D microassembly of spherical objects," IEEE/ASME Trans. Mechatronics, vol. 17, no. 1, pp. 116-127, 2012.
45. H. Xie and S. Régnier, "Development of a flexible robotic system for multiscale applications of micro/nanoscale manipulation and assembly," IEEE/ASME Trans. Mechatronics, vol. 16, no. 2, pp. 266-276, Apr. 2011.
46. H. Xie, S. Haliyo, and S. Régnier, "Parallel imaging/manipulation force microscopy," Appl. Phys. Lett., vol. 94, p. 153106, 2009.
47. Z. Ni, A. Bolopion, J. Agnus, R. Benosman, and S. Régnier, "Asynchronous event-based visual shape tracking for stable haptic feedback in microrobotics," IEEE Trans. Robot., vol. 28, no. 5, pp. 1081-1089, 2012.
48. G. Millet, A. Lécuyer, J. Burkhardt, D. Haliyo, and S. Régnier, "Improving perception and understanding of nanoscale phenomena using haptics and visual analogy," in Eurohaptics. Berlin, Germany: Springer-Verlag, 2008, pp. 847-856.
49. S. Grange, F. Conti, P. Helmer, P. Rouiller, and C. Baur, "The delta haptic device as a nanomanipulator," in SPIE Microrobotics and Microassembly III, 2001.
50. W. Vogl, B. K.-L. Ma, and M. Sitti, "Augmented reality user interface for an atomic force microscope-based nanorobotic system," IEEE Trans. Nanotechnol., vol. 5, no. 4, pp. 397-406, Jul. 2006.
51. R. Taylor, II, J. Chen, S. Okimoto, N. Llopis-Artime, V. L. Chi, F. P. Brooks, Jr., M. Falvo, S. Paulson, P. Thiansathaporn, D. Glick, S. Washburn, and R. Superfine, "Pearls found on the way to the ideal interface for scanned-probe microscopes," in Proc. 8th Conf. Visualization, 1997, p. 467.
52. M. Falvo, G. Clary, A. Helser, S. Paulson, R. Taylor, II, V. Chi, F. Brooks, Jr., S.Washburn, and R. Superfine, "Nanomanipulation experiments exploring frictional and mechanical properties of carbon nanotubes," J. Microscopy Microanalysis, vol. 4, pp. 504-512, 1999.
53. M. Guthold, M. Falvo, W. Matthews, S. Paulson, S.Washburn, D. Erie, R. Superfine, F. Brooks, Jr., and R. Taylor, II, "Controlled manipulation of molecular samples with the nanoManipulator," IEEE/ASME Trans. Mechatronics, vol. 5, no. 2, pp. 189-198, Jun. 2000.
54. R. Taylor, II, "Programming force feedback devices in computer graphics systems," in Course Notes for "Programming Virtual Worlds", SIGGRAPH, 1997.
55. L. Fok, Y. Liu, and W. Li, "Modeling of nanomanipulation with an integrated teleoperated system," in IEEE Int. Conf. Robot. Biomimetics, 2005, pp. 83-88.
56. A. Bolopion, C. Dahmen, C. Stolle, S. Haliyo, S. Régnier, and S. Fatikow, "Vision based haptic feedback for remote micromanipulation in-SEM environment," Int. J. Optomechatronics, vol. 6, no. 3, pp. 236-252, 2012.
57. Y. Murayama, C. E. Constantinou, and S. Omata, "Intuitive micromanipulation with haptic audio feedback," in IEEE Int. Conf. Comput. Inform. Technol., Sep. 2004, pp. 907-911.
58. A. Luciani, D. Urma, S.Marlière, and J. Chevrier, "Presence: The sense of believability of inaccessible worlds," Comput. Graphics, vol. 28, pp. 509-517, 2004.
59. F. Marchi, D. Urma, S. Marliere, J. L. Florens, A. Besancon, J. Chevrier, and A. Luciani, "Educational tool for nanophysics using multisensory rendering," in World Haptics Conf., 2005, vol. 0, pp. 473-474.