Vision-Based Haptic Feedback for Remote Micromanipulation in-SEM Environment

International Journal of Optomechatronics

Volumn 6, Issue 3, 2012, Pages 236-252

  Bolopion, Aude ^a   Dahmen, Christian ^b   Stolle, Christian ^b   Haliyo, Sinan ^c   Régnier, Stéphane ^c   Fatikow, Sergej ^b  

^a FEMTO ST INSTITUTE   (France)

^b UNIVERSITY OF OLDENBURG   (Germany)

^c UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

Author keywords

haptic feedback; micromanipulation; vision based teleoperation

Indexed keywords

CORRELATION MATCHING; GERMANY; HAPTIC COUPLING; HAPTIC FEEDBACKS; MICRO MANIPULATION; OBJECT POSITIONS; PARIS , FRANCE; POSITION SENSORS; RELATIVE POSITIONS; RELIABLE DETECTION; REMOTE MANIPULATION; SCANNING ELECTRON MICROSCOPE; TELEOPERATED; THREE DIFFERENT TECHNIQUES; VIRTUAL GUIDES; VISION ALGORITHMS; VISION BASED; VISUAL FEEDBACK;

ALGORITHMS; MICROMANIPULATORS; REMOTE CONTROL; SCANNING ELECTRON MICROSCOPY; VISUAL COMMUNICATION;

IMAGE MATCHING;

EID: 84864686846     PISSN: 15599612     EISSN: 15599620     Source Type: Journal    
DOI: 10.1080/15599612.2012.701370     Document Type: Article

References (25)

1. Beyeler, F., S. Muntwyler, and B. J. Nelson. 2009. A six-axis MEMS force-torque sensor with micro-newton and nano-newtonmeter resolution. Journal of Microelectromechanical Systems 18 (2): 433-441.
2. Blender. http://www.blender.org/ (accesed October 11, 2011).
3. Bolopion, A., C. Stolle, R. Tunnell, S. Haliyo, S. Régnier, and S. Fatikow. 2011. Remote microscale teleoperation through virtual reality and haptic feedback. IEEE/RSJ International Conference on Intelligent Robots and Systems 894-900.
4. Bolopion, A., H. Xie, S. Haliyo, and S. Régnier. 2012. Haptic teleoperation for 3-D microassembly of spherical objects. IEEE/ASME Transaction on Mechatronics 17 (1): 116-127.
5. Bradski, G. 2000. Programmers tool chest: The OpenCV library. Dr. Dobbs Journal of Software Tools 25 (11): 122-125.
6. Bukusoglu, I., C. Basdogan, A. Kiraz, and A. Kurt. 2008. Haptic manipulation of microspheres using optical tweezers under the guidance of artificial force fields. Presence: Teleoperators and Virtual Environments 17 (4): 344-364.
7. Chawda, V. and M. K. O'Malley. 2011. Vision-based force sensing for nanomanipulation. IEEE/ASME Transactions on Mechatronics 16 (6): 1177-1183.
8. Colgate, J. and G. Schenkel. 1997. Passivity of a class of sampled-data systems: Application to haptic interfaces. Journal of Robotic Systems 14 (1): 37-47.
9. Fahlbusch, S. and S. Fatikow. 1998. Force sensing in microrobotic systems-an overview. International Conference on Electronics, Circuits and Systems. 3: 259-262.
10. Ferreira, A. and C. Mavroidis. 2006. Virtual reality and haptics for nanorobotics. IEEE Robotics and Automation Magazine 13 (3): 78-92.
11. Gonzales, R. and R. Wood. 2002. Digital image processing. New Jersey: Prentice Hall, Inc.
12. Goshtasby, A., S. H. Gage, and J. F. Bartholic. 1984. A two-stage cross-correlation approach to template matching. IEEE Trans. Pattern Analysis and Machine Intelligence 6 (3): 374-378.
13. Greminger, M. A. and B. J. Nelson. 2004. Vision-based force measurement. IEEE Transactions on Pattern Analysis and Machine Intelligence 26 (3): 290-298.
14. Kim, S. G. and C. Sitti. 2006. Task-based and stable tele-nanomanipulation in a nanoscale virtual environment. IEEE Trans. on Automation Science and Engineering 3 (3): 240-247.
15. Kratochvil, B. E., L. X. Dong, and B. J. Nelson. 2009. Real-time rigid-body visual tracking in a scanning electron microscope. International Journal of Robotics Research 28 (4): 498-511.
16. Mick, U., V. Eichhorn, T. Wortmann, C. Diederichs, and S. Fatikow. 2010. Combined nanorobotic afm/sem system as novel toolbox for automated hybrid analysis and manipulation of nanoscale objects. Proceedings of the IEEE International Conference on Robotics and Automation 4088-4093.
17. Onal, C. D. and M. Sitti. 2007. Visual servoing-based autonomous 2-D manipulation of microparticles using a nanoprobe. IEEE Transactions on Control Systems Technology 15 (5): 842-852.
18. Pawashe, C. and M. Sitti. 2006. Two-dimensional vision-based autonomous microparticle assembly using nanoprobes. Journal of Micromechatronics 3 (3-4): 285-306.
19. Reddy, A. N., N. Maheshwari, D. K. Sahu, and G. K. Ananthasuresh. 2010. Miniature compliant grippers with Vision-Based force sensing. 2008. IEEE Transactions on Robotics 26 (5): 867-877.
20. Sievers, T. 2008. Real-time Object Tracking Inside an sem. In Automated Nanohandling by Microrobots, ed. Sergej Fatikow, 103-128. London: Springer Series in Advanced Manufacturing.
21. Sievers, T. and S. Fatikow. 2006. Real-time object tracking for the robot-based nanohandling in a scanning electron microscope. Journal of Micromechatronics 3 (3-4): 267-284.
22. Stolle, C. 2007. Distributed control architecture for automated nanohandling. International Conference on Informatics in Control, Automation and Robotics (ICINCO'07), 127-132. Angers, France.
23. Trevett, N.2008. The open standard for heterogeneous parallel programming. Proc. SIGGRAPH, Asia, Singapore.
24. Wortmann, T., C. Dahmen, R. Tunnel, and S. Fatikow. 2009. Image processing architecture for real-time micro- and nanohandling applications. Proc. of the Eleventh IAPR Conference on Machine Vision Applications (MVA).
25. Xie, H., C. D. Onal, S. Régnier, and M. Sitti. 2011. Atomic Force Microscopy Based Nanorobotics. Modelling, Simulation, Setup Building and Experiments Series edition. Springer Tracts in Advanced Robotics. 1-342.