Visually servoing magnetic intraocular microdevices

IEEE Transactions on Robotics

Volumn 28, Issue 4, 2012, Pages 798-809

  Bergeles, Christos ^a   Kratochvil, Bradley E ^b   Nelson, Bradley J ^a  

^a ETH ZURICH   (Switzerland)

^b BOSTON CHILDREN S HOSPITAL   (United States)

Author keywords

Eye; localization; magnetic manipulation; microrobot; ophthalmology; optics; surgery; visual servoing; wireless

Indexed keywords

3D STRUCTURES; DEXTEROUS MANIPULATION; EYE; HUMAN EYE; INTRAOCULAR; LOCALIZATION; MAGNETIC CONTROL; MAGNETIC MANIPULATION; MICRO DEVICES; MICRO ROBOTS; OPTICAL PARAMETER; PRECISION ANALYSIS; SERVOING; TARGETED DRUG DELIVERY;

COMPUTER VISION; DRUG DELIVERY; OPHTHALMOLOGY; OPTICS; RADIO; SURGERY; VISUAL SERVOING;

ALGORITHMS;

EID: 84864955832     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2012.2188165     Document Type: Conference Paper

References (49)

1. C. Bergeles, B. E. Kratochvil, and B. J. Nelson, "Model-based localization of intraocular microrobots for wireless electromagnetic control," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 2617-2622.
2. P. S. Jensen, K. W. Grace, R. Attariwala, J. E. Colgate, and M. R. Glucksberg, "Toward robot-assisted vascular microsurgery in the retina," Graefe's Arch. Clin. Exp. Ophthalmol., vol. 235, no. 11, pp. 696-701, 1997. (Pubitemid 27497048)
3. R. H. Taylor, P. S. Jensen, L. Whitcomb, A. Barnes, R. Kumar, D. Stoianovici, P. Gupta, Z. X. Wang, E. de Juan, and L. Kavoussi, "A steady-hand robotic system for microsurgical augmentation," Int. J. Robot. Res., vol. 18, no. 12, pp. 1201-1210, 1999. (Pubitemid 30522999)
4. M. Dewan, P. Marayong, A. M. Okamura, and G. D. Hager, "Vision-based assistance for ophthalmic microsurgery," in Proc. Int. Conf. Med. Image Comput. Comput. Assist. Intervent., 2004, pp. 49-57.
5. C. N. Riviere, W. T. Ang, and P. K. Khosla, "Toward active tremor canceling in handheld microsurgical instruments," IEEE Trans. Robot. Autom., vol. 19, no. 5, pp. 793-800, Oct. 2003.
6. W. Wei, R. Goldman, H. Fine, S. Chang, and N. Simaan, "Modeling and performance evaluation of hybrid multi-arm robots operating on hollow suspended organs," IEEE Trans. Robot., vol. 25, no. 1, pp. 147-157, Feb. 2009.
7. B. J. Nelson, I. K. Kaliakatsos, and J. J. Abbott, "Microrobots for minimally invasive medicine," Annu. Rev. Biomed. Eng., vol. 12, pp. 55-85, 2010.
8. S. Martel, O. Felfoul, J. Mathieu, A. Chanu, S. Tamaz, M. Mohammadi, M. Mankiewicz, and N. Tabatabaei, "MRI-based medical nanorobotic platform for the control of magnetic nanoparticles and flagellated bacteria for target interventions in human capillaries," Int. J. Robot. Res., vol. 28, no. 9, pp. 1169-1182, 2009.
9. P. Vartholomeos, M. Fruchard, A. Ferreira, and C. Mavroidis, "MRI-guided nanorobotic systems for therapeutic and diagnostic applications," Annu. Rev. Biomed. Eng., vol. 13, pp. 157-184, 2011.
10. T. W. R. Fountain, P. V. Kailat, and J. J. Abbott, "Wireless control of magnetic helical microrobots using a rotating-permanent-magnet manipulator," in Proc. IEEE Int. Conf. Robot. Autom., 2010, pp. 576-581.
11. M. P. Kummer, J. J. Abbott, B. E. Kratochvil, R. Borer, A. Sengul, and B. J. Nelson, "OctoMag: An electromagnetic system for 5-DOF wireless micromanipulation," IEEE Trans. Robot., vol. 26, no. 6, pp. 1006-1017, Dec. 2010.
12. C. Bergeles, M. P. Kummer, B. E. Kratochvil, C. Framme, and B. J. Nelson, "Steerable intravitreal inserts for drug delivery: In vitro and ex vivo mobility experiments," in Proc. Int. Conf. Med. Image Comput. Comput. Assist. Intervent., 2011, pp. 33-40.
13. O. Ergeneman, J. J. Abbott, G. Dogangil, and B. J. Nelson, "Functional-izing intraocular microrobots with surface coatings," in Proc. IEEE Int. Conf. Biomed. Robot. Biomechatron., 2008, pp. 232-237.
14. P. J. Chen, D. Rodger, S. Saati, M. Humayun, and Y. C. Tai, "Implantable parylene-based wireless intraocular pressure sensor," in Proc. IEEE Int. Conf. Micro Electro Mech. Syst., 2008, pp. 58-61.
15. Y. E. Choonara, V. Pillay, M. P. Danckwerts, T. R. Carmichael, and L. C. Du Toit, "A review of implantable intravitreal drug delivery technologies for the treatment of posterior segment eye diseases," J. Pharm. Sci., vol. 99, no. 5, pp. 2219-2239, 2010.
16. Aeon Scientific GmbH. (2011). [Online]. Available: www.aeon-scientific. com
17. J. J. Abbott, O. Ergeneman, M. P. Kummer, A. M. Hirt, and B. J. Nelson, "Modeling magnetic torque and force for controlled manipulation of soft-magnetic bodies," IEEE Trans. Robot., vol. 23, no. 6, pp. 1247-1252, Dec. 2007.
18. B. D. Cullity and C. D. Graham, Introduction to Magnetic Materials, 2nd ed. Hoboken, NJ: Wiley, 2009.
19. C. Bergeles, K. Shamaei, J. J. Abbott, and B. J. Nelson, "Single-camera focus-based localization of intraocular devices," IEEE Trans. Biomed. Eng., vol. 57, no. 8, pp. 2064-2074, Aug. 2010.
20. GWB International, Ltd., Marshfield Hills, MA. (2011). "Model eye (3 mm pupil) from GWB International, Ltd." [Online]. Available: http://www.gwbinternational.com/model-eye.htm
21. J. Ens and P. Lawrence, "An investigation of methods for determining depth from focus," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 2, pp. 97-108, Feb. 1993. (Pubitemid 23609373)
22. M. Subbarao and G. Surya, "Depth from defocus: A spatial domain approach," Int. J. Comput. Vis., vol. 13, no. 3, pp. 271-294, 1994.
23. K. B. Yeşin, K. Vollmers, and B. J. Nelson, "Guidance of magnetic intraocular microrobots by active defocused tracking," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2004, vol. 4, pp. 3309-3314. (Pubitemid 40276103)
24. Z. Pezzementi, S. Voros, and G. D. Hager, "Articulated object tracking by rendering consistent appearance parts," in Proc. IEEE Int. Conf. Robot. Autom., 2009, pp. 3940-3947.
25. R. M. Murray, Z. Li, and S. S. Sastry, A Mathematical Introduction to Robotic Manipulation. Boca Raton, FL: CRC, 1994.
26. M. D. Grossberg and S. K. Nayar, "The raxel imaging model and ray-based calibration," Int. J. Comput. Vis., vol. 61, no. 2, pp. 119-137, 2005.
27. R. Swaminathan, M. D. Grossberg, and S. K. Nayar, "Non-single viewpoint catadioptric cameras: Geometry and analysis," Int. J. Comput. Vis., vol. 66, no. 3, pp. 211-229, 2006.
28. I. Escudero-Sanz and R. Navarro, "Off-axis aberrations of a wide-angle schematic eye model," J. Opt. Soc. Amer. A, vol. 16, no. 8, pp. 1881-1891, 1999. (Pubitemid 129655481)
29. R. Navarro, L. Gonzalez, and J. O. S. L. Hernandez-Matamoros, "On the prediction of optical aberrations by personalized eye models," Optom. Vis. Sci., vol. 83, no. 6, pp. 371-381, 2006.
30. Lambda Res. Corp., (2010). [Online]. Available: http://www. lambdares.com/software-products/oslo/
31. D. A. Volk, "Indirect ophthalmoscopy lens for use with split lamp or other biomicroscope," U.S. Patent 5 706 073, Jan. 6, 1998.
32. S. Derrien and K. Konolige, "Approximating a single viewpoint in panoramic imaging devices," in Proc. IEEE Int. Conf. Robot. Autom., 2000, pp. 3931-3938.
33. D. G. Lowe, "Three-dimensional object recognition from single two-dimensional images," Artif. Intell., vol. 31, no. 3, pp. 355-395, 1987.
34. T. Drummond and R. Cipolla, "Real-time visual tracking of complex structures," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 932-946, Jul. 2002. (Pubitemid 34835468)
35. M. Balda. (2009). "LMFSolve.m: Levenberg-Marquardt-Fletcher algorithm for nonlinear least-squares problems." [Online]. Available: http://www.mathworks.com/matlabcentral/fileexchange/
36. M. I. A. Lourakis. (2004). "levmar: Levenberg-Marquardt nonlinear least-squares algorithms in C/C++." [Online]. Available: http://www.ics.forth.gr/lourakis/levmar/
37. T. Kirschkamp, M. Dunne, and J. C. Barry, "Phakometric measurement of ocular surface radii of curvature, axial separations and alignment in relaxed and accommodated human eyes," J. Ophthal. Physiol. Opt., vol. 24, no. 2, pp. 65-73, 2004. (Pubitemid 41711024)
38. C. E. Jones, D. A. Atchison, R. Meder, and J. M. Pope, "Refractive index distribution and optical properties of the isolated human lens measured using magnetic resonance imaging (MRI)," Vis. Res., vol. 45, no. 18, pp. 2352-2366, 2005. (Pubitemid 40848281)
39. K. Zadnik, D. O. Mutti, and A. J. Adams, "The repeatability of measurement of the ocular components," Investigat. Ophthalmol. Vis. Sci., vol. 33, no. 7, pp. 2325-2333, 1992.
40. D. A. Atchison and G. Smith, Optics of the Human Eye. Oxford, UK: Butterworth-Heinemann, 2000.
41. S. Norrby, "Sources of error in intraocular lens power calculation," J. Cataract Refract. Surg., vol. 34, no. 3, pp. 368-376, 2008. (Pubitemid 351625583)
42. Sumipro BV. (2010). [Online]. Available: http://www.sumipro.nl/
43. C. Bergeles, G. Fagogenis, J. J. Abbott, and B. J. Nelson, "Tracking intraocular microdevices based on colorspace evaluation and statistical color/shape information," in Proc. IEEE Int. Conf. Robot. Autom., 2009, pp. 3934-3939.
44. R. Sznitman, A. Basu, R. Richa, J. Handa, P. Gehlbach, R. Jedynak, R. H. Taylor, and G. D. Hager, "Unified detection and tracking in retinal microsurgery," in Proc. Int. Conf. Med. Image Comput. Comput. Assist. Intervent., 2011, pp. 1-8.
45. R. Richa, M. Balicki, E. Meisner, R. Sznitman, R. H. Taylor, and G. D. Hager, "Visual tracking of surgical tools for collision detection in retinal surgery," in Proc. Int. Conf. Inf. Process. Comput.-Assist. Intervent., 2011, pp. 55-66.
46. D. A. Atchison, N. Pritchard, K. L. Schmid, D. H. Scott, C. E. Jones, and J. M. Pope, "Shape of the retinal surface in emmetropia and myopia," Investigat. Ophthalmol. Vis. Sci., vol. 46, no. 8, pp. 2698-2707, 2005. (Pubitemid 43086689)
47. D. A. Atchison, C. E. Jones, K. L. Schmid, N. Pritchard, J. M. Pope, W. E. Strugnell, and R. A. Riley, "Eye shape in emmetropia and myopia," Investigat. Ophthalmol. Vis. Sci., vol. 45, no. 10, pp. 3380-3386, 2004. (Pubitemid 39298552)
48. E. Mouragnon, M. Lhuillier, M. Dhome, F. Dekeyser, and P. Sayd, "Generic and real-time structure from motion using local bundle adjustment," Image Vis. Comput., vol. 27, no. 8, pp. 1178-1193, 2009.
49. A. I. Comport, R. Mahony, and F. Spindler, "A visual servoing model for generalised cameras: Case study for non-overlapping cameras," in Proc. IEEE Int. Conf. Robot. Autom., 2011, pp. 5683-5688.