In vivo micro-image mosaicing

IEEE Transactions on Biomedical Engineering

Volumn 58, Issue 1, 2011, Pages 159-171

  Loewke, K E ^a   Camarillo, D B ^a   Piyawattanametha, W ^b,c   Mandella, M J ^a   Contag, C H ^d   Thrun, S ^a   Salisbury, J K ^a  

^a Stanford University   (United States)

^b NATIONAL ELECTRONICS AND COMPUTER TECHNOLOGY CENTER   (Thailand)

^c CHULALONGKORN UNIVERSITY   (Thailand)

^d STANFORD UNIVERSITY   (United States)

Author keywords

Confocal microscopy; image mosaicing; in vivo pathology; optical biopsy

Indexed keywords

CONFOCAL MICROENDOSCOPES; CONFOCAL MICROSCOPES; CUMULATIVE ERRORS; CUMULATIVE IMAGES; DEFORMABLE SURFACE MODELS; EFFICIENT ALGORITHM; FIELD OF VIEWS; GLOBAL ALIGNMENT; IMAGE INTERPRETATION; IMAGE MAPS; IMAGE MOSAICING; IMAGE SEQUENCE; IMAGING DEVICE; IN-VIVO; LOCAL ALIGNMENT; MOSAICING; OPTICAL BIOPSIES; OPTICAL IMAGING; REAL TIME; REGISTRATION ERROR; TISSUE BIOPSIES; TISSUE STRUCTURE; TWO PHOTON;

ALGORITHMS; ALIGNMENT; BIOPSY; CONFOCAL MICROSCOPY; DEFORMATION; DISEASES; ERRORS; HEALTH CARE; IMAGE REGISTRATION; MEDICAL APPLICATIONS; MICROSCOPES; PATHOLOGY; TOOLS;

MEDICAL IMAGING;

ALGORITHM; ANATOMICAL VARIATION; ARTICLE; CONFOCAL LASER MICROSCOPY; CONFOCAL MICROSCOPY; DEVICE; ERROR; IMAGE PROCESSING; MICRO IMAGE MOSAICING; MICROCOMPUTER; MICROSCOPE; MULTIPHOTON MICROSCOPY; PATHOLOGY; PROBABILITY; ROBOTICS; SURFACE PROPERTY;

ALGORITHMS; ANIMALS; BRAIN; ENDOSCOPES; ENDOSCOPY; HAND; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MICE; MICROSCOPY, CONFOCAL; MINIATURIZATION; ROBOTICS; SKIN;

EID: 79551535929     PISSN: 00189294     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBME.2010.2085082     Document Type: Article

References (38)

1. Mauna Kea Technologies Website. (2010). [Online]. Available: http://www.maunakeatech.com/.
2. P. Hsiung, J. Hardy, S. Friedland, R. Soetikno, C. Du, A. Wu, P. Sahbaie, J. Crawford, A. Lowe, C. Contag, and T. Wang, "Detection of colonic dysplasia in vivo using a targeted heptapeptide and confocal microendoscopy," Nature Med., vol. 14, pp. 454-458, 2008.
3. J. Liu, M. Mandella, H. Ra, L. Wong, O. Solgaard, G. Kino, W. Piyawattanametha, C. Contag, and T. Wang, "Miniature near-infrared dual-axes confocal microscope utilizing a two-dimensional microelectromechanical systems scanner," Opt. Lett., vol. 32, no. 3, pp. 256-258, 2007.
4. W. Piyawattanametha, H. Ra, M. Mandella, J. Liu, L. Wong, C. Du, T. Wang, C. Contag, G. Kino, and O. Solgaard, "Three-dimensional in vivo real time imaging by a miniature dual-axes confocal microscope based on a two-dimensional MEMS scanner," in Proc. Int. Conf. Solid- State Sens., Actuators, Microsyst., 2007, pp. 439-442.
5. V. Becker, T. Vercauteren, C. von Weyern, C. Prinz, R. Schmid, and A. Meining, "High resolution miniprobe-based confocal microscopy in combination with video-mosaicing," Gastrointestinal Endosc., vol. 66, no. 5, pp. 1001-1007, 2007.
6. W. Piyawattanametha, M. Mandella, H. Ra, J. Liu, E. Garai, G. Kino, O. Solgaard, and C. Contag, "MEMS based dual-axes confocal clinical endoscope for real time in vivo imaging," in Proc. Opt. MEMS Nanophoton., 2008, pp. 42-43.
7. W. Piyawattanametha, R. Barretto, T. Ko, B. Flusberg, E. Cocker, H. Ra, D. Lee, O. Solgaard, and M. Schnitzer, "Fast-scanning two-photon fluorescence imaging based on a microelectromechanical systems two dimensional scanning mirror," Opt. Lett., vol. 31, no. 13, pp. 2018-2020, 2006.
8. K. Deisseroth, G. Feng, A. Majewska, G. Miesenbock, A. Ting, and M. Schnitzer, "Next-generation optical technologies for illuminating genetically targeted brain circuits," J. Neurosci., vol. 26, no. 41, pp. 10 380- 10 386, 2006..
9. W. Piyawattanametha, E. Cocker, L. Burns, R. Barretto, J. Jung, H. Ra, O. Solgaard, and M. Schnitzer, "In vivo brain imaging using a portable 2.9 gram two-photon microscope based on a microelectromechanical systems scanning mirror," Opt. Lett., 2009, to be published..
10. R. Szeliski, "Video mosaics for virtual environments," IEEE Comput. Graph. Appl., vol. 16, no. 2, pp. 22-30, Mar. 1996.
11. L. Brown, "A survey of image registration techniques," ACM Comput. Surv., vol. 24, no. 4, pp. 325-376, 1992.
12. T. Vercauteren, X. Pennec, A. Perchant, and N. Ayache, "Symmetric logdomain diffeomorphic registration: A demons-based approach," in Proc. MICCAI, 2008, pp. 754-761.
13. T.Vercauteren, X. Pennec, A. Perchant, and N. Ayache, "Non-parametric diffeomorphic image registration with the demons algorithm," in Proc. MICCAI, 2007, pp. 319-326.
14. K. Loewke, D. Camarillo,W. Piyawattanametha, D. Breeden, and K. Salisbury, "Real-time image mosaicing with a hand-held dual-axes confocal microscope," in Proc. SPIE, 2008, vol. 6851, pp. 68510F-1-68510F-9.
15. K. Loewke, D. Camarillo, K. Salisbury, and S. Thrun, "Deformable image mosaicing for optical biopsy," in Proc. ICCV, 2007, pp. 1-8.
16. T. Vercauteren, A. Perchant, G. Malandain, X. Pennec, and N. Ayache, "Robust mosaicing with correction of motion distortions and tissue deformations for in vivo fibered microscopy," Med. Image Anal., vol. 10, no. 5, pp. 673-692, 2006.
17. Y. Patel, K. Nehal, I. Aranda, Y. Li, A. Halpern, and M. Rajadhyaksha, "Confocal reflectance mosaicing of basal cell carcinomas in mohs surgical skin excisions," J. Biomed. Opt., vol. 12, no. 3, p. 034027, 2007.
18. K. Loewke, D. Camarillo, C. Jobst, and K. Salisbury, "Real-time image mosaicing for medical applications," in Proc. MMVR, 2007, pp. 304-309.
19. S. Seshamani,W. Lau, andG.Hager, "Real-time endoscopicmosaicking, " in Proc. MICCAI, 2006, pp. 355-363.
20. S. Brekke, S. Rabben, A. Stoylen, A. Haugen, G. Haugen, E. Steen, and H. Torp, "Volume stitching in three-dimensional echocardiography: distortion analysis and extension to real time," Ultrasound Med. Biol., vol. 33, no. 5, pp. 782-796, 2007.
21. A. Can, C. Stewart, B. Roysam, and H. Tanenbaum, "A feature-based algorithm for joint, linear estimation of high-order image-to-mosaic transformations: Mosaicing the curved human retina," Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 412-419, Mar. 2002.
22. S. Atasoy, D. Noonan, S. Benhimane, N. Navab, and G. Yang, "A global approach for automatic fibroscopic video mosaicing inminimally invasive diagnosis," in Proc. MICCAI, 2008, pp. 850-857.
23. H. Y. Shum and R. Szeliski, "Construction of panoramic mosaics with global and local alignment," Int. J. Comput. Vis., vol. 36, no. 2, pp. 101- 130, 2000.
24. H. Sawhney, S. Hsu, and R. Kumar, "Robust video mosaicing through topology inference and local to global alignment," in Proc. ECCV, 1998, vol. 2, pp. 103-119.
25. C. Wachinger, B. Glocker, J. Zeltner, N. Paragios, N. Komodakis, M. S. Hansen, and N. Navab, "Deformable mosaicing for whole-body mri," in Proc. MICCAI, 2008, pp. 113-121.
26. S. Seshamania, M. Smith, J. Corso, M. Filipovich, A. Natarajan, and G. Hager, "Direct global adjustmentmethods for endoscopicmosaicking," in Proc. SPIE, 2009, vol. 7261, pp. 1-9.
27. J. Davis, "Mosaics of scenes with moving objects," in Proc. CVPR, 1998, pp. 354-360.
28. T. Vercauteren, A. Perchant, X. Pennec, and N. Ayache, "Mosaicing of confocal microscopic in vivo soft tissue video sequences," in Proc. MICCAI, 2005, pp. 753-760.
29. S. Thrun, W. Burgard, and D. Fox, Probabilistic Robotics. Cambridge, MA: MIT Press, 2005.
30. D. Hähnel, S. Thrun, andW. Burgard, "An extension of the ICP algorithm for modeling nonrigid objects with mobile robots," in Proc. IJCAI, 2003, pp. 915-920.
31. M. Sanderson, "Acquisition of multiple real-time images for laser scanning microscopy," Microsc. Anal., vol. 18, no. 4, pp. 17-23, 2004.
32. J. Liu, M. Mandella, N. Loewke, H. Haeberle, H. Ra, W. Piyawattanametha, O. Solgaard, G. Kino, and C. Contag, "Micromirror-scanned dual-axis confocal microscope utilizing a gradient-index relay lens for image guidance during brain surgery," J. Biomed. Opt., vol. 15, no. 2, pp. 026029-1-026029-5, 2010.
33. J. Bouguet, "Pyramidal implementation of the Lucas Kanade feature tracker," Intel Corporation, Microprocessor Research Labs, 2000.
34. T. Brox, C. Bregler, and J. Malik, "Large displacement optical flow," in Proc. CVPR, 2009, pp. 1-8.
35. Y. Wu and J. Fan, "Contextual flow," in Proc. CVPR, 2009, pp. 1-8.
36. P. Burt and E. Adelson, "A multiresolution spline with application to image mosaics," ACM Trans. Graph., vol. 2, no. 4, pp. 1217-236, 1983.
37. E. Olson, J. Leonard, and S. Teller, "Fast iterative alignment of pose graphs with poor initial estimates," in Proc. ICRA, 2006, pp. 2262-2269.
38. M. Fornefett, K. Rohr, and H. Stiehl, "Elastic registration of medical images using radial basis functions with compact support," in Proc. CVPR, 1999, pp. 402-407.