3-D registration of biological images and models: Registration of microscopic images and its uses in segmentation and annotation

IEEE Signal Processing Magazine

Volumn 32, Issue 1, 2015, Pages 70-77

  Qu, Lei ^a   Long, Fuhui ^b   Peng, Hanchuan ^b  

^a ANHUI UNIVERSITY   (China)

^b ALLEN INSTITUTE FOR BRAIN SCIENCE   (United States)

Author keywords

Biological system modeling; Biomedical imaging; Cells (biology); Image registration; Image segmentation; Microscropy; Three dimensional displays

Indexed keywords

BIOLOGICAL SYSTEMS; BRAIN MAPPING; IMAGE REGISTRATION; MEDICAL IMAGING;

BIOIMAGE INFORMATICS; BIOLOGICAL SYSTEM MODELING; BIOMEDICAL IMAGING; IMAGE-TO-IMAGE REGISTRATION; MICROSCROPY; REGISTRATION METHODS; THREE-DIMENSIONAL DISPLAY; THREEDIMENSIONAL (3-D);

IMAGE SEGMENTATION;

EID: 85032751270     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/MSP.2014.2354060     Document Type: Article

References (47)

1. F. Long, J. Zhou and H. Peng, "Visualization and analysis of 3D microscopic images," PLoS Comput. Biol., vol. 8, no. 6, p. e1002519, 2012.
2. H. Peng, "Bioimage informatics: A new area of engineering biology," Bioinformatics, vol. 24, no. 17, pp. 1827-1836, 2008.
3. O. Ronneberger, K. Liu, M. Rath, D. Rueb, T. Mueller, H. Skibbe, B. Drayer, T. Schmidt, A. Filippi and R. Nitschke, "ViBE-Z: A framework for 3D virtual colocalization analysis in zebrafish larval brains," Nat. Methods, vol. 9, no. 7, pp. 735-742, 2012.
4. N. Olivier, M. A. Luengo-Oroz, L. Duloquin, E. Faure, T. Savy, I. Veilleux, X. Solinas, D. Débarre, P. Bourgine and A. Santos, "Cell lineage reconstruction of early zebrafish embryos using label-free nonlinear microscopy," Science, vol. 329, no. 5994, pp. 967-971, 2010.
5. E. Meijering, "Cell segmentation: 50 years down the road" [Life Sciences], IEEE Signal Processing Mag., vol. 29, no. 5, pp. 140-145, 2012.
6. C. C. Fowlkes, C. L. L. Hendriks, S. V. Keränen, G. H. Weber, O. Rübel, M.-Y. Huang, S. Chatoor, A. H. DePace, L. Simirenko and C. Henriquez, "A quantitative spatiotemporal atlas of gene expression in the Drosophila blastoderm," Cell, vol. 133, no. 2, pp. 364-374, 2008.
7. E. S. Lein, M. J. Hawrylycz, N. Ao, M. Ayres, A. Bensinger, A. Bernard, A. F. Boe, M. S. Boguski, K. S. Brockway and E. J. Byrnes, "Genome-wide atlas of gene expression in the adult mouse brain," Nature, vol. 445, no. 7124, pp. 168-176, 2006.
8. S. W. Oh, J. A. Harris, L. Ng, B. Winslow, N. Cain, S. Mihalas, Q. Wang, C. Lau, L. Kuan and A. M. Henry, "A mesoscale connectome of the mouse brain," Nature, vol. 508, no. 7495, pp. 207-214, 2014.
9. A. S. Forouhar, M. Liebling, A. Hickerson, A. Nasiraei-Moghaddam, H.-J. Tsai, J. R. Hove, S. E. Fraser, M. E. Dickinson and M. Gharib, "The embryonic vertebrate heart tube is a dynamic suction pump," Science, vol. 312, no. 5774, pp. 751-753, 2006.
10. A.-S. Chiang, C.-Y. Lin, C.-C. Chuang, H.-M. Chang, C.-H. Hsieh, C.-W. Yeh, C.-T. Shih, J.-J. Wu, G.-T. Wang and Y.-C. Chen, "Three-dimensional reconstruction of brain-wide wiring networks in Drosophila at single-cell resolution," Curr. Biol., vol. 21, no. 1, pp. 1-11, 2011.
11. A. Jenett, G. M. Rubin, T.-T. Ngo, D. Shepherd, C. Murphy, H. Dionne, B. D. Pfeiffer, A. Cavallaro, D. Hall and J. Jeter, "A GAL4-driver line resource for Drosophila neurobiology," Cell Rep., vol. 2, no. 4, pp. 991-1001, 2012.
12. C. Castro-González, M. A. Luengo-Oroz, L. Duloquin, T. Savy, B. Rizzi, S. Desnoulez, R. Doursat, Y. L. Kergosien, M. J. Ledesma-Carbayo and P. Bourgine, "A digital framework to build, visualize and analyze a gene expression atlas with cellular resolution in zebrafish early embryogenesis," PLoS Comput. Biol., vol. 10, no. 6, p. e1003670, 2014.
13. P. Viola and W. M. Wells III, "Alignment by maximization of mutual information," Int. J. Comput. Vis., vol. 24, no. 2, pp. 137-154, 1997.
14. K. Rohr, M. Fornefett and H. S. Stiehl, "Spline-based elastic image registration: Integration of landmark errors and orientation attributes," Comput. Vis. Image Understand., vol. 90, no. 2, pp. 153-168, 2003.
15. D. Shen and C. Davatzikos, "HAMMER: Hierarchical attribute matching mechanism for elastic registration," IEEE Trans. Med. Imaging, vol. 21, no. 11, pp. 1421-1439, 2002.
16. E. G. Learned-Miller, "Data driven image models through continuous joint alignment," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 2, pp. 236-250, 2006.
17. L. Zöllei, E. Learned-Miller, E. Grimson and W. Wells, "Efficient population registration of 3D data," in Computer Vision for Biomedical Image Applications. New York: Springer, 2005, pp. 291-301.
18. G. S. Jefferis, C. J. Potter, A. M. Chan, E. C. Marin, T. Rohlfing, C. R. Maurer, Jr., and L. Luo, "Comprehensive maps of Drosophila higher olfactory centers: Spatially segregated fruit and pheromone representation," Cell, vol. 128, no. 6, pp. 1187-1203, 2007.
19. T. Rohlfing and C. R. Maurer, Jr., "Nonrigid image registration in shared-memory multiprocessor environments with application to brains, breasts, and bees," IEEE Trans. Inform. Technol. Biomed., vol. 7, no. 1, pp. 16-25, 2003.
20. H. Peng, P. Chung, F. Long, L. Qu, A. Jenett, A. M. Seeds, E. W. Myers and J. H. Simpson, "BrainAligner: 3D registration atlases of Drosophila brains," Nat. Methods, vol. 8, no. 6, pp. 493-498, 2011.
21. M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography,"Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
22. H.-H. Yu, T. Awasaki, M. D. Schroeder, F. Long, J. S. Yang, Y. He, P. Ding, J.-C. Kao, G. Y.-Y. Wu, and H. Peng, "Clonal development and organization of the adult Drosophila central brain," Curr. Biol., vol. 23, no. 8, pp. 633-643, 2013.
23. H. Peng, J. Tang, H. Xiao, A. Bria, J. Zhou, V. Butler, Z. Zhou, P. T. Gonzalez- Bellido, S. W. Oh, and J. Chen, "Virtual finger boosts three-dimensional imaging and microsurgery as well as terabyte volume image visualization and analysis," Nat. Commun., vol. 5, no. 4342, 2014. doi: 10.1038/ncomms5342.
24. L. Qu and H. Peng, "A principal skeleton algorithm for standardizing confocal images of fruit fly nervous systems," Bioinformatics, vol. 26, no. 8, pp. 1091-1097, 2010.
25. J. W. Brandt and V. R. Algazi, "Continuous skeleton computation by Voronoi diagram," CVGIP: Image Understand., vol. 55, no. 3, pp. 329-338, 1992.
26. J.-H. Chuang, N. Ahuja, C.-C. Lin, C.-H. Tsai, and C.-H. Chen, "A potentialbased generalized cylinder representation," Comput. Graph., vol. 28, no. 6, pp. 907-918, 2004.
27. L. Lam, S.-W. Lee and C. Y. Suen, "Thinning methodologies-a comprehensive survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 9, pp. 869-885, 1992.
28. G. Malandain and S. Fernández-Vidal, "Euclidean skeletons," Image Vis. Comput., vol. 16, no. 5, pp. 317-327, 1998.
29. C. Wählby, L. Kamentsky, Z. H. Liu, T. Riklin-Raviv, A. L. Conery, E. J. O'Rourke, K. L. Sokolnicki, O. Visvikis, V. Ljosa and J. E. Irazoqui, "An image analysis toolbox for high-throughput C. elegans assays," Nat. Methods, vol. 9, no. 7, pp. 714-716, 2012.
30. O. Ishaq, J. Negri, M.-A. Bray, A. Pacureanu, R. T. Peterson and C. Wahlby, "Automatic quantification of Zebrafish tail deformation for high-throughput drug screening," in IEEE 10th Int.Symp. Biomedical Imaging (ISBI), 7-11 Apr. 2013, San Francisco, CA, pp. 902-905.
31. H. Peng, F. Long, X. Liu, S. K. Kim and E. W. Myers, "Straightening Caenorhabditis elegans images," Bioinformatics, vol. 24, no. 2, pp. 234-242, 2008.
32. F. Long, H. Peng, X. Liu, S. K. Kim and E. Myers, "A 3D digital atlas of C. elegans and its application to single-cell analyses," Nat. Methods, vol. 6, no. 9, pp. 667-672, 2009.
33. A. White, B. Lees, H.-L. Kao, G. Cipriani, A. Paaby, E. Sontag, K. Erickson, D. Geiger, K. Gunsalus and F. Piano, "DevStaR: High-throughput quantification of C. elegans developmental stages," IEEE Trans. Med. Imaging vol. 32, no. 10, pp. 1791-1803, 2013.
34. A. Cardona, S. Saalfeld, I. Arganda, W. Pereanu, J. Schindelin and V. Hartenstein, "Identifying neuronal lineages of Drosophila by sequence analysis of axon tracts," J. Neurosci., vol. 30, no. 22, pp. 7538-7553, 2010.
35. L. R. Girard, T. J. Fiedler, T. W. Harris, F. Carvalho, I. Antoshechkin, M. Han, P. W. Sternberg, L. D. Stein and M. Chalfie, "WormBook: The online review of Caenorhabditis elegans biology," Nucleic Acids Res., vol. 35, no. 1, pp. D472-D475, 2007.
36. F. Long, H. Peng, X. Liu, S. Kim and G. Myers, "Automatic recognition of cells (ARC) for 3D images of C. elegans," in Research in Computational Molecular Biology, 2008, pp. 128-139.
37. D. Kainmueller, F. Jug, C. Rother and G. Myers, "Active graph matching for automatic joint segmentation and annotation of C. elegans," in Medical Image Computing and Computer-Assisted Intervention, pp. 81-88, 2014.
38. L. Qu, F. Long, X. Liu, S. Kim, E. Myers and H. Peng, "Simultaneous recognition and segmentation of cells: Application in C. elegans," Bioinformatics, vol. 27, no. 20, pp. 2895-2902, 2011.
39. A. Rangarajan, H. Chui and F. L. Bookstein, "The soft assign procrustes matching algorithm," in Proc. Information Processing in Medical Imaging, 1997, Poultney, VT, pp. 29-42.
40. G. Wahba, Spline Models for Observational Data. Philadelphia, PA: SIAM, 1990.
41. S. Gold, A. Rangarajan, C.-P. Lu, S. Pappu and E. Mjolsness, "New algorithms for 2D and 3D point matching: Pose estimation and correspondence," Pattern Recognit., vol. 31, no. 8, pp. 1019-1031, 1998.
42. Q. Wu, F. Merchant and K. Castleman, Microscope Image Processing. New York: Academic Press, 2010.
43. Y. Al-Kofahi, W. Lassoued, W. Lee and B. Roysam, "Improved automatic detection and segmentation of cell nuclei in histopathology images," IEEE Trans. Biomed. Eng., vol. 57, no. 4, pp. 841-852, 2010.
44. O. Dzyubachyk, W. A. van Cappellen, J. Essers, W. J. Niessen and E. Meijering, "Advanced level-set-based cell tracking in time-lapse fluorescence microscopy,"IEEE Trans. Med. Imaging, vol. 29, no. 3, pp. 852-867, 2010.
45. B. Roysam, W. Shain, E. Robey, Y. Chen, A. Narayanaswamy, C. Tsai, Y. Al- Kofahi, C. Bjornsson, E. Ladi and P. Herzmark, "The FARSIGHT project: Associative 4D/5D image analysis methods for quantifying complex and dynamic biological microenvironments," Microsc. Microanal., vol. 14, no. S2, pp. 60-61, 2008.
46. H. Peng, A. Bria, Z. Zhou, G. Iannello, and F. Long, "Extensible visualization and analysis for multidimensional images using Vaa3D," Nat. Protocols, vol. 9, no. 1, pp. 193-208, 2014.
47. S. Saalfeld, A. Cardona, V. Hartenstein and P. Tomancak, "CATMAID: Collaborative annotation toolkit for massive amounts of image data," Bioinformatics, vol. 25, no. 15, pp. 1984-1986, 2009.