Characterization of biological processes through automated image analysis

Annual Review of Biomedical Engineering

Volumn 12, Issue , 2010, Pages 315-344

  Rittscher, Jens ^a  

^a GE GLOBAL RESEARCH   (United States)

Author keywords

biological imaging; cell segmentation and tracking; live cell microscopy; phenotyping; tissue analysis

Indexed keywords

BIOLOGICAL IMAGING; CELL SEGMENTATION AND TRACKING; LIVE CELL MICROSCOPY; PHENOTYPING; TISSUE ANALYSIS;

DYNAMIC ANALYSIS; IMAGE ANALYSIS; SIGNALING; TISSUE;

IMAGE SEGMENTATION;

GREEN FLUORESCENT PROTEIN; NOCODAZOLE; ROSCOVITINE;

ALGORITHM; AUTOMATION; BRAIN; CELL CYCLE REGULATION; CELL STRUCTURE; EMBRYO DEVELOPMENT; FLY; GENE LOCATION; HEART DEVELOPMENT; IMAGE ANALYSIS; IN VIVO STUDY; LABELING INDEX; MOLECULAR DYNAMICS; NONHUMAN; PHENOTYPE; REVIEW; SYNAPSE; ZEBRA FISH; ANIMAL; BIOLOGICAL PHENOMENA AND FUNCTIONS CONCERNING THE ENTIRE ORGANISM; CELLS; CYTOLOGY; DEVICES; DIPTERA; EMBRYOLOGY; HEART; HUMAN; IMAGE PROCESSING; PROCEDURES; ULTRASTRUCTURE;

ALGORITHMS; ANIMALS; BIOLOGICAL PROCESSES; BRAIN; CELLS; DIPTERA; HEART; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; SYNAPSES; ZEBRAFISH;

EID: 77955632064     PISSN: 15239829     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev-bioeng-070909-105235     Document Type: Review

References (104)

1. Collins FS, Green ED, Guttmacher AE, Guyer MS. 2003. A vision for the future of genomics research. Nature 422(6934):835-847
2. Tsien RY. 2005. Breeding molecules to spy on cells. Harvey Lect. 99:77-93
3. Giepmans BNG, Adams SR, Ellisman MH, Tsien RY. 2006. The fluorescent toolbox for assessing protein location and function. Science 312:217-224
4. Tsien RY. 1998. The green fluorescent protein. Annu. Rev. Biochem. 67:509-544
5. Vonesch C, Aguet F, Vonesch JL, Unser M. 2006. The colored revolution of bioimaging. IEEE Signal Process. Mag. 23(3):20-31
6. Kitano H. 2002. Systems biology: a brief overview. Science 295(5560):1662-1664
7. Pawley JB, ed. 2006. Handbook of Biological Confocal Microscopy. New York: Springer. 3rd ed
8. Rittscher J, Machiraju R, Wong STC, eds. 2008. Microscopic Image Analysis for Life Science Applications. Norwood, MA: Artech House
9. Megason SG, Fraser SE. 2003. Digitizing life at the level of the cell: high-performance laser-scanning microscopy and image analysis for in toto imaging of development. Mech. Dev. 120(11):1407-1420
10. Hill DLG, Batchelor PG, Holden M, Hawkes DJ. 2001. Medical image registration. Phys. Med. Biol. 46:R1-45
11. Magee D, Treanor D, Quirke P. 2008. A new image registration algorithm with application to 3D histopathology. Proc. 3rd Workshop Microsc. Image Anal. Appl. Biol., New York, N.Y., ed. DN Metaxas, J Rittscher, S Lockett, T Tasdizien, K Rohr, S Megason
12. Anderson JR, Jones BW, Yang JH, Shaw MV, Watt CB, et al. 2009. A computational framework for ultrastructural mapping of neural circuitry. PLoS Biol. 7(3):e1000074
13. Emmenlauer M, Ronneberger O, Ponti A, Schwarb P, Griffa A, et al. 2009. XuvTools: free, fast and reliable stitching of large 3D datasets. J. Microsc. 233(1):42-60
14. Otsu N. 1978. A threshold selection method from gray-scale histogram. IEEE Trans. Syst. Man Cybern. 8:62-66
15. Vincent L, Soille P. 1991. Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. 13(6):583-598
16. Mumford D, Shah J. 1985. Boundary detection by minimizing functionals. Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Francisco, June 11-13, pp. 22-26
17. Sethian JA. 1999. Level Set Methods and Fast Marching Methods. Cambridge, UK: Cambridge Univ. Press. 2nd ed.
18. Malladi R, Sethian JA, Vemuri BC. 1995. Shape modeling with front propagation: a level set approach. IEEE Trans. Pattern Anal. Mach. Intell. 17(2):158-175
19. Osher S, Fedkiw RP. 2002. Level Set Methods and Dynamic Implicit Surfaces. New York: Springer-Verlag
20. Geman S, Geman D. 1984. Stochastic relaxation, Gibbs distributions, and the Bayesian relation of images. IEEE Trans. Pattern Anal. Mach. Intell. 6:721-741
21. Shi J, Malik J. 2000. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8):888-905
22. Boykov Y, Kolmogorov V. 2004. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26:1124-1137
23. Felzenszwalb PF, Huttenlocher DP. 2004. Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2):167-181
24. Hill AA, LaPan P, Li Y, Haney S. 2007. Impact of image segmentation on high-content screening data quality for SK-BR-3 cells. BMC Bioinforma. 8(1):340
25. Pan J, Kanade T, Chen M. 2009. Learning to detect different types of cells under phase contrast microscopy. Proc. 4th Workshop Microsc. Image Anal. Appl. Biol., New York, N.Y., ed. DN Metaxas, T Yoo, J Rittscher, T Tasdizien
26. Comaniciu D, Meer P. 2002. Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24:603-619
27. Roysam B, Shain W, Barnes C, Mohler W, Lin G, et al. 2008. FARSIGHT: a divide and conquer methodology for analyzing complex and dynamic biological microenvironments. See Reference 8, pp. 115-152
28. Bjornsson CS, Lin G, Al-Kofahi Y, Narayanaswamy A, Smith KL, et al. 2008. Associative image analysis: a method for automated quantification of 3D multi-parameter images of brain tissue. J. Neurosci. Methods 170(1):165-178
29. Lin G, Adiga U, Olson K, Guzowski JF, Barnes CA, Roysam B. 2003. A hybrid 3D watershed algorithm incorporating gradient cues and object models for automatic segmentation of nuclei in confocal image stacks. Cytom. A 56(1):23-36
30. Lin G, Chawla MK, Olson K, Barnes CA, Guzowski JF, et al. 2007. A multi-model approach to simultaneous segmentation and classification of heterogeneous populations of cell nuclei in 3D confocal microscope images. Cytom. A 71(9):724-736
31. Li G, Liu T, Tarokh A, Nie J, Guo L, et al. 2007. 3D cell nuclei segmentation based on gradient flow tracking. BMC Cell Biol. 8(1):40
32. Khairy K, Reynaud E, Stelzer E. 2008. Detection of deformable objects in 3D images using Markov-Chain Monte Carlo and spherical harmonics. Proc. 11th Int. Conf. Med. Image Comput. Comput. Assist. Interv. Pt. II, New York, N.Y., pp. 1075-1082
33. Tyrrell JA, di Tomaso E, Fuja D, Tong R, Kozak K, et al. 2007. Robust 3D modeling of vasculature imagery using superellipsoids. IEEE Trans. Med. Imaging 26(2):223-237
34. Mayerich DM, Abbott L, Keyser J. 2008. Visualization of cellular and microvascular relationships. IEEE Trans. Vis. Comput. Graph. 14(6):1611-1618
35. Jurrus E, Hardy M, Tasdizen T, Fletcher PT, Koshevoy P, et al. 2009. Axon tracking in serial block-face scanning electron microscopy. Med. Image Anal. 13(1):180-188
36. Losavio BE, Liang Y, Santamaria-Pang A, Kakadiaris IA, Colbert CM, Saggau P. 2008. Live neuron morphology automatically reconstructed from multiphoton and confocal imaging data. J. Neurophysiol. 100(4):2422-2429
37. Newberg J, Hua J, Murphy RF. 2009. Location proteomics: systematic determination of protein subcel-lular location. Methods Mol. Biol. 500:313-332
38. Newberg JY, Li J, Rao A, Pontén F, Uhlén M, et al. 2009. Automated analysis of human protein atlas immunofluorescence images. Proc. 6th IEEE Int. Symp. Biomed. Imaging, Boston, June 28-July 1, pp. 1023-1026
39. Bishop CM. 2006. Pattern Recognition and Machine Learning. New York: Springer. 738
40. Meaburn KJ, Misteli T. 2008. Locus-specific and activity-independent gene repositioning during early tumorigenesis. J. Cell Biol. 180(1):39-50
41. Meaburn KJ, Gudla PR, Khan S, Lockett SJ, Misteli T. 2009. Disease-specific gene repositioning in breast cancer. J. Cell Biol. 187(6):801-812
42. Pinkel D, Straume T, Gray JW. 1986. Cytogenetic analysis using quantitative, high-sensitivity, fluorescence hybridization. Proc. Natl. Acad. Sci. USA 83(9):2934-2938
43. Gudla PR, Nandy K, Collins J, Meaburn KJ, Misteli T, Lockett SJ. 2008. A high-throughput system for segmenting nuclei using multiscale techniques. Cytom. A 73(5):451-466
44. Berger AB, Cabal GG, Fabre E, Duong T, Buc H, et al. 2008. High-resolution statistical mapping reveals gene territories in live yeast. Nat. Methods 5(12):1031-1037
45. Pincus Z, Theriot JA. 2007. Comparison of quantitative methods for cell-shape analysis. J. Microsc. 227(2):140-156
46. Teh CH, Chin RT. 1988. On image analysis by the methods of moments. IEEE Trans. Pattern Anal. Mach. Intell. 10(4):496-513
47. Cootes TF, Edwards GJ, Taylor CJ. 2001. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6):681-685
48. Cootes TF, Taylor CJ, Cooper DH, Graham J. 1995. Active shape models\their training and application. Comput. Vis. Image Underst. 61(1):38-59
49. Matthews I, Baker S. 2004. Active appearance models revisited. Int. J. Comput. Vis. 60(2):135-164
50. Comon P. 1994 Independent Component Analysis, A New Concept? Signal Process. 36(3):287-314
51. Rohde GK, Wang W, Peng T, Murphy RF. 2008. Deformation-based nonlinear dimension reduction: applications to nuclear morphometry. Proc. 5th IEEE Int. Symp. Biomed. Imaging, Paris, May 14-17, pp. 500-503
52. Grenander U, Miller MI. 1998. Computational anatomy: an emerging discipline. Q. Appl. Math. 56(4):617-694
53. Kruskal JB. 1964. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29(1):1-27
54. Rubin MA, Zerkowski MP, Camp RL, Kuefer R, Hofer MD, et al. 2004. Quantitative determination of expression of the prostate cancer protein α-methylacyl-CoA racemase using automated quantitative analysis (AQUA): a novel paradigm for automated and continuous biomarker measurements. Am. J. Pathol. 164(3):831-840
55. Camp RL, Chung GG, Rimm DL. 2002. Automated subcellular localization and quantification of protein expression in tissue microarrays. Nat. Med. 8(11):1323-1328
56. Gibson MC, Patel AB, Nagpal R, Perrimon N. 2006. The emergence of geometric order in proliferating metazoan epithelia. Nature 442(7106):1038-1041
57. Doyle S, Hwang M, Shah K, Madabhushi A, Feldman M, Tomaszeweski J. 2007. Automated grading of prostate cancer using architectural and textural image features. Proc. 4th IEEE Int. Symp. Biomed. Imaging, Washington, DC, April 12-15, pp. 1284-1287
58. Hadjidemetriou S, Toomre D, Duncan J. 2008. Motion tracking of the outer tips of microtubules. Med. Image Anal. 12(6):689-702
59. Boulanger J, Kervrann C, Bouthemy P. 2009. A simulation and estimation framework for intracellular dynamics and trafficking in video-microscopy and fluorescence imagery. Med. Image Anal. 13(1):132-142
60. Jaqaman K, Loerke D, Mettlen M, Kuwata H, Grinstein S, et al. 2008. Robust single-particle tracking in live-cell time-lapse sequences. Nat. Methods 5(8):695-702
61. Bar-Shalom Y, Li XR. 1993. Estimation and Tracking: Principles, Techniques, and Software. Norwood, MA: Artech House, Inc.
62. Machacek M, Danuser G. 2006. Morphodynamic profiling of protrusion phenotypes. Biophys. J. 90(4):1439-1452
63. Paragios N, Deriche R. 1999. Geodesic active regions for motion estimation and tracking. Proc. Int. Conf. Comput. Vis., Corfu, Greece, Sept. 20-25, pp. 688-694 (Pubitemid 32080109)
64. Blake A, Isard M. 2000. Active Contours. New York: Springer
65. Yang F, Mackey M, Ianzini F, Gallardo G, Sonka M. 2005. Cell segmentation, tracking, and mitosis detection using temporal context. Med. Image Comput. Comput. Assist. Interv. 8(Pt. 1):302-309
66. Padfield D, Rittscher J, Thomas N, Roysam B. 2009. Spatio-temporal cell cycle phase analysis using level sets and fast marching methods. Med. Image Anal. 13(1):143-155
67. Dufour A, Shinin V, Tajbakhsh S, Guillen-Aghion N, Olivo-Marin JC, Zimmer C. 2005. Segmenting and tracking fluorescent cells in dynamic 3D microscopy with coupled active surfaces. 14(9):1396-1410
68. Comaniciu D, Ramesh V, Meer P. 2000. Real-time tracking of non-rigid objects using mean shift. Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Hilton Head, S.C., June 13-15, pp. 2142-2149
69. Debeir O, Van Ham P, Kiss R, Decaestecker C. 2005. Tracking of migrating cells under phase-contrast video microscopy with combined mean-shift processes. IEEE Trans. Med. Imaging 24(6):697-711
70. Gelb A, ed. 1974. Applied Optimal Estimation. Cambridge, MA: MIT Press. 382
71. Blake A, Isard M. 1998. Condensation\conditional density propagation for visual tracking. Int. J. Com-put. Vis. 29(1):5-28
72. Li K, Miller ED, Chen M, Kanade T, Weiss LE, Campbell PG. 2008. Cell population tracking and lineage construction with spatiotemporal context. Med. Image Anal. 12(5):546-566
73. Genovesio A, Liedl T, Emiliani V, Parak WJ, Coppey-Moisan M, Olivo-Marin JC. 2006. Multiple particle tracking in 3-D+t microscopy: method and application to the tracking of endocytosed quantum dots. IEEE Trans. Image Process. 15(5):1062-1070
74. Al-Kofahi O, Radke RJ, Goderie SK, Shen Q, Temple S, Roysam B. 2006. Automated cell lineage construction: a rapid method to analyze clonal development established with murine neural progenitor cells. Cell Cycle 5(3):327-335
75. De Hauwer C, Darro F, Camby I, Kiss R, Van Ham P, Decaesteker C. 1999. In vitro motility evaluation of aggregated cancer cells by means of automatic image processing. Cytometry 36(1):1-10
76. Zhang L, Li Y, Nevatia R. 2008. Global data association for multi-object tracking using network flows. Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, Alsk., June 24-26, pp. 1-8
77. Padfield D, Rittscher J, Roysam B. 2009. Coupled minimum-cost flow cell tracking. Inf. Process. Med. Imaging 21:374-385
78. Kastan MB, Bartek J. 2004. Cell-cycle checkpoints and cancer. Nature 432(7015):316-323
79. Harder N, Bermúdez F, Godinez WJ, Ellenberg J, Eils R, Rohr K. 2006. Automated analysis of the mitotic phases of human cells in 3D fluorescence microscopy image sequences. Med. Image Comput. Comput. Assist. Interv. 9(Pt. 1):840-848 (Pubitemid 44609184)
80. Harder N, Neumann B, Held M, Liebel U, Erfle H, et al. 2006. Automated recognition of mitotic patters in fluorescence microscopy images of human cells. Proc. 3rd IEEE Int. Symp. Biomed. Imaging, Arlington, Va., April 6-9, pp. 1016-1019 (Pubitemid 44732493)
81. Stubbs S, Thomas N. 2006. Dynamic green fluorescent protein sensors for high-content analysis of the cell cycle. Methods Enzymol. 414:1-21
82. Cohen A, Bjornsson C, Temple S, Banker G, Roysam B. 2009. Automatic summarization of changes in biological image sequences using algorithmic information theory. IEEE Trans. Pattern Anal. Mach. Intell. 31(8):1386-1403
83. Tibshirani R, Walther G, Hastie T. 2001. Estimating the number of clusters in a data set via the gap statistic. J. R. Stat. Soc. Ser. B 63(Pt. 2):411-423
84. Liebling M, Forouhar AS, Wolleschensky R, Zimmermann B, Ankerhold R, et al. 2006. Rapid three-dimensional imaging and analysis of the beating embryonic heart reveals functional changes during development. Dev. Dyn. 235(11):2940-2948
85. Niell CM, Meyer MP, Smith SJ. 2004. In vivo imaging of synapse formation on a growing dendritic arbor. Nat. Neurosci. 7(3):254-260
86. Cline HT. 2001. Dendritic arbor development and synaptogenesis. Curr. Opin. Neurobiol. 11(1):118-126
87. Holtmaat AJGD, Trachtenberg JT, Wilbrecht L, Shepherd GM, Zhang X, et al. 2005. Transient and persistent dendritic spines in the neocortex in vivo. Neuron 45(2):279-291
88. Kimmel CB, Ballard WW, Kimmel SR, Ullmann B, Schilling TF. 1995. Stages of embryonic development of the zebrafish. Dev. Dyn. 203(3):253-310
89. Bissell MJ, Radisky D. 2001. Putting tumours in context. Nat. Rev. Cancer 1(1):46-54
90. MosaligantiK,PanT,RidgwayR,SharpR,CooperL,etal. 2008.Animaging workflow for characterizing phenotypical change in large histological mouse model datasets. J. Biomed. Inform. 41(6):863-873
91. Ginty F, Adak S, Can A, Gerdes M, Larsen M, et al. 2008. The relative distribution of membranous and cytoplasmic Met is a prognostic indicator in stage I and II colon cancer. Clin. Cancer Res. 14(12):3814-3822
92. Yang MY, Armstrong JD, Vilinsky I, Strausfeld NJ, Kaiser K. 1995. Subdivision of the Drosophila mushroom bodies by enhancer-trap expression patterns. Neuron 15(1):45-54
93. Long F, Peng H, Liu X, Kim SK, Myers E. 2009. A 3D digital atlas of C. elegans and its application to single-cell analyses. Nat. Methods 6(9):667-672
94. Lam SC, Ruan Z, Zhao T, Long F, Jenett A, et al. 2010. Segmentation of center brains and optic lobes in 3D confocal images of adult fruit fly brains. Methods 50(2):63-69
95. Vese LA, Chan TF. 2002. A multiphase level set framework for image segmentation using the Mumford and Shah model. Int. J. Comput. Vis. 50(3):271-293
96. Collins TJ. 2007. ImageJ for microscopy. Biotechniques 43(Suppl. 1):25-30
97. Yoo TS, Ackerman MJ, Lorensen WE, Schroeder W,ChalanaV,et al. 2002. Engineering and algorithm design for an image processing API: a technical report on ITK\the Insight Toolkit. Stud. Health Technol. Informa. 85:586-592
98. Swedlow JR, Goldberg IG, Eliceiri KW, OME Consortium. 2009. Bioimage informatics for experimental biology. Annu. Rev. Biophys. 38:327-346
99. Swedlow JR, Eliceiri KW. 2009. Open source bioimage informatics for cell biology. Trends Cell Biol. 19:656-660
100. Moore J, Allan C, Burel J-M, Loranger B, MacDonald D, et al. 2008. Open tools for storage and management of quantitative image data. Methods Cell Biol. 85:555-570
101. Carpenter A, Jones T, Lamprecht M, Clarke C, Kang I, et al. 2006. CellProfiler: image analysis software for identifying and quantifying cell phenotypes. Genome Biol. 7(10):R100
102. Warfield SK, Zou KH, Wells WM. 2004. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans. Med. Imaging 23(7):903-921
103. Taylor CF, Paton NW, Lilley KS, Binz PA, Julian RK, et al. 2007. The minimum information about a proteomics experiment (MIAPE). Nat. Biotechnol. 25(8):887-893
104. Santamara-Pang A, Colbert CM, Saggau P, Kakadiaris IA. 2007. Automatic centerline extraction of irregular tubular structures using probability volumes from multiphoton imaging. Med. Image Comput. Comput. Assist. Interv. 10(Pt 2):486-494