Detection of neuron membranes in electron microscopy images using a serial neural network architecture

Medical Image Analysis

Volumn 14, Issue 6, 2010, Pages 770-783

  Jurrus, Elizabeth ^a,b   Paiva, Antonio R C ^a   Watanabe, Shigeki ^a   Anderson, James R ^c   Jones, Bryan W ^c   Whitaker, Ross T ^a,b   Jorgensen, Erik M ^a   Marc, Robert E ^c   Tasdizen, Tolga ^a,b  

^a UNIVERSITY OF UTAH   (United States)

^b Department of Electrical and Computer Engineering   (United States)

^c UNIVERSITY OF UTAH SCHOOL OF MEDICINE   (United States)

Author keywords

Artificial neural networks; Contour completion; Machine learning; Membrane detection; Neural circuit reconstruction

Indexed keywords

ARTIFICIAL NEURAL NETWORK; ARTIFICIAL NEURAL NETWORKS; AUTOMATED IMAGE ANALYSIS; AUTOMATED SYSTEMS; CONTOUR COMPLETION; DATA SETS; DETECTION ACCURACY; DETECTION METHODS; ELECTRON MICROSCOPY IMAGES; FEATURE VECTORS; IMAGE INTENSITIES; LARGE IMAGES; MACHINE-LEARNING; MANUAL ANALYSIS; NERVOUS SYSTEM; NEURAL CIRCUITS;

AUTOMATION; IMAGE ANALYSIS; IMAGE SEGMENTATION; LEARNING SYSTEMS; NEURONS; REPAIR; SCANNING ELECTRON MICROSCOPY;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; ELECTRON MICROSCOPY; NERVE CELL MEMBRANE; PRIORITY JOURNAL;

ALGORITHMS; ANIMALS; CAENORHABDITIS ELEGANS; CELL MEMBRANE; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MICROSCOPY, ELECTRON; NEURAL NETWORKS (COMPUTER); NEURONS; PATTERN RECOGNITION, AUTOMATED; RABBITS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 77954660421     PISSN: 13618415     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.media.2010.06.002     Document Type: Article

References (59)

1. Anderson J., Jones B., Yang J.-H., Shaw M., Watt C., Koshevoy P., Spaltenstein J., Jurrus E., Whitaker K.U.V.R., Mastronarde D., Tasdizen T., Marc R. A computational framework for ultrastructural mapping of neural circuitry. PLoS Biol. 2009, 7(3):e74.
2. Andres B., Kthe U., Helmstaedter M., Denk W., Hamprecht F.A. Segmentation of SBFSEM volume data of neural tissue by hierarchical classification. LNCS 2008, vol. 5096. Springer, pp. 142-152. doi:10.1007/978-3-540-69321-5_15. ISBN: 978-3-540-69320-8. G. Rigoll (Ed.).
3. Awate, S.P., Whitaker, R.T., 2006. Unsupervised, information-theoretic, adaptive image filtering for image restoration. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28 (3), pp. 364-376.
4. Awate, S.P., Tasdizen, T., Whitaker, R.T., 2006. Unsupervised texture segmentation with nonparametric neighborhood statistics. In: Proceedings of the European Conference on Computer Vision, pp. 494-507.
5. Borenstein, E., Sharon, E., Ullman, S., 2004. Combining top-down and bottom-up segmentation. In: Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW04), vol. 4. IEEE Computer Society, Washington, DC, USA, p. 46. ISBN: 0-7695-2158-4.
6. Briggman K.L., Denk W. Towards neural circuit reconstruction with volume electron microscopy techniques. Curr. Opin. Neurobiol. 2006, 16(5):562-570. doi:10.1016/j.conb.2006.08.010. .
7. Briggman K.L., Denk W. Towards neural circuit reconstruction with volume electron microscopy techniques. Curr. Opin. Neurobiol. 2006, 16(5):562-570.
8. Buades, A., Coll, B., Morel, J.-M., 2005. A non-local algorithm for image denoising. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 60-65.
9. Cottrell G.W. Extracting features from faces using compression networks. Proceedings of the 1990 Connectionist Models Summer School 1990, 328-337. Morgan Kaufman, San Mateo. D.S. Touretzky, J.L. Elman, T.J. Sejnowski, G.E. Hinton (Eds.).
10. Cybenko G. Approximation by superpositions of a sigmoidal function. Math. Control, Signals, Syst. 1989, 2(4):303-314. 10.1007/BF02551274.
11. DeBello W.M., Feldman D.E., Knudsen E.I. Adaptive axonal remodeling in the midbrain auditory space map. J. Neurosci. 2001, 21(9):3161-3174. .
12. Dollar, P., Tu, Z., Belongie, S., 2006. Supervised learning of edges and object boundaries. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2. IEEE Computer Society, Los Alamitos, CA, USA, pp. 1964-1971. ISSN: 1063-6919. doi:10.1109/CVPR.2006.298.
13. Fiala J.C., Harris K.M. Extending unbiased stereology of brain ultrastructure to three-dimensional volumes. J. Am. Med. Inform. Assoc. 2001, 8(1):1-16.
14. Fowlkes, C., Belongie, S., Chung, F., Malik, J., 2004. Spectral grouping using the Nystrm method. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, pp. 214-225.
15. Freund, Y., Schapire, R.E., 1995. A decision-theoretic generalization of on-line learning and an application to boosting. In: EuroCOLT 95: Proceedings of the Second European Conference on Computational Learning Theory. Springer-Verlag, London, UK, pp. 23-37. ISBN: 3-540-59119-2.
16. Haykin S. Neural Networks - A Comprehensive Foundation 1999, Prentice-Hall. second ed.
17. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks 1991, 4(2):251-257. doi:10.1016/0893-6080(91)90009-T.
18. Jain, V., Murray, J., Roth, F., Turaga, S., Zhigulin, V., Briggman, K., Helmstaedter, M., Denk, W., Seung, H., 2007. Supervised learning of image restoration with convolutional networks. In: IEEE 11th International Conference on Computer Vision, pp. 1-8.
19. Jin Y., Hoskins R., Horvitz H.R. Control of type-D GABAergic neuron differentiation by C. elegans UNC-30 homeodomain protein. Nature 1994, 372(6508):780-783.
20. Jones B.W., Marc R.E. Retinal remodeling during retinal degeneration. Exp. Eye Res. 2005, 81:123-137.
21. Jones B.W., Watt C.B., Frederick J.M., Baehr W., Chen C.K., Levine E.M., Milam A.H., Lavail M.M., Marc R.E. Retinal remodeling triggered by photoreceptor degenerations. J. Comp. Neurol. 2003, 464:1-16.
22. Jones B.W., Watt C.B., Marc R.E. Retinal remodelling. Clin. Exp. Optom. 2005, 88:282-291.
23. Jurrus, E., Whitaker, R., Jones, B., Marc, R., Tasdizen, T., 2008. An optimal-path approach for neural circuit reconstruction. In: Proceedings of the 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp. 1609-1612.
24. Jurrus E., Hardy M., Tasdizen T., Fletcher P., Koshevoy P., Chien C.-B., Denk W., Whitaker R. Axon tracking in serial block-face scanning electron microscopy. Med. Image Anal. 2009, 13(1):180-188.
25. Koyama R., Yamada M.K., Fujisawa S., Katoh-Semba R., Matsuki N., Ikegaya Y. Brain-derived neurotrophic factor induces hyperexcitable reentrant circuits in the dentate gyrus. J. Neurosci. 2004, 24:7215-7224.
26. Leung T., Malik J. Representing and recognizing the visual appearance of materials using three-dimensional textons. Int. J. Comput. Vis. 2001, 43(1):29-44. doi:10.1023/A:1011126920638. ISSN: 0920-5691.
27. Macke J., Maack N., Gupta R., Denk W., Schlkopf B., Borst A. Contour-propagation algorithms for semi-automated reconstruction of neural processes. J. Neurosci. Methods 2008, 167:349-357.
28. Mahamud, S., Williams, L., Thornber, K., Xu, K., 2003. Segmentation of multiple salient closed contours from real images. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25 (4), pp. 433-444. ISSN: 0162-8828. doi:10.1109/TPAMI.2003.1190570.
29. Marc R.E., Jones B.W., Watt C.B., Strettoi E. Neural remodeling in retinal degeneration. Prog. Retinal Eye Res. 2003, 22:607-655.
30. Marc R.E., Jones B.W., Anderson J.R., Kinard K., Marshak D.W., Wilson J.H., Wensel T., Lucas R.J. Neural reprogramming in retinal degeneration. Invest. Ophthalmol. Vis. Sci. 2007, 48:3364-3371.
31. Marc R.E., Jones B.W., Watt C.B., Vazquez-Chona F., Vaughan D.K., Organisciak D.T. Extreme retinal remodeling triggered by light damage: implications for age related macular degeneration. Mol. Vis. 2008, 14:782-806.
32. Mishchenko, Y., 2009. Automation of 3D reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs. J. Neurosci. Methods.
33. Venkataraju, K.U., Paiva, A., Jurrus, E., Tasdizen, T., 2009. Automatic markup of neural cell membranes using boosted decision stumps. In: Proceedings of the 6th IEEE International Symposium on Biomedical Imaging, pp. 1039-1042.
34. Paiva, A.R., Jurrus, E., Tasdizen, T., 2010. Using sequential context for image analysis. In: Proceedings of the International Conference on Pattern Recognition.
35. Peng Y.W., Hao Y., Petters R.M., Wong F. Ectopic synaptogenesis in the mammalian retina caused by rod photoreceptor-specific mutations. Nat. Neurosci. 2000, 3:1121-1127.
36. Pizer, S., Johnston, R., Ericksen, J., Yankaskas, B., Muller, K., 1990. Contrast-limited adaptive histogram equalization: speed and effectiveness. In: Proceedings of the First Conference on Visualization in Biomedical Computing, pp. 337-345. doi:10.1109/VBC.1990.109340.
37. Pollard H., Khrestchatisky M., Moreau J., Ben-Ari Y., Represa A. Correlation between reactive sprouting and microtubule protein expression in epileptic hippocampus. Neuroscience 1994, 61:773-787.
38. Pomerleau D. Knowledge-based training of artificial neural networks for autonomous robot driving. Robot Learning 1993, 19-43. Kluwer Academic Publishing. J. Connell, S. Mahadevan (Eds.).
39. Principe J.C., Euliano N.R., Lefebvre W.C. Neural and Adaptive Systems: Fundamentals Through Simulations 2000, John Wiley & Sons.
40. Rabi G., Lu S. Visual speech recognition by recurrent neural networks. J. Electron. Imag. 1998, 7(1):61-69.
41. Ren, X., Malik, J., 2002. A probabilistic multi-scale model for contour completion based on image statistics. In: ECCV 02: Proceedings of the 7th European Conference on Computer Vision, Part I. Springer-Verlag, London, UK, pp. 312-327. ISBN: 3-540-43745-2.
42. Ren, X., Fowlkes, C., Malik, J., 2005. Scale-invariant contour completion using conditional random fields. In: Tenth IEEE International Conference on Computer Vision 2005, ICCV 2005, vol. 2, pp. 1214-1221. ISSN: 1550-5499. doi:10.1109/ICCV.2005.213.
43. Schmid, C., 2001. Constructing models for content-based image retrieval. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 2, pp. II-39-II-45. ISSN: 1063-6919. doi:10.1109/CVPR.2001.990922.
44. Shashua, A., Ullman, S. 1988. Structural saliency: the detection of globally salient structures using a locally connected network. In: Second International Conference on Computer Vision, pp. 321-327.
45. Shotton, J., Blake, A., Cipolla, R., 2008. Multiscale categorical object recognition using contour fragments. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 30 (7), pp. 1270-1281. ISSN: 0162-8828. doi:10.1109/TPAMI.2007.70772.
46. Sorra K.E., Harris K.M. Overview on the structure, composition, function, development, and plasticity of hippocampal dendritic spines. Hippocampus 2000, 10:501-511.
47. Sporns O., Tononi G., Ktter R. The human connectome: a structural description of the human brain. PLoS Comput. Biol. 2005, 1:e42.
48. Sutula T. Seizure-induced axonal sprouting: assessing connections between injury, local circuits, and epileptogenesis. Epilepsy. Curr. 2002, 2:86-91.
49. Tang, C.-K., Medioni, G., 2002. Curvature-augmented tensor voting for shape inference from noisy 3D data. In: IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24 (6), pp. 858-864. ISSN: 0162-8828. doi:10.1109/TPAMI.2002.1008395.
50. Tasdizen, T., 2008. Principal components for non-local means image denoising. In: Proceeding of International Conference on Image Processing.
51. Tasdizen, T., Whitaker, R., Marc, R., Jones, B., 2005. Enhancement of cell boundaries in transmission electron microscopy images. In: ICIP, pp. 642-645.
52. Tu Z. Auto-context and its application to high-level vision tasks. IEEE Conf. Comput. Vis. Patt. Recognit. 2008, 1-8.
53. Varma, M., Zisserman, A., 2003. Texture classification: are filter banks necessary? In: Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. II-691-8. ISSN: 1063-6919. doi:10.1109/CVPR.2003.1211534.
54. Vazquez, L., Sapiro, G., Randall, G., 1998. Segmenting neurons in electronic microscopy via geometric tracing. In: Proceedings of ICIP, pp. 814-818.
55. Vu, N., Manjunath, B., 2008. Graph cut segmentation of neuronal structures from transmission electron micrographs. In: 15th IEEE International Conference on Image Processing 2008, ICIP 2008, pp. 725-728. ISSN: 1522-4880. doi:10.1109/ICIP.2008.4711857.
56. Wells G., Venaille C., Torras C. Promising research: vision-based robot positioning using neural networks. Image Vis. Comput. 1996, 14(10):715-732.
57. White J., Southgate E., Thomson J., Brenner F. The structure of the nervous system of the nematode Caenorhabditis elegans. Phil. Trans. Roy. Soc. Lond. Ser. B Biol. Sci. 1986, 314:1-340.
58. White J.Q., Nicholas T., Gritton J., Truong L., Davidson E.R., Jorgensen E.M. The sensory circuitry for sexual attraction in C. elegans males. Curr. Biol. 2007, 17(21):1847-1857.
59. Zhu, Q., Song, G., Shi, J., 2007. Untangling cycles for contour grouping. In: IEEE 11th International Conference on Computer Vision 2007, ICCV 2007, pp. 1-8. ISSN: 1550-5499. doi:10.1109/ICCV.2007.4408929.