Semi-automated reconstruction of neural circuits using electron microscopy

Current Opinion in Neurobiology

Volumn 20, Issue 5, 2010, Pages 667-675

  Chklovskii, Dmitri B ^a   Vitaladevuni, Shiv ^a   Scheffer, Louis K ^a  

^a HOWARD HUGHES MEDICAL INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; AUTOMATION; CAENORHABDITIS ELEGANS; DROSOPHILA; ELECTRON MICROSCOPY; IMAGE PROCESSING; IMAGE RECONSTRUCTION; NERVE CELL NETWORK; NONHUMAN; PRIORITY JOURNAL; REVIEW; SYNAPSE; THREE DIMENSIONAL IMAGING; TRANSMISSION ELECTRON MICROSCOPY;

ANIMALS; HUMANS; IMAGE CYTOMETRY; MICROSCOPY, ELECTRON; NERVE NET; NEUROBIOLOGY; NEURONS; PATTERN RECOGNITION, AUTOMATED;

EID: 77957017889     PISSN: 09594388     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.conb.2010.08.002     Document Type: Review

References (86)

1. Sporns O., Tononi G., Kotter R. The human connectome: a structural description of the human brain. PLoS Comput Biol 2005, 1:e42.
2. Lichtman J.W., Livet J., Sanes J.R. A technicolour approach to the connectome. Nat Rev Neurosci 2008, 9:417-422.
3. Helmstaedter M., Briggman K.L., Denk W. 3D structural imaging of the brain with photons and electrons. Curr Opin Neurobiol 2008, 18:633-641.
4. Smith S.J. Circuit reconstruction tools today. Curr Opin Neurobiol 2007, 17:601-608.
5. Denk W., Horstmann H. Serial block-face scanning electron microscopy to reconstruct three-dimensional tissue nanostructure. PLoS Biol 2004, 2:e329.
6. Wickersham I.R., Lyon D.C., Barnard R.J., Mori T., Finke S., Conzelmann K.K., Young J.A., Callaway E.M. Monosynaptic restriction of transsynaptic tracing from single, genetically targeted neurons. Neuron 2007, 53:639-647.
7. Livet J., Weissman T.A., Kang H., Draft R.W., Lu J., Bennis R.A., Sanes J.R., Lichtman J.W. Transgenic strategies for combinatorial expression of fluorescent proteins in the nervous system. Nature 2007, 450:56-62.
8. White J.G., Southgate E., Thomson J.N., Brenner S. The structure of the nervous system of the nematode caenorhabditis elegans. Philos Trans R Soc Lond, Ser B, Biol Sci. 1986, 314:1-340.
9. Varshney L, Chen B, Paniagua E, Hall D, Chklovskii D: Stuctural properties of the C. elegans neuronal network, submitted 2010.
10. Fahrenbach W.H. Anatomical circuitry of lateral inhibition in the eye of the horseshoe crab, Limulus polyphemus. Proc R Soc Lond B Biol Sci 1985, 225:219-249.
11. Meinertzhagen I.A., Sorra K.E. Synaptic organization in the fly's optic lamina: few cells, many synapses and divergent microcircuits. Prog Brain Res 2001, 131:53-69.
12. Sims S.J., Macagno E.R. Computer reconstruction of all the neurons in the optic ganglion of Daphnia magna. J Comp Neurol 1985, 233:12-29.
13. Stevens J.K., Davis T.L., Friedman N., Sterling P. A systematic approach to reconstructing microcircuitry by electron microscopy of serial sections. Brain Res 1980, 2:265-293.
14. Electron Microscopy: Methods and Protocols 2007, Humana Press. J. Kuo (Ed.).
15. Rostaing P., Weimer R.M., Jorgensen E.M., Triller A., Bessereau J.L. Preservation of immunoreactivity and fine structure of adult C. elegans tissues using high-pressure freezing. J Histochem Cytochem 2004, 52:1-12.
16. Sosinsky G.E., Crum J., Jones Y.Z., Lanman J., Smarr B., Terada M., Martone M.E., Deerinck T.J., Johnson J.E., Ellisman M.H. The combination of chemical fixation procedures with high pressure freezing and freeze substitution preserves highly labile tissue ultrastructure for electron tomography applications. J Struct Biol 2008, 161:359-371.
17. Harris K.M., Perry E., Bourne J., Feinberg M., Ostroff L., Hurlburt J. Uniform serial sectioning for transmission electron microscopy. J Neurosci 2006, 26:12101-12103.
18. Knott G., Marchman H., Wall D., Lich B. Serial section scanning electron microscopy of adult brain tissue using focused ion beam milling. J Neurosci 2008, 28:2959-2964.
19. Briggman K.L., Denk W. Toward neural circuit reconstruction with volume electron microscopy techniques. Curr Opin Neurobiol 2006, 16.
20. Hayworth K.J., Kasthuri N., Schalek R., Lichtman J.W. Automating the collection of ultrathin serial sections for large volume TEM reconstructions. Microscopy and Microanalysis 2006, 86-87.
21. Veeraraghavan A., Genkin A., Vitaladevuni S., Scheffer L., Xu S., Hess H., Fetter R., Cantoni M., Knott G., Chklovskii D. Increasing depth resolution of electron microscopy of neural circuits using sparse tomographic reconstruction. CVPR 2010.
22. Hu T, et al.: Super-resolution Reconstruction of Brain Structure Using Sparse Representation over Learned Dictionary, submitted for publication.
23. Rein K., Zockler M., Mader M.T., Grubel C., Heisenberg M. The Drosophila standard brain. Curr Biol 2002, 12:227-231.
24. Turaga S.C., Murray J.F., Jain V., Roth F., Helmstaedter M., Briggman K., Denk W., Seung H.S. Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput 2010, 22:511-538.
25. Turaga S.C., Briggman K., Helmstaedter M., Denk W., Seung H.S. Maximin affinity learning of image segmentation. NIPS 2009.
26. Jain V., Murray J.F., Roth F., Turaga S., Zhigulin V., Briggman K.L., Helmstaedter M.N., Denk W., Seung H.S. Supervised learning of image restoration with convolutional networks. ICCV 2007.
27. Andres B., Kothe U., Helmstaedter M., Denk W., Hamprecht F. Segmentation of SBFSEM volume data of neural tissue by hierarchical classification. Pattern Recognition. 30th DAGM Symposium 2008, 142-152. Springer, Munich, Germany. G. Rigoll (Ed.).
28. Turaga S.C., Murray J.F., Jain V., Roth F., Helmstaedter M., Briggman K., Denk W., Seung H.S. Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput 2009.
29. Mishchenko Y, Hu T, Spacek J, Mendenhall J, Harris K, Chklovskii D: Ultrastructural analysis of hippocampal neuropil from the connectomics perspective. Neuron, in press.
30. Mishchenko Y. Automation of 3D reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs. J Neurosci Methods 2009, 176:276-289.
31. Kaynig V., Fuchs T., Buhmann J.M. Geometrical consistent 3D tracing of neuronal processes in ssTEM data. MICCAI 2010.
32. Jurrus E., Whitaker R., Jones B.W., Marc R., Tasdizen T. An optimal-path approach for neural circuit reconstruction. Proc IEEE Int Symp Biomed Imaging 2008, 2008:1609-1612.
33. Macagno E.R., Levinthal C., Sobel I. Three-dimensional computer reconstruction of neurons and neuronal assemblies. Annu Rev Biophys Bioeng 1979, 8:323-351.
34. Fiala J.C. Reconstruct: a free editor for serial section microscopy. J Microsc 2005, 218:52-61.
35. ImageJ on World Wide Web URL: http://rsb.info.nih.gov/ij.
36. Kremer J.R., Mastronarde D.N., McIntosh J.R. Computer visualization of three-dimensional image data using IMOD. J Struct Biol 1996, 116:71-76.
37. Glaser J.R., Glaser E.M. Neuron imaging with neurolucida-a PC-based system for image combining microscopy. Comput Med Imaging Graphics 1990, 14:307-317.
38. Stalling D., Westerhoff M., Hege H.-C. Amira: a highly interactive system for visual data analysis. The Visualization Handbook 2005, Elsevier, pp. 749-767.
39. Kaynig V., Fischer B., Muller E., Buhmann J.M. Fully automatic stitching and distortion correction of transmission electron microscope images. J Struct Biol 2010, 171:163-173.
40. Cardona A, Saalfeld S, Preibisch S, Schmid B, Cheng A, Pulokas J, Tomancak P: An integrated micro- and macroarchitectural analysis of the Drosophila brain by computer-assisted serial section electron microscopy. PLoS Biol, in press.
41. Anderson J.R., Jones B.W., Yang J.H., Shaw M.V., Watt C.B., Koshevoy P., Spaltenstein J., Jurrus E., Kannan U.V., Whitaker R.T., et al. A computational framework for ultrastructural mapping of neural circuitry. PLoS Biol 2009, 7:e1000074.
42. Saalfeld S., Cardona A., Hartenstein V., Tomancak P. As-rigid-as-possible mosaicking and serial section registration of large ssTEM datasets. Bioinformatics 2010, 26:i57-i63.
43. Kaynig V, Fischer B, Buhmann J: Probabilistic Image Registration and Anomaly Detection by Nonlinear Warping, 2008.
44. Suloway C., Pulokas J., Fellmann D., Cheng A., Guerra F., Quispe J., Stagg S., Potter C.S., Carragher B. Automated molecular microscopy: the new Leginon system. J Struct Biol 2005, 151:41-60.
45. Lowe D. Object recognition from local scale-invariant features. ICCV 1999.
46. Li X.Y.S. An overview of SuperLU: Algorithms, implementation, and user interface Acm Transactions on Mathematical Software 2005, 31(3):302-325.
47. Olbris DJ, Winston P, Chklovskii DB: Raveler-a software for editing large segmented electron microscopy datasets, in preparation.
48. Martin D.R., Fowlkes C.C., Malik J. Learning to detect natural image boundaries using local brightness, color, and texture cues. IEEE Trans Pattern Anal Mach Intell 2004, 26:530-549.
49. Carlbom I., Terzopoulos D., Harris K.M. Computer-assisted registration, segmentation, and 3d reconstruction from images of neuronal tissue-sections. IEEE Trans Med Imaging 1994, 13:351-362.
50. Jeong W.K., Beyer J., Hadwiger M., Vazquez A., Pfister H., Whitaker R.T. Scalable and interactive segmentation and visualization of neural processes in EM datasets. IEEE Trans Visual Comput Graphics 2009, 15:1505-1514.
51. Reina A., Miller E., Pfister H. Multiphase geometric couplings for the segmentation of neural processes. CVPR 2009.
52. Reconstruction software: Program Elegance on World Wide Web URL: http://worms.aecom.yu.edu/pages/Reconstruction%20Software.html.
53. Helmstaedter M, Briggman K, Denk W: KNOSSOS skeleton tracing tool, 2010.
54. Helmstaedter M, Briggman KL, Denk W: High-accuracy neurite tracing for high-throughput neuroanatomy, in preparation.
55. Canny J. A computational approach to edge-detection. IEEE Trans Pattern Anal Mach Intell 1986, 8:679-698.
56. Konishi S., Yuille A.L., Coughlan J.M., Zhu S.C. Statistical edge detection: learning and evaluating edge cues. IEEE Trans Pattern Anal Mach Intell 2003, 25:57-74.
57. Dollar P, Tu Z, Belongie S: Supervised learning of edges and object boundaries, 2006.
58. Lecun Y., Bottou L., Bengio Y., Haffner P. Gradient-based learning applied to document recognition. Proc IEEE 1998, 86:2278-2324.
59. Kannan U., Paiva A., Jurrus E., Tasdizen T. Automatic markup of neural cell membranes using boosted decision stumps. IEEE Int'l Symp. Biomedical Engineering (ISBI 2009) 2009.
60. Kumar R., Reina A., Pfister H. Radon-like features and their application to connectomics. IEEE Computer Society Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA) 2010.
61. Jurrus E., Paiva A.R., Watanabe S., Anderson J.R., Jones B.W., Whitaker R.T., Jorgensen E.M., Marc R.E., Tasdizen T. Detection of neuron membranes in electron microscopy images using a serial neural network architecture. Med Image Anal 2010, 14:770-783.
62. Kaynig V., Fuchs T., Buhmann J. Neuron geometry extraction by perceptual grouping in ssTEM images. CVPR 2010.
63. On World Wide Web URL: http://ilastik.org/.
64. Trainable Segmentation Plugin (Fiji) on World Wide Web URL: http://pacific.mpi-cbg.de/wiki/index.php/Trainable_Segmentation_Plugin.
65. Arbelaez P., Maire M., Fowlkes C., Malik J. From contours to regions: an empirical evaluation. CVPR 2009.
66. Levner I., Zhang H. Classification-driven watershed segmentation. IEEE Trans Image Process 2007, 16:1437-1445.
67. Meyer F. Un algorithme optimal pour la ligne de partage des eaux. Dans 8me congrès de reconnaissance des formes et intelligence artificielle 1991, 847-857.
68. Vincent L., Soille P. Watersheds in digital spaces-an efficient algorithm based on immersion simulations. IEEE Trans Pattern Anal Mach Intell 1991, 13:583-598.
69. Ren X., Malik J. Learning a classification model for segmentation. ICCV 2003.
70. Haris K, Efstratiadis SN, Maglaveras N: Hierarchical image segmentation using contour dynamics. ICIP, 2001.
71. Haris K., Efstratiadis S.N., Maglaveras N., Katsaggelos A.K. Hybrid image segmentation using watersheds and fast region merging. IEEE Trans Image Process 1998, 7:1684-1699.
72. Najman L., Schmitt M. Geodesic saliency of watershed contours and hierarchical segmentation. IEEE Trans Pattern Anal Mach Intell 1996, 18:1163-1173.
73. Vitaladevuni S, Mishchenko Y, Genkin A, Chklovskii D: Segmentation of Neuronal Electron Micrographs, in preparation.
74. Rand W. Objective criteria for the evaluation of clustering methods. J Am Stat Assoc 1971, 66:846-850.
75. Jain V., Bollmann B., Richardson M., Berger D., Helmstaedter M., Briggman K., Denk W., Bowden J., Mendenhall J., Abraham W., et al. Boundary learning by optimization with topological constraints. CVPR 2010.
76. Macke J.H., Maack N., Gupta R., Denk W., Scholkopf B., Borst A. Contour-propagation algorithms for semi-automated reconstruction of neural processes. J Neurosci Methods 2008, 167:349-357.
77. Jurrus E., Hardy M., Tasdizen T., Fletcher P.T., Koshevoy P., Chien C.B., Denk W., Whitaker R. Axon tracking in serial block-face scanning electron microscopy. Med Image Anal 2009, 13:180-188.
78. Vitaladevuni S., Basri R. Co-clustering of image segments using convex optimization applied to EM neuronal reconstruction. CVPR 2010.
79. Rother C., Kolmogorov V., Blake A. " GrabCut" -interactive foreground extraction using iterated graph cuts. ACM Trans Graphics 2004, 23:309-314.
80. Vu N., Manjunath B. Graph cut segmentation of neuronal structures from transmission electron micrographs. ICIP 2008.
81. Rivera-Alba M, de Polavieja G, Lu Z, Chklovskii DB: Structural features of the Drosophila lamina cartridge, in preparation.
82. Meinertzhagen I.A., O'Neil S.D. Synaptic organization of columnar elements in the lamina of the wild type in Drosophila melanogaster. J Comp Neurol 1991, 305:232-263.
83. Takemura SY, Meinertzhagen IA, Chklovskii DB: Wiring of the medulla column in Drosophila, in preparation.
84. Pfeiffer B.D., Jenett A., Hammonds A.S., Ngo T.T., Misra S., Murphy C., Scully A., Carlson J.W., Wan K.H., Laverty T.R., et al. Tools for neuroanatomy and neurogenetics in Drosophila. Proc Natl Acad Sci USA 2008, 105:9715-9720.
85. Fischbach K.F., Dittrich A.P.M. The optic lobe of Drosophila melanogaster. 1. A Golgi analysis of wild-type structure. Cell Tissue Res 1989, 258:441-475.
86. Meinertzhagen I.A., Takemura S.Y., Lu Z., Huang S., Gao S., Ting C.Y., Lee C.H. From form to function: the ways to know a neuron. J Neurogenet 2009, 23:68-77.