Large-scale automatic reconstruction of neuronal processes from electron microscopy images

Medical Image Analysis

Volumn 22, Issue 1, 2015, Pages 77-88

  Kaynig, Verena ^a   Vazquez Reina, Amelio ^a,b   Knowles Barley, Seymour ^c   Roberts, Mike ^a   Jones, Thouis R ^a,c   Kasthuri, Narayanan ^c   Miller, Eric ^b   Lichtman, Jeff ^c   Pfister, Hanspeter ^a  

^a HARVARD UNIVERSITY   (United States)

^b Tufts University   (United States)

^c HARVARD UNIVERSITY   (United States)

Author keywords

Large scale neuron reconstruction; Proofreading; Random forest; Segmentation fusion; Serial section electron microscopy

Indexed keywords

AUTOMATION; DECISION TREES; ELECTRON MICROSCOPES; ELECTRON MICROSCOPY; ELECTRONS; IMAGE SEGMENTATION; NEURONS;

AUTOMATIC RECONSTRUCTION; CONDITIONAL RANDOM FIELD; ELECTRON MICROSCOPY IMAGES; NEURON RECONSTRUCTION; PROOFREADING; RANDOM FOREST CLASSIFIER; RANDOM FORESTS; SERIAL SECTION;

IMAGE PROCESSING;

ARTICLE; AUTOMATION; BRAIN SIZE; BRAIN TISSUE; CELL ORGANELLE; CELL STRUCTURE; CLASSIFIER; CONCEPTUAL FRAMEWORK; ELECTRON MICROSCOPY; GEOMETRY; HUMAN; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE RECONSTRUCTION; LARGE SCALE PRODUCTION; NERVE CELL; NONHUMAN; PRIORITY JOURNAL; QUALITATIVE ANALYSIS; QUANTITATIVE ANALYSIS; RANDOM FOREST; THREE DIMENSIONAL IMAGING; ALGORITHM; AUTOMATED PATTERN RECOGNITION; BRAIN; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; MACHINE LEARNING; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; ULTRASTRUCTURE;

ALGORITHMS; BRAIN; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MACHINE LEARNING; MICROSCOPY, ELECTRON; NEURONS; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 84924939729     PISSN: 13618415     EISSN: 13618423     Source Type: Journal    
DOI: 10.1016/j.media.2015.02.001     Document Type: Article

References (53)

1. Andres B., Koethe U., Helmstaedter M., Denk W., Hamprecht F.A. Segmentation of sbfsem volume data of neural tissue by hierarchical classification. Pattern Recognition 2008, vol. D:142-152. Springer.
2. Andres B., Koethe U., Kroeger T., Helmstaedter M., Briggman K.L., Denk W., Hamprecht F.A. 3d segmentation of sbfsem images of neuropil by a graphical model over supervoxel boundaries. Med. Image Anal. 2012, 16(4):796-805.
3. Andres, B., Kröger, T., Briggman, K.L., Denk, W., Korogod, N., Knott, G., Köthe, U., Hamprecht, F.A., 2012b. Globally optimal closed-surface segmentation for connectomics. In: ECCV, pp. 778-791.
4. Arbeláez P., Maire M., Fowlkes C., Malik J. Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Machine Intell. 2011, 33(5):898-916.
5. Bock D., Lee W., Kerlin A., Andermann M., Hood G., Wetzel A., Yurgenson S., Soucy E., Kim H., Reid R. Network anatomy and in vivo physiology of visual cortical neurons. Nature 2011, 471(7337):177-182.
6. Boykov Y., Funka-Lea G. Graph cuts and efficient n-d image segmentation. Int. J. Comput. Vis. 2006, 70(2):109-131.
7. Boykov Y., Kolmogorov V. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. 2004, 26(9):1124-1137.
8. Breiman L. Random forests. Mach. Learn. 2001, 45(1):5-32.
9. Briggman K.L., Bock D.D. Volume electron microscopy for neuronal circuit reconstruction. Current Opinion Neurobiol. 2012, 22(1):154-161.
10. Cardona A., Saalfeld S., Preibisch S., Schmid B., Cheng A., Pulokas J., Tomancak P., Hartenstein V. An integrated micro- and macroarchitectural analysis of the drosophila brain by computer-assisted serial section electron microscopy. PLoS Biol. 2010, 8(10).
11. Chen, C., Liaw, A., Breiman, L., July 2004. Using random forest to learn imbalanced data. Technical report, Department of Statistics, University of California, Berkeley.
12. Chklovskii D.B., Vitaladevuni S., Scheffer L.K. Semi-automated reconstruction of neural circuits using electron microscopy. Current Opinion Neurobiol. 2010, 20(5):667-675.
13. daCosta N.M., Martin K.A.C. How thalamus connects to spiny stellate cells in the cat's visual cortex. J. Neurosci: Official J. Soc. Neurosci. 2011, 31(8):2925-2937.
14. Denk W., Horstmann H. Serial block-face scanning electron microscopy to reconstruct three-dimensional tissue nanostructure. PLoS Biol. 2004, 2(11):e329.
15. Denk W., Briggman K.L., Helmstaedter M. Structural neurobiology: missing link to a mechanistic understanding of neural computation. Nature Rev. Neurosci. 2012, 13:351-358.
16. Fiala J.C. Reconstruct: a free editor for serial section microscopy. J. Microsc. 2005, 218(Pt 1):52-61.
17. Funke, J., Andres, B., Hamprecht, F.A., 2012. Efficient automatic 3D-reconstruction of branching neurons from EM data. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1004-1011.
18. Giuly R.J., Martone M.E., Ellisman M.H. Method: automatic segmentation of mitochondria utilizing patch classification, contour pair classification, and automatically seeded level sets. BMC Bioinform. 2012, 13(1):29.
19. Hayworth K.J., Kasthuri N., Schalek R., Lichtman J.W. Automating the collection of ultrathin serial sections for large volume tem reconstructions. Microsc. Microanal. 2006, 12(S02):86-87.
20. Helmstaedter M., Mitra P.P. Computational methods and challenges for large-scale circuit mapping. Current Opinion Neurobiol. 2012, 22(1):162-169.
21. Helmstaedter M., Briggman K.L., Denk W. High-accuracy neurite reconstruction for high-throughput neuroanatomy. Nature Neurosci. 2011, 14(8):1081-1088.
22. Hu T., Nunez-Iglesias J., Vitaladevuni S., Scheffer L., Xu S., Bolorizadeh M., Hess H., Fetter R., Chklovskii D. Electron microscopy reconstruction of brain structure using sparse representations over learned dictionaries. IEEE Trans. Med. Imaging 2013, 32(12):2179-2188.
23. IBM, 2014. Ilog cplex optimizer. http://www-01.ibm.com/software/integration/optimization/cplex-optimizer/.
24. Jain, V., Murray, J.F., Roth, F., Turaga, S., Zhigulin, V., Briggman, K.L., Helmstaedter, M.N., Denk, W., Seung, H.S., 2007. Supervised learning of image restoration with convolutional networks. In: 2007 IEEE 11th International Conference on Computer Vision. IEEE, pp. 1-8.
25. Jurrus, E., Whitaker, R., Jones, B.W., Marc, R., Tasdizen, T., May 2008. An optimal-path approach for neural circuit reconstruction. In: Proceedings/IEEE International Symposium on Biomedical Imaging: from nano to macro 2008 (4541320), pp. 1609-1612.
26. Jurrus E., Paiva A.R.C., Watanabe S., Anderson J.R., Jones W., Whitaker R.T., Jorgensen E.M., Marc R.E. Detection of neuron membranes in electron microscopy images using a serial neural network architecture. Med. Image Anal. 2010, 14(6):770-783.
27. Kaynig, V., Fuchs, T., Buhmann, J.M., 2010a. Neuron geometry extraction by perceptual grouping in sstem images. In: IEEE Conference on Computer Vision and Pattern Recognition 0, pp. 2902-2909.
28. Kaynig V., Fuchs T.J., Buhmann J.M. Geometrical consistent 3d tracing of neuronal processes in sstem data. Med. Image Comput. Comput.-Assist. Intervent. 2010, 13(Pt 2):209-216.
29. Knott G., Marchman H., Wall D., Lich B. Serial section scanning electron microscopy of adult brain tissue using focused ion beam milling. J. Neurosci. 2008, 28(12):2959-2964.
30. Knowles-Barley S., Butcher N.J., Meinertzhagen I.a., Armstrong J.D. Biologically inspired em image alignment and neural reconstruction. Bioinformatics 2011, 27(16):2216-2223.
31. Kolmogorov V., Zabin R. What energy functions can be minimized via graph cuts?. IEEE Trans. Pattern Anal. 2004, 26(2):147-159.
32. Kuwajima M., Mendenhall J.M., Lindsey L.F., Harris K.M. Automated transmission-mode scanning electron microscopy (tSEM) for large volume analysis at nanoscale resolution. PloS One 2013, 8(3):e59573. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3608656&tool=pmcentrez&rendertype=abstract
33. Kuwajima M., Spacek J., Harris K.M. Beyond counts and shapes: studying pathology of dendritic spines in the context of the surrounding neuropil through serial section electron microscopy. Neuroscience 2013, 251:75-89.
34. Lee W.-C.A., Reid R.C. Specificity and randomness: structure-function relationships in neural circuits. Current Opinion Neurobiol. 2011, 21(5):801-807.
35. Lichtman J.W., Sanes J.R. Ome sweet ome: what can the genome tell us about the connectome?. Current Opinion Neurobiol. 2008, 18(3):346-353.
36. Lucchi A., Smith K., Achanta R., Knott G., Fua P. Supervoxel-based segmentation of mitochondria in em image stacks with learned shape features. IEEE Trans. Med. Imaging 2012, 31(2):474-486.
37. Marc R.E., Jones B.W., Watt C.B., Anderson J.R., Sigulinsky C., Lauritzen S. Retinal connectomics: towards complete, accurate networks. Prog. Retinal Eye Res. 2013, 37:141-162.
38. Meila M. Comparing clusterings - an information based distance. J. Multivariate Anal. 2007, 98(5):873-895.
39. Mishchenko Y. Automation of 3d reconstruction of neural tissue from large volume of conventional serial section transmission electron micrographs. J. Neurosci. Methods 2009, 176:276-289.
40. Nunez-Iglesias J., Kennedyand R., Paragand T., Shi J., Chklovskii D.B. Machine learning of hierarchical clustering to segment 2d and 3d images. PLoS ONE 2013, 8(8):e71715.
41. Penzes P., Cahill M.E., Jones K.A., VanLeeuwen J.-E., Woolfrey K.M. Dendritic spine pathology in neuropsychiatric disorders. Nature Neurosci. 2011, 14(3):285-293. http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3530413&tool=pmcentrez&rendertype=abstract.
42. Roberts, M., Jeong, W.-K., Vázquez-Reina, A., Unger, M., Bischof, H., Lichtman, J., Pfister, H., 2011. Neural process reconstruction from sparse user scribbles. In: Medical Image Computing and Computer Assisted Intervention (MICCAI '11), pp. 621-628.
43. Saalfeld S., Fetter R., Cardona A., Tomancak P. Elastic volume reconstruction from series of ultra-thin microscopy sections. Nature Methods 2012, 9(7):717-720.
44. Seung H.S. Reading the book of memory: sparse sampling versus dense mapping of connectomes. Neuron 2009, 62(1):17-29.
45. Seung S. Connectome: How the Brain's Wiring Makes Us Who We Are 2012, Houghton, Mifflin Harcourt.
46. Sommer C., Straehle C., Ullrich K., Hamprecht F.A. Ilastik: interactive learning and segmentation toolkit. IEEE Int. Symp. Biomed. Imaging 2011, 230-233.
47. Straehle C.N., Köthe U., Knott G., Hamprecht F.A. Carving: scalable interactive segmentation of neural volume electron microscopy images. Int. Conf. Med. Image Comput. Comput.-Assist. Intervent. 2011, 14(Pt 1):653-660.
48. Turaga S.C., Murray J.F., Jain V., Roth F., Helmstaedter M., Briggman K., Denk W., Seung H.S. Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comput. 2010, 22(2):511-538.
49. Valiant L.G. A quantitative theory of neural computation. Biol. Cybernet. 2006, 95(3):205-211.
50. Vazquez-Reina A., Miller E., Pfister H. Multiphase geometric couplings for the segmentation of neural processes. Conference on Computer Vision and Pattern Recognition 2009, 2020-2027. IEEE.
51. Vazquez-Reina A., Huang D., Gelbart M., Lichtman J., Miller E., Pfister H. Segmentation fusion for connectomics. Int. Conf. Comput. Vis. 2011, 177-184.
52. Vitaladevuni S.N., Basri R. Co-clustering of image segments using convex optimization applied to em neuronal reconstruction. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2010, 2203-2210. IEEE.
53. Wang, C.-W., Ka, S.-M., Chen, A., January 2014. Robust image registration of biological microscopic images. Scientific reports 4, 6050.