ConnectomeExplorer: Query-guided visual analysis of large volumetric neuroscience data

IEEE Transactions on Visualization and Computer Graphics

Volumn 19, Issue 12, 2013, Pages 2868-2877

  Beyer, Johanna ^a   Al Awami, Ali ^a   Kasthuri, Narayanan ^b   Lichtman, Jeff W ^b   Pfister, Hanspeter ^b   Hadwiger, Markus ^a  

^a KING ABDULLAH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Saudi Arabia)

^b HARVARD UNIVERSITY   (United States)

Author keywords

Connectomics; neuroscience; petascale volume analysis; query algebra; visual knowledge discovery

Indexed keywords

CONNECTOMICS; NEUROSCIENCE; QUERY ALGEBRAS; VISUAL KNOWLEDGE DISCOVERY; VOLUME ANALYSIS;

DATA VISUALIZATION; KNOWLEDGE BASED SYSTEMS; NEURAL NETWORKS; NEUROLOGY; VISUALIZATION;

QUERY PROCESSING;

ALGORITHM; BRAIN; COMPUTER GRAPHICS; COMPUTER INTERFACE; CONNECTOME; DATA MINING; ELECTRON MICROSCOPY; IMAGE ENHANCEMENT; MYELINATED NERVE; PROCEDURES; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING; ULTRASTRUCTURE; ARTICLE; METHODOLOGY;

ALGORITHMS; BRAIN; COMPUTER GRAPHICS; CONNECTOME; DATA MINING; IMAGE ENHANCEMENT; IMAGING, THREE-DIMENSIONAL; MICROSCOPY, ELECTRON; NERVE FIBERS, MYELINATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; USER-COMPUTER INTERFACE;

EID: 84886679567     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2013.142     Document Type: Article

References (45)

1. Eyewire. http://eyewire.org/, 2012. Accessed on 16/06/2013.
2. Rambo3d. http://openconnectome.github.io/Rambo3D/, 2012. Accessed on 16/06/2013.
3. C. Ahlberg, C. Williamson, and B. Shneiderman. Dynamic queries for information exploration: an implementation and evaluation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '92, pages 619-626, 1992. (Pubitemid 23609778)
4. J. Anderson, S. Mohammed, B. Grimm, B. Jones, P. Koshevoy, T. Tasdizen, R. Whitaker, and R. Marc. The viking viewer for connectomics: scalable multi-user annotation and summarization of large volume data sets. Journal of Microscopy, 241(1):13-28, 2011.
5. J. Beyer, M. Hadwiger, A. Al-Awami, W.-K. Jeong, N. Kasthuri, J. W. Lichtman, and H. Pfister. Exploring the connectome: Petascale volume visualization of microscopy data streams. IEEE Computer Graphics and Applications, 33(4):50-61, 2013.
6. J. Beyer, M. Hadwiger, S.Wolfsberger, and K. B̈uhler. High-quality multimodal volume rendering for preoperative planning of neurosurgical interventions. IEEE Transactions on Visualization and Computer Graphics (Proceedings IEEE Visualization 2007), 13(6):1696-1703, 2007. (Pubitemid 350076650)
7. G. Bezgin, A. T. Reid, D. Schubert, and R. K̈otter. Matching spatial with ontological brain regions using java tools for visualization, database access, and integrated data analysis. Neuroinformatics, 7(1):7-22, 2009.
8. D. Bock, W.-C. Lee, A. Kerlin, M. Andermann, G. Hood, A. Wetzel, S. Yurgenson, E. Soucy, H. S. Kim, and R. C. Reid. Network anatomy and in vivo physiology of visual cortical neurons. Nature, 471(7337):177-182, 2011.
9. S. Bruckner, V. Solt́eszov́a, M. E. Gr̈oller, J. Hlad°uvka, K. B̈uhler, J. Yu, and B. Dickson. Braingazer-visual queries for neurobiology research. IEEE Transactions on Visualization and Computer Graphics (Proceedings IEEE Visualization 2009), 15(6):1497-1504, Nov. 2009.
10. W. Cai and G. Sakas. Data intermixing and multi-volume rendering. Computer Graphics Forum, 18(3):359-368, 1999.
11. T. Catarci, M. F. Costabile, S. Levialdi, and C. Batini. Visual query systems for databases: A survey. Journal of Visual Languages and Computing, 8:215-260, 1997. (Pubitemid 127168870)
12. C. Crassin, F. Neyret, S. Lefebvre, and E. Eisemann. Gigavoxels: Rayguided streaming for efficient and detailed voxel rendering. In Proceedings Symp. on Interactive 3D Graphics and Games, pages 15-22, 2009.
13. W. de Leeuw, P. Verschure, and R. van Liere. Visualization and analysis of large data collections: a case study applied to confocal microscopy data. IEEE Transactions on Visualization and Computer Graphics, 12(5):1251-1258, 2006. (Pubitemid 44955662)
14. M. Derthick, J. Kolojejchick, and S. F. Roth. An interactive visual query environment for exploring data. In Proceedings Symposium on User interface software and technology (UIST), pages 189-198, 1997.
15. E. Dyllong and C. Grimm. A modified reliable distance algorithm for octree-encoded objects. Proceedings in Applied Mathematics and Mechanics (PAMM), 7(1):4010015-4010016, 2007.
16. K. Engel. CERA-TVR: A framework for interactive high-quality teravoxel volume visualization on standard PCs. In Posters at Large-Data Analysis and Visualization (LDAV) 2011, 2011.
17. J. C. Fiala. Reconstruct: a free editor for serial section microscopy. Journal of Microscopy, 218(1):52-61, April 2005. (Pubitemid 40524168)
18. T. M. J. Fruchterman and E. M. Reingold. Graph drawing by forcedirected placement. Software: Practice and Experience, 21(11):1129-1164, Nov. 1991.
19. H. Garcia-Molina, J. D. Ullman, and J. Widom. Database systems-the complete book (2. ed.). Pearson Education, 2009.
20. S. Gerhard, A. Daducci, A. Lemkaddem, R. Meuli, J. Thiran, and P. Hagmann. The connectome viewer toolkit: an open source framework to manage, analyze, and visualize connectomes. Frontiers in Neuroinformatics, 5, 2011.
21. J. Gerken, M. Heilig, H.-C. Jetter, S. Rexhausen, M. Demarmels, W. A. Knig, and H. Reiterer. Lessons learned from the design and evaluation of visual information-seeking systems. International Journal on Digital Libraries, 10(2-3):49-66, 2009.
22. M. Hadwiger, J. Beyer, W.-K. Jeong, and H. Pfister. Interactive volume exploration of petascale microscopy data streams using a visualizationdriven virtual memory approach. IEEE Transactions on Visualization and Computer Graphics (Proceedings IEEE Scientific Visualization 2012), 18(12):2285-2294, 2012.
23. J. Heer and B. Shneiderman. Interactive dynamics for visual analysis. Queue, 10(2):30:30-30:55, Feb. 2012.
24. M. Helmsẗadter, K. L. Briggman, and W. Denk. High-accuracy neurite reconstruction for high-throughput neuroanatomy. Nature Neuroscience, 14(8):1081-1088, 2011.
25. V. Jain, B. Bollmann, M. Richardson, D. Berger, M. Helmsẗadter, K. Briggman, W. Denk, J. Bowden, J. Mendenhall, W. Abraham, K. Harris, N. Kasthuri, K. Hayworth, R. Schalek, J. Tapia, J. Lichtman, and S. Seung. Boundary learning by optimization with topological constraints. In Proceedings of IEEE CVPR 2010, pages 2488-2495, 2010.
26. W.-K. Jeong, J. Beyer, M. Hadwiger, R. Blue, C. Law, A. V́azquez-Reina, C. Reid, J. W. Lichtman, and H. Pfister. Ssecrett and neurotrace: Interactive visualization and analysis tools for large-scale neuroscience datasets. IEEE Computer Graphics and Applications, 30(3):58-70, 2010.
27. W.-K. Jeong, J. Beyer, M. Hadwiger, A. V́azquez-Reina, H. Pfister, and R. Whitaker. Scalable and interactive segmentation and visualization of neural processes in EM datasets. IEEE Trans. on Visualization and Computer Graphics (Proc. IEEE Visualization 2009), 15(6):1505-1514, 2009.
28. V. Kaynig, T. Fuchs, and J. Buhmann. Neuron geometry extraction by perceptual grouping in sstem images. In Proceedings of IEEE CVPR 2010, pages 2902-2909, 2010.
29. V. Kaynig, A. V́azquez-Reina, S. Knowles-Barley, M. Roberts, T. Jones, N. Kasthuri, E. Miller, J. W. Lichtman, and H. Pfister. Large-scale automatic reconstruction of neuronal processes from electron microscopy images. In arXiv: 1303.7186 [q-bio.NC], 2013.
30. A. Kuß, S. Prohaska, B. Meyer, J. Rybak, and H.-C. Hege. Ontology-Based Visualization of Hierarchical Neuroanatomical Structures. In Proceedings of Visual Computing for Biomedicine, pages 177-184, 2008.
31. J. W. Lichtman and W. Denk. The big and the small: Challenges of imaging the brain's circuits. Science, 334(6056):618-623, 2011.
32. C.-Y. Lin, K.-L. Tsai, S.-C. Wang, C.-H. Hsieh, H.-M. Chang, and A.-S. Chiang. The neuron navigator: Exploring the information pathway through the neural maze. In Proceedings of the 2011 IEEE Pacific Visualization Symposium, pages 35-42, 2011.
33. Z. Liu, B. Jiang, and J. Heer. immens: Real-time visual querying of big data. Computer Graphics Forum (Proceedings Eurovis), 32, 2013.
34. A. Martin and M. Ward. High dimensional brushing for interactive exploration of multivariate data. In Proceedings IEEE Conference on Visualization 1995, pages 271-, 1995.
35. D. Mayerich and J. C. Hart. Volume visualization of serial electron microscopy images using local variance. In 2nd IEEE Symposium on Biological Data Visualization, pages 9-16, 2012.
36. D. Osumi-Sutherland, S. Reeve, C. Mungall, F. Neuhaus, A. Ruttenberg, G. Jefferis, and J. Armstrong. A strategy for building neuroanatomy ontologies. Bioinformatics, 28(9):1262-1269, 2012.
37. M. Roberts,W.-K. Jeong, A. V́azquez-Reina, M. Unger, H. Bischof, J.W. Lichtman, and H. Pfister. Neural process reconstruction from sparse user scribbles. In Proceedings of MICCAI 2011, pages 621-628, 2011.
38. S. Saalfeld, A. Cardona, V. Hartenstein, and P. Tomanćak. CATMAID: collaborative annotation toolkit for massive amounts of image data. Bioinformatics, 25(15):1984-1986, Aug. 2009.
39. S. Seung. Connectome: How the Brain's Wiring Makes Us Who We Are. Houghton Mifflin Harcourt, Feb. 2012.
40. A. Sherbondy, D. Akers, R. Mackenzie, R. Dougherty, and B. Wandell. Exploring connectivity of the brain's white matter with dynamic queries. IEEE Trans. on Vis. and Computer Graphics, 11(4):419-430, 2005.
41. B. Shneiderman. Dynamic queries for visual information seeking. IEEE Software, 11(6):70-77, 1994.
42. P. R. Smart, A. Russell, D. Braines, Y. Kalfoglou, J. Bao, and N. R. Shadbolt. A visual approach to semantic query design using a web-based graphical query designer. In Proceedings of the 16th international conference on Knowledge Engineering: Practice and Patterns, EKAW '08, pages 275-291, Berlin, Heidelberg, 2008. Springer-Verlag.
43. K. Stockinger, J. Shalf, K.Wu, and E. Bethel. Query-driven visualization of large data sets. In Proceedings IEEE Visualization 2005, pages 167-174, 2005.
44. C. Stolte and P. Hanrahan. Polaris: A system for query, analysis and visualization of multi-dimensional relational databases. IEEE Transactions on Visualization and Computer Graphics, 8:52-65, 2002. (Pubitemid 34573482)
45. Y. Wan, H. Otsuna, C.-B. Chien, and C. Hansen. An interactive visualization tool for multi-channel confocal microscopy data in neurobiology research. IEEE Transactions on Visualization and Computer Graphics, 15(6):1489-1496, 2009.