DeepPicker: A deep learning approach for fully automated particle picking in cryo-EM

Journal of Structural Biology

Volumn 195, Issue 3, 2016, Pages 325-336

  Wang, Feng ^b   Gong, Huichao ^a   Liu, Gaochao ^a   Li, Meijing ^a   Yan, Chuangye ^a   Xia, Tian ^b   Li, Xueming ^a   Zeng, Jianyang ^a  

^a TSINGHUA UNIVERSITY   (China)

^b HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Automation; Cryo EM; Deep learning; Particle picking

Indexed keywords

ANALYSIS; ANALYTICAL PARAMETERS; ARTICLE; AUTOMATION; CONTROLLED STUDY; CRYOELECTRON MICROSCOPY; INTERMETHOD COMPARISON; MACHINE LEARNING; PARTICLE PICKING; PRIORITY JOURNAL; SINGLE PARTICLE ANALYSIS; SOFTWARE; ALGORITHM; CHEMISTRY; MOLECULAR MODEL; PROCEDURES; STATISTICAL ANALYSIS; THREE DIMENSIONAL IMAGING; ULTRASTRUCTURE;

SECRETASE; VANILLOID RECEPTOR;

ALGORITHMS; AMYLOID PRECURSOR PROTEIN SECRETASES; CRYOELECTRON MICROSCOPY; DATA INTERPRETATION, STATISTICAL; IMAGING, THREE-DIMENSIONAL; MACHINE LEARNING; MODELS, MOLECULAR; SOFTWARE; TRPV CATION CHANNELS;

EID: 84991394143     PISSN: 10478477     EISSN: 10958657     Source Type: Journal    
DOI: 10.1016/j.jsb.2016.07.006     Document Type: Article

References (60)

1. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., Levenberg, J., Mané, D., Monga, R., Moore, S., Murray, D., Olah, C., Schuster, M., Shlens, J., Steiner, B., Sutskever, I., Talwar, K., Tucker, P., Vanhoucke, V., Vasudevan, V., Viégas, F., Vinyals, O., Warden, P., Wattenberg, M., Wicke, M., Yu, Y., Zheng, X., 2015. TensorFlow: Large-scale machine learning on heterogeneous systems, software available from tensorflow.org. URL http://tensorflow.org/.
2. Adiga, P.U., Malladi, R., Baxter, W., Glaeser, R.M., A binary segmentation approach for boxing ribosome particles in cryo EM micrographs. J. Struct. Biol. 145:12 (2004), 142–151, 10.1016/j.jsb.2003.10.026.
3. Arbelez, P., Han, B.-G., Typke, D., Lim, J., Glaeser, R.M., Malik, J., Experimental evaluation of support vector machine-based and correlation-based approaches to automatic particle selection. J. Struct. Biol. 175:3 (2011), 319–328, 10.1016/j.jsb.2011.05.017.
4. Bai, X., McMullan, G., Scheres, S.H., How cryo-EM is revolutionizing structural biology. Trends Biochem. Sci. 40:1 (2015), 49–57, 10.1016/j.tibs.2014.10.005.
5. Bartesaghi, A., Matthies, D., Banerjee, S., Merk, A., Subramaniam, S., Structure of β-galactosidase at 3.2-Å resolution obtained by cryo-electron microscopy. Proc. Nat. Acad. Sci. 111:32 (2014), 11709–11714, 10.1073/pnas.1402809111.
6. Bishop, C.M., Pattern Recognition and Machine Learning (Information Science and Statistics). 2006, Springer-Verlag New York, Inc., Secaucus, NJ, USA.
7. Bottou, L., Large-scale machine learning with stochastic gradient descent. Lechevallier, Y., Saporta, G., (eds.) Proceedings of COMPSTAT’2010, 2010, Physica-Verlag HD, 177–186, 10.1007/978-3-7908-2604-3_16.
8. Canny, J., A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. PAMI-8(6), 1986, 679–698, 10.1109/TPAMI.1986.4767851.
9. Chen, J.Z., Grigorieff, N., SIGNATURE: A single-particle selection system for molecular electron microscopy. J. Struct. Biol. 157:1 (2007), 168–173, 10.1016/j.jsb.2006.06.001.
10. Cheng, Y., Single-particle cryo-EM at crystallographic resolution. Cell 161:3 (2015), 450–457, 10.1016/j.cell.2015.03.049.
11. Cheng, Y., Grigorieff, N., Penczek, P.A., Walz, T., A primer to single-particle cryo-electron microscopy. Cell 161:3 (2015), 438–449, 10.1016/j.cell.2015.03.050.
12. Cheng, M.-M., Mitra, N.J., Huang, X., Torr, P.H.S., Hu, S.-M., Zhang, G.-X., Mitra, N.J., Huang, X., Hu, S.-M., Torr, P.H.S., Hu, S.-M., Zhang, G.-X., Mitra, N.J., Huang, X., Hu, S.-M., Global contrast based salient region detection. IEEE Trans. Pattern Anal. Mach. Intell. 37:XX (2015), 569–582, 10.1109/TPAMI.2014.2345401 URL http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6871397.
13. Cun, Y.L., Boser, B., Denker, J.S., Howard, R.E., Habbard, W., Jackel, L.D., Henderson, D., Advances in Neural Information Processing Systems, vol. 2, 1990, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA Ch. Handwritten Digit Recognition with a Back-propagation Network, pp. 396–404.
14. Farabet, C., Couprie, C., Najman, L., LeCun, Y., Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35:8 (2013), 1915–1929, 10.1109/TPAMI.2012.231.
15. Goldberg, Y., 2015. A primer on neural network models for natural language processing, CoRR abs/1510.00726.
16. Grigorieff, N., FREALIGN: High-resolution refinement of single particle structures. J. Struct. Biol. 157:1 (2007), 117–125, 10.1016/j.jsb.2006.05.004.
17. Hall, R.J., Patwardhan, A., A two step approach for semi-automated particle selection from low contrast cryo-electron micrographs. J. Struct. Biol. 145:12 (2004), 19–28, 10.1016/j.jsb.2003.10.024.
18. Henderson, R., Avoiding the pitfalls of single particle cryo-electron microscopy: Einstein from noise. Proc. Nat. Acad. Sci. 110:45 (2013), 18037–18041, 10.1073/pnas.1314449110.
19. Hinton, G., Deng, L., Yu, D., Dahl, G.E., Mohamed, A.-r., Jaitly, N., Senior, A., Vanhoucke, V., Nguyen, P., Sainath, T.N., Kingsbury, B., Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. Signal Process. Mag., IEEE 29:6 (2012), 82–97, 10.1109/msp.2012.2205597.
20. Huang, Z., Penczek, P.A., Application of template matching technique to particle detection in electron micrographs. J. Struct. Biol. 145:12 (2004), 29–40, 10.1016/j.jsb.2003.11.004.
21. Jarrett, K., Kavukcuoglu, K., Ranzato, M., LeCun, Y., What is the best multi-stage architecture for object recognition?. Proceedings of the IEEE International Conference on Computer Vision, 2009, 2146–2153, 10.1109/ICCV.2009.5459469.
22. Krizhevsky, A., Sutskever, I., Hinton, G.E., ImageNet classification with deep convolutional neural networks. Pereira, F., Burges, C., Bottou, L., Weinberger, K., (eds.) Advances in Neural Information Processing Systems, vol. 25, 2012, Curran Associates, Inc., 1097–1105.
23. Langlois, R., Pallesen, J., Frank, J., Reference-free particle selection enhanced with semi-supervised machine learning for cryo-electron microscopy. J. Struct. Biol. 175:3 (2011), 353–361, 10.1016/j.jsb.2011.06.004.
24. Langlois, R., Pallesen, J., Ash, J.T., Ho, D.N., Rubinstein, J.L., Frank, J., Automated particle picking for low-contrast macromolecules in cryo-electron microscopy. J. Struct. Biol. 186:1 (2014), 1–7, 10.1016/j.jsb.2014.03.001.
25. Lawrence, S., Giles, C.L., Tsoi, A.C., Back, A.D., Face recognition: A convolutional neural network approach. IEEE Trans. Neural Networks 8 (1997), 98–113, 10.1109/72.554195.
26. Lecun, Y., Bottou, L., Bengio, Y., Haffner, P., Gradient-based learning applied to document recognition. Proc. IEEE, 1998, 2278–2324.
27. LeCun, Y., Bengio, Y., Hinton, G., Deep learning. Nature 521 (2015), 436–444, 10.1038/nature14539.
28. Liao, M., Cao, E., Julius, D., Cheng, Y., Structure of the TRPV1 ion channel determined by electron cryo-microscopy. Nature, 504(7478), 2013, 107 112, 10.1038/nature12822.
29. Li, X., Mooney, P., Zheng, S., Booth, C.R., Braunfeld, M.B., Gubbens, S., Agard, D.A., Cheng, Y., Electron counting and beam-induced motion correction enable near-atomic-resolution single-particle cryo-EM. Nat. Meth. 10:6 (2013), 584–590, 10.1038/nmeth.2472.
30. Ma, J., Sheridan, R.P., Liaw, A., Dahl, G.E., Svetnik, V., Deep neural nets as a method for quantitative structure activity relationships. J. Chem. Inf. Model. 55:2 (2015), 263–274, 10.1021/ci500747n.
31. Mikolov, T., Deoras, A., Povey, D., Burget, L., Cernocky, J., Strategies for training large scale neural network language models. Nahamoo, D., Picheny, M., (eds.) ASRU, 2011, IEEE, 196–201.
32. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., Hassabis, D., Human-level control through deep reinforcement learning. Nature 518:7540 (2015), 529–533, 10.1038/nature14236.
33. Nair, V., Hinton, G.E., Rectified linear units improve restricted boltzmann machines. Frnkranz, J., Joachims, T., (eds.) ICML, 2010, Omnipress, 807–814.
34. Nicholson, W.V., Glaeser, R.M., Review: Automatic particle detection in electron microscopy. J. Struct. Biol. 133:23 (2001), 90–101, 10.1006/jsbi.2001.4348.
35. Nogales, E., Scheres, S.H., Cryo-EM: A unique tool for the visualization of macromolecular complexity. Mol. Cell 58:4 (2015), 677–689, 10.1016/j.molcel.2015.02.019.
36. Norousi, R., Wickles, S., Leidig, C., Becker, T., Schmid, V.J., Beckmann, R., Tresch, A., Automatic post-picking using MAPPOS improves particle image detection from cryo-EM micrographs. J. Struct. Biol. 182:2 (2013), 59–66, 10.1016/j.jsb.2013.02.008.
37. Ogura, T., Sato, C., An automatic particle pickup method using a neural network applicable to low-contrast electron micrographs. J. Struct. Biol. 136:3 (2001), 227–238, 10.1006/jsbi.2002.4442 URL http://www.sciencedirect.com/science/article/pii/S1047847702944424.
38. Rohou, A., Grigorieff, N., CTFFIND4: Fast and accurate defocus estimation from electron micrographs. J. Struct. Biol. 192:2 (2015), 216–221, 10.1016/j.jsb.2015.08.008.
39. Scherer, D., Müller, A., Behnke, S., Evaluation of pooling operations in convolutional architectures for object recognition. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6354 LNCS (PART 3), 2010, 92–101, 10.1007/978-3-642-15825-4_10.
40. Scheres, S.H., RELION: Implementation of a bayesian approach to cryo-EM structure determination. J. Struct. Biol. 180:3 (2012), 519–530, 10.1016/j.jsb.2012.09.006.
41. Shatsky, M., Hall, R.J., Brenner, S.E., Glaeser, R.M., A method for the alignment of heterogeneous macromolecules from electron microscopy. J. Struct. Biol. 166:1 (2009), 67–78, 10.1016/j.jsb.2008.12.008.
42. Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., Hassabis, D., Mastering the game of Go with deep neural networks and tree search. Nature 529:7587 (2016), 484–489, 10.1038/nature16961.
43. Sorzano, C., Recarte, E., Alcorlo, M., Bilbao-Castro, J., San-Martn, C., Marabini, R., Carazo, J., Automatic particle selection from electron micrographs using machine learning techniques. J. Struct. Biol. 167:3 (2009), 252–260, 10.1016/j.jsb.2009.06.011.
44. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R., Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15:1 (2014), 1929–1958.
45. Subramaniam, S., Structure of trimeric HIV-1 envelope glycoproteins. Proc. Nat. Acad. Sci. 110:45 (2013), E4172–E4174, 10.1073/pnas.1313802110.
46. Sun, L., Zhao, L., Yang, G., Yan, C., Zhou, R., Zhou, X., Xie, T., Zhao, Y., Wu, S., Li, X., Shi, Y., Structural basis of human γ-secretase assembly. Proc. Nat. Acad. Sci. USA 112:19 (2015), 6003–6008, 10.1073/pnas.1506242112.
47. Sutskever, I., Vinyals, O., Le, Q.V., 2014. Sequence to sequence learning with neural networks, CoRR abs/1409.3215.
48. Tompson, J.J., Jain, A., Lecun, Y., Bregler, C., Joint training of a convolutional network and a graphical model for human pose estimation. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N., Weinberger, K., (eds.) Advances in Neural Information Processing Systems, vol. 27, 2014, Curran Associates, Inc., 1799–1807.
49. van Heel, M., Finding trimeric HIV-1 envelope glycoproteins in random noise. Proc. Nat. Acad. Sci. USA 110:45 (2013), E4175–E4177, 10.1073/pnas.1314353110.
50. Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A., Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11:3 (2010), 3371–3408, 10.1111/1467-8535.00290 arXiv:0-387-31073-8.
51. Voss, N., Yoshioka, C., Radermacher, M., Potter, C., Carragher, B., DoG picker and TiltPicker: Software tools to facilitate particle selection in single particle electron microscopy. J. Struct. Biol. 166:2 (2009), 205–213, 10.1016/j.jsb.2009.01.004.
52. Wu, J., Yan, Z., Li, Z., Yan, C., Lu, S., Dong, M., Yan, N., Structure of the voltage-gated calcium channel Cav1.1 complex. Science, 350(5), 2015, aad2395, 10.1126/science.aad2395.
53. Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., Bengio, Y., Show, attend and tell: Neural image caption generation with visual attention. Blei, D., Bach, F., (eds.) Proceedings of the 32nd International Conference on Machine Learning (ICML-15), JMLR Workshop and Conference Proceedings, 2015, 2048–2057.
54. Yan, C., Hang, J., Wan, R., Huang, M., Wong, C.C.L., Shi, Y., Structure of a yeast spliceosome at 3.6-angstrom resolution. Science 349:6253 (2015), 1182–1191, 10.1126/science.aac7629.
55. Zeiler, M.D., Fergus, R., 2013. Visualizing and understanding convolutional networks, CoRR abs/1311.2901.
56. Zhao, J., Brubaker, M.A., Rubinstein, J.L., TMaCS: A hybrid template matching and classification system for partially-automated particle selection. J. Struct. Biol. 181:3 (2013), 234–242, 10.1016/j.jsb.2012.12.010.
57. Zhao, M., Wu, S., Zhou, Q., Vivona, S., Cipriano, D.J., Cheng, Y., Brunger, A.T., Mechanistic insights into the recycling machine of the SNARE complex. Nature 518:7537 (2015), 61–67, 10.1038/nature14148.
58. Zhao, J., Benlekbir, S., Rubinstein, J.L., Electron cryomicroscopy observation of rotational states in a eukaryotic V-ATPase. Nature 521:5 (2015), 241–245, 10.1038/nature14365.
59. Zhou, J., Troyanskaya, O.G., Predicting effects of noncoding variants with deep learning-based sequence model. Nat. Meth. 12:10 (2015), 931–934, 10.1038/nmeth.3547.
60. Zhu, Y., Carragher, B., Glaeser, R.M., Fellmann, D., Bajaj, C., Bern, M., Mouche, F., de Haas, F., Hall, R.J., Kriegman, D.J., Ludtke, S.J., Mallick, S.P., Penczek, P.A., Roseman, A.M., Sigworth, F.J., Volkmann, N., Potter, C.S., Automatic particle selection: results of a comparative study. J. Struct. Biol. 145:12 (2004), 3–14, 10.1016/j.jsb.2003.09.033.