Quantum-chemical insights from deep tensor neural networks

Nature Communications

Volumn 8, Issue , 2017, Pages

  Schütt, Kristof T ^a   Arbabzadah, Farhad ^a   Chmiela, Stefan ^a   Müller, Klaus R ^a,b   Tkatchenko, Alexandre ^c,d  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^b Korea University   (South Korea)

^c FRITZ HABER INSTITUT DER MAX PLANCK GESELLSCHAFT   (Germany)

^d UNIVERSITY OF LUXEMBOURG   (Luxembourg)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BIOINFORMATICS; CHEMICAL ANALYSIS; MACHINE LEARNING; MOLECULAR ANALYSIS; NUMERICAL MODEL; QUANTUM MECHANICS;

CHEMISTRY; CLASSIFICATION; ISOMER; MACHINE LEARNING; MODEL; NERVOUS SYSTEM; PREDICTION;

EID: 85009110385     PISSN: None     EISSN: 20411723     Source Type: Journal    
DOI: 10.1038/ncomms13890     Document Type: Article

References (54)

1. Kang, B., & Ceder, G. Battery materials for ultrafast charging and discharging. Nature 458, 190-193 (2009).
2. Nørskov, J. K., Bligaard, T., Rossmeisl, J., & Christensen, C. H. Towards the computational design of solid catalysts. Nat. Chem. 1, 37-46 (2009).
3. Hachmann, J., et al. The Harvard clean energy project: large-scale computational screening and design of organic photo-voltaics on the world community grid. J. Phys. Chem. Lett. 2, 2241-2251 (2011).
4. Pyzer-Knapp, E. O., Suh, C., Gomez-Bombarelli, R., Aguilera-Iparraguirre, J., & Aspuru-Guzik, A. What is high-Throughput virtual screening? A perspective from organic materials discovery. Annu. Rev. Mater. Res. 45, 195-216 (2015).
5. Curtarolo, S., et al. The high-Throughput highway to computational materials design. Nat. Mater. 12, 191-201 (2013).
6. Snyder, J. C., Rupp, M., Hansen, K., Müller, K.-R., & Burke, K. Finding density functionals with machine learning. Phys. Rev. Lett. 108, 253002 (2012).
7. Rupp, M., Tkatchenko, A., Muller, K.-R., & Von Lilienfeld, O. A. Fast and accurate modeling of molecular atomization energies with machine learning. Phys. Rev. Lett. 108, 058301 (2012).
8. Ramakrishnan, R., Dral, P. O., Rupp, M., & von Lilienfeld, O. A. Big data meets quantum chemistry approximations: the D-machine learning approach. J. Chem. Theory Comput. 11, 2087-2096 (2015).
9. Bishop, C. M. Pattern Recognition and Machine Learning (Springer, 2006).
10. Ghiringhelli, L. M., Vybiral, J., Levchenko, S. V., Draxl, C., & Scheffler, M. Big data of materials science: critical role of the descriptor. Phys. Rev. Lett. 114, 105503 (2015).
11. Schütt, K., et al. How to represent crystal structures for machine learning: towards fast prediction of electronic properties. Phys. Rev. B 89, 205118 (2014).
12. Montavon, G., et al. Machine learning of molecular electronic properties in chemical compound space. New J. Phys. 15, 095003 (2013).
13. Hansen, K., et al. Assessment and validation of machine learning methods for predicting molecular atomization energies. J. Chem. Theory Comput. 9, 3404-3419 (2013).
14. Hirn, M., Poilvert, N., & Mallat, S. Quantum energy regression using scattering transforms. Preprint at https://arxiv.org/abs/1502.02077 (2015).
15. Hansen, K., et al. Machine learning predictions of molecular properties: accurate many-body potentials and nonlocality in chemical space. J. Phys. Chem. Lett. 6, 2326 (2015).
16. Bartók, A. P., Kondor, R., & Csanyi, G. On representing chemical environments. Phys. Rev. B 87, 184115 (2013).
17. Bartók, A. P., Payne, M. C., Kondor, R., & Csanyi, G. Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. Phys. Rev. Lett. 104, 136403 (2010).
18. Behler, J. Atom-centered symmetry functions for constructing highdimensional neural network potentials. J. Chem. Phys. 134, 074106 (2011).
19. Behler, J. Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations. Phys. Chem. Chem. Phys. 13, 17930-17955 (2011).
20. LeCun, Y., Bengio, Y., & Hinton, G. Deep learning. Nature 521, 436-444 (2015).
21. Montavon, G., Braun, M. L., & Müller, K.-R. Kernel analysis of deep networks. J. Mach. Learn. Res. 12, 2563-2581 (2011).
22. Ciresan, D., Meier, U., & Schmidhuber, J. Multi-column deep neural networks for image classification. In Proc. Conference on Computer Vision and Pattern Recognition. 3642-3649 (2012).
23. Krizhevsky, A., Sutskever, I., & Hinton, G. E. ImageNet classification with deep convolutional neural networks. In Proc. Advances in Neural Information Processing Systems. 25, 1097-1105 (2012).
24. LeCun, Y., & Bengio, Y. in The Handbook of Brain Theory and Neural Networks (ed. Arbib M.A.) 255-257 (The MIT Press, Cambridge, MA, USA, 1995).
25. Hinton, G., et al. Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process. Mag. 29, 82-97 (2012).
26. Sainath, T. N., et al. Deep convolutional neural networks for large-scale speech tasks. Neural Netw. 64, 39-48 (2015).
27. Collobert, R., & Weston, J. A unified architecture for natural language processing: deep neural networks with multitask learning. In Proc. 25th International Conference on Machine Learning. 160-167 (2008).
28. Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Mon-fardini, G. The graph neural network model. IEEE Trans. Neural Netw. 20, 61-80 (2009).
29. Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., & Mon-fardini, G. The graph neural network model. IEEE Trans. Neural Netw. 20, 61-80 (2009).
30. Duvenaud, D. K., et al. Convolutional networks on graphs for learning molecular fingerprints. In Proc. Advances in Neural Information Processing Systems. 28, 2224-2232 (2015).
31. Socher, R., et al. Recursive deep models for semantic compositionality over a sentiment treebank. In Proc. of the conference on empirical methods in natural language processing (EMNLP) 1631-1642 (2013).
32. Sutskever, I., Martens, J., & Hinton, G. E. Generating text with recurrent neural networks. Proc. 28th Annu. Int. Conf. Mach. Learn. 1017-1024 (2011).
33. Socher, R., Chen, D., Manning, C. D., & Ng, A. Reasoning with neural tensor networks for knowledge base completion. In Proc. Advances in Neural Information Processing Systems. 26, 926-934 (2013).
34. Taylor, G. W., & Hinton, G. E. Factored conditional restricted Boltzmann machines for modeling motion style. In Proc. 26th Annual International Conference on Machine Learning. 1025-1032 (2009).
35. Blum, L. C., & Reymond, J.-L. 970 Million Druglike Small Molecules for Virtual Screening in the Chemical Universe Database GDB-13. J. Am. Chem. Soc. 131, 8732 (2009).
36. Reymond, J.-L. The chemical space project. Acc. Chem. Res. 48, 722-730 (2015).
37. Ramakrishnan, R., Dral, P. O., Rupp, M., & von Lilienfeld, O. A. Quantum chemistry structures and properties of 134 kilo molecules. Sci. Data 1, 140022 (2014).
38. von Lilienfeld, O. A. First principles view on chemical compound space: gaining rigorous atomistic control of molecular properties. Int. J. Quantum Chem. 113, 1676-1689 (2013).
39. De, S., Bartok, A. P., Csanyi, G., & Ceriotti, M. Comparing molecules and solids across structural and alchemical space. Phys. Chem. Chem. Phys. 18, 13754-13769 (2016).
40. Malshe, M., et al. Development of generalized potential-energy surfaces using many-body expansions, neural networks, and moiety energy approximations. J. Chem. Phys. 130, 184102 (2009).
41. Manzhos, S., & Carrington, Jr. T. A random-sampling high dimensional model representation neural network for building potential energy surfaces. J. Chem. Phys. 125, 084109 (2006).
42. Manzhos, S., & Carrington, Jr. T. Using neural networks, optimized coordinates, and high-dimensional model representations to obtain a vinyl bromide potential surface. J. Chem. Phys. 129, 224104 (2008).
43. Behler, J., & Parrinello, M. Generalized neural-network representation of high-dimensional potential-energy surfaces. Phys. Rev. Lett. 98, 146401 (2007
44. Hohenberg, P., & Kohn, W. Inhomogeneous electron gas. Phys. Rev. 136, B864-B871 (1964).
45. Perdew, J. P., Ernzerhof, M., & Burke, K. Rationale for mixing exact exchange with density functional approximations. J. Chem. Phys. 105, 9982-9985 (1996).
46. Becke, A. D. Density-functional exchange-energy approximation with correct asymptotic behavior. Phys. Rev. A 38, 3098-3100 (1988).
47. Lee, C., Yang, W., & Parr, R. G. Development of the Colle-Salvetti correlationenergy formula into a functional ofthe electron density. Phys. Rev. B 37, 785-789 (1988).
48. Vosko, S. H., Wilk, L., & Nusair, M. Accurate spin-dependent electron liquid correlation energies for local spin density calculations: a critical analysis. Can. J. Phys. 58, 1200-1211 (1980).
49. Stephens, P., Devlin, F., Chabalowski, C., & Frisch, M. J. Ab initio calculation of vibrational absorption and circular dichro-ism spectra using density functional force fields. J. Phys. Chem. 98, 11623-11627 (1994).
50. Becke, A. d. Beckes 3 parameter functional combined with the non-local correlation LYP. J. Chem. Phys. 98, 5648 (1993).
51. Perdew, J. P., Burke, K., & Ernzerhof, M. Generalized gradient approximation made simple. Phys. Rev. Lett. 77, 3865-3868 (1996).
52. Glorot, X., & Bengio, Y. Understanding the difficulty of training deep feedforward neural networks. In Proc. 13th International Conference on Artificial Intelligence and Statistics. 249-256 (2010).
53. LeCun, Y. A., Bottou, L., Orr, G. B., & Müller, K.-R. in Neural Networks: Tricks of the Trade 9-48 (Springer, 2012).
54. Ramachandran, P., & Varoquaux, G. Mayavi: 3D visualization of scientific data. Comput. Sci. Eng. 13, 40-51 (2011).