Grammar variational autoencoder

34th International Conference on Machine Learning, ICML 2017

Volumn 4, Issue , 2017, Pages 3072-3084

  Kusner, Matt J ^a,b   Paige, Brooks ^a,c   Hemández Lobato, José Miguel ^c  

^a ALAN TURING INSTITUTE   (United Kingdom)

^b UNIVERSITY OF WARWICK   (United Kingdom)

^c UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CONTEXT FREE GRAMMARS; DECODING; FORESTRY; FORMAL LANGUAGES; TREES (MATHEMATICS);

ARITHMETIC EXPRESSION; AUTO ENCODERS; BAYESIAN OPTIMIZATION; CONTINUOUS DATA; GENERATIVE MODEL; NATURAL IMAGES; STATE-OF-THE-ART METHODS; SYMBOLIC REGRESSION;

LEARNING SYSTEMS;

EID: 85035751935     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (44)

1. Allamanis, Miltiadis, Chanthirasegaran, Pankajan, Kohli, Pushmeet, and Sutton, Charles. Learning continuous semantic representations of symbolic expressions. arXiv preprint arXiv: 1611.01423, 2016.
2. Baker, James K. Trainable grammars for speech recognition. The Journal of the Acoustical Society of America, 65(S1): S132-S132, 1979.
3. Booth, Taylor L and Thompson, Richard A. Applying probability measures to abstract languages. IEEE transactions on Computers, 100(5): 442-450, 1973.
4. Bowman, Samuel R, Vilnis, Luke, Vinyals, Oriol, Dai, Andrew M, Józefowicz, Rafal, and Bengio, Samy. Generating sentences from a continuous space. CoNLL 2016, pp. 10, 2016.
5. Cho, Kyunghyun, Van Merrie'nboer, Bart, Gulcehre, Caglar, Bahdanau, Dzmitry, Bougares, Fethi, Schwenk, Holger, and Bengio, Yoshua. Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv: 1406.1078, 2014.
6. Cressie, Noel. The origins of kriging. Math. Geol, 22(3): 239-252, 1990.
7. Dyer, Chris, Kuncoro, Adhiguna, Ballesteros, Miguel, and Smith, Noah A. Recurrent neural network grammars. In Proceedings of NAACL-HLT, pp. 199-209, 2016.
8. Ertl, Peter and Schuffenhauer, Ansgar. Estimation of synthetic accessibility score of drug-like molecules based on molecular complexity and fragment contributions. Journal of cheminformatics, 1(1): 8, 2009.
9. Gatys, Leon A, Ecker, Alexander S, and Bethge, Matthias. A neural algorithm of artistic style. arXiv preprint arXiv: 1508.06576, 2015.
10. Gaunt, Alexander L, Brockschmidt, Marc, Singh, Rishabh, Kushman, Nate, Kohli, Pushmeet, Taylor, Jonathan, and Tarlow, Daniel. Terpret: A probabilistic programming language for program induction. arXiv preprint arXiv: 1608.04428, 2016.
11. Gómez-Bombarelli, Rafael, Aguilera-Iparraguirre, Jorge, Hirzel, Timothy D, Duvcnaud, David, Maclaurin, Dou-gal, Blood-Forsythe, Martin A, Chac, Hyun Sik, et al. Design of efficient molecular organic light-emitting diodes by a high-throughput virtual screening and experimental approach. Nature Materials, 15(10): 1120-1127, 2016a.
12. Gómez-Bombarelli, Rafael, Duvenaud, David, Hernândez-Lobato, José Miguel, Aguilera-Iparraguirre, Jorge, Hirzel, Timothy D, Adams, Ryan P, and Aspuru-Guzik, Alan. Automatic chemical design using a data-driven continuous representation of molecules. arXiv preprint arXiv: 1610.02415, 2016b.
13. Hachmann, J., Olivarcs-Amaya, R., Atahan-Evrcnk, S., Amador-Bcdolla, C, Sanchcz-Carrcra, R. S., Gold-Parker, A., Vogt, L., Brockway, A. M., and Aspuru-Guzik, A. The Harvard Clean Energy Project: Large-Scale Computational Screening and Design of Organic Photovoltaics on the World Community Grid. J. Phys. Chem. Lett., 2(17): 2241-2251, sep 2011.
14. Hochreiter, Sepp and Schmidhuber, Jürgen. Long short-term memory. Neural computation, 9(8): 1735-1780, 1997.
15. Hopcroft, John E, Motwani, Rajccv, and Ullman, Jeffrey D. Introduction to Automata theory, languages, and computation. 2006.
16. Irsoy, Ozan and Cardie, Claire. Deep recursive neural networks for compositionality in language. In NIPS, pp. 2096-2104, 2014.
17. James, Craig A, Vandermeersch, T, and Dalke, A. Opens-miles specification, 2015.
18. Jaques, Natasha, Gu, Shixiang, Turner, Richard E, and Eck, Douglas. Tuning recurrent neural networks with reinforcement learning. arXiv preprint arXiv: 1611.02796, 2016.
19. Johnson, Mark, Griffiths, Thomas L, Goldwater, Sharon, et al. Adaptor grammars: A framework for specifying compositional nonparametric bayesian models. Advances in neural information processing systems, 19: 641, 2007.
20. Jones, Donald R, Schonlau, Matthias, and Welch, William J. Efficient global optimization of expensive black-box functions. Journal of Global optimization, 13 (4): 455-492, 1998.
21. Kalchbrenner, Nal, Grefenstette, Edward, and Blunsom, Phil. A convolutional neural network for modelling sentences. 2014.
22. Kcrnighan, Brian W, Ritchie, Dennis M, and Ejcklint, Per. The C programming language, volume 2. Prcnticc-Hall Englcwood Cliffs, 1988.
23. Kingma, Diederik P and Welling, Max. Auto-encoding variational Bayes. In Proceedings of the International Conference on Learning Representations (ICLR), 2014.
24. Kusner, Matt J and Hemândez-Lobato, José Miguel. Gans for sequences of discrete elements with the gumbel-softmax distribution. arXiv: 1611.04051, 2016.
25. Maddison, Chris and Tarlow, Daniel. Structured generative models of natural source code. In Proceedings of the 31st International Conference on Machine Learning (ICML), pp. 649-657, 2014.
26. Paulus, Romain, Socher, Richard, and Manning, Christopher D. Global belief recursive neural networks. In Advances in Neural Information Processing Systems, pp. 2888-2896, 2014.
27. Perov, Yura and Wood, Frank. Automatic sampler discovery via probabilistic programming and approximate bayesian computation. In International Conference on Artificial General Intelligence, pp. 262-273, 2016.
28. Pyzer-Knapp, Edward O, Suh, Changwon, Gómez-Bombarelli, Rafael, Aguilera-Iparraguirre, Jorge, and Aspuru-Guzik, Alan. What is high-throughput virtual screening? a perspective from organic materials discovery. Annual Review of Materials Research, 45: 195-216, 2015.
29. Radford, Alec, Metz, Luke, and Chintala, Soumith. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv: 1511.06434, 2015.
30. Rezende, Danilo Jimenez, Mohamed, Shakir, and Wierstra, Daan. Stochastic backpropagation and approximate inference in deep generative models. arXiv preprint arXiv: 1401.4082, 2014.
31. Riedel, Sebastian, Bošnjak, Matko, and Rocktäschel, Tim. Programming with a differentiable forth interpreter. CoRR, abs/1605.06640, 2016.
32. Rupakheti, Chetan, Virshup, Aaron, Yang, Weitao, and Beratan, David N. Strategy to discover diverse optimal molecules in the small molecule universe. Journal of chemical information and modeling, 55(3): 529-537, 2015.
33. Schmidt, Michael and Lipson, Hod. Distilling free-form natural laws from experimental data. Science, 324 (5923): 81-85, 2009.
34. Segler, Marwin HS, Kogej, Thierry, Tyrchan, Christian, and Waller, Mark P. Generating focussed molecule libraries for drug discovery with recurrent neural networks. arXiv preprint arXiv: 1701.01329, 2017.
35. Shahriari, Bobak, Swersky, Kevin, Wang, Ziyu, Adams, Ryan P, and de Freitas, Nando. Taking the human out of the loop: A review of bayesian optimization. Proceedings of the IEEE, 104(1): 148-175, 2016.
36. Snelson, Edward and Ghahramani, Zoubin. Sparse Gaussian processes using pseudo-inputs. In NIPS, pp. 1257- 1264, 2005.
37. Socher, Richard, Huang, Eric H, Pennington, Jeffrey, Ng, Andrew Y, and Manning, Christopher D. Dynamic pooling and unfolding recursive autoencoders for paraphrase detection. In NIPS, volume 24, pp. 801-809, 201 la.
38. Socher, Richard, Pennington, Jeffrey, Huang, Eric H, Ng, Andrew Y, and Manning, Christopher D. Semi-supervised recursive autoencoders for predicting sentiment distributions. In Proceedings of the conference on empirical methods in natural language processing, pp. 151-161. Association for Computational Linguistics, 2011b.
39. Socher, Richard, Perclygin, Alex, Wu, Jean Y, Chuang, Jason, Manning, Christopher D, Ng, Andrew Y, Potts, Christopher, et al. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the conference on empirical methods in natural language processing (EMNLP), volume 1631, pp. 1642. Citeseer, 2013.
40. Upchurch, Paul, Gardner, Jacob, Bala, Kavita, Pless, Robert, Snavely, Noah, and Weinberger, Kilian. Deep feature interpolation for image content changes. arXiv preprint arXiv: 1611.05507, 2016.
41. Virshup, Aaron M, Contreras-Garcfa, Julia, Wipf, Peter, Yang, Weitao, and Beratan, David N. Stochastic voyages into uncharted chemical space produce a representative library of all possible drug-like compounds. Journal of the American Chemical Society, 135(19): 7296-7303, 2013.
42. Weininger, David. Smiles, a chemical language and information system. 1. introduction to methodology and encoding rules. J. Chem. Inf. Comput. Sei, 28(1): 31-36, 1988.
43. Willis, M-J, Hiden, Hugo G, Marenbach, Peter, McKay, Ben, and Montague, Gary A. Genetic programming: An introduction and survey of applications. In Genetic Algorithms in Engineering Systems, pp. 314-319. IET, 1997.
44. Zhao, Shengjia, Song, Jiaming, and Ermon, Stefano. Infovae: Information maximizing variational autoencoders. arXiv preprint arXiv: 1706.02262, 2017.