Sequence to better sequence: Continuous revision of combinatorial structures

34th International Conference on Machine Learning, ICML 2017

Volumn 5, Issue , 2017, Pages 3900-3916

  Mueller, Jonas ^a   Gifford, David ^a   Jaakkola, Tommi ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; GRADIENT METHODS;

APPROXIMATE INFERENCE; AUTO ENCODERS; COMBINATORIAL SEARCH; COMBINATORIAL STRUCTURES; GENERATIVE MODEL; HIGH PROBABILITY; LATENT FACTOR; NATURAL LANGUAGES;

LEARNING SYSTEMS;

EID: 85047006547     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Blei, D. M., Kucukelbir, A., and McAuliffe, J. D. Variational inference: A review for statisticians. Journal of the American Statistical Association, 2017.
2. Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A. M., Joze-fowicz, R., and Bengio, S. Generating sentences from a continuous space. Conference on Computational Natural Language Learning, 2016.
3. Cho, K., van Merrienboer, B., Gulcehre, C, Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. Learning phrase representations using rnn encoder-decoder for statistical machine translation. Empirical Methods on Natural Language Processing, 2014.
4. Eck, D. and Schmidhuber, J. A first look at music composition using lstm recurrent neural networks. IDSIA Technical Report, 2002.
5. Erhan, D., Bengio, Y, Courville, A., Manzagol, P., Vincent, R, and Bengio, S. Why does unsupervised pretraining help deep learning? Journal of Machine Learning Research, 11:625-660, 2010.
6. Gatys, L. A., Ecker, A. S., and Bethge, M. Image style transfer using convolutional neural networks. Computer Vision and Pattern Recognition, 2016.
7. Gómez-Bombarelli, R., Duvenaud, D., Hernández-Lobato, J. M., Aguilera-Iparraguirre, J.,, Hirzel, T., Adams, R. R, and Aspuru-Guzik, A. Automatic chemical design using a data-driven continuous representation of molecules. arXiv:1610.02415, 2016.
8. Graves, A. Generating sequences with recurrent neural networks. arXiv:1308.0850, 2013.
9. Gupta, R, Banchs, R. E., and Rosso, R Squeezing bottlenecks: Exploring the limits of autoencoder semantic representation capabilities. Neurocomputing, 175:1001-1008, 2016.
10. Higgins, I., Matthey, L., Glorot, X., Pal, A., Uria, B., Blundell, C, Mohamed, S., and Lerchner, A. Early visual concept learning with unsupervised deep learning. arXiv:1606.05579, 2016.
11. Hoffman, M. D. and Johnson, M. J. Elbo surgery: yet another way to carve up the variational evidence lower bound. NIPS Workshop on Advances in Approximate Bayesian Inference, 2016.
12. Hutto, C.J. and Gilbert, E. Vader: A parsimonious rule-based model for sentiment analysis of social media text. Eighth International Conference on Weblogs and Social Media, 2014.
13. Karpathy, A. The unreasonable effectiveness of recurrent neural networks. Andrej Karpathy blog, 2015. URL karpathy.github.io.
14. Kingma, D. P. and Welling, M. Auto-encoding variational bayes. International Conference on Learning Representations, 2014.
15. Kiros, R., Zhu, Y, Salakhutdinov, R., Zemel, R. S., Tor-ralba, A., Urtasun, R., and Fidler, S. Skip-thought vectors. Advances in Neural Information Processing Systems, 2015.
16. McAuley, J., Leskovec, J., and Jurafsky, D. Learning attitudes and attributes from multi-aspect reviews. IEEE International Conference on Data Mining, 2012.
17. Mikolov, T., Karafiat, M., Bürget, L., Cernocky, J., and Khudanpur, S. Recurrent neural network based language model. Interspeech, 2010.
18. Mueller, J. and Thyagarajan, A. Siamese recurrent architectures for learning sentence similarity. Proc. AAAI Conference on Artificial Intelligence, 2016.
19. Mueller, J., Reshef, D. N., Du, G., and Jaakkola, T. Learning optimal interventions. Artificial Intelligence and Statistics, 2017.
20. Nguyen, A., Yosinski, J., and Clune, J. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. Computer Vision and Pattern Recognition, 2015.
21. Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T., and Clune, J. Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. Advances in Neural Information Processing Systems, 2016.
22. Simonyan, K., Vedaldi, A., and Zisserman, A. Deep inside convolutional networks: Visualising image classification models and saliency maps. ICLR Workshop Proceedings, 2014.
23. Sutskever, I., Vinyals, O., and Le, Q.V. Sequence to sequence learning with neural networks. Advances in Neural Information Processing Systems, 2014.
24. Wiseman, S. and Rush, A. M. Sequence-to-sequence learning as beam-search optimization. Empirical Methods in Natural Language Processing, 2016.
25. Zaefferer, M., Stork, J., Friese, M., Fischbach, A., Naujoks, B., and Bartz-Beielstein, T. Efficient global optimization for combinatorial problems. Genetic and Evolutionary Computation Conference, 2014.
26. Bird, S., Klein, E., and Loper, E. Natural Language Processing with Python. O'Reilly Media, 2009.
27. Dasgupta, S. D. A. and Gupta, A. K. An elementary proof of a theorem of Johnson and lindenstrauss. Random Structures and Algorithms, 22:60-65, 2002.
28. Kingma, D. and Ba, J. Adam: A method for stochastic optimization. International Conference on Learning Representations, 2015.