Retrosynthetic Reaction Prediction Using Neural Sequence-to-Sequence Models

ACS Central Science

Volumn 3, Issue 10, 2017, Pages 1103-1113

  Liu, Bowen ^a   Ramsundar, Bharath ^b   Kawthekar, Prasad ^b   Shi, Jade ^a   Gomes, Joseph ^a   Luu Nguyen, Quang ^a   Ho, Stephen ^a   Sloane, Jack ^a   Wender, Paul ^a   Pande, Vijay ^a,b  

^a STANFORD UNIVERSITY   (United States)

^b Stanford University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FORECASTING; LEARNING SYSTEMS; RECURRENT NEURAL NETWORKS;

DATA-DRIVEN MODEL; ENCODER-DECODER ARCHITECTURE; MACHINE LEARNING APPROACHES; MACHINE TRANSLATIONS; REACTION PREDICTION; RETROSYNTHETIC ANALYSIS; RULE BASED EXPERT SYSTEMS; SEQUENCE PREDICTION;

EXPERT SYSTEMS;

EID: 85032259185     PISSN: 23747943     EISSN: 23747951     Source Type: Journal    
DOI: 10.1021/acscentsci.7b00303     Document Type: Article

References (59)

1. Corey, E. J.; Cheng, X.-M. The Logic of Chemical Synthesis; Wiley: New York, 1989.
2. Corey, E. J. General Methods for the Construction of Complex Molecules Pure Appl. Chem. 1967, 14, 19-38 10.1016/B978-0-08-020741-4.50004-X
3. Corey, E. J.; Wipke, W. T. Computer-Assisted Design of Complex Organic Syntheses Science (Washington, DC, U. S.) 1969, 166, 178-192 10.1126/science.166.3902.178
4. Wender, P. A.; Quiroz, R. V.; Stevens, M. C. Function through Synthesis-Informed Design Acc. Chem. Res. 2015, 48, 752-760 10.1021/acs.accounts.5b00004
5. Wender, P. A. Toward the Ideal Synthesis and Molecular Function through Synthesis-Informed Design Nat. Prod. Rep. 2014, 31, 433-440 10.1039/C4NP00013G
6. Ley, S. V.; Fitzpatrick, D. E.; Ingham, R. J.; Myers, R. M. Organic Synthesis: March of the Machines Angew. Chem., Int. Ed. 2015, 54, 3449-3464 10.1002/anie.201410744
7. Judson, P. Knowledge-Based Expert Systems in Chemistry: Not Counting on Computers; RSC Theoretical and Computational Chemistry Series; The Royal Society of Chemistry: 2009.
8. Szymkuć, S.; Gajewska, E. P.; Klucznik, T.; Molga, K.; Dittwald, P.; Startek, M.; Bajczyk, M.; Grzybowski, B. A. Computer-Assisted Synthetic Planning: The End of the Beginning Angew. Chem., Int. Ed. 2016, 55, 5904-5937 10.1002/anie.201506101
9. Pensak, D. A.; Corey, E. J. LHASA-Logic and Heuristics Applied to Synthetic Analysis. In Computer-Assisted Organic Synthesis; ACS Symposium Series; American Chemical Society: 1977; Vol. 61, pp 1-32.
10. Corey, E. J.; Wipke, W. T.; Cramer, R. D.; Howe, W. J. Techniques for Perception by a Computer of Synthetically Significant Structural Features in Complex Molecules J. Am. Chem. Soc. 1972, 94, 431-439 10.1021/ja00757a021
11. Corey, E. J.; Howe, W. J.; Orf, H. W.; Pensak, D. A.; Petersson, G. General Methods of Synthetic Analysis. Strategic Bond Disconnections for Bridged Polycyclic Structures J. Am. Chem. Soc. 1975, 97, 6116-6124 10.1021/ja00854a026
12. Corey, E. J.; Long, A. K.; Greene, T. W.; Miller, J. W. Computer-Assisted Synthetic Analysis. Selection of Protective Groups for Multistep Organic Syntheses J. Org. Chem. 1985, 50, 1920-1927 10.1021/jo00211a027
13. Salatin, T. D.; Jorgensen, W. L. Computer-Assisted Mechanistic Evaluation of Organic Reactions. 1. Overview J. Org. Chem. 1980, 45, 2043-2051 10.1021/jo01299a001
14. Gasteiger, J.; Hutchings, M. G.; Christoph, B.; Gann, L.; Hiller, C.; Löw, P.; Marsili, M.; Saller, H.; Yuki, K. A New Treatment of Chemical Reactivity: Development of EROS, an Expert System for Reaction Prediction and Synthesis Design. In Organic Synthesis, Reactions and Mechanisms; Springer Berlin Heidelberg: Berlin, Heidelberg, 1987; pp 19-73.
15. Satoh, H.; Funatsu, K. SOPHIA, a Knowledge Base-Guided Reaction Prediction System-Utilization of a Knowledge Base Derived from a Reaction Database J. Chem. Inf. Model. 1995, 35, 34-44 10.1021/ci00023a005
16. Satoh, K.; Funatsu, K. A Novel Approach to Retrosynthetic Analysis Using Knowledge Bases Derived from Reaction Databases J. Chem. Inf. Comput. Sci. 1999, 39, 316-325 10.1021/ci980147y
17. Gelernter, H.; Rose, J. R.; Chen, C. Building and Refining a Knowledge Base for Synthetic Organic Chemistry via the Methodology of Inductive and Deductive Machine Learning J. Chem. Inf. Model. 1990, 30, 492-504 10.1021/ci00068a023
18. Chen, J. H.; Baldi, P. No Electron Left Behind: A Rule-Based Expert System To Predict Chemical Reactions and Reaction Mechanisms J. Chem. Inf. Model. 2009, 49, 2034-2043 10.1021/ci900157k
19. Chen, J. H.; Baldi, P. Synthesis Explorer: A Chemical Reaction Tutorial System for Organic Synthesis Design and Mechanism Prediction J. Chem. Educ. 2008, 85, 1699 10.1021/ed085p1699
20. Law, J.; Zsoldos, Z.; Simon, A.; Reid, D.; Liu, Y.; Khew, S. Y.; Johnson, A. P.; Major, S.; Wade, R. A.; Ando, H. Y. Route Designer: A Retrosynthetic Analysis Tool Utilizing Automated Retrosynthetic Rule Generation J. Chem. Inf. Model. 2009, 49, 593-602 10.1021/ci800228y
21. Gothard, C. M.; Soh, S.; Gothard, N. A.; Kowalczyk, B.; Wei, Y.; Baytekin, B.; Grzybowski, B. A. Rewiring Chemistry: Algorithmic Discovery and Experimental Validation of One-Pot Reactions in the Network of Organic Chemistry Angew. Chem., Int. Ed. 2012, 51, 7922-7927 10.1002/anie.201202155
22. Segler, M. H. S.; Waller, M. P. Modelling Chemical Reasoning to Predict and Invent Reactions Chem.-Eur. J. 2017, 23, 6118-6128 10.1002/chem.201604556
23. Jorgensen, W. L.; Laird, E. R.; Gushurst, A. J.; Fleischer, J. M.; Gothe, S. A.; Helson, H. E.; Paderes, G. D.; Sinclair, S. CAMEO: A Program for the Logical Prediction of the Products of Organic Reactions Pure Appl. Chem. 1990, 62, 1921-1932 10.1351/pac199062101921
24. Zimmerman, P. M. Automated Discovery of Chemically Reasonable Elementary Reaction Steps J. Comput. Chem. 2013, 34, 1385-1392 10.1002/jcc.23271
25. Wang, L.-P.; Titov, A.; McGibbon, R.; Liu, F.; Pande, V. S.; Martínez, T. J. Discovering Chemistry with an Ab Initio Nanoreactor Nat. Chem. 2014, 6, 1044-1048 10.1038/nchem.2099
26. Wang, L.-P.; McGibbon, R. T.; Pande, V. S.; Martinez, T. J. Automated Discovery and Refinement of Reactive Molecular Dynamics Pathways J. Chem. Theory Comput. 2016, 12, 638-649 10.1021/acs.jctc.5b00830
27. Xu, L.; Doubleday, C. E.; Houk, K. N. Dynamics of 1,3-Dipolar Cycloaddition Reactions of Diazonium Betaines to Acetylene and Ethylene: Bending Vibrations Facilitate Reaction Angew. Chem. 2009, 121, 2784-2786 10.1002/ange.200805906
28. Rappoport, D.; Galvin, C. J.; Zubarev, D. Y.; Aspuru-Guzik, A. Complex Chemical Reaction Networks from Heuristics-Aided Quantum Chemistry J. Chem. Theory Comput. 2014, 10, 897-907 10.1021/ct401004r
29. Socorro, I. M.; Taylor, K.; Goodman, J. M. ROBIA: A Reaction Prediction Program Org. Lett. 2005, 7, 3541-3544 10.1021/ol0512738
30. Martínez, T. J. Ab Initio Reactive Computer Aided Molecular Design Acc. Chem. Res. 2017, 50, 652-656 10.1021/acs.accounts.7b00010
31. Kayala, M. A.; Azencott, C.-A.; Chen, J. H.; Baldi, P. Learning to Predict Chemical Reactions J. Chem. Inf. Model. 2011, 51, 2209-2222 10.1021/ci200207y
32. Kayala, M. A.; Baldi, P. ReactionPredictor: Prediction of Complex Chemical Reactions at the Mechanistic Level Using Machine Learning J. Chem. Inf. Model. 2012, 52, 2526-2540 10.1021/ci3003039
33. Carrera, G. V. S. M.; Gupta, S.; Aires-de-Sousa, J. Machine Learning of Chemical Reactivity from Databases of Organic Reactions J. Comput.-Aided Mol. Des. 2009, 23, 419-429 10.1007/s10822-009-9275-2
34. Zhang, Q.-Y.; Aires-de-Sousa, J. Structure-Based Classification of Chemical Reactions without Assignment of Reaction Centers J. Chem. Inf. Model. 2005, 45, 1775-1783 10.1021/ci0502707
35. Segler, M. H. S.; Waller, M. Neural-Symbolic Machine Learning for Retrosynthesis and Reaction Prediction Chem.-Eur. J. 2017, 23, 5966-5971 10.1002/chem.201605499
36. Wei, J. N.; Duvenaud, D.; Aspuru-Guzik, A. Neural Networks for the Prediction of Organic Chemistry Reactions ACS Cent. Sci. 2016, 2, 725-732 10.1021/acscentsci.6b00219
37. Coley, C. W.; Barzilay, R.; Jaakkola, T. S.; Green, W. H.; Jensen, K. F. Prediction of Organic Reaction Outcomes Using Machine Learning ACS Cent. Sci. 2017, 3, 434-443 10.1021/acscentsci.7b00064
38. Weininger, D. SMILES, a Chemical Language and Information System. 1. Introduction to Methodology and Encoding Rules J. Chem. Inf. Model. 1988, 28, 31-36 10.1021/ci00057a005
39. Heller, S.; McNaught, A.; Stein, S.; Tchekhovskoi, D.; Pletnev, I. InChI-the Worldwide Chemical Structure Identifier Standard J. Cheminf. 2013, 5, 7 10.1186/1758-2946-5-7
40. Gómez-Bombarelli, R.; Duvenaud, D.; Hernández-Lobato, J. M.; Aguilera-Iparraguirre, J.; Hirzel, T. D.; Adams, R. P.; Aspuru-Guzik, A. Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules arXiv 2016, 1610.02415
41. Ikebata, H.; Hongo, K.; Isomura, T.; Maezono, R.; Yoshida, R. Bayesian Molecular Design with a Chemical Language Model J. Comput.-Aided Mol. Des. 2017, 31, 379-391 10.1007/s10822-016-0008-z
42. Jastrzȩbski, S.; Leśniak, D.; Czarnecki, W. M. Learning to SMILE(S) arXiv 2016, 1602.06289
43. Bjerrum, E. J. SMILES Enumeration as Data Augmentation for Neural Network Modeling of Molecules arXiv 2017, 1703.07076
44. Segler, M. H. S.; Kogej, T.; Tyrchan, C.; Waller, M. P. Generating Focussed Molecule Libraries for Drug Discovery with Recurrent Neural Networks arXiv 2017, 1701.01329
45. Cadeddu, A.; Wylie, E. K.; Jurczak, J.; Wampler-Doty, M.; Grzybowski, B. A. Organic Chemistry as a Language and the Implications of Chemical Linguistics for Structural and Retrosynthetic Analyses Angew. Chem., Int. Ed. 2014, 53, 8108-8112 10.1002/anie.201403708
46. Nam, J.; Kim, J. Linking the Neural Machine Translation and the Prediction of Organic Chemistry Reactions arXiv 2016, 1612.09529
47. Lowe, D. M. Extraction of Chemical Structures and Reactions from the Literature; University of Cambridge: 2012.
48. Schneider, N.; Stiefl, N.; Landrum, G. A. What's What: The (Nearly) Definitive Guide to Reaction Role Assignment J. Chem. Inf. Model. 2016, 56, 2336-2346 10.1021/acs.jcim.6b00564
49. Bahdanau, D.; Cho, K.; Bengio, Y. Neural Machine Translation by Jointly Learning to Align and Translate. In ICLR; 2014.
50. Sutskever, I.; Vinyals, O.; Le, Q. V. Sequence to Sequence Learning with Neural Networks. In NIPS; 2014.
51. Britz, D.; Goldie, A.; Luong, T.; Le, Q. Massive Exploration of Neural Machine Translation Architectures arXiv 2017, 1703.03906
52. Hochreiter, S.; Schmidhuber, J. LONG SHORT-TERM MEMORY Neural Comput. 1997, 9, 1735-1780 10.1162/neco.1997.9.8.1735
53. Bøgevig, A.; Federsel, H.-J.; Huerta, F.; Hutchings, M. G.; Kraut, H.; Langer, T.; Löw, P.; Oppawsky, C.; Rein, T.; Saller, H. Route Design in the 21st Century: The IC SYNTH Software Tool as an Idea Generator for Synthesis Prediction Org. Process Res. Dev. 2015, 19, 357-368 10.1021/op500373e
54. RDKit: Open-source cheminformatics http://www.rdkit.org.
55. Abadi, M.; Agarwal, A.; Barham, P.; Brevdo, E.; Chen, Z.; Citro, C.; Corrado, G. S.; Davis, A.; Dean, J.; Devin, M. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems arXiv 2015, 1603.04467
56. Chen, W. L.; Chen, D. Z.; Taylor, K. T. Automatic Reaction Mapping and Reaction Center Detection Wiley Interdiscip. Rev. Comput. Mol. Sci. 2013, 3, 560-593 10.1002/wcms.1140
57. Vinyals, O.; Blundell, C.; Lillicrap, T.; Kavukcuoglu, K.; Wierstra, D. Matching Networks for One Shot Learning. In NIPS; 2016.
58. Santoro, A.; Bartunov, S.; Botvinick, M.; Wierstra, D.; Lillicrap, T. One-Shot Learning with Memory-Augmented Neural Networks arXiv 2016, 1605.06065
59. Altae-Tran, H.; Ramsundar, B.; Pappu, A. S.; Pande, V. Low Data Drug Discovery with One-Shot Learning ACS Cent. Sci. 2017, 3, 283-293 10.1021/acscentsci.6b00367