The knowledge-gradient algorithm for sequencing experiments in drug discovery

INFORMS Journal on Computing

Volumn 23, Issue 3, 2011, Pages 346-363

  Negoescu, Diana M ^a   Frazier, Peter I ^b   Powell, Warren B ^c  

^a Stanford University   (United States)

^b Cornell University   (United States)

^c Princeton University   (United States)

Author keywords

Decision analysis: sequential; Simulation: design of experiments; Statistics, Bayesian

Indexed keywords

EID: 79961092747     PISSN: 10919856     EISSN: 15265528     Source Type: Journal    
DOI: 10.1287/ijoc.1100.0417     Document Type: Article

References (45)

1. Bajorath, J. 2002. Integration of virtual and high-throughput screening. Nature Rev. Drug Discovery 1(11) 882-894. (Pubitemid 37361583)
2. Brown, A. C., T. R. Fraser. 1868. On the connection between chemical consitution and physiological action. Part 1. On the physiological action of salts of the amonium bases, derived from Strychnia, Brucia, Thebia, Codeia, Morphia, and Nicotia. J. Anatomy Physiol. 2(2) 224-242.
3. Burbidge, R., M. Trotter, B. Buxton, S. Holden. 2001. Drug design by machine learning: Support vector machines for pharmaceutical data analysis. Comput. Chemistry 26(1) 5-14. (Pubitemid 33034554)
4. Calvin, J. M., A. Zilinskas. 2005. One-dimensional global optimization for observations with noise. Comput. Math. Appl. 50(1-2) 157-169. (Pubitemid 41542484)
5. Chen, C.-H., H.-C. Chen, L. Dai. 1996. A gradient approach for smartly allocating computing budget for discrete event simulation. Proc. 28th Conf. Winter Simul. IEEE Computer Society, Washington, DC, 398-405. http://portal.acm.org/citation.cfm?id=256696.
6. Chick, S. E., J. Branke, C. Schmidt. 2010. Sequential sampling to myopically maximize the expected value of information. INFORMS J. Comput. 22(1) 71-80.
7. Chick, S. E., K. Inoue. 2001a. New procedures to select the best simulated system using common random numbers. Management Sci. 47(8) 1133-1149. (Pubitemid 34192811)
8. Chick, S. E., K. Inoue. 2001b. New two-stage and sequential procedures for selecting the best simulated system. Oper. Res. 49(5) 732-743. (Pubitemid 34011324)
9. Cox, D. D., S. John. 1997. SDO: A statistical method for global optimization. N. M. Alexandrov, M. Y. Hussaini, eds. Multidisciplinary Design Optimization: State of the Art. SIAM, Philadelphia, 315-329.
10. Davies, J. W., M. Glick, J. Jenkins. 2006. Streamlining lead discovery by aligning in silico and high-throughput screening. Current Opinion Chemical Biol. 10(4) 343-351. (Pubitemid 44080652)
11. De Grave, K., J. Ramon, L. De Raedt. 2008. Active learning for high throughput screening. Discovery Science. Lecture Notes in Computer Science, Vol. 5255. Springer, Berlin, 185-196.
12. Ehrlichman, S. M. T., S. G. Henderson. 2008. Comparing two systems: Beyond common random numbers. Proc. 40th Winter Simul. Conf., IEEE Computer Society, Washington, DC, 245-251.
13. Frazier, P. I. 2011. Learning with dynamic programming. J. J. Cochran, L. A. Cox Jr., P. Keskinocak, J. P. Kharoufeh, J. C. Smith, eds. Wiley Encyclopedia of Operations Research and Management Science. John Wiley & Sons, New York.
14. Frazier, P. I., W. B. Powell, S. Dayanik. 2008. A knowledge-gradient policy for sequential information collection. SIAM J. Control Optim. 47(5) 2410-2439.
15. Frazier, P. I., W. B. Powell, S. Dayanik. 2009. The knowledgegradient policy for correlated normal rewards. INFORMS J. Comput. 21(4) 599-613.
16. Free, S. M., W. J. Wilson. 1964. A mathematical contribution to structure-activity studies. J. Medicinal Chemistry 7(4) 395-399.
17. Fu, M. C., J.-Q. Hu, C.-H. Chen, X. Xiong. 2007. Simulation allocation for determining the best design in the presence of correlated sampling. INFORMS J. Comput. 19(1) 101-111.
18. Gelman, A. B., J. B. Carlin, H. S. Stern, D. B. Rubin. 2004. Bayesian Data Analysis, 2nd ed. CRC Press, Boca Ration, FL.
19. Grover, M., B. Singh, M. Bakshi, S. Singh. 2000. Quantitative structure-property relationships in pharmaceutical research-Part 1. Pharmaceutical Sci. Tech. Today 3(1) 28-35. (Pubitemid 30066492)
20. Gupta, S. S., K. J. Miescke. 1996. Bayesian look ahead one-stage sampling allocations for selection of the best population. J. Statist. Planning Inference 54(2) 229-244. (Pubitemid 126161097)
21. Hansch, C., T. Fujita. 1964. p-Analysis: A method for the correlation of biological activity and chemical structure. J. Amer. Chemical Soc. 86 1616-1626.
22. Hsu, J. C. 1996. Multiple Comparisons: Theory and Methods. CRC Press, Boca Raton, FL.
23. Huang, D., T. T. Allen, W. I. Notz, N. Zeng. 2006. Global optimization of stochastic black-box systems via sequential Kriging meta-models. J. Global Optim. 34(3) 441-466. (Pubitemid 43352177)
24. Jones, D. R., M. Schonlau, W. J. Welch. 1998. Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4) 455-492. (Pubitemid 128507405)
25. Jorissen, R. N., M. K. Gilson. 2005. Virtual screening of molecular databases using a support vector machine. J. Chemical Inform. Modeling 45(3) 549-561. (Pubitemid 40795161)
26. Kaelbling, L. P. 1993. Learning in Embedded Systems. MIT Press, Cambridge, MA.
27. Katz, R., S. F. Osborne, F. Ionescu. 1977. Application of the Free-Wilson technique to structurally related series of homologues: Quantitative structure-activity relationship studies of narcotic analgetics. J. Medicinal Chemistry 20(11) 1413-1419. (Pubitemid 8209550)
28. Kim, S.-H., B. L. Nelson. 2006. Selecting the best system. S. G. Henderson, B. L. Nelson, eds. Handbooks in Operations Research and Management Science: Simulation, Vol. 13. Elsevier, Amsterdam, 501-534.
29. Kim, S.-H., B. L. Nelson. 2001. A fully sequential procedure for indifference-zone selection in simulation. ACM Trans. Model. Comput. Simul. 11(3) 251-273.
30. Kleijnen, J. 2008. Design and Analysis of Simulation Experiments. Springer, New York.
31. Kleinberg, R. D. 2005. Online decision problems with large strategy sets. Ph.D. thesis, Massachusetts Institute of Technology, Cambridge.
32. Kushner, H. J. 1964. A new method of locating the maximum of an arbitrary multipeak curve in the presence of noise. J. Basic Engrg. 86(1) 97-106.
33. Močkus, J. 1972. On Bayesian methods for seeking the extremum. Automatics Comp. 4(1) 53-62 (in Russian).
34. Močkus, J., V. Tiesis, A. Zilinskas. 1978. The application of Bayesian methods for seeking the extremum. L. C. W. Dixon, G. P. Szegö, eds. Towards Global Optimisation, Vol. 2. North-Holland, Amsterdam, 117-129.
35. Montgomery, D. 2005. Design and Analysis of Experiments, 6th ed. John Wiley & Sons, New York.
36. Myers, R., D. Montgomery. 2002. Response Surface Methodology: Process and Product Optimization Using Designed Experiments. John Wiley & Sons, Hoboken, NJ.
37. Nelson, B. L., F. J. Matejcik. 1995. Using common random numbers for indifference-zone selection and multiple comparisons in simulation. Management Sci. 41(12) 1935-1945.
38. Perevozchikov, A. G. 1991. The approximation of generalized stochastic gradients of random regular functions. Comput. Math. Math. Phys. 31(5) 28-33.
39. Powell, W. B. 2007. Approximate Dynamic Programming: Solving the Curses of Dimensionality. John Wiley & Sons, Hoboken, NJ.
40. Sasena, M. J. 2002. Flexibility and efficiency enhancements for constrained global design optimization with Kriging approximations. Ph.D. thesis, University of Michigan, Ann Arbor.
41. Stuckman, B. E. 1988. A global search method for optimizing nonlinear systems. IEEE Trans. Systems, Man Cybernetics 18(6) 965-977.
42. Swisher, J. R., S. H. Jacobson, E. Yücesan. 2003. Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures: A survey. ACM Trans. Model. Comput. Simul. 13(2) 134-154.
43. Warmuth, M. K., G. Ratsch, M. Mathieson, J. Liao, C. Lemmen. 2002. Active learning in the drug discovery process. T. G. Dietterich, S. Becker, Z. Ghahramani, eds. Advances in Neural Information Processing Systems. MIT Press, Cambridge, MA, 1449-1456.
44. Warmuth, M. K., J. Liao, G. Ratsch, M. Mathieson, S. Putta, C. Lemmen. 2003. Active learning with support vector machines in the drug discovery process. J. Chemical Inform. Comput. Sci. 43(2) 667-673.
45. Yang, W. C.-N., B. L. Nelson. 1991. Using common random numbers and control variates in multiple-comparison procedures. Oper. Res. 39(4) 583-591.