Optimal control of multiscale systems using reduced-order models

Journal of Computational Dynamics

Volumn 1, Issue 2, 2014, Pages 279-306

  Hartmann, Carsten ^a   Latorre, Juan C ^a   Zhang, Wei ^a   Pavliotis, Grigorios A ^b  

^a FREIE UNIVERSITÄT BERLIN   (Germany)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Dynamic programming; Homogenization; Logarithmic transformation; Model order reduction; Singular perturbations; Stochastic control

Indexed keywords

EID: 84979965404     PISSN: None     EISSN: 21582505     Source Type: Journal    
DOI: 10.3934/jcd.2014.1.279     Document Type: Article

References (60)

1. O. Alvarez and M. Bardi, Viscosity solutions methods for singular perturbations in deterministic and stochastic control, SIAM J. Control Optim., 40 (2002), 1159-1188
2. O. Alvarez, M. Bardi and C. Marchi, Multiscale singular perturbations and homogenization of optimal control problems, in Geometric Control and Nonsmooth Analysis, vol. 76, World Scientific, Singapore, (2008), 1-27
3. O. Alvarez, M. Bardi and C. Marchi, Multiscale problems and homogenization for secondorder hamilton-jacobi equations, J. Differential Equations, 243 (2007), 349-387
4. A. Antoulas, Approximation of Large-Scale Dynamical Systems, SIAM, Philadelphia, 2005
5. Z. Artstein, On singularly perturbed ordinary differential equations with measure-valued limits, Math. Bohem., 127 (2002), 139-152
6. E. Asplund and T. Klüner, Optimal control of open quantum systems applied to the photochemistry of surfaces, Phys. Rev. Lett., 106 (2011), 140404
7. A. Bensoussan and G. Blankenship, Singular perturbations in stochastic control, in Singular Perturbations and Asymptotic Analysis in Control Systems (eds. P. V. Kokotovic, A. Bensoussan and G. L. Blankenship), vol. 90 of Lecture Notes in Control and Information Sciences, Springer Berlin Heidelberg, (1987), 171-260
8. A. Bensoussan, Perturbation Methods in Optimal Control, Gauthiers-Villars, Chichester, 1988
9. A. Bensoussan and H. Nagai, An ergodic control problem arising from the principal eigenvalue of an elliptic operator, J. Math. Soc. Japan, 43 (1991), 49-65
10. J.-M. Bismut, Martingales, the malliavin calculus and hypoellipticity under general hörmander's conditions, Z. Wahrsch. Verw. Gebiete, 56 (1981), 469-505
11. R. Buckdahn and Y. Hu, Probabilistic approach to homogenizations of systems of quasilinear parabolic PDEs with periodic structures, Nonlinear Analysis, 32 (1998), 609-619
12. R. Buckdahn, Y. Hu and S. Peng, Probabilistic approach to homogenization of viscosity solutions of parabolic pdes, NoDEA Nonlinear Differential Equations Appl., 6 (1999), 395-411
13. Y. Chahlaoui and P. Van Dooren, Benchmark examples for model reduction of linear time invariant dynamical systems, in Dimension Reduction of Large-Scale Systems, vol. 45 of Lect. Notes Comput. Sci. Eng., (2005), 379-392
14. P. Dai Pra, L. Meneghini and W. Runggaldier, Connections between stochastic control and dynamic games, Mathematics of Control, Signals and Systems, 9 (1996), 303-326
15. M. H. Davis and A. R. Norman, Portfolio selection with transaction costs, Math. Oper. Res., 15 (1990), 676-713
16. P. Dupuis, K. Spiliopoulos and H. Wang, Importance sampling for multiscale diffusions, Mul-tiscale Model. Simul., 10 (2012), 1-27
17. P. Dupuis and H. Wang, Importance sampling, large deviations, and differential games, Stochastics and Stochastic Reports, 76 (2004), 481-508
18. L. C. Evans, The perturbed test function method for viscosity solutions of nonlinear PDE, P. Roy. Soc. Edinb. A, 111 (1989), 359-375
19. W. H. Fleming and W. M. McEneaney, Risk-sensitive control on an infinite time horizon, SIAM J. Control Optim., 33 (1995), 1881-1915
20. W. H. Fleming and H. M. Soner, Controlled Markov Processes and Viscosity Solutions, Springer, 2006
21. V. Gaitsgory, Suboptimization of singularly perturbed control systems, SIAM J .Control Optim., 30 (1992), 1228-1249
22. Z. Gajic and M.-T. Lim, Optimal Control of Singularly Perturbed Linear Systems and Ap-plications, CRC Press, New York, 2001
23. K. Glover, All optimal Hankel-norm approximations of linear multivariable systems and their L1-error bounds, Int. J. Control, 39 (1984), 1115-1193
24. G. Grammel, Averaging of singularly perturbed systems, Nonlinear Analysis, 28 (1997), 1851-1865
25. S. Gugercin and A. Antoulas, A survey of model reduction by balanced truncation and some new results, Int. J. Control, 77 (2004), 748-766
26. C. Hartmann, Balanced model reduction of partially observed Langevin equations: An averaging principle, Math. Comput. Model. Dyn. Syst., 17 (2011), 463-490
27. C. Hartmann, B. Schäfer-Bung and A. Zueva, Balanced averaging of bilinear systems with applications to stochastic control, J. Control Optim., 51 (2013), 2356-2378
28. C. Hartmann and C. Schütte, Efficient rare event simulation by optimal nonequilibrium forcing, J. Stat. Mech. Theor. Exp., 2012 (2012), P11004
29. C. Hartmann, V. Vulcanov and C. Schütte, Balanced truncation of linear second-order systems: A Hamiltonian approach, Multiscale Model. Simul., 8 (2010), 1348-1367
30. C. J. Holland, A minimum principle for the principal eigenvalue for second-order linear elliptic equations with natural boundary conditions, Comm. Pure Appl. Math., 31 (1978), 509-519
31. N. Ichihara, A stochastic representation for fully nonlinear PDEs and its application to homogenization, J. Math. Sci. Univ. Tokyo, 12 (2005), 467-492
32. P. Imkeller, N. S. Namachchivaya, N. Perkowski and H. C. Yeong, Dimensional reduction in nonlinear filtering: A homogenization approach, Ann. Appl. Probab., 23 (2013), 2290-2326
33. Y. Kabanov and S. Pergamenshchikov, Two-scale Stochastic Systems: Asymptotic Analysis and Control, Springer, Berlin, Heidelberg, Paris, 2003
34. P. V. Kokotovic, Applications of singular perturbation techniques to control problems, SIAM Review, 26 (1984), 501-550
35. P. Kokotovic, Singular perturbation techniques in control theory, in Singular Perturbations and Asymptotic Analysis in Control Systems (eds. P. V. Kokotovic, A. Bensoussan and G. L. Blankenship), vol. 90 of Lecture Notes in Control and Information Sciences, Springer Berlin Heidelberg, (1987), 1-55
36. T. Kurtz and R. H. Stockbridge, Stationary solutions and forward equations for controlled and singular martingale problems, Electron. J. Probab, 6 (2001), 52pp
37. H. J. Kushner, Direct averaging and perturbed test function methods for weak convergence, Lect. Notes Contr. Inf., 81 (1986), 412-426
38. H. J. Kushner, Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems, Birkhäuser, Boston, 1990
39. H. J. Kushner and P. G. Dupuis, Numerical Methods for Stochastic Control Problems in Continuous Time, Springer, New York, 2001
40. J. C. Latorre, P. Metzner, C. Hartmann and C. Schütte, A structure-preserving numerical discretization of reversible diffusions, Commun. Math. Sci., 9 (2011), 1051-1072
41. P.-L. Lions, G. Papanicolaou and S. R. S. Varadhan, Homogenization of hamilton-jacobi equations, Preprint
42. P.-L. Lions and P. E. Souganidis, Correctors for the homogenization of hamilton-jacobi equations in the stationary ergodic setting, Commun. Pure Appl. Math., 56 (2003), 1501-1524
43. P. Malliavin, Stochastic calculus of variations and hypoelliptic operators, in Proceedings of the International Conference on Stochastic Differential Equations 1976, Wiley, New York, (1978), 195-263
44. B. Moore, Principal component analysis in linear system: Controllability, observability and model reduction, IEEE Trans. Automat. Control, 26 (1981), 17-32
45. E. Nelson, Dynamical Theories of Brownian Motion, Princeton University Press, 1967
46. G. Nguetseng, A general convergence result for a functional related to the theory of homogenization, SIAM J. Math. Anal., 20 (1989), 608-623
47. B. K. Oksendal, Stochastic Differential Equations: An Introduction With Applications, Springer, 2003
48. G. Papanicolaou, A. Bensoussan and J. Lions, Asymptotic Analysis for Periodic Structures, Elsevier, Burlington, MA, 1978
49. A. Papavasiliou, G. A. Pavliotis and A. M. Stuart, Maximum likelihood drift estimation for multiscale diffusions, Stochastic Process. Appl., 119 (2009), 3173-3210
50. J. H. Park, R. B. Sowers and N. S. Namachchivaya, Dimensional reduction in nonlinear filtering, Nonlinearity, 23 (2010), 305-324
51. G. A. Pavliotis and A. M. Stuart, Parameter estimation for multiscale diffusions, J. Stat. Phys., 127 (2007), 741-781
52. G. Pavliotis and A. Stuart, Multiscale Methods: Averaging and Homogenization, Springer, 2008
53. H. Pham, Continuous-time Stochastic Control and Optimization with Financial Applications, Stochastic modelling and applied probability, Springer, Berlin, Heidelberg, 2009
54. M. Robin, Long-term average cost control problems for continuous time Markov processes: A survey, Acta Appl. Math., 1 (1983), 281-299
55. C. Schütte, S. Winkelmann and C. Hartmann, Optimal control of molecular dynamics using markov state models, Math. Program. Ser. B, 134 (2012), 259-282
56. H. Stapelfeldt, Laser aligned molecules: Applications in physics and chemistry, Physica Scripta, 2004 (2004), 132-136
57. A. Steinbrecher, Optimal control of robot guided laser material treatment, in Progress in In-dustrial Mathematics at ECMI 2008 (eds. A. D. Fitt, J. Norbury, H. Ockendon and E. Wilson), Springer Berlin Heidelberg, (2010), 505-511
58. A. Vigodner, Limits of singularly perturbed control problems with statistical dynamics of fast motions, SIAM J. Control Optim., 35 (1997), 1-28
59. F. Watbled, On singular perturbations for differential inclusions on the infinite interval, J. Math. Anal. Appl., 310 (2005), 362-378
60. J. Zabczyk, Exit problem and control theory, Syst. Control Lett., 6 (1985), 165-172