Optimal experimental design and some related control problems

Automatica

Volumn 44, Issue 2, 2008, Pages 303-325

  Pronzato, Luc ^a  

^a UNIVERSITY OF NICE SOPHIA ANTIPOLIS   (France)

Author keywords

Active control; Active learning; Adaptive control; Design of experiments; Parameter estimation

Indexed keywords

DESIGN OF EXPERIMENTS; DYNAMICAL SYSTEMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; PROBLEM SOLVING; STATISTICAL METHODS;

ACTIVE CONTROL; ACTIVE LEARNING; EXPERIMENTAL DESIGN; STATISTICAL LEARNING;

ADAPTIVE CONTROL SYSTEMS;

EID: 37849021822     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2007.05.016     Document Type: Article

References (197)

1. Åström K.J., and Wittenmark B. On self-tuning regulators. Automatica 9 (1973) 195-199
2. Åström K.J., and Wittenmark B. Adaptive control (1989), Addison-Wesley, Reading, MA
3. Atkinson A.C., and Cox D.R. Planning experiments for discriminating between models (with discussion). Journal of Royal Statistical Society B 36 (1974) 321-348
4. Atkinson A.C., and Donev A.N. Optimum experimental design (1992), Oxford University Press, Oxford
5. Atkinson A.C., and Fedorov V.V. The design of experiments for discriminating between two rival models. Biometrika 62 1 (1975) 57-70
6. Atkinson A.C., and Fedorov V.V. Optimal design: Experiments for discriminating between several models. Biometrika 62 2 (1975) 289-303
7. Bar-Shalom Y., and Tse E. Dual effect, certainty equivalence, and separation in stochastic control. IEEE Transactions on Automatic Control 19 5 (1974) 494-500
8. ∞ input design in identification. In Proceedings of the 16th IFAC world congress on automatic control, Prague, 2005. CD-ROM - Paper 03882.
9. Barker H.A., and Godfrey K.R. System identification with multi-level periodic perturbation signals. Control Engineering Practice 7 (1999) 717-726
10. Bartlett, P. L. (2003). Prediction algorithms: complexity, concentration and convexity. In Preprints of the 13th IFAC symposium on system identification (pp. 1507-1517), Rotterdam, August.
11. Bates R., and Pronzato L. Emulator-based global optimisation using lattices and Delaunay tesselation. In: Prado P., and Bolado R. (Eds). Proceedings of the 3rd international symposium on sensitivity analysis of model output (2002), Madrid, Spain 189-192
12. Biedermann, S., & Dette, H. (2001). Minimax optimal designs for nonparametric regression-a further optimality property of the uniform distribution. In P. Hackl, A. C. Atkinson, W. G. Müller (Eds.), mODa'6-advances in model-oriented design and analysis, Proceedings of the 76th international workshop (pp. 13-20), Puchberg/Schneberg (Austria), June. Physica-Verlag: Heidelberg.
13. Böhning D. Likelihood inference for mixtures: Geometrical and other constructions of monotone step-length algorithms. Biometrika 76 2 (1989) 375-383
14. Bombois X., Anderson B.D.O., and Gevers M. Quantification of frequency domain error bounds with guaranteed confidence level in prediction error identification. System & Control Letters 54 (2005) 471-482
15. Bombois, X., Scorletti, G., Gevers, M., Hildebrand, R., & Van den Hof, P. (2004). Cheapest open-loop identification for control. In: Proceedings of the 43rd conference on decision and control (pp. 382-387), The Bahamas, December.
16. Bombois X., Scorletti G., Gevers M., Van den Hof P., and Hildebrand R. Least costly identification experiment for control. Automatica 42 10 (2006) 1651-1662
17. Box G.E.P., and Hill W.J. Discrimination among mechanistic models. Technometrics 9 1 (1967) 57-71
18. Box G.E.P., and Wilson K.B. On the experimental attainment of optimum conditions (with discussion). Journal of Royal Statistical Society B 13 1 (1951) 1-45
19. Box M.J. Bias in nonlinear estimation. Journal of Royal Statistical Society B 33 (1971) 171-201
20. Boyd S., El Ghaoui L., Feron E., and Balakrishnan V. Linear matrix inequalities in system and control theory (1994), SIAM, Philadelphia
21. Boyd S., and Vandenberghe L. Convex optimization (2004), Cambridge University Press, Cambridge
22. Bozin, A. S., & Zarrop, M. B. (1991). Self tuning optimizer-convergence and robustness properties. In Proceedings of the 1st European control conference (pp. 672-677), Grenoble, July.
23. Breiman L. Bagging predictors. Machine Learning 24 2 (1996) 123-140
24. Caines P.E. Linear stochastic systems (1988), Wiley, New York
25. Campi M.C., and Weyer E. Guaranteed non-asymptotic confidence regions in system identification. Automatica 41 10 (2005) 1751-1764
26. Chaloner K., and Larntz K. Optimal Bayesian design applied to logistic regression experiments. Journal of Statistical Planning and Inference 21 (1989) 191-208
27. Chaloner K., and Verdinelli I. Bayesian experimental design: A review. Statistical Science 10 3 (1995) 273-304
28. Chaudhuri P., and Mykland P.A. Nonlinear experiments: Optimal design and inference based likelihood. Journal of the American Statistical Association 88 422 (1993) 538-546
29. n fractional factorial designs. Annals of Statistics 8 (1980) 436-446
30. Cheng M.-Y., Hall P., and Titterington D.M. Optimal design for curve estimation by local linear smoothing. Bernoulli 4 1 (1998) 3-14
31. Chernoff H. Locally optimal designs for estimating parameters. Annals of Mathematical Statistics 24 (1953) 586-602
32. Choi J.-Y., Krstić M., Ariyur K.B., and Lee J.S. Extremum seeking control for discrete-time systems. IEEE Transactions on Automatic Control 47 2 (2002) 318-323
33. Cohn, D. A. (1994). Neural network exploration using optimal experiment design. In J. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in neural information processing systems (Vol. 6). Los Altos, CA: Morgan Kaufmann.
34. Cohn D.A., Ghahramani Z., and Jordan M.I. Active learning with statistical models. Journal of Artificial Intelligence Research 4 (1996) 129-145
35. Cox, D. D., & John, S. (1992). A statistical method for global optimization. In Proceedings of the IEEE international conference on systems man and cybernetics (Vol. 2, pp. 1241-1246), Chicago, IL, October.
36. Cox D.R., and Hinkley D.V. Theoretical statistics (1974), Chapman & Hall, London
37. Cucker F., and Smale S. On the mathematical foundations of learning. Bulletin of the AMS 39 1 (2001) 1-49
38. Currin C., Mitchell T.J., Morris M.D., and Ylvisaker D. Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. Journal of the American Statistical Association 86 (1991) 953-963
39. D'Argenio D.Z. Optimal sampling times for pharmacokinetic experiments. Journal of Pharmacokinetics and Biopharmaceutics 9 6 (1981) 739-756
40. den Hertog D. Interior point approach to linear, quadratic and convex programming (1994), Kluwer, Dordrecht
41. Faraway J.J. Sequential design for the nonparametric regression of curves and surfaces. Computing Science and Statistics 22 (1990) 104-110
42. Fedorov V.V. Theory of optimal experiments (1972), Academic Press, New York
43. Fedorov V.V. Convex design theory. Mathematische Operationsforschung und Statistik, Series Statistics 11 3 (1980) 403-413
44. Fedorov V.V., and Hackl P. Model-oriented design of experiments (1997), Springer, Berlin
45. Fedorov, V. V., & Müller, W. G. (2004). Optimum design for correlated processes via eigenfunction expansions. Report 6, Department of Statistics and Mathematics, Wirtschaftsuniversität Wien.
46. Fisher R.A. Statistical methods for research workers (1925), Oliver & Boyd, Edimbourgh
47. Fliess, M., & Sira-Ramiírez, H. (2003). An algebraic framework for linear identification. ESAIM: Control, Optimization and Calculus of Variations, (9), 151-168.
48. Forsgren A., Gill P.E., and Wright M.H. Interior methods for nonlinear optimization. SIAM Review 44 4 (2002) 525-597
49. Forssell U., and Ljung L. Closed-loop identification revisited. Automatica 35 (1999) 1215-1241
50. Forssell U., and Ljung L. Some results on optimum experiment design. Automatica 36 (2000) 749-756
51. Gautier R., and Pronzato L. Adaptive control for sequential design. Discussiones Mathematicae, Probability & Statistics 20 1 (2000) 97-114
52. Gazut, S., Martinez, J. -M., & Issanchou, S. (2006). Plans d'expériences itératifs pour la construction de modèles non linéaires. In CD - 38èmes Journées de Statistique de la SFdS, Clamart, France.
53. Gevers M. Identification for control. From the early achievements to the revival of experimental design. European Journal of Control 11 45 (2005) 335-352
54. Gevers M., Bombois X., Codrons B., Scorletti G., and Anderson B.D.O. Model validation for control and controller validation in a prediction error identification framework-Part I: Theory. Automatica 39 (2003) 403-415
55. Gevers M., Bombois X., Codrons B., Scorletti G., and Anderson B.D.O. Model validation for control and controller validation in a prediction error identification framework-Part II: Illustrations. Automatica 39 (2003) 417-427
56. Gevers, M., & Ljung, L. (1985). Benefits of feedback in experiment design. In Preprints of the 7th IFAC/IFORS symposium on identification and system parameter estimation (pp. 909-914). York.
57. Gevers M., and Ljung L. Optimal experiment design with respect to the intended model application. Automatica 22 (1986) 543-554
58. Goodwin G.C., and Payne R.L. Dynamic system identification: Experiment design and data analysis (1977), Academic Press, New York
59. Goodwin G.C., and Salgado M.E. A stochastic imbedding approach for quantifying uncertainty in the estimation of restricted complexity models. International Journal of Adaptive Control and Signal Processing 3 (1989) 333-356
60. Guo L. Further results on least-squares based adaptive minimum variance control. SIAM Journal on Control and Optimization 32 1 (1994) 187-212
61. Harman R., and Pronzato L. Improvements on removing non-optimal support points in D-optimum design algorithms. Statistics & Probability Letters 77 (2007) 90-94
62. Hastie T., Tibshirani R., and Friedman J. The elements of statistical learning. Data mining, inference and prediction (2001), Springer, Heidelberg
63. Heyde C.C. Quasi-likelihood and its application. A general approach to optimal parameter estimation (1997), Springer, New York
64. Hildebrand R., and Gevers M. Identification for control: Optimal input design with respect to a worst-case ν-gap cost function. SIAM Journal on Control and Optimization 42 5 (2003) 1586-1608
65. Hill P.D.H. A review of experimental design procedures for regression model discrimination. Technometrics 20 (1978) 15-21
66. Hjalmarsson H. From experiment design to closed-loop control. Automatica 41 (2005) 393-438
67. Hjalmarsson H., Gevers M., and De Bruyne F. For model-based control design, closed-loop identification gives better performance. Automatica 32 12 (1996) 1659-1673
68. Hu I. Strong consistency of Bayes estimates in stochastic regression models. Journal of Multivariate Analysis 57 (1996) 215-227
69. Hu I. Strong consistency in stochastic regression models via posterior covariance matrices. Biometrika 84 3 (1997) 744-749
70. Hu I. On sequential designs in nonlinear problems. Biometrika 85 2 (1998) 496-503
71. Hu I. Strong consistency of Bayes estimates in nonlinear stochastic regression models. Journal of Statistical Planning and Inference 67 (1998) 155-163
72. Huber P.J. Robust statistics (1981), Wiley, New York
73. Ivanov A.V., and Leonenko N.N. Asymptotic theory of nonlinear regression with long-range dependence. Mathematical Methods of Statistics 13 2 (2004) 153-178
74. 2 input design for identification. In Proceedings of the 43rd conference on decision and control (pp. 388-393), The Bahamas, December.
75. Jansson H., and Hjalmarsson H. Input design via LMIs admitting frequency-wise model specifications in confidence regions. IEEE Transactions on Automatic Control 50 10 (2005) 1534-1549
76. Jansson, H., & Hjalmarsson, H. (2005b). Optimal experiment design in closed loop. In Proceedings of the 16th IFAC world congress on automatic control, Prague. CD-ROM - Paper 04528.
77. Jennrich R.I. Asymptotic properties of nonlinear least squares estimation. Annals of Mathematical Statistics 40 (1969) 633-643
78. Johnson M.E., Moore L.M., and Ylvisaker D. Minimax and maximin distance designs. Journal of Statistical Planning and Inference 26 (1990) 131-148
79. Jones D., Schonlau M., and Welch W.J. Efficient global optimization of expensive black-box functions. Journal of Global Optimization 13 (1998) 455-492
80. Kaelbling L.P., Littman M.L., and Moore A.W. Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4 (1996) 237-285
81. Kanamori T. Statistical asymptotic theory of active learning. Annals of the Institute of Statistical Mathematics 54 3 (2002) 459-475
82. Kerestecioǧlu F. Change detection and input design in dynamical systems (1993), Research Studies Press, Taunton, UK
83. Kiefer J., and Wolfowitz J. Stochastic estimation of the maximum of a regression function. Annals of Mathematical Statistics 23 (1952) 462-466
84. Kiefer J., and Wolfowitz J. Optimum designs in regression problems. Annals of Mathematical Statistics 30 (1959) 271-294
85. Kiefer J., and Wolfowitz J. The equivalence of two extremum problems. Canadian Journal of Mathematics 12 (1960) 363-366
86. Krige, D. G. (1951). A statistical approach to some mine valuation and allied problems on the Witwatersrand. Master Thesis, University of Witwatersrand.
87. Krstić M. Performance improvement and limitations in extremum seeking control. System & Control Letters 39 (2000) 313-326
88. Krstić M., Kanellakopoulos I., and Kokotović P. Nonlinear and adaptive control design (1995), Wiley, New York
89. Krstić M., and Wang H.-H. Stability of extremum seeking feedback for general nonlinear dynamic systems. Automatica 36 (2000) 595-601
90. Kubrusly C.S., and Malebranche H. Sensors and controllers location in distributed systems-a survey. Automatica 21 2 (1985) 117-128
91. Kulcsár C., Pronzato L., and Walter E. Dual control of linearly parameterised models via prediction of posterior densities. European Journal of Control 2 1 (1996) 135-143
92. Kulcsár, C., Pronzato, L., & Walter, E. (1996b). Experimental design for the control of linear state-space systems. In Proceedings of the 13th IFAC world congress (Vol. C, pp. 175-180), San Francisco, June.
93. Kumar P.R. Convergence of adaptive control schemes using least-squares parameter estimates. IEEE Transactions on Automatic Control 35 4 (1990) 416-424
94. Lai T.L. Asymptotically efficient adaptive control in stochastic regression models. Advances in Applied Mathematics 7 23 (1986) 23-45
95. Lai T.L. Asymptotic properties of nonlinear least squares estimates in stochastic regression models. Annals of Statistics 22 4 (1994) 1917-1930
96. Lai T.L., and Robbins H. Consistency and asymptotic efficiency of slope estimates in stochastic approximation schemes. Zeitschrift fur Wahrscheinlichkeitstheorie und Verwandte Gebietez 56 (1981) 329-360
97. Lai T.L., Robbins H., and Wei C.Z. Strong consistency of least squares estimates in multiple regression. Proceedings of the National Academy of Sciences of the USA 75 7 (1978) 3034-3036
98. Lai T.L., Robbins H., and Wei C.Z. Strong consistency of least squares estimates in multiple regression II. Journal of Multivariate Analysis 9 (1979) 343-361
99. Lai T.L., and Wei C.Z. Least squares estimates in stochastic regression models with applications to identification and control of dynamic systems. Annals of Statistics 10 1 (1982) 154-166
100. Lai T.L., and Wei C.Z. On the concept of excitation in least squares identification and adaptive control. Stochastics 16 (1986) 227-254
101. Lai T.L., and Wei C.Z. Asymptotically efficient self-tuning regulators. SIAM Journal on Control and Optimization 25 2 (1987) 466-481
102. Leary S., Bhaskar A., and Keane A.J. A derivative based surrogate model for approximating and optimizing the output of an expensive computer simulation. Journal of Global Optimization 30 (2004) 39-58
103. Liang K.-Y., and Zeger S.L. Inference based on estimating functions in the presence of nuisance parameters. Statistical Science 10 2 (1995) 158-173
104. Ljung L. System identification, theory for the user (1987), Prentice-Hall, Englewood Cliffs
105. Mardia K.V. Maximum likelihood estimation for spatial models. In: Griffith D.A. (Ed). Spatial statistics: Past, present and future (1990), Michigan Document Services, Ann Arbor, Michigan 203-253
106. Mardia K.V., Kent J.T., Goodall C.R., and Little J.A. Kriging and splines with derivative information. Biometrika 83 1 (1996) 207-221 (correction in Biometrika (1998), 85(2), 205)
107. Matheron G. Principles of geostatistics. Economic Geology 58 (1963) 1246-1266
108. Mitchell T.J. An algorithm for the construction of "D-optimal" experimental designs. Technometrics 16 (1974) 203-210
109. Mockus J. Bayesian approach to global optimization, theory and applications (1989), Kluwer, Dordrecht
110. Mockus, J., Tiesis, V., & Zilinskas, A. (1978). The application of Bayesian methods for seeking the extremum. In L. C. W. Dixon, G. P. Szego (Eds.), Towards global optimisation (Vol. 2, pp. 117-129). Amsterdam: North Holland.
111. Molchanov I., and Zuyev S. Variational calculus in the space of measures and optimal design. In: Atkinson A., Bogacka B., and Zhigljavsky A. (Eds). Optimum design 2000 (2001), Kluwer, Dordrecht 79-90
112. Molchanov I., and Zuyev S. Steepest descent algorithm in a space of measures. Statistics and Computing 12 (2002) 115-123
113. Morris M.D., and Mitchell T.J. Exploratory designs for computational experiments. Journal of Statistical Planning and Inference 43 (1995) 381-402
114. Morris M.D., Mitchell T.J., and Ylvisaker D. Bayesian design and analysis of computer experiments: Use of derivatives in surface prediction. Technometrics 35 3 (1993) 243-255
115. Müller H.-G. Optimal designs for nonparametric kernel regression. Statistics & Probability Letters 2 (1984) 285-290
116. Müller W.G. Collecting spatial data. Optimum design of experiments for random fields. 2nd revised ed. (2002), Physica-Verlag, Heidelberg
117. Müller W.G., and Pázman A. Measures for designs in experiments with correlated errors. Biometrika 90 2 (2003) 423-434
118. Nadaraya E.A. On estimating regression. Theory of Probability and its Applications 9 (1964) 141-142
119. Näther W. The choice of estimators and experimental designs in a linear regression model according to a joint criterion of optimality. Mathematische Operationsforschung und Statistik 6 (1975) 677-686
120. Nesterov Y., and Nemirovskii A. Interior-point polynomial algorithms in convex programming (1994), SIAM, Philadelphia
121. Nešić D., and Laila D.S. A note on input-to-state stabilization for nonlinear sampled-data systems. IEEE Transactions on Automatic Control 47 7 (2002) 1153-1158
122. Nešić, D., & Teel, A. R. (2001). Sampled-data control of nonlinear systems: An overview of recent results. In Perspectives in robust control (Vol. 268, pp. 221-239). Lecture Notes in Control and Information Science. New York: Springer.
123. Ninness B. Strong laws of large numbers under weak assumptions with application. IEEE Transactions on Automatic Control 45 11 (2000) 2117-2122
124. Ninness B., and Goodwin G. Estimation of model quality. Automatica 31 12 (1995) 1771-1797
125. Pázman, A. (1986). Foundations of optimum experimental design. Reidel (Kluwer group), Dordrecht (co-pub. VEDA, Bratislava).
126. Pázman A. Nonlinear statistical models (1993), Kluwer, Dordrecht
127. Pázman A., and Müller W.G. Optimum design of experiments subject to correlated errors. Statistics & Probability Letters 52 (2001) 29-34
128. Pázman A., and Pronzato L. Nonlinear experimental design based on the distribution of estimators. Journal of Statistical Planning and Inference 33 (1992) 385-402
129. Pázman A., and Pronzato L. A Dirac function method for densities of nonlinear statistics and for marginal densities in nonlinear regression. Statistics & Probability Letters 26 (1996) 159-167
130. Pázman, A., & Pronzato, L. (2004). Simultaneous choice of design and estimator in nonlinear regression with parameterized variance. In A. Di Bucchianico, H. Läuter, H. P. & Wynn (Eds.), mODa'7-Advances in model-oriented design and analysis, Proceedings of the 7th international workshop (pp. 117-124), Heeze (Netherlands). Physica-Verlag: Heidelberg.
131. Pázman A., and Pronzato L. On the irregular behavior of LS estimators for asymptotically singular designs. Statistics & Probability Letters 76 (2006) 1089-1096
132. Pilz, J. (1983). Bayesian estimation and experimental design in linear regression models (Vol. 55). Teubner-Texte zur Mathematik, Leipzig. (also Wiley, New York, 1991).
133. Poggi J.-M., and Portier B. Nonlinear adaptive tracking using kernel estimators: Estimation and test for linearity. SIAM Journal on Control Optimization 39 3 (2000) 707-727
134. Portier B., and Oulidi A. Nonparametric estimation and adaptive control of functional autoregressive models. SIAM Journal on Control Optimization 39 2 (2000) 411-432
135. Pronzato L. Adaptive optimisation and D-optimum experimental design. Annals of Statistics 28 6 (2000) 1743-1761
136. Pronzato L. On the sequential construction of optimum bounded designs. Journal of Statistical Planning and Inference 136 (2006) 2783-2804
137. Pronzato L., Kulcsár C., and Walter E. An actively adaptive control policy for linear models. IEEE Transactions on Automatic Control 41 6 (1996) 855-858
138. Pronzato L., and Pázman A. Second-order approximation of the entropy in nonlinear least-squares estimation. Kybernetika 30 2 (1994) 187-198 Erratum, 32(1) (1996) 104
139. Pronzato L., and Pázman A. Using densities of estimators to compare pharmacokinetic experiments. Computers in Biology and Medicine 31 3 (2001) 179-195
140. Pronzato, L., & Pázman, A. (2004). Recursively re-weighted least-squares estimation in regression models with parameterized variance. In Proceedings of the EUSIPCO'2004, Vienna, Austria (pp. 621-624).
141. Pronzato L., and Thierry E. Sequential experimental design and response optimisation. Statistical Methods and Applications 11 3 (2003) 277-292
142. Pronzato L., and Walter E. Robust experiment design via stochastic approximation. Mathematical Biosciences 75 (1985) 103-120
143. Pronzato L., and Walter E. Robust experiment design via maximin optimization. Mathematical Biosciences 89 (1988) 161-176
144. Pronzato L., and Walter E. Experimental design for estimating the optimum point in a response surface. Acta Applicandae Mathematicae 33 (1993) 45-68
145. Pronzato L., and Walter E. Minimum-volume ellipsoids containing compact sets: Application to parameter bounding. Automatica 30 11 (1994) 1731-1739
146. Pronzato L., Wynn H.P., and Zhigljavsky A.A. Dynamical search (2000), Chapman & Hall/CRC, Boca Raton
147. Pronzato L., Wynn H.P., and Zhigljavsky A.A. Renormalised steepest descent in Hilbert space converges to a two-point attractor. Acta Applicandae Mathematicae 67 (2001) 1-18
148. d and Hilbert spaces. Mathematical Programming A 107 (2006) 409-438
149. Pukelsheim F. Optimal experimental design (1993), Wiley, New York
150. Pukelsheim F., and Reider S. Efficient rounding of approximate designs. Biometrika 79 4 (1992) 763-770
151. Rafajłowicz E. Optimal experiment design for identification of linear distributed parameter systems: Frequency domain approach. IEEE Transactions on Automatic Control 28 7 (1983) 806-808
152. Rafajłowicz E. Optimum choice of moving sensor trajectories for distributed parameter system identification. International Journal of Control 43 5 (1986) 1441-1451
153. Raynaud H.-F., Pronzato L., and Walter E. Robust identification and control based on ellipsoidal parametric uncertainty descriptions. European Journal of Control 6 3 (2000) 245-257
154. Robertazzi T.G., and Schwartz S.C. An accelerated sequential algorithm for producing D-optimal designs. SIAM Journal on Scientific and Statistical Computing 10 2 (1989) 341-358
155. Rojas C.R., Welsh J.S., Goodwin G.C., and Feuer A. Robust optimal experiment design for system identification. Automatica 43 (2007) 993-1008
156. Sacks, J., & Schiller, S. (1988). Spatial designs. In S. S. Gupta, & J. O. Berger (Eds.), Statistical decision theory and related topics IV (Vol. 2, pp. 385-399). Heidelberg: Springer.
157. Sacks J., Welch W.J., Mitchell T.J., and Wynn H.P. Design and analysis of computer experiments. Statistical Science 4 4 (1989) 409-435
158. Santner T., Williams B.J., and Notz W.I. The design and analysis of computer experiments (2003), Springer, Heidelberg
159. Schaback, R. (2003). Mathematical results concerning kernel techniques. In Preprints of the 13th IFAC symposium on system identification (pp. 1814-1819), Rotterdam.
160. Scheffé H. Simultaneous interval estimates of linear functions of parameters. Bulletin Institute of International Statistics 38 (1961) 245-253
161. Schonlau, M., Welch, W. J., & Jones, D. R. (1998). Global versus local search in constrained optimization of computer models. In New developments and applications in experimental design, lecture notes - monograph series (Vol. 34, pp. 11-25). IMS, Hayward.
162. Schwabe R. On adaptive chemical balance weighting designs. Journal of Statistical Planning and Inference 17 (1987) 209-216
163. Shewry M.C., and Wynn H.P. Maximum entropy sampling. Applied Statistics 14 (1987) 165-170
164. Shiryaev A.N. Probability (1996), Springer, Berlin
165. Sibson R. Discussion on a paper by H.P. Wynn. Journal of Royal Statistical Society B34 (1972) 181-183
166. Silverman B.W., and Titterington D.M. Minimum covering ellipses. SIAM Journal on Scientific and Statistical Computing 1 4 (1980) 401-409
167. Silvey S.D. Optimal design (1980), Chapman & Hall, London
168. Silvey S.D., Titterington D.M., and Torsney B. An algorithm for optimal designs on a finite design space. Communications in Statistics-Theory and Methods A 7 14 (1978) 1379-1389
169. Söderström T., and Stoica P. Comparison of some instrumental variable methods-consistency and accuracy aspects. Automatica 17 1 (1981) 101-115
170. Söderström T., and Stoica P. Instrumental variable methods for system identification (1983), Springer, New York
171. Söderström T., and Stoica P. System identification (1989), Prentice-Hall, New York
172. Spokoinyi V.G. On asymptotically optimal sequential experimental design. Advances in Soviet Mathematics 12 (1992) 135-150
173. Stein M.L. Interpolation of spatial data. Some theory for Kriging (1999), Springer, Heidelberg
174. Sternby J. On consistency for the method of least squares using martingale theory. IEEE Transactions on Automatic Control 22 3 (1977) 346-352
175. Titterington D.M. Optimal design: Some geometrical aspects of D-optimality. Biometrika 62 2 (1975) 313-320
176. Titterington, D. M. (1976). Algorithms for computing D-optimal designs on a finite design space. In Proceedings of the 1976 conference on information science and systems, (pp. 213-216), Baltimore, 1976. Department of Electronic Engineering, John Hopkins University.
177. Torsney B. A moment inequality and monotonicity of an algorithm. In: Kortanek K.O., and Fiacco A.V. (Eds). Proceedings of the international symposium on semi-infinite programming and applications (1983), Springer, Heidelberg 249-260
178. Tse E., and Bar-Shalom Y. An actively adaptive control for linear systems with random parameters via the dual control approach. IEEE Transactions on Automatic Control 18 2 (1973) 109-117
179. Tse E., Bar-Shalom Y., and Meier III L. Wide-sense adaptive dual control for nonlinear stochastic systems. IEEE Transactions on Automatic Control 18 2 (1973) 98-108
180. Uciński D. Optimal measurement methods for distributed parameter system identification (2005), CRC Press, Boca Raton
181. van der Vaart A.W. Maximum likelihood estimation under a spatial sampling scheme. Annals of Statistics 24 5 (1996) 2049-2057
182. Vandenberghe L., Boyd S., and Wu S.-P. Determinant maximisation with linear matrix inequality constraints. SIAM Journal on Matrix Analysis and Applications 19 2 (1998) 499-533
183. Vapnik V.N. Statistical learning theory (1998), Wiley, New York
184. Vapnik V.N. The nature of statistical learning theory. 2nd ed. (2000), Springer, New York
185. Vazquez, E. (2005). Modélisation comportementale de systèmes nonlinéaires multivariables par méthodes à noyaux et applications. Ph.D. Thesis, Université Paris XI, Orsay, France.
186. Vazquez, E., & Walter, E. (2003). Multi-output support vector regression. In Preprints of the 13th IFAC symposium on system identification (pp. 1820-1825), Rotterdam.
187. Vazquez E., Walter E., and Fleury G. Intrinsic Kriging and prior information. Applied Stochastic Models in Business and Industry 21 (2005) 215-226
188. Walter E., and Pronzato L. Identification of parametric models from experimental data (1997), Springer, Heidelberg
189. Watson G.S. Smooth regression analysis. Sankhya, Series A 26 (1964) 359-372
190. Wright, S. (Ed.) (1997). Primal-dual interior-point methods. Philadelphia: SIAM.
191. Wu C.F.J. Asymptotic inference from sequential design in a nonlinear situation. Biometrika 72 3 (1985) 553-558
192. Wynn H.P. The sequential generation of D-optimum experimental designs. Annals of Mathematical Statistics 41 (1970) 1655-1664
193. Wynn, H. P. (2004). Maximum entropy sampling and general equivalence theory. In A. Di Bucchianico, H. Läuter, & H. P. Wynn (Eds.), mODa'7-advances in model-oriented design and analysis, Proceedings of the 7th international workshop (pp. 211-218), Heeze (Netherlands), June. Heidelberg: Physica-Verlag.
194. Ye Y. Interior-point algorithms: Theory and analysis (1997), Wiley, Chichester
195. Ying Z. Maximum likelihood estimation of parameters under a spatial sampling scheme. Annals of Statistics 21 (1993) 1567-1590
196. Zarrop M.B. Optimal experiment design for dynamic system identification (1979), Springer, Heidelberg
197. Zhu Z., and Zhang H. Spatial sampling design under the infill asymptotic framework. Environmetrics 17 4 (2006) 323-337