A review of the parameter estimation problem of fitting positive exponential sums to empirical data

Applied Mathematics and Computation

Volumn 126, Issue 1, 2002, Pages 31-61

  Holmström, Kenneth ^a   Petersson, Jöran ^a  

^a MÄLARDALEN UNIVERSITY   (Sweden)

Author keywords

Compartment models; Exponential sums; Nonlinear least squares; Nonlinear parameter estimation; Pisarenko's method; Prony's method

Indexed keywords

EID: 0037082774     PISSN: 00963003     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0096-3003(00)00138-7     Document Type: Article

References (97)

1. M. Agha A direct method for fitting linear combinations of exponentials Biometrics 27 1971 399 413
2. H. Akaike Fitting autoregressive models for prediction Ann. Inst. Stat. Math. 20 1969 425 439
3. H. Akaike, Information theory and an extension of the maximum likelihood principle, in: B.N. Petrov, F. Csaki, (Eds.), Proceedings from Second International Symposium on Information Theory, Budapest, Supp. to Problems of Control and Information Theory, 1972, pp. 267–281
4. H. Akaike A new look at the statistical model identification IEEE Trans. Autom. Control AC-19 6 1974 716 723
5. N.L. Akhiezer The Classical Moment Problem and Some Related Questions in Analysis 1965 Oliver and Boyd Edinburgh
6. M. Al-Baali R. Fletcher Variational methods for nonlinear least squares J. Oper. Res. Soc. 36 1985 405 421
7. G. Ammar W. Dayawansa C. Martin Exponential interpolation: theory and numerical algorithms Appl. Math. Comput. 41 1991 189 232
8. E. Avrett D. Hummer Mon. Notic. Roy. Astron. Soc. 130 1965 865
9. M. Bertero, P. Boccacci, E.R. Pike, On the recovery and resolution of exponential relaxation rates from experimental data ii – the optimum choice of experimental sampling points for Laplace transform inversion, Proc. Roy. Soc. 393 (51) (1984)
10. M. Bertero P. Brianzi E.R. Pike On the recovery and resolution of exponential relaxation rates from experimental data: Laplace transform inversions in weighted spaces Inverse Problems 1 1985 1 15
11. 2-norm J. Approximation Theory 12 1 1974 91 93
12. p -approximation J. Approximation Theory 18 2 1976 136 151
13. D. Braess Chebyshev approximation by γ -polynomials. III On the number of best approximations J. Approximation Theory 24 2 1978 119 145
14. D. Braess, Global analysis and nonlinear approximation and its application to exponential approximation. 2. Applications to exponential approximation, in: Z. Ziegler, Approximation Theory and Applications, Academic Press Technicon, Haifa, Israel, 1981, pp. 39–63
15. D. Braess, Global analysis in nonlinear approximation and its application to exponential approximation. 1. The uniqueness theorem for Haar-Embedded manifolds, in: Z. Ziegler, Approximation Theory and Applications, Academic Press Technicon, Haifa, Israel, 1981, pp. 23–37
16. R. Brockett, The geometry of the partial realization problem, in: Proceedings of the1978 IEEE Conference on Decision and control, 1978, pp. 1048–1052
17. J. Burstein Approximations by Exponentials, Their Extensions and Differential Equations 1997 Metric Press Boston, MA
18. D.G. Cantor J.W. Evans On approximation by positive sums of powers SIAM J. Appl. Math. 18 2 1970 380 388
19. T.F. Coleman P.E. Plassmann Solution of nonlinear least-squares problems on a multiprocessor G.A. van Zee J.G.G. van de Vorst Parallel Computing, Lecture Notes in Computer Science, vol. 384 1988 Springer Berlin 44 60
20. T.F. Coleman P.E. Plassmann A parallel nonlinear least-squares solver: theoretical analysis and numerical results SIAM J. Sci. Statist. Comput. 13 3 1992 771 793
21. R.G. Cornell, A method for fitting linear combinations of exponentials, Biometrics (1962) 104–113
22. L. Cromme Eine Klasse von verfahren zur ermittlung bester nichtlinearer Tschebyscheff-Approximationen Numerische Mathematik 25 1976 447 459
23. L. Cromme Strong uniqueness – a far-reaching criterion for the convergence analysis of iterative procedures Numerische Mathematik 29 1978 179 193
24. L. Cromme, A unified approach to differential characterizations of local best approximations for exponential sums and splines, Technical Report, Lehrstühle für Numerische und Angewandte Mathematik, Universität Göttingen, University of Berkeley, CA, May 1981
25. 1-parametrizations for exponential sums and splines J. Approximation Theory 35 1 1982 30 44
26. M. Della Corte L. Buricchi S. Romano On the fitting of linear combinations of exponentials Biometrics 30 1974 367 369
27. J.E. Dennis R.B. Schnabel Numerical Methods for Unconstrained Optimization and Nonlinear Equations 1983 Prentice-Hall Englewood Cliffs, NJ
28. J.E. Dennis Jr D.M. Gay R.E. Welch An adaptive nonlinear least-squares algorithm ACM Trans. Math. Software 7 3 1981 348 368
29. G.T. Duncan An empirical study of jackknife-constructed confidence regions in nonlinear regression Technometrics 20 2 1978 123 129
30. J.W. Evans W.B. Gragg R.J. LeVeque On least-squares exponential sum approximation with positive coefficients Math. Comput. 34 149 1980 203 211
31. R. Fletcher C. Xu Hybrid methods for nonlinear least squares IMA J. Numer. Anal. 7 1987 371 389
32. R. Fletcher Practical Methods of Optimization second ed. 1987 Wiley New York
33. W. Gragg A. Lindquist On the partial realization problem Linear Algebra Appl. 50 1983 277 319
34. J. Guddat H.Th. Jongen Structural stability in nonlinear optimization Optimization 18 1987 617 631
35. S.-Å. Gustafson A computational scheme for exponential approximation Z. Angew. Math. Mech. 61 1981 284 287
36. F. Hilebrand Introduction to Numerical analysis 1956 McGraw-Hill New York
37. K. Holmström, NLPLIB TB 1.0 – A MATLAB toolbox for nonlinear optimization and parameter estimation, Technical Report IMa-TOM-1997-02, Department of Mathematics and Physics, Mälardalen University, Sweden, 1997
38. K. Holmström, The NLPLIB toolbox for nonlinear programming, in: MATLAB, Advanced Modeling and Optimization 1 (1999) 70–86
39. K. Holmström, The TOMLAB optimization environment in MATLAB, Advanced Modeling and Optimization 1 (1999) 47–69
40. K. Holmström, A. Ahnesjö, J. Petersson, Algorithms for exponential sum fitting in radiotherapy planning, Advanced Modeling and Optimization 3 (2001)
41. G. Hunt I. Grant J. Atmos. Sci. 26 1969 963
42. J. Huschens On the use of product structure in secant methods for nonlinear least-squares problems SIAM J. Opt. 4 1 1994 108 129
43. R.I. Jennrich P.B. Bright Fitting systems of linear differential equations using computer generated exact derivatives Technometrics 18 4 1976 385 392
44. H.Th. Jongen G.-W. Weber Nonlinear optimization, characterization of structural stability J. Global Opt. 1 1 1991 47 64
45. M. Kahn M.S. Mackisack M.R. Osborne G.K. Smyth On the consistency of Prony's method and related algorithms J. Comput. Graphical Statist. 1 1992 329 349
46. T. Kaijser, A simple inversion method for determining aerosol size distributions, Technical Report C 30231-E, FOA, Huvudavdelning 3, 581 11 Linköping, September 1981
47. D.W. Kammler Least squares approximation of completely monotonic functions by sums of exponentials SIAM J. Numer. Anal. 16 1979 801 818
48. P. Kirkegaard M. Eldrup POSITRONFIT: a versatile program for analysing positron lifetime spectra Comput. Phys. Comm. 3 1972 240 255
49. P. Kirkegaard M. Eldrup POSITRONFIT extended: a new version of a program for analysing positron lifetime spectra Comput. Phys. Comm. 7 1974 401 409
50. M. Kojima Strongly stable stationary solutions in nonlinear programs S.M. Robinsson Analysis and Computation of Fixed Points 1980 Academic Press New York
51. S.Y. Kung, Multivariable and multidimensional systems: analysis and design, Ph.D. Thesis, Department of Electrical Engineering, Stanford University, CA, June 1977
52. P. Lindström and P. Wedin, Methods and software for nonlinear least-squares problems, Technical Report UMINF-133.87, Inst. of Information Processing, University of Umeå, Sweden, 1988
53. L. Ljung System Identification: Theory for the User 1987 Prentice-Hall Englewood Cliffs, NJ
54. M.S. Mackisack M.R. Osborne G.K. Smyth A modified Prony algorithm for estimating sinusoidal frequencies J. Statist. Comput. Simulation 49 1994 111 124
55. L. Marple, Spectral line analysis by Pisarenko and Prony methods, Technical Report CH1379-7/79/0000-0159, Advent systems INC, 1183 Bourdeaux Dr. Sunnyvale, CA 94086, 1979
56. C. Martin J. Smith Approximation, interpolation and sampling Contemp. Math. 68 1987 227 252
57. M. Nakamura, T. Takahashi, Inversion of the chi-square transform, 1978 (Translated paper from the original Japanese paper)
58. M. Nakamura T. Takahashi S. Kodama Parameter estimation of a linear combination of exponential decays by a method of the gamma transformation – a investigation Trans. IECE Jpn. E 63 6 1980 500 501
59. L. Nazareth Some recent approaches to solving large residual nonlinear least-squares problems SIAM 22 1 1980 1 11
60. M.R. Osborne, A class of nonlinear regression problems, in: R.S. Anderssen, M.R. Osborne, (Eds.), Data Representation, University of Queensland Press, 1970, pp. 94–101
61. M.R. Osborne Some special nonlinear least-squares problems SIAM J. Numer. Anal. 12 4 1975 571 592
62. M.R. Osborne Nonlinear least squares – the Levenberg algorithm revisited J. Aust. Math. Soc. B 19 1976 343 357
63. M.R. Osborne, G.K. Smyth, An algorithm for exponential fitting revisited, in: J. Gani, M.B. Priestly, (Eds.), Essays in Time Series and Allied Processes: Papers in Honour of E. LJ. Hannan, Applied Probability Trust, Sheffield, 1986, pp. 419–430
64. M.R. Osborne G.K. Smyth A modified Prony algorithm for fitting functions defined by difference equations SIAM J. Sci. Statist. Comput. 12 1991 362 382
65. M.R. Osborne G.K. Smyth A modified Prony algorithm for exponential function fitting SIAM J. Sci. Comput. 16 1 1995 119 138
66. J. Petersson, Algorithms for fitting two classes of exponential sums to empirical data, Licentiate Thesis, ISSN 1400-5468, Opuscula ISRN HEV-BIB-OP-35-SE, Division of Optimization and Systems Theory, Royal Institute of Technology, Stockholm, Mälardalen University, Sweden, 4 December 1998
67. J. Petersson, K. Holmström, Fitting of exponential sums to empirical data, Technical Report IMa-TOM-1997-05, Department of Mathematics and Physics, Mälardalen University, Sweden, 1997, Presented at the 16th International Symposium on Mathematical Programming, Lausanne, Switzerland, 24–29 August 1997
68. J. Petersson, K. Holmström, Identifying parameters and model order for two classes of exponential sum fitting problems, Technical Report IMa-TOM-1998-05, Department of Mathematics and Physics, Mälardalen University, Sweden, 1998
69. J. Petersson, K. Holmström, Initial values for a class of exponential sum least-squares fitting problems, Technical Report IMa-TOM-1998-04, Department of Mathematics and Physics, Mälardalen University, Sweden, 1998
70. J. Petersson, K. Holmström, Initial values for the exponential sum least-squares fitting problem, Technical Report IMa-TOM-1998–01, Department of Mathematics and Physics, Mälardalen University, Sweden, 1998
71. J. Petersson, K. Holmström, Initial values for two classes of exponential sum least-squares fitting problems, Technical Report IMa-TOM-1998-07, Department of Mathematics and Physics, Mälardalen University, Sweden, 1998
72. J. Petersson and K. Holmström, Methods for parameter estimation in exponential sums, in: A. Løkketangen, (Ed.), Proceedings from the Fifth Meeting of the Nordic Section of the Mathematical Programming Society, ISBN 82-90347-76-6, Molde, Division of Operations Research, Molde University, 1998
73. P.F. Price A comparison of the Least-Squares and maximum likelihood estimators for counts of radiation quanta which follow a Poisson distribution Acta Cryst. A 35 1979 57 60
74. E. Raschke U. Stucke Beitr. Physik Atmos. 46 1973 203
75. J. Rissanen Recursive identification of linear sequences SIAM J. Control 9 1971 420 430
76. J. Rissanen Modelling by shortest data description Automatica 14 1978 465 471
77. A. Ruhe, Least-squares fitting by positive sums of exponentials, Technical Report UMINF-70.78, Inst. of Information Processing, University of Umeå, Sweden, 1978, Revised 29 February 1980
78. A. Ruhe Fitting empirical data by positive sums of exponentials SIAM J. Sci. Statist. Comput. 1 4 1980 481 498
79. A. Ruhe, Fitting empirical data by positive sums of exponentials, Compstat (1980) 622–628
80. A. Ruhe P. Wedin Algorithms for separable nonlinear least-squares problems SIAM Rev. 22 1980 318 337
81. B.K. Shah Obtaining preliminary estimates to fit two-term exponential model to blood concentration data J. Pharm. Sci. 62 1973 1208 1209
82. R. Shapiro Information loss and compensation in linear interpolation J. Comput. Phys. 10 1972 65 84
83. R. Shapiro Smoothing Filtering and boundary effects Ref. Geophys. and Space Phys. 8 1972 359 387
84. M.R. Smith S. Cohn-Sfetcu H.A. Buckmaster Decomposition of multicomponent exponential decays by spectral analytic techniques Technometrics 18 4 1976 467 482
85. G.K. Smyth, Coupled and separable iterations in nonlinear estimation, Ph.D. Thesis, Canberra, Australian National University, 1985
86. H.S. Steyn, Fitting linear combinations of exponential decays by using Fourier analysis, in: Compstat, Physica-Verlag, Vienna, 1980, pp. 615–621
87. H.S. Steyn and J.W.J. van Wyk, Some methods for fitting compartment models to data, Technical Report, Wetenskaplike bydraes van die pu vir cho, Potchefstroomse Universiteit vir CHO, 1977
88. A. Van den Bos A class of small sample nonlinear least-squares problems Automatica 16 1980 487 490
89. J.M. Varah On fitting exponentials by nonlinear least squares SIAM J. Sci. Statist. Comput. 6 1985 30 44
90. W.J. Wiscombe J.W. Evans Exponential–sum fitting of radiative transmission functions Comput. Phys. 24 4 1977 416 444
91. H. Yabe T. Takahashi Factored quasi-Newton methods for nonlinear least-squares problems Math. Programming 51 1 1991 75 100
92. E.M.L. Beale Confidence regions in nonlinear estimation J. Roy. Statist. Soc. Ser. B 22 1960 41 76
93. R.R. Meyer The validity of a family of optimization methods SIAM J. of Control 8 1970 41 54
94. J.J. Mckcown Specialized versus general purpose algorithms for minimizing functions that are sums of squared terms Mathematical Programming 9 1975 57 60
95. D.g. Gardner J.C. Gardner G. Laush W.W. Meinke Method for the analysis of muticomponent experimental decay curves J. Chem. Phys. 31 1959 978 986
96. J.R. Rice, Minimization and techniques in nonlinear approximation, in: J.M. Ortega, W.C. Rheinboldt (Eds.), Studies in Numerical analysis2, Society for Industrial and Applied Mathemetics, Philadelphia, PA, 1970, pp. 80-89
97. K. Holmström New optimization algorithms and software Theory of Stochastic Processes 5 21 1999 55 63