Partitioning: A Unifying Framework for Adaptive Systems, I: Estimation

Proceedings of the IEEE

Volumn 64, Issue 8, 1976, Pages 1126-1143

  Lainiotis, Demetrios G ^a  

^a UNIVERSITY AT BUFFALO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE ESTIMATION; PARTITIONING;

SIGNAL FILTERING AND PREDICTION;

CONTROL SYSTEMS, ADAPTIVE;

EID: 0016991136     PISSN: 00189219     EISSN: 15582256     Source Type: Journal    
DOI: 10.1109/PROC.1976.10284     Document Type: Article

References (81)

1. D. G. Lainiotis “Estimation: A brief survey,” J Inform. Sci., vol. 7, no. 3, pp. 197–202, 1974.
2. D. G. Lainiotis “Partitioned estimation algorithms, I: Nonlinear estimation,” J. Inform. Sciences, vol. 7, no. 3, pp. 203–255, 1974.
3. R. L. Stratonovich “On the theory of optimal nonlinear filtration of random functions,” Theory Prob. App., vol. 4, pp. 223–225, 1959.
4. W. M. Wonham “Some applications of stochastic differential equations to optimal nonlinear filtering,” SIAM J. Control, vol. 2, pp. 347–369, 1965.
5. H. J. Kushner “Dynamical equations for optimal nonlinear filtering,” J. Differential Equations, vol. 3, no. 2, pp. 179–190, Apr. 1967.
6. H. W. Sorenson “On the development of practical nonlinear filters,” J. Inform. Sciences, vol. 7, no. 3, pp. 63–80, 1974.
7. D. G. Lainiotis, “Optimal adaptive estimation: Structure and parameter adaptation,” in Proc. IEEE Symp. Adaptive Processes, Nov. 1969; also Electronics Res. Center, Univ. of Texas, Austin, TX, Tech. Rep. no. 74, Sept. 1969.
8. B. W. Licht, “Approximations in optimal nonlinear filtering,” Tech. Systems Res. Center, Case Western Reserve Univ., Cleveland, OH, Tech. Rep. SRC 701, Apr. 1970.
9. A. H. Jazwinski, Stochastic Processes and Filtering Theory. New York: Academic Press, 1970.
10. D. G. Lainiotis “Optimal adaptive estimation: Structure and parameter adaptation,” IEEE Trans. Automat. Contr., vol. AC-16, pp. 160–170, Apr. 1971.
11. D. G. Lainiotis “Joint detection, estimation, and system identification,” Inform. Control J., vol. 19, no. 8, pp. 75–92, Aug. 1971.
12. S. K. Park and D. G. Lainiotis “Monte-Carlo study of the optimal nonlinear estimator: Linear systems with non-gaussian initial state,” Int. J. Control, vol. 16, no. 6, pp. 1029–1040, 1972.
13. D. G. Lainiotis and S. K. Park “On joint detection, estimation and system identification: Discrete data case,” Int. J. Control, vol. 17, no. 3, pp. 609–633, Mar. 1973.
14. D. G. Lainiotis and J. G. Deshpande “Parameter estimation using splines,” J. Inform. Sciences, vol. 7, no. 3, pp. 101–125, 1974.
15. D. G. Lainiotis “Supervised learning sequential structure and parameter adaptive pattern recognition: Discrete data case,” IEEE Trans. Inform. Theory, vol. IT-17, pp. 106–110, Jan. 1971.
16. D. G. Lainiotis “Optimal nonlinear estimation,” Int. J. Control, vol. 14, no. 6, pp. 1137–1148, 1971.
17. D. G. Lainiotis, and K. S. Govindaraj, “A unifying approach to linear estimation via the partitioned algorithms, I: Continuous models,” Proc. 1975 IEEE Decision and Control Conf., Dec. 1975.
18. D. G. Lainiotis, “A unifying framework for linear estimation: Generalized partitioned algorithms,” J. Inform. Sciences, vol. 10, no. 3, Apr. 1976.
19. D. G. Lainiotis, “Adaptive pattern recognition: A state variable approach,” in Advances in Pattern Recognition, M. Watanabe, Ed. New York: Academic Press, May 1972.
20. D. G. Lainiotis “Partitioned estimation algorithms, II: Linear estimation,” J. Inform. Sciences, vol. 7, no. 3, pp. 317–340, July 1974.
21. D. G. Lainiotis, “Sequential structure and parameter adaptive pattern recognition, Part I: Supervised learning,” IEEE Trans. Inform. Theory, vol. IT-16, Sept. 1970.
22. D. G. Lainiotis, “On a general relationship between estimation, detection, and the Bhattacharyya coefficient,” IEEE Trans. Inform. Theory, vol. IT-15, July 1969.
23. R. E. Mortensen, “Optimal control of continuous-time stochastic systems,” Electronics Res. Lab., Univ. of California, Berkeley, CA, Tech. Rep. ERL-66-1, Aug. 19, 1966.
24. J. R. Fisher and E. B. Stear “Optimal nonlinear filtering for independent increment processes, Part I, II,” IEEE Trans. Inform. Theory, vol. IT-13, pp. 558–578, Oct. 1967.
25. S. K. Park and D. G. Lainiotis, “A unified approach to detection estimation and system identification,” Electronics Res. Center, Univ. of Texas, Austin, TX, Tech. Rep. no. 136, Aug. 1972.
26. D. G. Lainiotis and F. L. Sims, “Performance measures for adaptive Kaiman estimators,” IEEE Trans. Automat. Contr., vol. AC-15, Apr. 1970.
27. D. G. Lainiotis, “Partitioned estimation algorithms, II: Linear estimation,” in Proc. IEEE Decision and Control Conf., Nov. 1974.
28. D. G. Lainiotis, “Fast Riccati equation solutions: Partitioned algorithms,” in Proc. 1975 Milwaukee Symp. Automatic Computation and Control, Apr. 1975.
29. D. G. Lainiotis, S. K. Park, and R. Krishnaiah “Optimal state-vector estimation for non-Gaussian initial state-vector,” IEEE Trans. Automat. Contr., vol. AC-16, pp. 197–198, Apr. 1971.
30. D. G. Lainiotis, “Fast Riccati equation solutions: Partitioned algorithms,” J. Computers and Electrical Engineering, Nov. 1975.
31. D. G. Lainiotis and K. S. Govindaraj, “Partitioned Riccati equation solution algorithms: Computer simulation,” in Proc. 1975 Pittsburgh Conf. Modeling and Simulation, Apr. 1975.
32. D. G. Lainiotis “Partitioned linear estimation algorithms: Discrete case,” IEEE Trans. Automat. Contr., vol. AC-20, pp. 255–257, June 1975.
33. D. G. Lainiotis “Discrete Riccati equation solutions: Partitioned algorithms,” IEEE Trans. Automat. Contr., vol. AC-20, pp. 555–556, Aug. 1975.
34. S. Fralick, “Learning to recognize patterns without a teacher,” Stanford Electronics Labs, Stanford Univ., Stanford, CA, Tech. Rep. SEL-65-011, Mar. 1965.
35. D. T. Magill “Optimal adaptive estimation of sampled stochastic processes,” IEEE Trans. Automat. Contr., vol. AC-10, pp. 434–439, Oct. 1965.
36. D. G. Lainiotis, “A nonlinear adaptive estimation recursive algorithm,” IEEE Trans. Automat. Contr., vol. AC-13, Apr. 1968.
37. D. G. Lainiotis, “Adaptive mixture decomposition: A unifying approach,” in Proc. Nat. Electron. Conf. 24, 1968.
38. D. G. Lainiotis and C. G. Hilborn, “Learning systems for minimum risk adaptive pattern classification and optimal adaptive estimation,” Dep. Elec. Eng., Univ. of Texas, Austin, TX, CSRG Tech. Rep. no. 9, Nov. 1967.
39. C. G. Hilborn and D. G. Lainiotis, “Optimal estimation in the presence of unknown parameters,” IEEE Trans. Syst., Mar., Cybern., vol. SMC-5, Jan. 1969.
40. C. G. Hilborn and D. G. Lainiotis, “Optimal adaptive filter realization for sampled stochastic processes with an unknown parameter,” IEEE Trans. Automat. Contr., vol. AC-14, Dec. 1969.
41. F. L. Sims and D. G. Lainiotis, “A recursive algorithm for the calculation of the adaptive Kaiman filter weighting coefficients,” IEEE Trans. Automat. Contr., vol. AC-14, Apr. 1969.
42. D. G. Lainiotis and K. S. Govindaraj, “A unifying approach to linear estimation via the partitioned algorithms, II: Discrete models,” in Proc. 1975 IEEE Decision and Control Conf., Dec. 1975.
43. R. M. Hawkes and J. R. Moore, “Performance of Bayesian parameter estimators for linear signal models,” IEEE Trans. Automat. Contr., vol. AC-21, June 1976.
44. R. M. Hawkes and J. R. Moore, “Performance bounds for adaptive estimation,” Proc. IEEE, vol. 64, Aug. 1976.
45. L. A. Liporace, “Variance of Bayes estimates,” IEEE Trans. Inform. Theory, IT-17, Nov. 1971.
46. D. G. Lainiotis, “A class of upper bounds on probability of error for multihypotheses pattern recognition,” IEEE Trans. Inform. Theory, vol. IT-15, Nov. 1969.
47. D. G. Lainiotis and S. K. Park, “Probability of error bounds,” IEEE Trans. Syst, Man, Cybern., vol. SMC-7, Apr. 1971.
48. R. M. Hawkes and J. B. Moore, “Decision methods in dynamic system identification,” in Proc. IEEE Decision and Control Conf., Dec. 1975.
49. D. G. Lainiotis “Optimal linear smoothing: Continuous data case,” Int J. Control, vol. 17, no. 5, pp. 921–930, 1973.
50. D. G. Lainiotis, “Generalized Chandrasekhar algorithms: Time-varying models,” in Proc. 1975 IEEE Decision and Control Conf., Dec. 1975.
51. D. G. Lainiotis, “Partitioned Riccati algorithms,” in Proc. 1975 IEEE Decision and Control Conf., Dec. 1975.
52. D. G. Lainiotis, “Partitioned Riccati solutions and ingegration-free doubling algorithms,” to be published in IEEE Trans. Automat Contr., 1976.
53. D. G. Lainiotis, “Generalized Chandrasekhar algorithms: Time-Varying models,” to be published in IEEE Trans. Automat Contr., 1976.
54. T. Kailath “Some new Algorithms for recursive estimation in constant linear systems,” IEEE Trans. Inform. Theory, vol. IT-19, pp. 750–760, Nov. 1973.
55. A. Lindquist, “Optimal filtering of continuous-time stationary processes by means of the backward innovation process,” SIAM J. Control, vol. 12, no. 4, Nov. 1974.
56. J. Casti “Matrix Riccati equations, demensionality reduction, and generalized X and Y functions,” Utilitas Mathematicas, vol. 6, pp. 95–110, 1974.
57. L. Ljung, T. Kailath, and B. Friedlander “Scattering theory and linear least squares estimation—Part I: Continuous-time problems,” Proc. IEEE, vol. 64, pp. 131–139, Jan. 1976.
58. J. T. Lo, “Finite dimensional sensor orbits and optimal nonlinear filtering,” Ph.D. dissertation, Dep. Aerospace Engineering, Univ. Southern California, Los Angeles, Aug. 1969.
59. D. L. Alspach and H. W. Sorenson “Nonlinear Bayesian estimation using Gaussian sum approximations,” IEEE Trans. Automat. Contr., vol. AC-17, pp. 439–448, Aug. 1972.
60. D. G. Alspach, “The use of Gaussian sum approximations in non-linear filtering,” J. Inform. Sciences, vol. 7, no. 3/4, Fall 1974.
61. D. G. Lainiotis and J. G. Deshpande, “Parameter estimation using splines,” J. Inform. Sciences, vol. 7, no. 4, 1974.
62. J. G. Deshpande and D. G. Lainiotis, “Identification and control of linear stochastic systems using spline functions,” Electronics Res. Center, Univ. of Texas, Austin, TX, Tech. Rep. no. 146, May 1973.
63. D. Q. Mayne “A solution of the smoothing problem for linear dynamic systems,” Automatica, vol. 4, pp. 73–92, 1966.
64. J. S. Meditch, “Optimal fixed-point continuous linear smoothing,” in Proc. 1967 Joint Automat. Control Conf., pp. 249–257.
65. T. Kailath and P. Frost “An innovations approach to least-squares estimation—Part II: Linear smoothing in additive white noise,” IEEE Trans. Automat. Contr., vol. AC-13, pp. 655–660, 1968.
66. D. G. Lainiotis, “General backward Markov models,” to be published in IEEE Trans. Automat. Contr., Aug. 1976.
67. L. Ljung and T. Kailath, “A unified approach to smoothing problems,” to be published in Automatica, Apr. 1976.
68. J. L. Center “Practical nonlinear filtering of discrete observations by generalized least-squares approximation of the conditional probability distribution,” in Proc. Nonlinear Estim. Symp., vol. 2, pp. 88–99, 1971.
69. C. T. Leondes, et al. “Nonlinear smoothing theory,” IEEE Trans. Syst., Man, Cybern., vol. SMC-6, pp. 63–71, 1970.
70. R. S. Bucy and K. D. Senne “Digital synthesis of nonlinear filters,” Automatica, vol. 7, no. 3, pp. 287–298, May 1971.
71. D. G. Lainiotis and K. S. Govindaraj, “A unifying approach to linear estimation via partitioning,” Systems Res. Center, State Univ. of New York at Buffalo, Tech. Rep. no. 1976-1, Apr. 1976.
72. D. G. Lainiotis, “A unifying framework for discrete adaptive estimation: Generalized partitioned algorithms,” submitted for publication.
73. R. L. Sengbush and D. G. Lainiotis “Simplified parameter quantization procedure for adaptive estimation,” IEEE Trans. Automat. Contr., vol. AC-14, pp. 424–425, Aug. 1969.
74. R. M. Redheffer “On the relation of transmission-line theory to scattering and transfer,” J. Math, and Physics, vol. 41, pp. 1–41, 1962.
75. R. M. Redheffer, “Difference equations and functional equations in transmission-line theory,” Modem Mathematics for the Engineer, E. F. Bechenbach, Ed. New York: McGraw-Hill, 1961.
76. E. D. Denman, “Invariant imbedding and linear systems,” in Invariant Imbedding, R. E. Bellman and E. D. Denman, Eds. New York: Springer-Verlag, 1971.
77. E. D. Denman “A numerical method for coupled differential equations,” Int. J. Numerical Methods in Engineering, vol. 4, pp. 587–596, 1972.
78. G. S. Sidhu and U. B. Desai, “New smoothing algorithms based on reversed-time lumped models,” to be published in IEEE Trans. Automat. Contr., 1976.
79. G. S. Sidhu and U. B. Desai, “New smoothing algorithms based on reverse-time Markov models,” to be published in Proc. 1976 Johns Hopkins Conf. Information Sciences and Systems.
80. B. Friendlander, T. Kailath, and L. Ljung, “Scattering theory and linear least squares estimation, Part II: Discrete-time problems,” J. Franklin Inst., Jan. 1976.
81. U. B. Desai, “An orthogonal directions approach to discrete-time, TPBVP' s, scattering matrices, and recursive estimation algorithms,” M.S. thesis, Dep. Elec. Eng., State Univ. of New York at Buffalo, Feb. 1976.