On-line parameter estimation for a partially observable system subject to random failure

Naval Research Logistics

Volumn 53, Issue 5, 2006, Pages 477-483

  Lin, Darning ^a   Makis, Viliam ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Condition based maintenance; Continuous discrete model; On line parameter estimation; Partially observable system; Recursive maximum likelihood

Indexed keywords

ALGORITHMS; CONSTRAINT THEORY; MARKOV PROCESSES; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; VIBRATIONS (MECHANICAL);

CONDITION-BASED MAINTENANCE; CONTINUOUS-DISCRETE MODELS; ON-LINE PARAMETER ESTIMATION; PARTIALLY OBSERVABLE SYSTEMS; RECURSIVE MAXIMUM LIKELIHOOD;

ONLINE SYSTEMS;

EID: 33746338246     PISSN: 0894069X     EISSN: 15206750     Source Type: Journal    
DOI: 10.1002/nav.20156     Document Type: Article

References (26)

1. T. Aven, Condition based replacement policies-A counting process approach, Reliab Eng Syst Safety 51 (1996), 275-281.
2. C. Bunks, D. McCarthy, and T. Al-Ani, Condition-based maintenance of machines using hidden Markov models, Mech Syst Signal Process 14 (2000), 597-612.
3. S. Challa, and Y. Bar-Shalom, Nonlinear filter design using Fokker-Planck-Kolmogorov probability density evolutions, IEEE Trans Aerospace Electr Syst 36 (2000), 309-315.
4. A. H. Christer, W. Wang, and J. M. Sharp, A state space condition monitoring model for furnace erosion prediction and replacement, Eur J Oper Res 101 (1997), 1-14.
5. I. B. Collings, V. Krishnamurthy, and J. B. Moore, On-line identification of hidden Markov models via recursive prediction error techniques, IEEE Trans Signal Process 42 (1994), 3535-3539.
6. I. B. Collings and T. Rydén, A new maximum likelihood gradient algorithm for on-line hidden Markov model identification, Proc 1998 IEEE Int Conf Acoustics, Speech and Signal Processing, Vol. 4, 1998, pp. 2261-2264.
7. R. J. Elliott, L. Aggoun, and J. B. Moore, Hidden Markov Models: Estimation and Control, Springer-Verlag, 1995.
8. E. Fernández-Gaucherand, A. Arapostathis, and S. J. Marcus, Analysis of an adaptive control scheme for a partially observed controlled Markov chain, IEEE Trans Automatic Control 38 (1993), 987-993.
9. O. Hernandez-Lerma, Adaptive Markov Control Processes, Springer-Verlag, 1989.
10. U. Holst, and G. Lindgren, Recursive estimation in mixture models with Markov regime, IEEE Trans Inform Theor 37 (1991), 1683-1690.
11. J. A. M. Hontelez, H. H. Burger, and J. D. Wijnmalen, Optimum condition-based maintenance policies for deteriorating systems with partial information, Reliab Eng Syst Safety 51 (1996), 267-274.
12. W. J. Hopp and Y. L. Kuo, An optimal structured policy for maintenance of partially observable aircraft engine components, Nav Res Logist 45 (1998), 335-352.
13. U. Jensen, and G. H. Hsu, Optimal stopping by means of point process observations with applications in reliability, Math Oper Res 18 (1993), 645-657.
14. V. Krishnamurthy, and J. B. Moore, On-line estimation of hidden Markov model parameters based on the Kullback-Leibler information measure, IEEE Trans Signal Process 41 (1993), 2557-2573.
15. D. Lin and V. Makis, Recursive filters for a partially observable system subject to random failure, Adv Appl Probabil 35 (2003), 207-227.
16. L. Ljung and T. Söderström, Theory and Practice of Recursive Identification, MIT Press, Cambridge, MA, 1983.
17. S. V. Lototsky and B. L. Rozovskii, Recursive nonlinear filter for a continuous discrete-time model: Separation of parameters and observations, IEEE Trans Autom Control 43 (1998), 1154-1158.
18. V. Makis and A. K. S. Jardine, Optimal replacement in the proportional hazards model, INFOR 30 (1992), 172-183.
19. V. Makis and X. Jiang, Optimal replacement under partial observations, Math Oper Res 28 (2003), 382-394.
20. V. Makis, X. Jiang, and A. K. S. Jardine, A condition-based maintenance model, IMA J Math Appl Bu Ind 9 (1998), 201-210.
21. P. Mandl, Estimation and control in Markov chains, Adv Appl Probabil 6 (1974), 40-60.
22. A. J. Miller, A new wavelet basis for the decomposition of gear motion error signals and its application to gearbox diagnostics, M.Sc. Thesis, Pennsylvania State University, 1999.
23. J. N. Nielsen, H. Madsen, and P. C. Young, Parameter estimation in stochastic differential equations: An overview, Annu Rev Control 24 (2000), 83-94.
24. E. J. Sondik, The optimal control of partially observable Markov processes over the infinite horizon: Discounted costs, Oper Res 26 (1978), 282-304.
25. W. Stadje, Maximal wearing-out of a deteriorating system, Eur J Oper Res 73 (1994), 472-479.
26. C. C. White, Optimal control-limit strategies for a partially observed replacement problem, Int J Syst Sci 10 (1979), 321-331.