Lumping Markov chains with silent steps

Third International Conference on the Quantitative Evaluation of Systems, QEST 2006

Volumn , Issue , 2006, Pages 221-230

  Markovski, Jasen ^a   Trčka, Nikola ^a  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

DYNAMICAL SYSTEMS; PARAMETERIZATION; SYSTEMS ANALYSIS;

DISCONTINUOUS MARKOV CHAINS; LUMPING; MARKOVIAN PROCESS ALGEBRAS; PERFORMANCE MEASURES;

MARKOV PROCESSES;

EID: 38149133299     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/QEST.2006.28     Document Type: Conference Paper

References (22)

1. J. L. Doob, Stochastic Processes. Wiley, 1953.
2. K. L. Chung, Markov Chains with Stationary Probabilities. Springer, 1967.
3. J. G. Kemeny and J. L. Snell, Finite Markov chains. Springer, 1976.
4. P. Buchholz, "Exact and ordinary lumpability in finite Markov chains," Journal of Applied Probability, vol. 31, pp. 59-75, 1994.
5. J. P. Katoen and P. R. D'Argenio, "General distributions in process algebra," in Lectures on formal methods and performance analysis: first EEF/Euro summer school on trends in computer science, E. Brinksma, H. Hermanns, and J. Katoen, Eds. Springer, 2001, vol. 2090, pp. 375-429.
6. M. Bravetti and P. R. D'Argenio, "Tutte le algebre insieme: Concepts, discussions and relations of stochastic process algebras with general distributions," in Validation of Stochastic Systems ?A Guide to Current Research, ser. Lecture Notes of Computer Science, C. Baier, B. R. Haverkort, H. Hermanns, J. P. Katoen, and M. Siegle, Eds. Springer, 2004, vol. 2925, pp. 44-88.
7. P. R. D'Argenio, "Algebras and automata for timed and stochastic systems," Ph.D. dissertation, University of Twente, 1999.
8. M. Bravetti, "Real time and stochastic time," in Formal Methods for the Design of Real-lime Systems, ser. Lecture Notes of Computer Science, M. Bernardo and F. Corradini, Eds. Springer, 2004, vol. 3185, pp. 132-180.
9. H. Hermanns, Interactive Markov chains: The Quest for Quantified Quality, ser. Lecture Notes of Computer Science. Springer, 2002, vol. 2428.
10. J. Hillston, A Compositional Approach to Performance Modelling. Cambridge University Press, 1996.
11. M. Coderch, A. Willsky, S. Sastry, and D. Castanon, "Hierarchical aggregation of singularly perturbed finite state Markov processes," Stochastics, vol. 8, pp. 259-289, 1983.
12. J. Markovski and N. Trčka, "Lumping Markov chains with silent steps," Technische Universiteit Eindhoven, Tech. Rep. CS 06/13, 2006, Available from: http://library.tue.nl/catalog/CSRPublication.csp.
13. V. Nicola, "Lumping in Markov reward processes," IBM, IBM Research Report RC 14719, 1989.
14. E. Hille and R. S. Phillips, Functional Analysis and Semi-Groups. AMS, 1957.
15. R. P. Agaev and P. Y. Chebotarev, "On determining the eigenprojection and components of a matrix," Automated Remote Control, vol. 63, pp. 1537-1545, 2002.
16. S. L. Campbell, Singular Systems of Differential Equations I. Pitman, 1980.
17. J. J. Koliha and T. D. Tran, "Semistable operators and singularly perturbed differential equations," Journal of Mathematical Analysis and Applications, vol. 231, pp. 446-458, 1999.
18. F. Delebecque and J. P. Quadrat, "Optimal control of Markov chains admitting strong and weak interactions," Automatica, vol. 17, pp. 281-296, 1981.
19. F. Delebecque, "A reduction process for perturbed Markov chains," SIAM Journal of Applied Mathematics, vol. 2, pp. 325-330, 1983.
20. G. Ciardo, J. Muppala, and K S. Trivedi, "On the solution of GSPN reward models," Performance Evaluation, vol. 12, pp. 237-253, 1991.
21. W. K. Grassmann and Y. Wang, "Immediate events in Markov chains," in Computations with Markov chains, W. J. Stewart, Ed. Kluwer, 1995, pp. 163-176.
22. A. Bobbio and K. S. Trivedi, "An aggregation technique for the transient analysis of stiff Markov chains," IEEE Transactions on Computers, vol. C-35, pp. 803-814, 1986.