The evolution of the theory of non-homogeneous Markov systems

Applied Stochastic Models and Data Analysis

Volumn 13, Issue 3-4, 1997, Pages 159-176

  Vassiliou, P C G ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Asymptotic behaviour; Control theory; Cyclic behaviour; Non homogeneous Markov systems (NHMS); Physics of populations

Indexed keywords

CONTROL THEORY; MATHEMATICAL MODELS; PROBABILITY; RANDOM PROCESSES;

ASYMPTOTIC BEHAVIOUR; CYCLIC BEHAVIOUR; NON HOMOGENEOUS MARKOV SYSTEMS;

MARKOV PROCESSES;

EID: 0031222557     PISSN: 87550024     EISSN: None     Source Type: Journal    
DOI: 10.1002/(sici)1099-0747(199709/12)13:3/4<159::aid-asm309>3.0.co;2-q     Document Type: Article

References (118)

1. A. Young and G. Almond, 'Predicting distributions of staff', Comp. J., 3, 246-250 (1961).
2. D. J. Bartholomew, 'A multistage renewal process', J. R. Statist. Soc. B, 25, 150-168 (1963).
3. A Young, D. Chapman and W. Wightman, 'The remuneration of university teachers', Association of University Teachers, London, U.K., 1962.
4. A. Young and D. Ellman, 'Some aspects of university staffing and prediction of staffing needs', Association of University of Teachers, London, U.K., 1963.
5. A. Young, 'The remuneration of university of teachers 1964-65', Association of University Teachers, London, U.K.
6. A. Young, 'The remuneration of university of teachers 1967-68', Association of University Teachers, London, U.K.
7. A. Young, 'The remuneration of university of teachers 1970-71', Association of University Teachers, London, U.K.
8. A Young, 'Demographic and ecological models for manpower planning' in D. J. Bartholomew and B. R. Morris (eds), Aspects of Manpower Planning, English University Press, 1971, pp. 75-97.
9. D. J. Bartholomew, Stochastic Models for Social Processes, 1st edn, Wiley, Chichester, U.K., 1962.
10. D. J. Bartholomew, Stochastic Models for Social Processes, 2nd edn, Wiley, Chichester, U.K., 1973.
11. D. J. Bartholomew, Stochastic Models for Social Processes, 3rd edn, Wiley, Chichester, U.K., 1982.
12. A. Young and P.-C. G. Vassiliou, 'A non-linear model on the promotion of staff', J. R. Statist. Soc., A 137, 584-595 (1974).
13. P.-C. G. Vassiliou, 'A Markov chain model for wastage in manpower systems., Oper. Res. Q., 27, 57-70 (1976).
14. P.-C. G. Vassiliou, 'A high order non-linear Markovian model for promotion in manpower systems', J. R. Staist. Soc., A, 141, 86-94 (1978).
15. P.-C. G. Vassiliou, 'Asymptotic behaviour of Markov systems', J. Appl. Prob., 19, 851-857 (1982).
16. P. H. Leslie, 'On the use of matrices in certain population mathematics., Biometrika, 33, 183-212 (1945).
17. P. H. Leslie, 'On the use of matrices in certain population mathematics., Biometrika, 33, 183-212 (1948).
18. S. J. Prais, 'Measuring social mobility', J. R. Stat. Soc., A, 118, 56-66 (1955).
19. J. H. Pollard, Mathematical Models for Growth of Human Population, Cambridge University Press, 1973.
20. J. H. Pollard, 'On the use of the direct matrix product in analysing certain stochastic population models', Biometrika, 53, 397-415 (1966).
21. P.-C. G. Vassiliou and J. Gerontidis, 'Variances and covariances of the grade sizes in manpower systems., J. Appl. Prob., 22, 583-597 (1985).
22. G. Tsaklidis and P.-C. G. Vassiliou, 'Asymptotic periodicity of the variances and covariances of the state sizes in non-homogeneous Markov systems., J. Appl. Prob., 27, 776-783 (1988).
23. P.-C. G. Vassiliou and G. Tsaklidis, 'The rate of convergence of the vector of variances and covariances in nonhomogeneous Markov systems', J. Appl. Prob., 26, 776-783 (1989).
24. G. Tsaklidis, 'Asymptotic variability in non-homogeneous Markov systems', Ph.D. thesis, Mathematics Department, University of Thessaloniki, Greece, 1987.
25. I. Gerontidis, 'Asymptotic behaviour of non-homogeneous Markov systems' Ph.D. thesis, Mathematics Department, University of Thessaloniki, Greece, 1989.
26. W. G. Leeson, 'Markov models of two hierarchically graded police manpower systems', Eur. J. Oper, Res., 6, 291-297 (1981).
27. W. G. Leeson, 'Manpower planning procedures for hierarchical manpower systems', Eur. J. Oper. Res., 10, 260-270 (1982).
28. W. G. Leeson, 'Recruitment effects on manpower structures', J. Appl. Prob., 35, 933-938 (1984).
29. L. R. Haury, J. A. McGowan and P. H. Wiebie, 'Patterns and processes in the time scales of plankton distribution', in J. H. Steele (ed.), Spatial Patterns in Plankton Communities, Plenum, 1978, pp. 277-324.
30. E. A. Shushkina and M. Ya Vinogradov, 'Changes in the functional and structural characteristics of plankton communities in the course of development', Oceanology, 23, 645-651 (1970).
31. J. C. Roff, K. Middlebrook and F. Evans, 'Long term variability in North Sea, zooplankton of the Northumberland coast: productivity of small copepods an analysis of trofic interactions', J. Mar. Biol. Assoc., 68, 143-164 (1988).
32. J. M. Colebrook, 'Continuous plankton records: Seasonal cycles of phytoplankton and copepods in the North Atlantic Ocean and North Sea', Mar. Biol., 51, 23-32 (1979).
33. J. R. Beers, M. M. Reed and G. L. Steward, 'Seasonal abundance of the mikroplakton population in the North Pacific central gyre', Deep Sea Res., 29, 227-245 (1982).
34. S. Haritonodis, G. Nikolaidis and I. Tsekos, 'Seasonal variation in the biomass of marine macrophyta from Greek coasts', Mar. Ecol., 7, 359-370 (1986).
35. J. A. Lindley, 'Continuous plankton records, the geographical distribution and seasonal cycles of decapod crustacean larrae and pelagic post larrae in the north eastern Atlantic Ocean and the North Sea', J. Mar. Biol. Assoc., 67, 145-147 (1987).
36. A. G. Kasymov, 'Abundance of zooplankton and zoobenthos in Baku Bay, Caspian Sea', Oceanology, 28, 524-526 (1988).
37. C. Amblard, 'Seasonal succession and the strategies of phytoplankton development in two lakes of different tropic states', J. Plankton Res., 10, 1189-1208 (1988).
38. P. J. Moran and T. R. Grant, 'The effects of industrial pollution on the development and succession of marine fouling comunities', Mar. Ecol., 10, 231-246 (1989).
39. P. D. Patoucheas and Stamoy, 'Non homogeneous Markovian models in ecological modelling: a study of the zoobenthos dynamics in Thermaikos Gulf, Greece, Ecological Modelling, 66, 197-215 (1993).
40. P.-C. G. Vassiliou, 'Cyclic behaviour and asymptotic stability of non-homogeneous Markov systems., J. Appl. Prob., 21, 315-325 (1984).
41. P.-C. G. Vassiliou, 'Asymptotic variability of non-homogeneous Markov systems under cyclic behaviour', Eur. J. Oper. Res., 27, 215-228 (1986).
42. Stewman, 'Markov models of occupational mobility: theoretical development and empirical support - part I: Careers', J. Math. Sociology, 4, 201-245 (1976).
43. Stewman, 'Markov models of occupational mobility: theoretical development and empirical support - Part 2: Continuously operative job systems', J. Math. Sociology, 4, 247-278 (1976).
44. R. W. Hodge, 'Occupational mobility as a probability process', Demography, 3, 19-34 (1966).
45. T. Mayer, 'Models of intragenerational mobility' in J. Berger, M. Zeld and Anderson (eds), Sociological Theories in Progress, Vol. 2 New York, 1972.
46. N. W. Henry, R. McGinnis and H. W. Tegtmeger, 'A finite model of mobility', J. Math. Sociology, 1, 107-118 (1971).
47. G. C. Myers, R. McGinnis and Masnick, 'The duration of residence approach to a dynamic stochastic model of internal migration: a test of the axiom of the cummulative inertia', Eugenics Quarterly, 14, 122-126 (1967).
48. Sabolo, 'A structural approach to the projection of occupational categories and its applications to South Korea and Taiwan', Int. Labour Rev., 103, 131-155 (1971).
49. W. G. Leeson, 'A projection model for hierarchical manpower system', J. Oper. Res. Soc., 31, 247-256 (1980).
50. U. N. Bhat, Elements of Applied Stochastic Processes, 2nd edn, Wiley, New York, 1984.
51. G. Feichtinger and A. Mehlmann, 'The recruitment trajectory corresponding to particular stock sequences in Markovian person-flow models', Math. Oper. Res., 1, 175-184 (1976).
52. A. Mehlmann, 'A note on the limiting behaviour of discrete-time Markovian manpower models with inhomogeneous independent Poisson input', J. Appl. Prob., 14, 611-613 (1977).
53. M. L. Marshal, 'Equlibrium age distributions for graded systems', J. R. Stat. Soc., A138, 62-69 (1975).
54. D. L. Isacson and R. W. Madsen, Markov Chains: Theory and Applications, Wiley, New York, 1976.
55. C.-.C. Huang, D. Isaacson and B. Vinograde, 'The rate of convergence of certain non-homogeneous Markov chains', Z. Wahrscheinlichkeitstheory 35, 141-146 (1976).
56. B. Bowerman, H. T. David and D. Isaacson, 'The convergence of Cesaro averages for certain non stationary Markov chains', Stoch. Process. Appl., 5, 221-230 (1977).
57. J. T. Johnson, 'Ergodic properties of non-homogeneous continuous time Markov chains', Ph.D. theis, Iowa State University, Ames, 1984.
58. J. T. Johnson and D. L. Isaacson 'Conditions for strong ergodicity using intensity matrices', J. Appl. Prob., 25, 34-42 (1998).
59. P.-C. G. Vassiliou, 'On the limiting behaviour of a non-homogeneous Markov chain model in manpower systems', Biometrika, 68, 557-561 (1981).
60. P.-C. G. Vassiliou, 'Stability in a non-homogeneous Markov chain model in manpower systems', J. Appl. Prob., 18, 224-230 (1981).
61. P.-C. G. Vassiliou, 'On the limiting behaviour of a non-homogeneous Markovian manpower model with independent Poisson input', J. Appl. Prob., 433-438 (1982).
62. G. Tsaklidis and P.-C. G. Vassiliou, 'Infinite products of matrices with some negative elements and row sums equal to one', Linear Alg. & its Appl., 127, 41-58 (1990).
63. G. Tsaklidis and P.-C. G. Vassiliou, 'V-matrices as covariance matrices in homogeneous Markov systems., In M. J. C. Gover and S. Barnett, (eds), Applications of Matrix Theory, Oxford, U.K., 1989.
64. G. Tsaklidis and P.-C. G. Vassiliou, 'Periodicity of infinite products of matrices with some negative elements and row sums equal to one', Linear Alg. & its Appl., 176, 175-196 (1992).
65. P.-C. G. Vassiliou and A. Georgiou, 'Asymptotically attainable structures in non-homogeneous Markov systems', Oper. Res., 38, 537-545 (1990).
66. S. I. McClean, 'A semi-Markov model for a multigrade population with Poisson recruitment', J. Appl. Prob., 17, 846-852 (1980).
67. P.-C. G. Vassiliou, A. Georgiou and N. Tsantas, 'Control of asymptotic variability in non-homogeneous Markov systems., J. Appl. Prob., 27, 756-766 (1990).
68. D. J. Bartholomew, A mathematical analysis of structural control in a graded manpower system', Paper P. 3. Research Program in University Administration, University of California, 1969.
69. G. S. Davies, 'Structural control in a graded manpower system', Man. Sci., 20, 76-84 (1973).
70. G. S. Davies, 'Maintainability of structures in Markov chain models under recruitment control', J. Appl. Prob., 12, 376-382 (1975).
71. G. S. Davies, 'Maintainable regions in a Markov manpower model', J. Appl. Prob., 18, 738-742 (1981).
72. G. S. Davies, 'Control of grade sizes in a partially stochastic Markov manpower model', J. Appl. Prob., 19, 439-443 (1982).
73. G. S. Davies, 'A note on the geometric/probabilistic relationship in a Markov model', J. Appl. Prob., 20, 423-428 (1983).
74. D. J. Bartholomew, 'A stochastic control problem in the social sciences, Bull. Int. Stat. Inst., 46, 670-680 (1975).
75. A. F. Forbes, 'Promotion and recruitment policies for the control of quasi stationary hierarchical system', in A. Smith (ed.), Models for Manpower Systems, English University Press, 1971.
76. R. C. Grinold and K. Marsall, Manpower Planning Models, North-Holland, Amsterdan, The Netherlands, 1977.
77. R. C. Grinold and R. E. Standford, 'Optimal control of a graded manpower system', Man Sci., 20,1201-1215 (1974).
78. J. Haigh, 'Maintainability of manpower structures counter examples, results and conjectures', J. Appl. Prob., 20, 700-705 (1983).
79. S. Vajda, Mathematics of Manpower Planning. Wiley, Chichester, U.K., 1978.
80. S. Vajda, 'Mathematical aspects of manpower planning', Oper. Res. Quart., 26, 527-542 (1975).
81. D. J. Bartholomew, 'Maintaining a grade or age structure in stochastic environment', Adv. Appl. Prob., 9, 1-17 (1977).
82. D. J. Bartholomew, 'The control of a grade structure in a stochastic evironment using promotion control', Adv. Appl. Prob., 603-615 (1979).
83. N. Tsantas, 'Stochastic methods of control of nonhomogeneous Markov systems', Ph.D. thesis, Mathematics Department, University of Thessaloniki, Greece, 1984.
84. P.-C. G. Vassiliou and N. Tsantas, 'Stochastic control in nonhomogeneous Markov systems', Int. J. Computer Math., 16, 139-115 (1984).
85. P.-C. G. Vassiliou and N. Tsantas, 'Maintainability of structures in nonhomogeneous Markov systems under cyclic behaviour and input control', SIAM J. Appl. Math., 44, 1014-1022 (1984).
86. A. Georgiou and P.-C. Vassiliou, 'Periodicity of asymptotically attainable structures in non-homogeneous Markov systems', Linear Alg. Appl., 176, 137-174 (1992).
87. A. Georgiou, 'Partial maintainability and control in non-homogeneous Markov manpower systems', Eur. J. Operat. Res., 62, 241-251 (1992).
88. G. Tsaklidis, 'The evolution of the attainable structures of a homogeneous Markov system with fixed size', J. Appl. Prob., 31, 348-361 (1994).
89. G. Tsaklidis, 'The evolution of the attainable structures of a continuous time homogeneous Markov system with fixed size', J. Appl. Prob., 33, 34-47 (1996).
90. J. Gani, 'Formulae for projecting enrolments and degrees awarded in universities', J. R. Stat. Soc., A, 126, 400-409 (1963).
91. G. Feichtinger, 'On the generalization of stable age distributions to Gani type person-flow models', Adv. Appl. Prob., 8, 433-445 (1976).
92. P.-C. G. Vassiliou, 'A note on the stability of Gani-type models in manpower systems', J. Oper. Res. Soc., 31, 953-954 (1980).
93. S. I. McClean and T. Abodunde, 'Entropy as a measure of stability in a manpower system', J. Oper. Res. Soc., 29, 880-885 (1978).
94. S. I. McClean, 'Extending the entropy stability measure for manpower planning', J. Oper. Res. Soc., 37, 1133-1138 (1986).
95. P.-C. G. Vassiliou, 'Entropy as a measure of the experience distribution in manpower systems., J. Oper. Res. Soc., 35, 1021-1025 (1984).
96. P.-C. G. Vassiliou and A. A. Papadopoulou, 'Non-homogeneous semi-Markov systems and maintainability of the state sizes', J. Appl. Prob., 29, 519-534 (1992).
97. A. A. Papadopoulou, 'Theory of non-homogeneous simi-Markov systems', Ph.D. thesis, Mathematics Department, University of Thessaloniki, Greece, 1993.
98. S. I. McClean, 'The two stage model for personnel behaviour', J. R. Stat. Soc., A., 139, 205-217 (1976).
99. S. I. McClean, 'Continuous time stochastic models for a multigrade population', J. Appl. Prob., 15, 26-32 (1978).
100. S. I. McClean, 'Semi-Markov models for manpower planning', in J. Janssen (ed.), Semi-Markov Models: Theory and Applilcations, Plenum Press, New York, U.S.A., 1986.
101. A. Mehlmann, 'Semi Markovian manpower models in continuous time', J. Appl. Prob., 16, 416-422 (1979).
102. D. J. Bartholomew, A. F. Forbes and S. I. McClean, Statistical Techniques for Manpower Planning, Wiley, Chichester, U.K., 1991.
103. D. J. Bartholomew, ' Social applications of semi-Markov processes', in J. Janssen (ed.), Semi-Markov Models: Theory and Applications, Plenum Press, New York, U.S.A., 1986.
104. J. Janssen, Semi-Markov Models: Theorey and Applications, (1989). Plenum Press, New York, U.S.A., 1986.
105. A. A. Papadopoulou and P.-C. G. Vassiliou, 'Asymptotic behavior of non-homogeneous semi-Markov systems', Linear Alg. its Appl., 210, 153-198 (1994).
106. I. Gerontidis, 'Semi Markov replacement chains', Adv. Appl. Prob., 26, 728-755 (1994).
107. N. Tsantas and P.-C. G. Vassiliou, 'The nonhomogeneous Markov system in a stochastic environment', J. Appl. Prob., 30, 285-301 (1993).
108. J. E. Cohen, 'Ergodicity of age structure in populations with Markovian vital rates - I: Countable states', J. Amer, Statist. Assoc., 71, 335-339 (1976).
109. J. E. Cohen, 'Ergodicity of age structure in populations with Markovian vital rates - II: General states', J. Appl. Prob., 9, 18-37 (1997).
110. N. Tsantas and A. C. Georgiou, 'Periodicity of equilibrium structures in a time dependent Markov model under stochastic environment', Appl. Stochastic Models & Data Anal.
111. P.-C. G. Vassiliou, 'The non-homogeneous Markov system in a stochastic environment in continuous time', to be published.
112. A. Greorgiou and N. Tsantas, 'Non stationary cyclic behaviour in Markov systems', Linear Alg. Appl., to be published.
113. B. Bowerman, 'Non stationary Markov decision processes and related topics in non stationary Markov chains', Ph.D. thesis, Iowa State University, Ames, U.S.A., 1974.
114. A. Georgiou, 'Control of asymptotic behaviour of non-homogeneous Markov systems' Ph.D. thesis, Mathematics Department, University of Thessaloniki, Greece 1989.
115. J. H. Pollard, 'A note on certain discrete stochastic population models with Poisson immigration., J. Appl. Prob., 4, 209-213 (1967).
116. N. Tsantas, 'Stochastic analysis of a nonhomogeneous Markov system', Eur. J. Operat. Res. 85, 670-685 (1995).
117. S. Vajda, 'The stratified semi-stationary population', Biometrika, 34, 243-254 (1947).
118. S. Vajda, Planning by Mathematics, 2nd edn, Pitman, London, U. K., 1973.