Mixed Hidden Markov Models for Longitudinal Data: An Overview

International Statistical Review

Volumn 79, Issue 3, 2011, Pages 427-454

  Maruotti, Antonello ^a  

^a ROMA TRE UNIVERSITY   (Italy)

Author keywords

Longitudinal data; Mixed hidden Markov model; Random effects model; Unobserved heterogeneity

Indexed keywords

EID: 82055200209     PISSN: 03067734     EISSN: 17515823     Source Type: Journal    
DOI: 10.1111/j.1751-5823.2011.00160.x     Document Type: Article

References (118)

1. Agresti, A. (2010). Analysis of Ordinal Categorical Data, 2nd ed. Hoboken, NJ: Wiley.
2. Aiello, F. & Cardamone, P. (2008). R&D Spillovers and firms performance in ITA. Evidence from a flexible production function. Empir. Econom., 34, 143-166.
3. Aitkin, M. (1999). A general maximum likelihood analysis of variance components in generalized linear models. Biometrics, 55, 117-128.
4. Albert, P.S. (1991). A two-state Markov model for a time series of epileptic seizure counts. Biometrics, 47, 1371-1381.
5. Alfó, M. & Maruotti, A. (2010). Two-part regression models for longitudinal zero-inflated count data. Canad. J. Statist., 38, 197-216.
6. Altman, R.J. & Petkau, A.J. (2005). Application of hidden Markov models to multiple sclerosis lesion count data. Stat. Med., 24, 2335-2344.
7. Altman, R.J. (2007). Mixed hidden Markov models: An extension of the hidden Markov model to the longitudinal data setting. J. Amer. Statist. Assoc., 102, 201-210.
8. Andersson, S. & Rydén, T. (2009). Subspace estimation and prediction methods for hidden Markov models. Ann. Statist., 37, 4131-4152.
9. Baltagi, H.B. (2001). Econometric Analysis of Panel Data. Chichester: Wiley.
10. Barbu, V. & Limnios, N. (2008). Semi-Markov Chains and Hidden Semi-Markov Models Toward Applications: Their Use in Reliability and DNA Analysis. New York: Springer.
11. Bartolucci, F. & Farcomeni, A. (2010). A note on the mixture transition distribution and hidden Markov models. J. Time Ser. Anal., 31, 132-138.
12. Bartolucci, F., Farcomeni, A. & Pennoni, F. (2010). An overview of latent Markov models for longitudinal categorical data.
13. Bartolucci, F. & Besag, J. (2002). A recursive algorithm for Markov random fields. Biometrika, 89, 724-730.
14. Baum, L.E. & Petrie, T. (1966). Statistical inference for probabilistic functions of finite state Markov chains. Ann. Math. Statist., 37, 1554-1563.
15. Baum, L.E., Petrie, T., Soules, G. & Weiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Statist., 41, 164-171.
16. Beerenwinkel, N. & Drton, M. (2007). A mutagenetic tree hidden Markov model for longitudinal clonal HIV sequence data. Biostatistics, 8, 53-71.
17. Betrò, B., Bodini, A. & Cossu, Q.A. (2009). Using hidden Markov model to analyse extreme rainfall events in Central-East Sardinia. Environmetrics, 19, 702-713.
18. Bickel, P.J. & Ritov, Y. (1996). Inference in hidden Markov models I. Local asymptotic normality in the stationary case. Bernoulli, 2, 199-228.
19. Bickel, P.J., Ritov, Y. & Rydén, T. (1998). Asymptotic normality of the maximum likelihood estimator for general hidden Markov models. Ann. Statist., 26, 1614-1635.
20. Bickel, P.J., Ritov, Y. & Rydén, T. (2002). Hidden Markov models and state space models: Asymptotic analysis of exact and approximate methods for prediction, filtering, smoothing and statistical inference. In Proceedings of the International Congress of Mathematicians, Vol.I, pp. 555-556. Beijing.
21. Biernacki, C., Celeux, G. & Govaert, G. (2003). Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture models. Comput. Statist. Data Anal., 41, 561-575.
22. Böhning, D. (2003). The EM algorithm with gradient function update for discrete mixtures with known (fixed) number of components. Statist. Comput., 13, 257-265.
23. Bound, J., Cummins, C., Griliches, Z., Hall, B.H. & Jaffe, A. (1984). Who does R&D and who patents? In R&D, Patents and Productivity, Ed. R. Griliches Chicago: University of Chicago Press.
24. Breslow, N.E. & Clayton, D.G. (1993). Approximate inference in generalized linear mixed models. J. Amer. Statist. Assoc., 88, 9-25.
25. Bulla, J. (2011). Hidden Markov models with t components. Increased persistence and other aspects. Quant. Finance, 11, 459-475.
26. Bulla, J. & Berzel, A. (2008). Computational issues in parameter estimation for stationary hidden Markov models. Comput. Statist., 23, 1-18.
27. Bulla, J., Bulla, I. & Nenadic, O. (2010). An R package for analyzing hidden semi-Markov models. Comput. Statist. Data Anal., 54, 611-619.
28. Bulla, J., Mergner, S., Bulla, I., Sesboüé, A. & Chesneau, C. (2011). Markov-switching asset allocation: Do profitable strategies exist? J. Asset Allocation, doi:.
29. Cappé, O., Moulines, E. & Rydén, T. (2005). Inference in Hidden Markov Models. New York: Springer - Series in Statistics.
30. Cardamone, P. (2010). The role of R&D spillovers in product and process innovation. Appl. Econom. Lett., 10, 483-493.
31. Celeux, G. & Durand, J.B. (2008). Selecting hidden Markov model state number with cross-validated likelihood. Comput. Statist., 23, 541-564.
32. Cincera, M. (2005). Firms and close curly quote; productivity growth and R&D spillovers: An analysis of alternative technological proximity measures. Econom. Innov. New Technol., 14, 657-682.
33. Cooper, B. & Lipsitch, M. (2004). The analysis of hospital infection data using hidden Markov models. Biostatistics, 5, 223-237.
34. Costa, M. & De Angelis, L. (2011). A dynamic analysis of stock markets through latent Markov models. In New Perspectives in Statistical Modeling and Data Analysis, Eds. S. Ingrassia, R. Rocci & M. Vichi Berlin: Springer.
35. Crouch, E. & Spiegelman, D. (1990). The evaluation of integrals of the form: Application to logistic-normal model. J. Amer. Statist. Assoc., 85, 464-469.
36. Davies, R.B. (1987). Mass point method for dealing with nuisance parameters in longitudinal studies. In Longitudinal Data Analysis, Ed. R. Crouchley Aldershot: Avebury.
37. De Angelis, L., Costa, M. & Paas, L.J. (2010). Interdependence and contagion in international stock markets: A latent Markov model approach. In Mathematical and Statistical Methods for Actuarial Sciences and Finance, Eds. C. Perna & M. Sibillo Spinger.
38. de Rassenfosse, G. & van Pottelsberghe de la Potterie, B. (2009). A policy insight into R&D relationship. Res. Policy, 38, 779-792.
39. Delattre, M. (2010). Inference in mixed hidden Markov models and applications to medical studies. J. Soc. Fr. de Stat., 151, 90-105.
40. Devijver, P.A. (1985). Baum's forward-backward algorithm revisited. Pattern Recogn. Lett., 3, 369-373.
41. Dias, J.G., Vermunt, J.K. & Ramos, S. (2010). Mixture hidden Markov models in finance research. In Advances in Data Analysis, Data Handling and Business Intelligence, Eds. A. Fink, L. Berthold, W. Seidel & A. Ultsch, pp. 451-459. Berlin-Heidelberg: Springer.
42. Diggle, P.J., Farewll, D. & Henderson, R. (2007). Analysis of longitudinal data with drop-out: Objectives, assumptions and a proposal. J. Roy. Statist. Soc. Ser. C, 56, 499-550.
43. Fitzmaurice, G., Davidian, M., Verbeke, G. & Molenberghs, G. (2008). Longitudinal Data Analysis. Boca Rato, FL: Chapman & Hall.
44. Fitzmaurice, G. (1995). A likelihood-based method for analysing longitudinal binary responses. Biometrika, 80, 141-151.
45. Fridman, M. (1994). A two state capital asset pricing model. IMA Preprint Series # 1221.
46. Forney, G.D. (1973). The Viterbi algorithm. Proc. IEEE, 61, 268-278.
47. Frühwirth-Schnatter, S. (2006). Finite Mixture and Markov Switching Models. New York: Springer Series in Statistics.
48. Frühwirth-Schnatter, S. & Kaufmann, S. (2008). Model-based clustering of multiple time series. J. Bus. Econom. Statist., 26, 78-89.
49. Genon-Catalot, V. & Laredo, C. (2006). Leroux's method for general hidden Markov models. Stochastic Process. Appl., 116, 222-243.
50. Guo, J.Q. & Trivedi, P.K. (2002). Flexible parametric models for long-tailed patent count distributions. Oxford Bull. Econom. Statist., 63, 63-82.
51. Gupta, M., Qu, P. & Ibrahim, J.G. (2007). A temporal hidden Markov regression model for the analysis of gene regulatory networks. Biostatisitcs, 8, 805-820.
52. Gurmu, S. & Pérez-Sebastián, F. (2008). Patents, R&D and lag effects: Evidence from flexible methods for count panel data on manufacturing firms. Empir. Econom., 35, 507-526.
53. Hall, B.H., Griliches, Z. & Hausman, J.A. (1986). Patents and R&D: Is there a lag? Internat. Econom. Rev., 27, 265-283.
54. Hamilton, J.D. (1989). A new approach to the economic analysis of nonstationary time series and business cycle. Econometrica, 57, 357-384.
55. Hamilton, J.D. (1990). Analysis of time series subject to changes in regime. J. Econometrics, 45, 39-70.
56. Hasan, M.T. & Sneddon, G. (2009). Zero-inflated Poisson regression for longitudinal data. Comm. Statist. Simulation Comput., 38, 638-653.
57. Hastie, T., Tibshirani, R. & Friedman, J. (2001). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer.
58. Hausman, J.A., Hall, B.H. & Griliches, Z. (1984). Econometric models for count data with applications to the patents R&D relationship. Econometrica, 52, 909-938.
59. Heckman, J. & Singer, B. (1984). A method for minimizing the impact of distributional assumptions in econometric models of duration. Econometrica, 52, 271-320.
60. Holzmann, H., Munk, A., Suster, M. & Zucchini, W. (2006). Hidden Markov models for circular and linear-circular time series. Environ. Ecol. Stat., 13, 325-247.
61. Jaffe, A.B. (1989). Characterizing the "Technological Position" of firms, with application to quantifying technological opportunity and research spillovers. Res. Policy, 18, 87-97.
62. Jamishidian, M. & Jennrich, R.J. (1997). Acceleration of the EM algorithm using quasi-Newton methods. J. R. Stat. Soc. Ser. B, 59, 569-587.
63. Kosaka, T., Katoh, M. & Kohda, M. (2005). Robust speech recognition using discrete-mixture HMMs. IEICE Trans. Inf. Syst., 88(12), 2811-2818.
64. Lagona, F., Maruotti, A. & Picone, M. (2011). A non-homogeneous hidden Markov model for the analysis of multi-pollutant exceedances data. In Hidden Markov Models: Theory and Applications, Ed. P. Dymarski Rijeka: Intech-Publisher.
65. Laird, N. (1978). Nonparametric maximum likelihood estimation of a mixing distribution. J. Amer. Statist. Assoc., 73, 805-811.
66. Laird, N.M. & Ware, J.H. (1982). Random effects models for longitudinal data. Biometrics, 38, 963-974.
67. Langeheine, R. & van de Pol, F. (1994). Discrete-time mixed Markov laten class models. In Analyzing Social and Political Change: A Casebook of Methods, Eds. A. Dale & R.B. Davies London: Sage.
68. Langrock, R. & Zucchini, W. (2011). Hidden Markov models with arbitrary state dwell-time distributions. Comput. Statist. Data Anal., 55, 715-724.
69. Le, N.D., Leroux, B.G. & Puterman, M.L. (1992). Exact likelihood evaluation in a Markov mixture model for time series of seizure counts. Biometrics, 48, 317-323.
70. Leroux, B.G. (1992). Maximum likelihood estimation for hidden Markov models. Stochastic Process. Appl., 40, 127-143.
71. Leroux, B.G. & Puterman, M.L. (1992). Maximum-Penalized-Likelihood estimation for independent and Markov dependent mixture models. Biometrics, 48, 545-558.
72. Liang, K.Y. & Zeger, S.L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73, 13-22.
73. Lindgren, G. (1978). Markov regime models for mixed distributions and switching regression. Scand. J. Statist., 5, 81-91.
74. Lindsay, B.G. (1983a). The geometry of mixture likelihoods: A general theory. Ann. Statist., 11, 86-94.
75. Lindsay, B.G. (1983b). The geometry of mixture likelihoods, part ii: The exponential family. Ann. Statist., 11, 783-792.
76. Lindsay, B.G., & Lesperance, M.L. (1995). A review of semiparametric mixture models. J. Statist. Plann. Inference, 47, 29-39.
77. Lindsay, B.G. & Roeder, K. (1992). Residual dignostics in the mixture model. J. Amer. Statist. Assoc., 87, 785-795.
78. Lindsey, J.K. (1999). Models for Repeated Measurements. New York: Oxford University Press.
79. Lintner, J. (1965). The valuation of risk assets and the selection of risky investments in stock portfolios and capital budgets. Rev. Econom. Statist., 47, 13-37.
80. Lystig, T.C. & Hughes, J.P. (2002). Exact computation of the observed information matrix for hidden Markov models. J. Comput. Graph. Statist., 11(3), 678-689.
81. MacDonald, I. & Zucchini, W. (1997). Hidden Markov and Other Models for Discrete-valued Time Series. London: Chapman Hall.
82. Maddala, G.S. (1993). The Econometrics of Panel Data. Cheltenham: Edward Elgar Publishing.
83. Mancl, L.A. & Leroux, B.G. (1996). Efficiency of regression estimates for clustered data. Biometrics, 52, 500-511.
84. Maruotti, A. & Rydén, T. (2009). A semiparametric approach to hidden Markov models under longitudinal observations. Statist. Comput., 19, 381-393.
85. Meng, X.L. & van Dyk, D. (1997). The EM algorithm: an old folk-song sung to a new fast tune (with discussion). J. R. Stat. Soc. Ser. B, 59, 511-567.
86. Mergner, S. & Bulla, J. (2008). Time-varying beta risk of Pan-European industry portfolios: A comparison of alternative modeling techniques. Eur. J. Finance, 14, 771-802.
87. Monbet, V., Ailliot, P. & Prevosto, M. (2007). Survey of stochastic models for wind and sea-state time series. Probab. Eng. Mech., 22, 113-126.
88. Neuhaus, J.M., Hauck, W.W. & Kalbfleisch, J.D. (1992). The effects of mixture distribution misspecification when fitting mixed-effects logistic models. Biometrika, 79, 755-762.
89. Petrie, T. (1969). Probabilistic functions of finite Markov chains. Ann. Math. Statist., 40, 97-115.
90. Rabiner, L.R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE, 77, 257-286.
91. Rigby, R.A. & Stasinopoulos, D.M. (2005). Generalized additive models for location, scale and shape (with discussion). J. Roy. Statist. Soc. Ser. C, 54, 507-554.
92. Rijmen, F., Ip, E.H., Rapp, S. & Shaw, E.G. (2008a). Qualitative longitudinal analysis of symptoms in patients with primary and metastatic brain tumors. J. Roy. Statist. Soc. Ser. A, 171, 739-753.
93. Rijmen, F., Vansteelandt, K. & De Boeck, P. (2008b). Latent class models for diary method data: Parameter estimation by local computations. Psychometrika, 73, 167-182.
94. Rydén, T. (1994). Consistent and asymptotically normal parameter estimates for hidden Markov models. Ann. Statist., 22, 1884-1895.
95. Rydén, T. (2008). EM versus Markov chain Monte Carlo for estimation of hidden Markov Models: A computational perspective. Bayesian Anal., 3, 659-688.
96. Rydén, T., Teräsvirta, T. & Asbrink, S. (1998). Stylized facts of daily return series and the hidden Markov model. J. Appl. Econom., 13, 217-244.
97. Sharpe, W.F. (1964). Capital asset prices: A theory of market equilibrium under conditions of risk. J. Finance, 19, 425-442.
98. Sichel, H.S. (1974). On a distribution representing sentence-length in written prose. J. Roy. Statist. Soc. Ser. A, 137, 25-34.
99. Shirley, K.E., Small, D.S., Lynch, K.G., Maisto, S.A. & Oslin, D.W. (2010). Hidden Markov models for alcoholism treatment trial data. Ann. Appl. Stat., 4, 366-395.
100. Simar, L. (1976). Maximum likelihood estimation of a compound Poisson process. Ann. Statist., 4, 1200-1209.
101. Skrondal, A. & Rabe-Hesketh, S. (2004). Generalized Latent Variable Modeling: Multilevel, Longitudinal and Structural Equation Models. Boca Raton, FL: Chapman & Hall/CRC.
102. Sutradhar, B.C. (2003). An overview on regression models for discrete longitudinal responses. Statist. Sci., 18, 377-393.
103. Sutradhar, B.C. & Das, K. (2000). On the accuracy of efficiency of estimating equation approach. Biometrics, 56, 622-625.
104. Turner, R. (2008). Direct maximization of the likelihood of a hidden Markov model. Comput. Stat. Data Anal., 52, 4147-4160.
105. van den Hout, A., Jagger, C. & Matthews, F.E. (2009). Estimating life expectancy in health and ill health using a hidden Markov model. J. Roy. Statist. Soc. Ser. C, 58, 449-465.
106. Venkataramanan, L. & Sigworth, F.J. (2002). Applying hidden Markov models to the analysis of songle ion channel activity. Biophys. J., 82, 1930-1942.
107. Verbeke, G. & Molenberghs, G. (2000). Linear Mixed Models for Longitudinal Data. New York: Springer-Verlag.
108. Viterbi, A.J. (2006). A personal history of the Viterbi algorithm. IEEE Signal Process. Mag., July, 120-122.
109. Wall, M.M. & Li, R. (2009). Multiple indicator hidden Markov model with an application to medical utilization data. Stat. Med., 28, 293-310.
110. Wang, P., Cockburn, I.M. & Puterman, M.L. (1998). Analysis of patent data: A mixed-poisson-regression-model approach. J. Bus. Econom. Statist., 16, 27-41.
111. Wang, P. & Puterman, M.L. (2001). Analysis of longitudinal data of epileptic seizure: A two state hidden Markov approach. Biom. J., 43(8), 941-962.
112. Welch, L.R. (2003). Hidden Markov models and the Baum-Welch algorithm. IEEE Inf. Theory Soc. Newsl., 53(4), 1-13.
113. Winkelmann, R. (2008). Econometric Analysis of Count Data, fifth edition. Heidelberg, New York: Springer.
114. Wood, A. & Hinde, J.P. (1987). Binomial variance component models with a nonparametric assumption concerning random effects. In Longitudinal Data Analysis, Ed. R. Crouchley Aldershot: Avebury.
115. Wooldridge, J. (2002). Econometric Analysis of Cross-section and Panel Data. Cambridge, MA: MIT Press.
116. Yau, C., Papaspiliopoulos, O., Roberts, G.O. & Holmes, C. (2011). Bayesian non-parametric hidden Markov models with applications in genomics. J. R. Statist. Soc. Ser. B, 73, 37-57.
117. Zucchini, W. & MacDonald, I.L. (2009). Hidden Markov Models for Time Series: An Introduction Using R. Boca Raton, FL: Chapman & Hall.
118. Zucchini, W., Raubenheimer, D. & MacDonald, I.L. (2008). Modeling time series of animal behavior by means of a latent-state model with feedback. Biometrics, 64, 807-815.