On the application of mixed hidden markov models to multiple behavioural time series

Interface Focus

Volumn 2, Issue 2, 2012, Pages 180-189

  Schliehe Diecks, S ^a,b   Kappeler, P M ^a,b   Langrock, R ^c  

^a UNIVERSITY OF GÖTTINGEN   (Germany)

^b GERMAN PRIMATE CENTER   (Germany)

^c UNIVERSITY OF ST ANDREWS   (United Kingdom)

Author keywords

Behavioural analysis; Maximum likelihood; Motivational states; Random effects; State space model; Subject specific covariate

Indexed keywords

EID: 84860893762     PISSN: 20428898     EISSN: 20428901     Source Type: Journal    
DOI: 10.1098/rsfs.2011.0077     Document Type: Article

References (65)

1. McNamara, J. M. & Houston, A. I. 2009 Integrating function and mechanism. Trends Ecol. Evol. 24, 670-675. (doi:10.1016/j.tree.2009.05.011)
2. MacArthur, R. H. & Pianka, E. R. 1966 On optimal use of a patchy environment. Am. Nat. 100, 603-609. (doi:10.1086/282454)
3. Charnov, E. L. 1976 Optimal foraging, the marginal value theorem. Theor. Popul. Biol. 9, 129-136. (doi:10.1016/0040-5809(76)90040-X)
4. Caraco, T. 1980 On foraging time allocation in a stochastic environment. Ecology 61, 119-128. (doi:10.2307/1937162)
5. Houston, A. I. & McNamara, J. M. 1999 Models of adaptive behaviour. New York, NY: Cambridge University Press.
6. Yackulic, C. B., Blake, S., Deem, S., Kock, M. & Uriarte, M. 2011 One size does not fit all: flexible models are required to understand animal movement across scales. J. Anim. Ecol. 80, 1088-1096. (doi:10.1111/j.1365-2656.2011.01851.x)
7. McFarland, D. 1999 Animal behaviour: psychobiology, ethology and evolution, 3rd edn. Harlow, UK: Longman Scientific and Technical.
8. Whitten, P. I., Brockman, D. K. & Stavisky, R. C. 1998 Recent advances in noninvasive techniques to monitor hormone-behavior interactions. Yearbook Phys. Anthropol. 41, 1-23. (doi:10.1002/(SICI)1096-8644(1998)107: 27+,1::AID-AJPA2.3.0.CO;2-H)
9. Kyriazakis, I., Tolkamp, B. J. & Emmans, G. 9 Diet selection and animal state: an integrative framework. Proc. Nutrit. Soc. 58, 765-772. (doi:10.1017/ S0029665199001044)
10. Winnie Jr., J., Christianson, D., Creel, S. & Maxwell, B. 2006 Elk decision-making rules are simplified in the presence of wolves. Behav. Ecol. Sociobiol. 61, 277-289. (doi:10.1007/s00265-006-0258-1)
11. Riters, L. V., Eens, M., Pinxten, R., Duffy, D. L., Balthazart, J. & Ball, G. F. 2000 Seasonal changes in courtship song and the medial preoptic area in male European starlings (Sturnus vulgaris). Horm. Behav. 38, 250-261. (doi:10.1006/hbeh.2000.1623)
12. Morgan, B. J. T. 1976 Markov properties of sequences of behaviours. J. R. Stat. Soc. Ser. C 25, 31-36.
13. Zucchini, W., Raubenheimer, D. & MacDonald, I. L. 2008 Modeling time series of animal behavior by means of a latent-state model with feedback. Biometrics 64, 807-815. (doi:10.1111/j.1541-0420.2007.00939.x)
14. Pedersen, M. W., Patterson, T. A., Thygesen, U. H. & Madsen, H. 2011 Estimating animal behaviour and residency from movement data. Oikos 120, 1281-1290. (doi:10.1111/j.1600-0706.2011.19044.x)
15. Fruhwirth-Schnatter, S. 2006 Finite mixture and Markov switching models. New York, NY: Springer.
16. MacDonald, I. L. & Raubenheimer, D. 1995 Hidden Markov models and animal behaviour. Biometric. J. 37, 701-712. (doi:10.1002/bimj.4710370606)
17. Patterson, T. A., Basson, M., Bravington, M. V. & Gunn, J. S. 2009 Classifying movement behaviour in relation to environmental conditions using hidden Markov models. J. Anim. Ecol. 78, 1113-1123. (doi:10.1111/j.1365-2656. 2009.01583.x)
18. Rabiner, L. R. 1989 A tutorial on hidden Markov models and selected applications in speech recognition. IEEE Proc. 77, 257-286. (doi:10.1109/5.18626)
19. Langrock, R., MacDonald, I. L. & Zucchini, W. 2012 Some nonstandard stochastic volatility models and their estimation using structured hidden Markov models. J. Empir. Finance 19, 147-161. (doi:10.1016/j.jempfin. 2011.09.003)
20. Banachewicz, K., Lucas, A. & Vaart, A. 2008 Modelling portfolio defaults using hidden Markov models with covariates. Econ. J. 11, 155-171. (doi:10.1111/j.1368423X.2008.00232.x)
21. Hamilton, J. D. 1989 A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica 57, 357-384. (doi:10.2307/1912559)
22. Krogh, A., Brown, M., Mian, I. S., Sjolander, K. & Haussler, D. 1994 Hidden Markov models in computational biology. Applications to protein modeling. J. Mol. Biol. 235, 1501-1531. (doi:10.1006/jmbi.1994.1104)
23. Durbin, R., Eddy, S., Krogh, A. & Mitchison, G. J. 1998 Biological sequence analysis: probabilistic models of proteins and nucleic acids. Cambridge, UK: Cambridge University Press.
24. Vogler, C. & Metaxas, D. 1997 Adapting hidden Markov models for ASL recognition by using three-dimensional computer vision methods. In IEEE Int. Conf. on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation, Orlando, Florida, vol. 1, pp. 156-161.
25. Zucchini, W. & MacDonald, I. L. 2009 Hidden Markov models for time series: an introduction using R. London: Chapman & Hall. (doi:10.1201/9781420010893)
26. Scott, S. L. 2002 Bayesian methods for hidden Markov models: recursive computing in the 21st century. J. Am. Stat. Assoc. 97, 337-351. (doi:10.1198/016214 502753479464)
27. Clark, J. S. 2005 Why environmental scientists are becoming Bayesians. Ecol. Lett. 8, 2-14. (doi:10.1111/j.14610248.2004.00702.x)
28. King, R., Morgan, B. J. T., Gimenez, O. & Brooks, S. P. 2010 Bayesian analysis for population ecology. London, UK: Chapman & Hall/ CRC Press.
29. Patterson, T. A., Thomas, L., Wilcox, C., Ovaskainen, O. & Matthiopoulos, J. 2008 State-space models of individual animal movement. Trends Ecol. Evol. 23, 87-94. (doi:10. 1016/j.tree.2007.10.009)
30. Buckland, S. T., Newman, K. B., Thomas, L. & Koesters, N. B. 2004 State-space models for the dynamics of wild animal populations. Ecol. Modell. 171, 157-175. (doi:10. 1016/j.ecolmodel.2003.08.002)
31. Royer, F., Fromentin, J.-M. & Gaspar, P. 2005 A state-space model to derive bluefin tuna movement and habitat from archival tags. Oikos 109, 473-484. (doi:10.1111/j. 0030-1299.2005.13777.x)
32. Jonsen, I. D., Myers, R. A. & James, M. C. 2006 Robust hierarchical state-space models reveal diel variation in travel rates of migrating leatherback turtles. J. Anim. Ecol. 75, 1046-1057. (doi:10.1111/j.1365-2656.2006. 01129.x)
33. Breed, G. A., Jonsen, I. D., Myers, R. A., Bowen, W. D. & Leonard, M. L. 2009 Sex-specific, seasonal foraging tactics of adult grey seals (Halichoerus grypus) revealed by state space analysis. Ecology 90, 3209-3221. (doi:10.1890/071483.1)
34. Melino, A. & Turnbull, S. M. 1990 Pricing foreign curency options with stochastic volatility. J. Econ. 45, 239-265. (doi:10.1016/0304-4076(90)90100-8)
35. Welch, G. & Bishop, G. 1995 An introduction to the Kalman filter. UNC-CH Computer Science Technical Report 95-041.
36. Durbin, J. & Koopman, S. J. 1997 Monte Carlo maximum likelihood estimation for non-Gaussian state space models. Biometrika 84, 669-684. (doi:10.1093/biomet/84.3.669)
37. Langrock, R. 2011 Some applications of nonlinear and non-Gaussian state-space modelling by means of idden Markov models. J. Appl. Stat. 38, 2955-2970. (doi:10. 1080/02664763.2011.573543)
38. Morales, J. M., Haydon, D. T., Frair, J., Holsinger, K. E. & Fryxell, J. M. 2004 Extracting more out of relocation data: building movement models as mixtures of random walks. Ecology 85, 2436-2445. (doi:10.1890/03-0269)
39. Altman, R. 2007 Mixed hidden Markov models: an extension of the hidden Markov model to the longitudinal data setting. J. Am. Stat. Assoc. 102, 201-210. (doi:10.1198/ 016214506000001086)
40. Rasoloarison, R., Goodman, S. & Ganzhorn, J. 2000 Taxonomic revision of mouse lemur (Microcebus) in the Western portions of Madagascar. Int. J. Primatol. 21, 963-1019. (doi:10.1023/A:1005511129475)
41. Mittermeier, R. et al. 2006 Lemurs of Madagascar. Washington DC: Conservation International.
42. Kappeler, P. & Rasoloarison, R. 2003 Microcebus, mouse lemurs, tsidy. In The natural history of Madagascar (eds S. Goodman & J. Benstead), pp. 1310-1315. Chicago, IL: The University of Chicago Press.
43. Dammhahn, M. & Kappeler, P. M. 2008 Small-scale co existence of two mouse lemur species (Microcebus berthae and M. murinus) within a homogeneous competitive environment. Oecologica 157, 473-483. (doi:10.1007/ s00442-008-1079-x)
44. Dammhahn, M. & Kappeler, P. M. 2008 Comparative feeding ecology of sympatric Microcebus berthae and M. murinus. Int. J. Primatol. 19, 1567-1589. (doi:10. 1007/s10764-008-9312-3)
45. Dammhahn, M. & Kappeler, P. M. 2010 Scramble or contest competition over food in solitarily foraging mouse lemurs (Microcebus spp.): new insights from stable isotopes. Am. J. Phys. Anthropol. 141, 181-189.
46. Schmid, J. 1999 Sex-specific differences in activity patterns and fattening in the grey mouse lemur (Microcebus murinus) in Madagascar. J. Mammol. 80, 749-757. (doi:10.2307/1383244)
47. Eberle, M. & Kappeler, P. M. 2002 Mouse lemurs in space and time: a test to the socioecological model. Behav. Ecol. Sociobiol. 51, 131-139. (doi:10.1007/s002650100409)
48. Radespiel, U., Lutermann, H., Schmelting, B., Bruford, M. W. & Zimmermann, E. 2003 Patterns and dynamics of sex-biased dispersal in a nocturnal primate, the grey mouse lemur, Microcebus murinus. Anim. Behav. 65, 707-719. (doi:10.1006/anbe.2003.2121)
49. Fredsted, T., Pertoldi, C., Schierup, H. & Kappeler, P. M. 2005 Microsatellite analyses reveal fine-scale genetic structure in gray mouse lemurs (Microcebus murinus). Mol. Ecol. 14, 2363-2372. (doi:10.1111/j.1365-294X.2005.02596.x)
50. Sorg, J.-P., Ganzhorn, J. & Kappeler, P. 2003, Forestry and research in the Kirindy Forest/Centre de Formation Professionelle Forestière. In The natural history of Madagascar (eds S. Goodman & J. Benstead), pp. 1512-1519. Chicago, IL: The University of Chicago Press.
51. Martin, A. & Bateson, P. 1993 Measuring behaviour: an introductory guide. Cambridge, UK: Cambridge University Press.
52. Welch, L. R. 2003 Hidden Markov models and the Baum-Welch algorithm. IEEE Inform. Theory Soc. Newsl. 3, 10-13.
53. Humphreys, K. 1998 The latent Markov chain with multivariate random effects. Sociol. Methods Res. 26, 269-299. (doi:10.1177/0049124198026003001)
54. Seltman, H. J. 2002 Case studies in Bayesian statistics: Hidden Markov Models Anal. Biol. Rhythm Data 5, 397-405.
55. MacDonald, I. L. & Zucchini, W. 1997 Hidden Markov models and other models for discrete-valued time series. London, UK: Chapman & Hall.
56. Wang, P. & Puterman, M. L. 2001 Analysis of longitudinal data of epileptic seizure: a two state hidden Markov approach. Biometric. J. 43, 941-962. (doi:10. 1002/1521-4036(200112)43:8,941::AID-BIMJ941.3.0. CO;2-#)
57. Bartolucci, F., Lupparelli, M. & Montanari, G. E. 2009 Latent Markov model for longitudinal binary data: an application to the performance evaluation of nursing homes. Ann. Appl. Stat. 3, 611-636. (doi:10.1214/08AOAS230)
58. Maruotti, A. & Rydén, T. 2009 A semiparametric approach to hidden Markov models under longitudinal observations. Stat. Comput. 19, 381-393. (doi:10.1007/ s11222-008-9099-2)
59. Tucker, B. C. & Anand, M. 2005 On the use of stationary versus hidden Markov models to detect simple versus complex ecological dynamics. Ecol. Model. 185, 177-193. (doi:10.1016/j.ecolmodel.2004.11.021)
60. Franke, A., Caelli, T., Kuzyk, G. & Hudson, R. J. 2006 Prediction of wolf (Canis lupus) kill-sites using hidden Markov models. Ecol. Model. 197, 237-246. (doi:10. 1016/j.ecolmodel.2006.02.043)
61. Réale, D., Reader, S. M., Sol, D., McDougall, P. T. & Dingemanse, N. 2005 Integrating animal temperament within ecology and evolution Biol. Rev. 142, 291-318
62. Langrock, R. & Zucchini, W. 2011 Hidden Markov models with arbitrary dwell-time distributions. Comput. Stat. Data Anal. 55, 715-724. (doi:10.1016/j.csda.2010.06.015)
63. Génin, F. 2003 Female dominance in competition for gum trees in the grey mouse lemur (Microcebus murinus). Revue Écol. Terre et la Vie 58, 397-410.
64. Eberle, M. & Kappeler, P. M. 2004 Sex in the dark: determinants and consequences of mixed male mating tactics in Microcebus murinus, a small solitary nocturnal primate. Behav. Ecol. Sociobiol. 57, 77-90. (doi:10.1007/s00265004-0826-1)
65. Radespiel, U. & Zimmermann, E. 2001 Female dominance in captive gray mouse lemurs (Microcebus murinus). Am. J. Primatol. 54, 181-192. (doi:10.1002/ajp.1029)