Joint modeling of multiple time series via the beta process with application to motion capture segmentation

Annals of Applied Statistics

Volumn 8, Issue 3, 2014, Pages 1281-1313

  Fox, Emily B ^a   Hughes, Michael C ^b   Sudderth, Erik B ^b   Jordan, Michael I ^c  

^a UNIVERSITY OF WASHINGTON   (United States)

^b Brown Univerity   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Bayesian nonparametrics; Beta process; Hidden Markov models; Motion capture; Multiple time series

Indexed keywords

EID: 84908309028     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/14-AOAS742     Document Type: Article

References (50)

1. AACH, J. and CHURCH, G. (2001). Aligning gene expression time series with time warping algo- rithms. Bioinformatics 17 495-508.
2. ALON, J., SCLAROFF, S., KOLLIOS, G. and PAVLOVIC, V. (2003). Discovering clusters in motion time-series data. In Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Madison, WI, USA.
3. ALTMAN, R. M. (2007). Mixed hidden Markov models: An extension of the hidden Markov model to the longitudinal data setting. J. Amer. Statist. Assoc. 102 201-210. MR2345538
4. AOKI, M. and HAVENNER, A. (1991). State space modeling of multiple time series. Econometric Rev. 10 1-99. MR1108250
5. BARBI Č, J., SAFONOVA, A., PAN, J.-Y., FALOUTSOS, C., HODGINS, J. K. and POLLARD, N. S. (2004). Segmenting motion capture data into distinct behaviors. In Proc. of Graphics Interface. London, Ontario, Canada.
6. BEAL, M., GHAHRAMANI, Z. and RASMUSSEN, C. (2001). The infinite hidden Markov model. In Advances in Neural Information Processing Systems (NIPS) 14. Vancouver, Canada.
7. CMU (2009). Carnegie Mellon University graphics lab motion capture database. Available at http://mocap.cs.cmu.edu/.
8. DAHL, D. B. (2005). Sequentially-allocated merge-split sampler for conjugate and nonconjugate dirichlet process mixture models. Technical report, Texas A&M Univ., College Station, TX.
9. DUH, K. (2005). Jointly labeling multiple sequences: A factorial HMM approach. In 43rd Annual Meeting of the Assoc. for Computational Linguistics (ACL). Ann Arbor, MI.
10. DUNSON, D. B. (2009). Nonparametric Bayes local partition models for random effects. Biometrika 96249-262. MR2507141
11. DUNSON, D. B. (2010). Multivariate kernel partition process mixtures. Statist. Sinica 20 1395-1422. MR2777330
12. FOX, E. B., SUDDERTH, E. B., JORDAN, M. I. and WILLSKY, A. S. (2009). Sharing features among dynamical systems with beta processes. In Advances in Neural Information Processing Systems (NIPS) 22. Vancouver, Canada.
13. FOX, E. B., SUDDERTH, E. B., JORDAN, M. I. and WILLSKY, A. S. (2010). Bayesian nonpara- metric methods for learning Markov switching processes. IEEE Signal Process. Mag. 27 43-54.
14. FOX, E. B., SUDDERTH, E. B., JORDAN, M. I. and WILLSKY, A. S. (2011a). Bayesian nonpara- metric inference of switching dynamic linear models. IEEE Trans. Signal Process. 59 1569-1585.
15. FOX, E. B., SUDDERTH, E. B., JORDAN, M. I. and WILLSKY, A. S. (2011b). A sticky HDP-HMM with application to speaker diarization. Ann. Appl. Stat. 5 1020-1056. MR2840185
16. FOX, E. B., HUGHES, M. C., SUDDERTH, E. B. and JORDAN, M. I. (2014). Supplement to “Joint modeling of multiple time series via the beta process with application to motion capture segmen- tation.” DOI:10.1214/14-AOAS742SUPP.
17. FRIGESSI, A., DI STEFANO, P., HWANG, C.-R. and SHEU, S. J. (1993). Convergence rates of the Gibbs sampler, the Metropolis algorithm and other single-site updating dynamics. J. Roy. Statist. Soc. Ser. B 55 205-219. MR1210432
18. GHAHRAMANI, Z., GRIFFITHS, T. L. and SOLLICH, P. (2006). Bayesian nonparametric latent feature models. In Proc. of the Eighth Valencia International Meeting on Bayesian Statistics (Bayesian Statistics 8). Alicante, Spain.
19. GHAHRAMANI, Z. and JORDAN, M. I. (1997). Factorial hidden Markov models. Machine Learning 29245-273.
20. GREEN, P. J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82 711-732. MR1380810
21. GRIFFIN, J. E. and STEEL, M. F. J. (2006). Order-based dependent Dirichlet processes. J. Amer. Statist. Assoc. 101 179-194. MR2268037
22. HJORT, N. L. (1990). Nonparametric Bayes estimators based on beta processes in models for life history data. Ann. Statist. 18 1259-1294. MR1062708
23. HSU, E., PULLI, K. and POPOVIĆ, J. (2005). Style translation for human motion. In Proc. of the 32nd International Conference on Computer Graphics and Interactive Technologies (SIG- GRAPH). Los Angeles, CA.
24. HUGHES, M., FOX, E. B. and SUDDERTH, E. B. (2012). Effective split merge Monte Carlo meth- ods for nonparametric models of sequential data. In Advances in Neural Information Processing Systems (NIPS) 25. Lake Tahoe, NV, USA.
25. JAIN, S. and NEAL, R. M. (2004). A split-merge Markov chain Monte Carlo procedure for the Dirichlet process mixture model. J. Comput. Graph. Statist. 13 158-182. MR2044876
26. JAIN, S. and NEAL, R. M. (2007). Splitting and merging components of a nonconjugate Dirichlet process mixture model. Bayesian Anal. 2 445-472. MR2342168
27. KINGMAN, J. F. C. (1967). Completely random measures. Pacific J. Math. 21 59-78. MR0210185
28. KINGMAN, J. F. C. (1993). Poisson Processes. Oxford Univ. Press, New York. MR1207584
29. LEHRACH, W. P. and HUSMEIER, D. (2009). Segmenting bacterial and viral DNA sequence align- ments with a trans-dimensional phylogenetic factorial hidden Markov model. J. R. Stat. Soc. Ser. C. Appl. Stat. 58 307-327. MR2750008
30. LISTGARTEN, J., NEAL, R., ROWEIS, S., PUCKRIN, R. and CUTLER, S. (2006). Bayesian detec- tion of infrequent differences in sets of time series with shared structure. In Advances in Neural Information Processing Systems (NIPS) 19. Vancouver, Canada.
31. LIU, J. S. (1996). Peskun’s theorem and a modified discrete-state Gibbs sampler. Biometrika 83 681-682. MR1423883
32. MACEACHERN, S. N. (1999). Dependent nonparametric processes. In ASA Proc. of the Section on Bayesian Statistical Science. Amer. Statist. Assoc., Alexandria, VA.
33. MEEDS, E., GHAHRAMANI, Z., NEAL, R. M. and ROWEIS, S. T. (2006). Modeling dyadic data with binary latent factors. In Advances in Neural Information Processing Systems (NIPS) 19. Vancouver, Canada.
34. MØRUP, M., SCHMIDT, M. N. and HANSEN, L. K. (2011). Infinite multiple membership relational modeling for complex networks. In IEEE International Workshop on Machine Learning for Sig- nal Processing. Beijing, China.
35. MURPHY, K. P. (1998). Hidden Markov model (HMM) toolbox for MATLAB. Available at http://www.cs.ubc.ca/∼murphyk/Software/HMM/hmm.html.
36. MURPHY, K. P. (2002). Dynamic Bayesian networks: Representation, inference and learning. Ph.D. thesis, Univ. California, Berkeley. MR2704368
37. PAVLOVI Ć, V., REHG, J. M. and MACCORMICK, J. (2000). Learning switching linear models of human motion. In Advances in Neural Information Processing Systems (NIPS) 13. Vancouver, Canada.
38. PAVLOVI Ć, V., REHG, J. M., CHAM, T. J. and MURPHY, K. P. (1999). A dynamic Bayesian network approach to figure tracking using learned dynamic models. In Proc. of the 7th IEEE International Conference on Computer Vision (ICCV). Kerkyra, Greece.
39. QI, Y., PAISLEY, J. W. and CARIN, L. (2007). Music analysis using hidden Markov mixture models. IEEE Trans. Signal Process. 55 5209-5224. MR2469377
40. RABINER, L. R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77 257-286.
41. SARIA, S., KOLLER, D. and PENN, A. (2010). Discovering shared and individual latent structure in multiple time series. Available at arXiv:1008.2028.
42. TAYLOR, G. W., HINTON, G. E. and ROWEIS, S. T. (2006). Modeling human motion using binary latent variables. In Advances in Neural Information Processing Systems (NIPS) 19. Vancouver, Canada.
43. TEH, Y. W., JORDAN, M. I., BEAL, M. J. and BLEI, D. M. (2006). Hierarchical Dirichlet processes. J. Amer. Statist. Assoc. 101 1566-1581. MR2279480
44. THIBAUX, R. and JORDAN, M. I. (2007). Hierarchical beta processes and the Indian buffet pro- cess. In Proc. of the Eleventh International Conference on Artificial Intelligence and Statistics (AISTATS). San Juan, Puerto Rico.
45. TIERNEY, L. (1994). Markov chains for exploring posterior distributions. Ann. Statist. 22 1701-1762. MR1329166
46. TU, Z. and ZHU, S. C. (2002). Image segmentation by data-driven Markov chain Monte Carlo. IEEE Trans. Pattern Anal. Mach. Intell. 24 657-673.
47. VAN GAEL, J., TEH, Y. W. and GHAHRAMANI, Z. (2009). The infinite factorial hidden Markov model. In Advances in Neural Information Processing Systems (NIPS) 21. Vancouver, Canada.
48. WANG, C. and BLEI, D. (2012). A split-merge MCMC algorithm for the hierarchical Dirichlet process. Available at arXiv:1201.1657.
49. WANG, J. M., FLEET, D. J. and HERTZMANN, A. (2008). Gaussian process dynamical models for human motion. IEEE Trans. Pattern Anal. Mach. Intell. 30 283-298.
50. WEST, M. and HARRISON, J. (1997). Bayesian Forecasting and Dynamic Models, 2nd ed. Springer, New York. MR1482232