Nonparametric mixtures of gaussian processes with power-law behavior

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 12, 2012, Pages 1862-1871

  Chatzis, Sotirios P ^a   Demiris, Yiannis ^b  

^a CYPRUS UNIVERSITY OF TECHNOLOGY   (Cyprus)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Gaussian process; mixture model; Pitman Yor process

Indexed keywords

GAUSSIAN PROCESSES; MACHINE LEARNING APPROACHES; MIXTURE MODEL; NON-STATIONARY COVARIANCE; NONPARAMETRIC BAYESIAN MODELS; NONPARAMETRIC MIXTURES; PITMAN-YOR PROCESS; VARIATIONAL BAYESIAN FRAMEWORKS;

ALGORITHMS; BAYESIAN NETWORKS; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); MIXTURES;

SPACE POWER GENERATION;

EID: 84876887691     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2217986     Document Type: Article

References (40)

1. D. Gu and H. Hu, "Spatial Gaussian process regression with mobile sensor networks," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 8, pp. 1279-1290, Aug. 2012.
2. S. Walker, P. Damien, P. Laud, and A. Smith, "Bayesian nonparametric inference for random distributions and related functions," J. Royal Stat. Soc. B, vol. 61, no. 3, pp. 485-527, 1999.
3. R. Neal, "Markov chain sampling methods for Dirichlet process mixture models," J. Comput. Graph. Stat., vol. 9, no. 2, pp. 249-265, 2000.
4. P. Muller and F. Quintana, "Nonparametric Bayesian data analysis," Stat. Sci., vol. 19, no. 1, pp. 95-110, 2004.
5. C. Antoniak, "Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems," Ann. Stat., vol. 2, no. 6, pp. 1152-1174, 1974.
6. D. Blei and M. Jordan, "Variational methods for the Dirichlet process," in Proc. 21st Int. Conf. Mach. Learn., Jul. 2004, pp. 12-19.
7. J. Pitman and M. Yor, "The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator," Ann. Probab., vol. 25, pp. 855-900, Mar. 1997.
8. S. Goldwater, T. Griffiths, and M. Johnson, "Interpolating between types and tokens by estimating power-law generators," in Advances in Neural Information Processing Systems, vol. 18. Cambridge, MA: MIT Press, 2006.
9. T. Ferguson, "A Bayesian analysis of some nonparametric problems," Ann. Stat., vol. 1, pp. 209-230, Jan. 1973.
10. D. Blackwell and J. MacQueen, "Ferguson distributions via Pólya urn schemes," Ann. Stat., vol. 1, no. 2, pp. 353-355, 1973.
11. Y. W. Teh, "A hierarchical Bayesian language model based on Pitman-Yor processes," in Proc. Assoc. Comput. Linguist., 2006, pp. 985-992.
12. J. Sethuraman, "A constructive definition of the Dirichlet prior," Stat. Sinica, vol. 2, pp. 639-650, Mar. 1994.
13. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
14. M. Seeger, "Bayesian Gaussian process models: PAC-Bayesian generalisation error bounds and sparse approximations," Ph.D. dissertation, School of Informatics, Univ. Edinburgh, Newington, U.K., 2003.
15. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. Cambridge, MA: MIT Press, 2006.
16. D. M. Blei and M. I. Jordan, "Variational inference for Dirichlet process mixtures," Bayesian Anal., vol. 1, no. 1, pp. 121-144, 2006.
17. Y. Qi, J. W. Paisley, and L. Carin, "Music analysis using hidden Markov mixture models," IEEE Trans. Signal Process., vol. 55, no. 11, pp. 5209-5224, Nov. 2007.
18. W. Fan, N. Bouguila, and D. Ziou, "Variational learning for finite dirichlet mixture models and applications," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 5, pp. 762-774, May 2012.
19. A. Penalver and F. Escolano, "Entropy-based incremental variational bayes learning of Gaussian mixtures," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 3, pp. 534-540, Mar. 2012.
20. C. M. Bishop, Neural Networks for Pattern Recognition. Gloucestershire, U.K.: Clarendon Press, 1995.
21. M. Jordan, Z. Ghahramani, T. Jaakkola, and L. Saul, "An introduction to variational methods for graphical models," in Learning in Graphical Models, M. Jordan, Ed. Dordrecht, The Netherlands: Kluwer, 1998, pp. 105-162.
22. S. Chatzis, D. Kosmopoulos, and T. Varvarigou, "Signal modeling and classification using a robust latent space model based on t distributions," IEEE Trans. Signal Process., vol. 56, no. 3, pp. 949-963, Mar. 2008.
23. D. Chandler, Introduction to Modern Statistical Mechanics. New York: Oxford Univ. Press, 1987.
24. D. Liu and J. Nocedal, "On the limited memory method for large scale optimization," Math. Program. B, vol. 45, no. 3, pp. 503-528, 1989.
25. C. Rasmussen and Z. Ghahramani, "Infinite mixtures of Gaussian process experts," in Advances in Neural Information Processing Systems, vol. 14. Cambridge, MA: MIT Press, 2002, pp. 881-888.
26. E. Meeds and S. Osindero, "An alternative infinite mixture of Gaussian process experts," in Advances in Neural Information Processing Systems, vol. 18. Cambridge, MA: MIT Press, 2006, pp. 883-890.
27. L. Xu, M. I. Jordan, and G. E. Hinton, "Analternative model for mixtures of experts," in Advances in Neural Information Processing Systems, vol. 7. Cambridge, MA: MIT Press, 1995, pp. 633-640.
28. C. Yuan and C. Neubauer, "Variational mixture of gaussian process experts," in Advances in Neural Information Processing Systems, vol. 21. Cambridge, MA: MIT Press, 2008, pp. 897-1904.
29. S. Sun and X. Xu, "Variational inference for infinite mixtures of Gaussian processes with applications to traffic flow prediction," IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 466-475, Jun. 2011.
30. A. J. Smola and P. Bartlet, "Sparse greedy gaussian process regression," in in Advances in Neural Information Processing Systems, vol. 13. Cambridge, MA: MIT Press, 2001, pp. 619-625.
31. C.-C. Chang and C.-J. Lin. (2001). LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/∼cjlin/libsvm
32. J. Geweke, "Evaluating the accuracy of sampling-based approaches to calcualting posterior moments," in Bayesian Statistics, vol. 4, J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Eds. Oxford, U.K.: Clarendon Press, 1992.
33. Aldebaran Robotics: The NAO Robot. (2012) [Online]. Available: http://www.aldebaran-robotics.com/en/Nao.php
34. B. Pearlmutter, "Gradient calculations for dynamic recurrent neural networks: A survey," IEEE Trans. Neural Netw., vol. 6, no. 5, pp. 1212-1228, Sep. 1995.
35. P. Zegers and M. K. Sundareshan, "Trajectory generation and modulation using dynamic neural networks," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 520-533, May 2003.
36. C. S. Myers and L. R. Rabiner, "A comparative study of several dynamic time-warping algorithms for connected word recognition," Bell Syst. Tech. J., vol. 60, no. 7, pp. 1389-1409, Sep. 1981.
37. The CMU MoCap Database. (2012) [Online]. Available: http://mocap.cs. cmu.edu/
38. J. M. Wang, D. J. Fleet, and A. Hertzmann, "Gaussian process dynamical models for human motion," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 2, pp. 283-298, Feb. 2008.
39. S. Chatzis and Y. Demiris, "Echo state Gaussian process," IEEE Trans. Neural Netw., vol. 22, no. 9, pp. 1435-1445, Sep. 2011.
40. D. Verstraeten, B. Schrauwen, M. D'Haene, and D. Stroobandt, "2007 special issue: An experimental unification of reservoir computing methods," Neural Netw., vol. 20, no. 3, pp. 391-403, 2007.