Nonlinear models using dirichlet process mixtures

Journal of Machine Learning Research

Volumn 10, Issue , 2009, Pages 1829-1850

  Shahbaba, Babak ^a   Neal, Radford ^b  

^a 5226 Donald Bren Hall   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Classification; Dirichlet process; Mixture models

Indexed keywords

ALTERNATIVE METHODS; CLASSIFICATION; COVARIATES; DIRICHLET PROCESS; DIRICHLET PROCESS MIXTURE; HIDDEN STRUCTURES; JOINT DISTRIBUTIONS; MIXTURE COMPONENTS; MIXTURE MODELS; MULTINOMIAL LOGIT; NEW APPROACHES; NON-LINEAR MODEL; PARKINSON'S DISEASE; PREDICTIVE ACCURACY; PROTEIN SEQUENCES; REGRESSION COEFFICIENT; SIMULATED DATA; SUB-POPULATIONS; TWO CLASSIFICATION;

DECISION TREES; MULTILAYER NEURAL NETWORKS; POPULATION STATISTICS; PROTEIN FOLDING;

MIXTURES;

EID: 70349425847     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (44)

1. E. L. Allwein, R. E. Schapire, Y. Singer, and P. Kaelbling. Reducing multiclass to binary: A unifying approach for margin classifiers. Journal of Machine Learning Research, 1:113-141, 2000.
2. C. E. Antoniak. Mixture of Dirichlet process with applications to Bayesian nonparametric problems. Annals of Statistics, 273(5281):1152-1174, 1974.
3. D. Blackwell and J. B. MacQueen. Ferguson distributions via polya urn scheme. Annals of Statistics, 1:353-355, 1973.
4. D. M. Blei and M. I. Jordan. Variational inference for dirichlet process mixtures. Bayesian Analysis, 1:121-144,2005.
5. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent Dirichlet allocation. Journal of Machine Learning Research, 3:993-1022, January 2003.
6. L. Breiman, J. Friedman, R. A. Olshen, and C. J. Stone. Classification and Regression Trees. Chapman and Hall, Boca Raton, 1993.
7. C. A. Bush and S. N. MacEachern. A semi-parametric Bayesian model for randomized block designs. Biometrika, 83:275-286, 1996.
8. B. Cai and D. B. Dunson. Bayesian covariance selection in generalized linear mixed models. Biometrics, 62:446-457, 2006. (Pubitemid 43926649)
9. L. Cnockaert, J. Schoentgen, R Auzou, C. Ozsancak, L. Defebvre, and F. Grenez. Low-frequency vocal modulations in vowels produced by parkinsonian subjects. Speech Communication, 50(4): 288-300, 2008.
10. M. J. Daniels and R. E. Kass. Nonconjugate Bayesian estimation of covariance matrices and its use in hierarchical models. Journal of the American Statistical Association, 94(448): 1254-1263, 1999.
11. C. H. Q. Ding and I. Dubchak. Multi-class protein fold recognision using support vector machines and neural networks. Bioinformatics, 17(4):349-358, 2001. (Pubitemid 32421929)
12. J. R. Duffy. Motor Speech Disorders: Substrates, Differential Diagnosis and Management. Elsevier Mosby, St. Louis, Mo., 2nd edition, 2005.
13. M. D. Escobar and M. West. Bayesian density estimation and inference using mixtures. Journal of American Statistical Society, 90:577-588, 1995.
14. T. S. Ferguson. A Bayesian analysis of some nonparametric problems. Annals of Statistics, 1: 209-230,1973.
15. T. S. Ferguson. Recent Advances in Statistics, Ed: Rizvi, H. and Rustagi, J., chapter Bayesian density estimation by mixtures of normal distributions, pages 287-302. Academic Press, New York, 1983.
16. J. Fürnkranz. Round robin classification. Journal of Machine Learning Research, 2:121-1 Al, 2002. ISSN 1533-7928.
17. Z. Ghahramani and G. E. Hinton. The EM algorithm for mixtures of factor analyzers. Technical report, Technical Report CRG-TR-96-101, Department of Computer Science, University of Toronto, 1996.
18. A. K. Ho, R. Iansek, C. Marigliani, J. L. Bradshaw, and S. Gates. Speech impairment in a large sample of patients with Parkinson's disease. Behavioural Neurology, 11:131-137, 1998.
19. U. Hobohm and C. Sander. Enlarged representative set of proteins. Protein Science, 3:522-524, 1994.
20. U. Hobohm, M. Scharf, R. Schneider, and C. Sander. Selection of a representative set of structure from the brookhaven protein bank. Protein Science, 1:409-417, 1992.
21. C. W. Hsu and C. J. Lin. A comparison of methods for multi-class support vector machines. IEEE Transactions on Neural Networks, 13:415-425, 2002. (Pubitemid 34475042)
22. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton. Adaptive mixtures of local experts. Neural Computation, 3(1):79-87, 1991.
23. S. Jain and R. M. Neal. Splitting and merging components of a nonconjugate Dirichlet process mixture model (with discussion). Bayesian Analysis, 2:445-472, 2007.
24. M. A. Little, P E. McSharry, E. J. Hunter, J. Spielman, and L. O. Ramig. Suitability of dysphonia measurements for telemonitoring of Parkinson's disease. IEEE Transactions on Biomedical Engineering, (in press), 2008.
25. L. Lo Conte, B. Ailey, T.J.P Hubbard, S. E. Brenner, A.G. Murzing, and C. Chothia. Scop: a structural classification of protein database. Nucleic Acids Research, 28:257-259, 2000.
26. S. N. MacEachern and P Müller. Estimating mixture of Dirichlet process models. Journal of Computational and Graphcal Statistics, 7:223-238, 1998. (Pubitemid 128094873)
27. E. Meeds and S. Osindero. An alternative infinite mixture of Gaussian process experts. Advances in Neural Information Processing Systems, 18:883, 2006.
28. P Müller, A. Erkanli, and M. West. Bayesian curve fitting using multivariate mormal mixtures. Biometrika, 83(1):67-79, 1996.
29. R. M. Neal. Markov chain sampling methods for Dirichlet process mixture models. Journal of Computational and Graphical Statistics, 9:249-265, 2000.
30. R. M. Neal. Slice sampling. Annals of Statistics, 31(3):705-767, 2003.
31. R. M. Neal. Probabilistic Inference Using Markov Chain Monte Carlo Methods. Technical Report CRG-TR-93-101, Department of Computer Science, University of Toronto, 1993.
32. R. M. Neal. Bayesian Learning for Neural Networks. Lecture Notes in Statistics No. 118, New York: Springer-Verlag, 1996.
33. D. A. Rahn, M. Chou, J. J. Jiang, and Y Zhang. Phonatory impairment in Parkinson's disease: evidence from nonlinear dynamic analysis and perturbation analysis.(Clinical report). Journal of Voice, 21:64-71, 2007.
34. C. E. Rasmussen and Z. Ghahramani. Infinite mixtures of Gaussian process experts. In Advances in Neural Information Processing Systems 14, page 881. MIT Press, 2002.
35. D. Rubin and D. Thayer. EM algorithms for ML factor analysis. Pshychometrika, 47(1):69-76, 2007.
36. S. Sapir, J. L. Spielman, L. O. Ramig, B. H. Story, and C. Fox. Effects of intensive voice treatment (the Lee Silverman Voice Treatment [lsvt]) on vowel articulation in dysarthric individuals with idiopathic Parkinson disease: Acoustic and perceptual findings. Journal of Speech, Language, and Hearing Research, 50(4):899-912, 2007.
37. B. Shahbaba. Discovering hidden structures using mixture models: Application to nonlinear time series processes. Studies in Nonlinear Dynamics & Econometrics, 13(2):Article 5, 2009.
38. B. Shahbaba. Improving Classification Models When a Class Hierarchy is Available. PhD thesis, Biostatistics, Public Health Sciences, University of Toronto, 2007.
39. B. Shahbaba and R. M. Neal. Improving classification when a class hierarchy is available using a hierarchy-based prior. Bayesian Analysis, 2(1):221-238, 2007.
40. B. Shahbaba and R. M. Neal. Gene function classification using Bayesian models with hierarchybased priors. BMC Bioinformatics, 7:448, 2006.
41. N. Singh, V Pillay, and Y E. Choonara. Advances in the treatment of Parkinson's disease. Progress in Neurobiology, 81:29-44, 2007.
42. I. Ulusoy and C. M. Bishop. Generative versus discriminative methods for object recognition. In CVPR '05: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume2, pages 258-265, Washington, DC, USA, 2005. IEEE Computer Society.
43. V. N. Vapnik. The Nature of Statistical Learning Theory. Springer-Verlag New York, Inc., New York, NY, USA, 1995. ISBN 0-387-94559-8.
44. S. Waterhouse, D. MacKay, and T. Robinson. Bayesian methods for mixtures of experts. In Advances in Neural Information Processing Systems 8, page 351. MIT Press, 1996.