Semiparametric regression using student t processes

IEEE Transactions on Neural Networks

Volumn 18, Issue 6, 2007, Pages 1572-1588

  Zhang, Zhihua ^a   Wu, Gang ^b,c   Chang, Edward Y ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of California   (United States)

^c MICROSOFT   (United States)

Author keywords

Expectation maximization (EM) algorithms; Inductive inference; Reproducing kernel Hilbert space (RKHS); Semiparametric regression; Student t process; Transductive inference

Indexed keywords

ALGORITHMS; MATHEMATICAL MODELS; OPTIMIZATION; PARAMETER ESTIMATION; RANDOM PROCESSES;

EXPECTATION-MAXIMIZATION ALGORITHM; MULTIVARIATE-RESPONSE REGRESSION; REPRODUCING KERNEL HILBERT SPACE;

REGRESSION ANALYSIS;

EID: 36348951585     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.899736     Document Type: Article

References (45)

1. R. B. Arellano-Valle and H. Bolfarine, "On some characterization of the t-distribution," Statist. Probab. Lett., vol. 25, pp. 79-85, 1995.
2. R. B. Arellano-Valle, G. del Pino, and P. Iglesias, "Bayesian inference in spherical linear models: Robustness and conjugate analysis," J. Multivariate Anal., vol. 97, pp. 179-197, 2006.
3. N. Aronszajn, "Theory of reproducing kernels," Trans. Amer. Math. Soc., vol. 68, pp. 337-404, 1950.
4. D. J. Bartholomew and M. Knott, Latent Variable Models and Factor Analysis, 2nd ed. London, U.K.: Arnold, 1999.
5. M. Belkin, P. Niyugi, and V. Sindhwani, "Manifold regularization: A geometric framework for learning from examples," Univ. Chicago, Chicago, IL, Tech. Rep. TR-2004-06, 2004.
6. S. A. Billings and H.-L.Wei, "On global-local artificial neural networks for function approximation," IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 862-874, Jul. 2005.
7. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Oxford Univ. Press, 1995.
8. S. Chakraborty, M. Ghosh, and B. K. Mallick, "Bayesian nonlinear regression for large p small n problems," Dept. Statist., Univ. Florida, Gainesville, FL, Tech. Rep., 2005.
9. M. Clyde and E. I. George, "Flexible empirical Bayes estimation for wavelets," J. Roy. Statist. Soc. Ser. B, vol. 62, no. 4, pp. 681-698, 2000.
10. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc. Ser. B vol. 39, no. 1, pp. 1-38, 1977.
11. T. Evgeniou, M. Pontil, and T. Poggio, "Regularization networks and support vector machines," in Advances in Computational Mathematics Berlin, Germany: Springer-Verlag, 2000, vol. 13, pp. 1-50.
12. K. T. Fang and Y. T. Zhang, Generalized Multivariate Analysis. New York: Springer-Verlag, 1990.
13. M. Figueiredo, "Adaptive sparseness for supervised learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1150-1159, Sep. 2003.
14. G. H. Golub and C. F. VanLoan, Matrix Computations, 3rd ed. Baltimore, MD: The Johns Hopkins University Press, 1996.
15. A. K. Gupta and D. K. Nagar, Matrix Variate Distributions. New York: Chapman & Hall, 2000.
16. T. J. Hastie and R. J. Tibshirani, Generalized Additive Models. New York: Chapman & Hall, 1990.
17. T. Joachims, B. Schölkopf, C. Burges, and A. Smola, Eds., "Making large-scale SVM learning practical," in Advances in Kernel Methods - Support Vector Learning. Cambridge, MA: MIT Press, 1999.
18. T. Joachims, "Transductive inference for text classification using support vector machines," in Proc. 14th Int. Conf. Mach. Learn., 1999, pp. 200-209.
19. H. H. Kelejian and I. R. Prucha, "Independent or uncorrelated disturbances in linear regression: An illustration of the difference," Econom. Lett., vol. 19, pp. 717-726, 1985.
20. G. Kimeldorf and G. Wahba, "Some results on Tchebychean spline functions," J. Math. Anal. Appl., vol. 33, pp. 82-95, 1971.
21. S. Kotz and S. Nadarajah, Multivariate t Distributions and Their Applications. Cambridge, U.K.: Cambridge Univ. Press, 2004.
22. K. Lange and J. S. Sinsheimer, "Normal/independent distributions and their applications in robust regression," J. Comput. Graph. Statist. vol. 2, no. 2, pp. 175-198, 1993.
23. K. L. Lange, R. J. A. Little, and J. M. G. Taylor, "Robust statistical modeling using the t distribution," J. Amer. Statist. Assoc. vol. 84, pp. 881-896, 1989.
24. R. J. A. Little and D. B. Rubin, Statistical Analysis with Missing Data, 2nd ed. New York: Wiley, 2002.
25. C. Liu and D. B. Rubin, "The ECME algorithm: A simple extension of EM and ECM with faster monotone convergence," Biometrika, vol. 81, pp. 633-648, 1994.
26. H. Lütkepohl, Handbook of Matrices. New York: Wiley, 1996.
27. K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. New York: Academic, 1979.
28. X. L. Meng and D. B. Rubin, "Maximum likelihood estimation via the ECM algorithm: A general framework," Biometrika, vol. 80, pp. 267-278, 1993.
29. R. M. Neal, Bayesian Learning for Neural Networks. New York: Springer-Verlag, 1996.
30. R. M. Neal, J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Eds., "Regression and classification using Gaussian process priors (with discussion)," in Bayesian Statistics. Oxford, U.K.: Oxford Univ. Press, 1998, vol. 6, pp. 475-501.
31. K. Nigam, A. K. McCallum, S. Thrun, and T. Mitchell, "Text classification from labeled and unlabeled documents using EM," Mach. Learn., vol. 39, no. 2/3, pp. 103-134, 2000.
32. A. O'Hagan, M. C. Kennedy, and J. E. Oakley, J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, Eds., "Uncertainty analysis and other inference tools for complex computer codes (with discussion)," in Bayesian Statistics. Oxford, U.K.: Oxford Univ. Press, 1999, vol. 6, pp. 503-524.
33. L. R. Pericchi and A. F. M. Smith, "Exact and approximate posterior moments for a normal location parameter," J. Roy. Statist. Soc. Ser. B, vol. 54, no. 3, pp. 793-804, 1992.
34. B. Schölkopf and A. Smola, Learning with Kernels. Cambridge, MA: MIT Press, 2002.
35. B. Skagerberg, J. F. MacGregor, and C. Kiparissides, "Multivariate data analysis applied to low-density polyethylene reactors," Chemometrics Intell. Lab. Syst., vol. 14, pp. 341-356, 1992.
36. B. C. Sutradhar and M. M. Ali, "Estimation of the parameters of a regression model with a multivariate T error variable," Commun. Statist. - Theory Methods, vol. 71, pp. 400-405, 1976.
37. Y. W. Teh, M. Seeger, and M. I. Jordan, "Semiparametric latent factor models," in Proc. Workshop Artif. Intell. Statist., 2005, vol. 10, pp. 333-340.
38. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol. 1, pp. 211-244, 2001.
39. V. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
40. G. Wahba, Spline Models for Observational Data. Philadelphia, PA: SIAM, 1990.
41. D. Wedge, D. Ingram, D. McLean, C. Mingham, and Z. Bandar, "On global-local artificial neural networks for function approximation," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 942-952, Sep. 2006.
42. M. West, J. M. Bernardo, M. J. Bayarri, J. O. Berger, A. P. Dawid, D. Heckerman, A. F. M. Smith, and M. West, Eds., "Bayesian factor regression models in the "large p, small n" paradigm," in Bayesian Statistics. Oxford, U.K.: Oxford Univ. Press, 2003, vol. 7, pp. 723-732.
43. C. K. I. Williams, M. Jordan, Ed., "Prediction with Gaussian processes: From linear regression to linear prediction and beyond," in Learning and Inference in Graphical Models. Cambridge, MA: MIT Press, 1999, pp. 599-621.
44. A. Zellner, "Bayesian and non-Bayesian analysis of the regression model with multivariate student-t error terms," J. Amer. Statist. Assoc., vol. 71, pp. 400-405, 1976.
45. Q. H. Zhang, "Using wavelet network in nonparametric estimation," IEEE Trans. Neural Netw., vol. 8, no. 2, pp. 227-236, Mar. 1997.