Adaptive mixtures of regressions: Improving predictive inference when population has changed

Communications in Statistics: Simulation and Computation

Volumn 43, Issue 10, 2014, Pages 2570-2592

  Bouveyron, C ^a   Jacques, J ^b,c,d  

^a Université Paris 1 Panthéon Sorbonne   (France)

^b UNIVERSITÉ LILLE 1   (France)

^c INRIA   (France)

^d UNIV LILLE   (France)

Author keywords

Bayesian inference; EM algorithm; MCMC algorithm; Mixture of regressions; Switching regression; Transfer learning

Indexed keywords

ALGORITHMS; BAYESIAN NETWORKS; INFERENCE ENGINES; MIXTURES;

BAYESIAN INFERENCE; EM ALGORITHMS; MCMC ALGORITHMS; SWITCHING REGRESSIONS; TRANSFER LEARNING;

REGRESSION ANALYSIS;

EID: 84902687136     PISSN: 03610918     EISSN: 15324141     Source Type: Journal    
DOI: 10.1080/03610918.2012.758737     Document Type: Article

References (30)

1. Allen, D. M. (1974). The relationship between variable selection and data augmentation and amethod for prediction. Technometrics 16: 125-127.
2. Biernacki, C. (2004). Initializing EM using the properties of its trajectories in Gaussian mixtures. Statistics and Computing 14 (3): 267-279.
3. Biernacki, C., Beninel, F., Bretagnolle, V. (2002). A generalized discriminant rule when training population and test population differ on their descriptive parameters. Biometrics 58 (2): 387-397.
4. Blitzer, J., Dredze, M., Pereira, F., (2007).Biographies, Bollywood, boomboxes and blenders: Domain adaptation for sentiment classification. In: Proceedings of the 45th Annual Meeting of the Association of Computational Inguistics., Czech Republic: Prague, pp. 432-439.
5. Bouveyron, C., Jacques, J. (2010). Adaptive linear models for regression: Improving prediction when population has changed. Pattern Recognition Letters 31 (14): 2237-2247.
6. Celeux, G., Hurn, M., Robert, C. (2000). Computational and inferential difficulties with mixture posterior distributions. Journal of the American Statistical Association 95: 957-970.
7. Dempster, A., Laird, N., Rubin, D. (1977). Maximum likelihood from incomplete data (with discussion). Journal of the Royal Statistical Society. Series B 39: 1-38.
8. Diebolt, J., Robert, C. (1994). Estimation of finite mixture distributions through Bayesian sampling. Journal of the Royal Statistical Society. Series B 56 (2): 363-375.
9. Evgeniou, T., Pontil, M. (2004). Regularized multi-task learning. In: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Seatlle, Washington, USA, pp. 109-117.
10. Goldfeld, M., Quandt, R. (1973).AMarkov model for switching regressions. Journal of Econometrics 1: 3-16.
11. Hastie, T., Tibshirani, R., Friedman, J. (2001). The Elements of Statistical Learning, Springer Series in Statistics. New York: Springer-Verlag.
12. Hurn, M., Justel, A., Robert, C. P. (2003). Estimating mixtures of regressions. Journal of Computational and Graphical Statistics 12 (1): 55-79.
13. Jacques, J., Biernacki, C. (2010). Extension of model-based classification for binary data when training and test populations differ. Journal of Applied Statistics 37 (5): 749-766.
14. Khalili, A., Chen, J. (2007). Variable selection in finite mixture of regression models. Journal of the American Statistical Association 102 (479): 1025-1038.
15. Lawrence, N., Platt, J. (2004). Learning to learn with the informative vector machine. In: Proceedings of the 21st International Conference on Machine Learning. Banff, Alberta, Canada.
16. Lourme, A., Biernacki, C. (2008). Gaussian model-based classification when training and test population differ: Estimating jointly related parameters. In: First Joint Meeting of the Société Francophone de Classification and of the Classification and Data Analysis Group of SIS. Caserta, Italy, June 2008.
17. Pan, S., Tsang, I., Kwok, J., Yang, Q. (2009). Domain adaptation via transfer component analysis. IEEE Transactions on Neural Networks 49: 1-12.
18. Pan, S., Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22 (10): 1345-1359.
19. Raftery, A. E., Newton, M. A., Satagopan, J. M., Krivitsky, P. N. (2007). Estimating the integrated likelihood via posterior simulation using the harmonic mean identity. In: Bayesian Statistics 8. Oxford: Oxford Sci. Publ. Oxford Univ. Press, pp. 371-416.
20. Richardson, S., Green, P. (1997). On Bayesian analysis of mixtures with an unknown number of components. Journal of the Royal Statistical Society. Serie B 59: 731-792.
21. Robert, C. (2007). The Bayesian Choice. New York: Springer.
22. Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics 6 (2): 461-464.
23. Shimodaira, H. (2000). Improving predictive inference under covariate shift by weighting the loglikelihood function. Journal of Statistical Planning and Inference 90 (2): 227-244.
24. Stephens, M. (2000). Dealing with label switching in mixture models. Journal of the Royal Statistical Society. Serie B 62 (4): 795-809.
25. Storkey, A., Sugiyama, M. (2007). Mixture Regression for Covariate Shift, Advances in Neural Information Processing Systems 19. Cambridge: MIT Press, pp. 1337-1344.
26. Sugiyama, M. (2006). Active learning in approximately linear regression based on conditional expectation of generalization error. Journal of Machine Learning Research 7: 141-166.
27. Sugiyama, M., Müller, K.-R. (2005). Input-dependent estimation of generalization error under covariate shift. Statistics & Decisions 23: 249-279.
28. Sugiyama, M., Krauledat, M., Müller, K.-R. (2007). Covariate shift adaptation by importance weighted cross validation. Journal of Machine Learning Research 8: 985-1005.
29. Xue, G.-R., Dai, W., Yang, Q., Yu, Y. (2008). Topic-bridged plsa for cross-domain text classification. In: 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '08). New York, NY, USA, pp. 627-634.
30. Zhu, H.-T., Zhang, H. (2004). Hypothesis testing in mixture regression models. Journal of the Royal Statistical Society. Series B 66 (1): 3-16.