Improving generalization ability of neural networks ensemble with multi-task learning

Journal of Computational Information Systems

Volumn 2, Issue 4, 2006, Pages 1235-1240

  Li, Guozheng ^a,b   Liu, Tianyu ^a,b   Wu, Gengfeng ^a,b  

^a NANJING UNIVERSITY   (China)

^b SHANGHAI UNIVERSITY   (China)

Author keywords

Multi task learning; Neural networks ensemble

Indexed keywords

FEATURE EXTRACTION; FORECASTING; GENETIC ALGORITHMS; HEURISTIC METHODS; NEURAL NETWORKS;

MULTI TASK LEARNING; NEURAL NETWORKS ENSEMBLE;

LEARNING SYSTEMS;

EID: 33845734163     PISSN: 15539105     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (16)

1. T. Dietterich. Machine-learning research: Four current directions. The AI Magazine, 1998. 18(4): 97-136.
2. R. Schapire. The strength of weak learn ability. Machine learning, 1990. 5(2): 197-227.
3. L. Breiman. Bagging predictors, machine learning. Machine learning, 1996. 24(2): 123-140.
4. E Bauer, R. Kohavi. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine learning, 1999. 36(2): 105-139.
5. H. Liu, L. Yu. Toward integrating feature selection algorithms for classification and clustering. IEEE Trans, on Knowledge and Data Engineering, 2005. 17(3): 1-12.
6. I. Guyon, A. Elisseeff. An introduction to variable and feature selection. Journal of machine learning research, 2003. 3: 1157-1182.
7. L. Yu, H. Liu. Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research, 2004. 5 (Oct): 1205-1224.
8. P. Mitra, C. A. Murthy, S. K. Pal. Unsupervised feature selection using feature similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002. 24(3): 301-312.
9. R. Caruana. Multitask learning. Machine Learning, 1997. 28(1): 41-75.
10. R. Caruana, V. R. de Sa. Benefiting from the variables that variable selection discards. Journal of machine learning research, 2003. 3: 1245-1264.
11. G. Z. Li, J. Yang, J. Lu. On multivariate calibration problems. In: Lecture Notes on Computer Science 3173. Springer:, 2004 389-394.
12. T. Jebara. Multi-task feature and kernel selection for SVMs. In: International Conference on Machine Learning. 2004.
13. D. E. Goldberg. Genetic Algorithms in Search, Optimization, and Machine Learning. Boston: Addison Wesley, 1998.
14. J. Yang, V. Honavar. Feature subset selection using a genetic algorithm. IEEE Intelligent Systems, 1998. 13: 44-49.
15. G. Brown, J. L. Wyatt, P. Tino. Managing diversity in regression ensembles. Journal of Machine Learning Research, 2005. 3: 1621-1650.
16. J. Moody, J. Utans. Principled architecture selection for neural networks: Application to corporate bond rating prediction. In: Advances in Neural Information Processing Systems, Moody E, Hanson J, Lippmann R P, eds., vol. 4. Morgan Kaufmann Publishers, Inc., 1992 683-690.