Inductive bias for semi-supervised extreme learning machine

Neurocomputing

Volumn 174, Issue , 2016, Pages 154-167

  Bisio, Federica ^a   Decherchi, Sergio ^b   Gastaldo, Paolo ^a   Zunino, Rodolfo ^a  

^a UNIVERSITY OF GENOA   (Italy)

^b ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

Author keywords

Extreme learning machine; Inductive bias; Semi supervised learning

Indexed keywords

CLUSTERING ALGORITHMS; KNOWLEDGE ACQUISITION; LEARNING ALGORITHMS;

EXTREME LEARNING MACHINE; GENERALIZATION PROPERTIES; INDUCTIVE BIAS; REFERENCE FUNCTIONS; REFERENCE SOLUTION; SEMI- SUPERVISED LEARNING; SEMI-SUPERVISED CLASSIFICATION; SUPERVISED LEARNING PROBLEMS;

SUPERVISED LEARNING;

ALGORITHM; ARTICLE; CLASSIFICATION; DATA PROCESSING; INDUCTIVE BIAS; LEARNING THEORY; MACHINE LEARNING; PRIORITY JOURNAL; PROBLEM SOLVING; RELIABILITY; SEMI SUPERVISED EXTREME MACHINE LEARNING;

EID: 84940062177     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.04.104     Document Type: Article

References (43)

1. T.M. Mitchell, The Need for Biases in Learning Generalizations CBM-TR 5-110, Rutgers University, New Brunswick, NJ, 1980.
2. G.-B. Huang, H. Zhou, X. Ding, R. Zhang, Extreme Learning Machine for Regression and Multiclass Classification, IEEE Trans. Syst. Man, Cybern. B:Cybern. 42 (2) (2012) 513-529.
3. S. Decherchi, P. Gastaldo, R. Zunino, E. Cambria, J. Redi, Circular-ELM for the reduced-reference assessment of perceived image quality, Neurocomputing 102 (2013) 78-89.
4. P. Gastaldo, R. Zunino, E. Cambria, S. Decherchi, Combining ELM with Random Projections, IEEE Intell. Syst. 28 (6) (2013) 46-48.
5. O. Chapelle, B. Schölkopf, A. Zien, Semi-Supervised Learning, MIT Press, 2006.
6. S. Poria, A. Gelbukh, A. Hussain, S. Bandyopadhyay, N. Howard, Music genre Classification: A Semi-Supervised Approach In Pattern Recognition, Springer, Berlin Heidelberg (2013) 254-263.
7. S. Poria, A. Gelbukh, E. Cambria, D. Das, S. Bandyopadhyay, Enriching senticnet polarity scores through semi-supervised fuzzy clustering. In: Proceedings of the 12th International Conference on Data Mining Workshops (ICDMW), IEEE, December 2012, pp. 709-716.
8. B. Schlkopf, R. Herbrich, A.J.Smola, A generalized representer theorem, In:Proceedings of the 14th Annual Conference on Computational Learning Theory and and 5th European Conference on Computational Learning Theory, Springer-Verlag, 2001, pp. 416-426.
9. W.Kienzle, K.Chellapilla, Personalized Handwriting Recognition via Biased Regularization. in: Proceedings of the 23 rd International Conference on Machine Learning, ACM Press, 2006, pp. 457-464.
10. F.Bisio, P.Gastaldo , R.Zunino , S.Decherchi , Semi-supervised machine learning approach for unknown malicious software detection, In: Proceedings of the 2014 IEEE International Symposium on Innovations in Intelligent Systems and Applications (INISTA), IEEE, June 2014, pp. 52-59.
11. S. Decherchi, S. Ridella, R. Zunino, P. Gastaldo, D. Anguita, Using unsupervised analysis to constrain generalization bounds for support vector classifiers, IEEE Trans. Neural Netw. 21 (3) (2010) 424-438.
12. S.Ben-David, T.Lu, D.Pál , Does unlabeled data provably help? worst-case analysis of the sample complexity of semi-supervised learning. In: Proceedings of the the 21st Annual Conference on Learning Theory COLT-08, 2008.
13. A. Ambroladze, E. Parrado-Hernandez, J. Shawe-Taylor, Tighter PAC-bayes bounds, in: B. Scholkopf, J. Platt, T. Hoffman (Eds.), Advances in Neural Information Processing Systems, 19, MIT Press, Cambridge, 2007, pp. 9-16.
14. M. Belkin, P. Niyogi, V. Sindhwani, Manifold regularization: a geometric framework for learning from labeled and unlabeled examples, J. Mach. Learn. Res. 7 (2399) (2006) 2434.
15. P. Bartlett, S. Boucheron, G. Lugosi, Model selection and error estimation, Mach. Learn. 48 (2001) 85-113.
16. D. Anguita, A. Ghio, S. Ridella, Maximal discrepancy for support vector machines, Neurocomputing 74 (9) (2011) 1436-1443.
17. D. Anguita, A. Ghio, L. Oneto, S. Ridella, The impact of unlabeled patterns in rademacher complexity theory for Kernel classifiers, in: J. Shawe-Taylor, R. S. Zemel, P.L. Bartlett, F. Pereira, K.Q Weinberger (Eds.), NIPS 2011, 2011, pp. 585-593.
18. J. Liu, Y. Chen, M. Liu, Z. Zhao, SELM: Semi-supervised ELM with application in sparse calibrated location estimation, Neurocomputing 74 (16) (2011) 2566-2572.
19. K. Li, J. Zhang, H. Xu, S. Luo, H. Li, A semi-supervised extreme learning machine method based on co-training, J. Comput. Inf. Syst. 9 (1) (2013) 207-214.
20. G. Huang, S. Song, J.N.D. Gupta, C. Wu, Semi-supervised and unsupervised extreme learning machines, IEEE Trans. Cybern. 44 (12) (2014) 2405-2417.
21. 〈http://www.csie.ntu.edu.tw/_cjlin/libsvmtools/datasets/multiclass.html〉, dataset.
22. 〈https://archive.ics.uci.edu/ml/datasets/ISOLET〉, dataset.
23. 〈http://www.csie.ntu.edu.tw/_cjlin/libsvmtools/datasets/multiclass.html〉, dataset.
24. 〈http://www.cs.columbia.edu/CAVE/software/softlib/coil-20.php〉, dataset.
25. V.N. Vapnik, Statistical Learning Theory, Wiley-Interscience Pub, 1998.
26. B.McWilliams , D.Balduzzi , J.Buhmann, Correlated random features for fast semi-supervised learning. Advances in Neural Information Processing Systems, 2013, pp. 440-448.
27. A.N. Tikhonov, V.Y. Arsenin, Solution of Ill-posed Problems, Winston & Sons, Washington, 1977.
28. B. Schlkopf, A.J. Smola, Learning With Kernels, MIT Press, 2001.
29. S. Arlot, A. Celisse, A survey of cross-validation procedures for model selection, Stat. Surv. 4 (2010) 40-79.
30. P.L. Bartlett, S. Mendelson, Rademacher and Gaussian complexities: risk bounds and structural results, J. Mach. Learn. Res. 3 (2002) 463-482.
31. Utgoff P.E., Shift of bias for inductive concept learning, Ph.D. Dissertation, 1984.
32. D. Erhan, Y. Bengio, A. Courville, P.A. Manzagol, P. Vincent, S. Bengio, Why does unsupervised pre-training help deep learning? J. Mach. Learn. Res. 11 (2010) 625-660.
33. W.Y. Chen, Y. Song, H. Bai, C.J. Lin, E.Y. Chang, Parallel spectral clustering in distributed systems, IEEE Trans. Pattern Anal. Mach. Intell. 33 (3) (2011) 568-586.
34. R.E. Fan, K.W. Chang, C.J. Hsieh, X.-R. Wang, C.J. Lin, LIBLINEAR: a library for large linear classification, J. Mach. Learn. Res. 9 (2008) 1871-1874.
35. A.Blum , T.,Mitchell : Combining labeled and unlabeled data with co-training. in: Proceedings of the Eleventh Annual Conference On Computational Learning Theory, COLT 98, ACM Press, 1998, pp. 92-100.
36. Z.Guo, Z.Zhang, E.PXing, C.Faloutsos: Semi-supervised learning based on semiparametric regularization, In: Proceedings of the SIAM International Conference on Data Mining, SDM 2008, 2008, pp. 132-142.
37. P.K. Mallapragada, R. Jin, A.K. Jain, Y. Liu, Semiboost: boosting for semisupervised learning, IEEE Trans. Pattern Anal. Mach.Intell. 31 (2009) 2000-2014.
38. K. Chen, S. Wang, Semi-supervised learning via regularized boosting working on multiple semi-supervised assumptions, IEEE Trans. Pattern Anal. Mach. Intell. 33 (1) (2011) 129-143.
39. K. Nigam, A. McCallum, T. Mitchell, Semi-supervised Text Classification Using EM, in: O. Chapelle, A. Zien, B. Scholkopf (Eds.), MIT Press, Boston, 2006.
40. S. Melacci, M. Belkin, Laplacian support vector machines trained in the primal, J. Mach. Learn. Res. 12 (2011) 1149-1184.
41. R. Collobert, F. Sinz, J. Weston, L. Bottou, Large scale transductive SVMs, J. Mach. Learn. Res. 7 (2006) 1687-1712.
42. 〈http://manifold.cs.uchicago.edu/manifold_regularization/data.html〉, Matlab code.
43. M.Ji T.Yang, B.Lin, R.Jin, J.Han: A Simple algorithm for semi-supervised learning with improved generalization error bound. In arXiv preprint:1206.6412, ICML 2012.