Feature combiners with gate-generated weights for classification

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 1, 2013, Pages 158-163

  Omari, Adil ^a   Figueiras Vidal, Aníbal R ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Functional weights; Gate fusion; Maximal margin; Neural networks

Indexed keywords

COMPUTATIONAL DESIGN; FUNCTIONAL WEIGHTS; LINEAR COMBINATIONS; MAXIMAL MARGIN; MAXIMAL MARGIN ALGORITHMS; NON-LINEAR TRANSFORMATIONS; RADIAL BASIS FUNCTIONS; SUPPORT VECTOR MACHINE (SVMS);

ADAPTIVE BOOSTING; LINEAR TRANSFORMATIONS; MATHEMATICAL TRANSFORMATIONS; NEURAL NETWORKS; RADIAL BASIS FUNCTION NETWORKS;

SUPPORT VECTOR MACHINES;

EID: 84884949945     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2223232     Document Type: Article

References (32)

1. B. Schölkopf, K. Sung, C. Burges, F. Girosi, P. Niyogi, T. Poggio, and V. Vapnik, "Comparing support vector machines with Gaussian kernels to radial basis function classifiers," IEEE Trans. Signal Process., vol. 45, no. 11, pp. 2758-2765, Nov. 1997. (Pubitemid 127766345)
2. K. R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-202, Mar. 2001.
3. S. Haykin, Neural Networks: A Comprehensive Foundation, 1st ed. New York: Macmillan, 1994.
4. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Netw., vol. 2, no. 2, pp. 302-209, Mar. 1991.
5. A. S. Weigend, M. Mangeas, and A. N. Srivastava, "Nonlinear gated experts for time series discovering regimes and avoiding overfitting," Int. J. Neural Syst., vol. 6, no. 4, pp. 373-399, 1995.
6. C. M. Bishop, Pattern Recognition and Machine Learning. London, U.K.: Springer-Verlag, 2006.
7. R. A. Jacobs and M. I. Jordan, "A competitive modular connectionist architecture," in Advances in Neural Information Processing Systems 3, R. P. Lippmann, J. E. Moody, and D. J. Touretzky, Eds. San Mateo, CA: Morgan Kaufmann, 1991, pp. 767-773.
8. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, "Adaptive mixtures of local experts," Neural Comput., vol. 3, no. 1, pp. 79-87, 1991.
9. M. I. Jordan and R. A. Jacobs, "Hierarchies of adaptive experts," in Advances in Neural Information Processing Systems 4, J. E. Moody, S. J. Hanson, and R. P. Lippmann, Eds. San Mateo, CA: Morgan Kaufmann, 1992, pp. 985-992.
10. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," MIT Comput. Cognit. Sci. Group, MIT, Cambridge, Tech. Rep. 9203, 1992.
11. M. I. Jordan and L. Xu, "Convergence properties of the EM approach to learning in mixture-of-experts architectures," MIT Comput. Cognit. Sci. Group, MIT, Cambridge, Tech. Rep. 9301, 1993.
12. M. I. Jordan and R. A. Jacobs, "Hierarchical mixtures of experts and the EM algorithm," Neural Comput., vol. 6, no. 2, pp. 181-214, 1994.
13. R. A. Jacobs, F. Peng, and M. Tanner, "Bayesian approach to model selection in hierarchical mixture-of-experts architectures," Neural Netw., vol. 10, no. 2, pp. 231-241, 1997. (Pubitemid 27165626)
14. V. Ramamurty and J. Ghosh, "Structurally adaptive modular networks for nonstationary environments," IEEE Trans. Neural Netw., vol. 10, no. 1, pp. 152-160, Jan. 1999.
15. S. E. Yuksel, J. N. Wilson, and P. D. Gader, "Twenty years of mixture of experts," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 8, pp. 1177-1193, Aug. 2012.
16. Y. Freund and R. E. Schapire, "Game theory, online prediction and boosting," in Proc. 9th Annu. Conf. Comput. Learn. Theory, Desenzano di Garda, Italy, 1996, pp. 325-332.
17. R. E. Schapire and Y. Singer, "Improved boosting algorithms using confidence-rated predictions," Mach. Learn., vol. 37, no. 3, pp. 297-336, 1999. (Pubitemid 32210620)
18. J. T. Kwok, "Moderating the outputs of support vector machine classifiers," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1018-1031, Sep. 1999.
19. B. D. Ripley, "Neural networks and related methods for classification (with discussion)," J. Royal Stat. Soc. Ser. B, vol. 56, no. 3, pp. 409-456, 1994.
20. UCI Repository of Machine Learning Databases. (2010) [Online]. Available: http://archive.ics.uci.edu/ml/
21. B. D. Ripley. (2009). Pattern Recognition and Neural Networks [Online]. Available: http://www.stats.ox.ac.uk/pub/PRNN
22. Basic Research Project ELENA. (2008) [Online]. Available FTP: ftp.dice.ucl.ac.be/pub/neural-nets/ELENA/databases
23. A. Lyhyaoui, M. Martínez-Ramón, I. Mora-Jiménez, M. Vázquez-Castro, J. L. Sancho-Gómez, and A. R. Figueiras-Vidal, "Sample selection via clustering to construct support vector-like classifiers," IEEE Trans. Neural Netw., vol. 10, no. 6, pp. 1474-1481, Nov. 1999. (Pubitemid 30536579)
24. M. B. Almeida, A. Braga, and J. P. Braga, "SVM-KM: Speeding SVMs learning with a priori cluster selection and k-means," in Proc. 6th Brazilian Symp. Neural Netw., Rio de Janeiro, Brazil, 2000, pp. 162-167.
25. H. J. Shin and S. Cho, "Neighborhood property-based pattern selection for support vector machines," Neural Comput., vol. 19, no. 3, pp. 816-855, 2007.
26. Y.-S. Hwang and S.-Y. Bang, "An efficient method to construct a radial basis function neural network classifier and its application to unconstrained handwritten digit recognition," in Proc. Int. Conf. Pattern Recognit., Vienna, Austria, 1996, pp. 640-644.
27. D. Geebelen, J. A. K. Suykens, and J. Vandewalle, "Reducing the number of support vectors of SVM classifiers using the smoothed separable case approximation," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 4, pp. 682-688, Apr. 2012.
28. W. Yao, X. Chen, Y. Zhao, and M. Van Tooren, "Concurrent subspace width optimization method for RBF neural network modeling," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 247-259, Feb. 2012.
29. V. Gómez-Verdejo, J. Arenas-García, and A. R. Figueiras-Vidal, "Boosting by weighting critical and erroneous samples," Neurocomputing, vol. 69, nos. 7-9, pp. 679-885, 2006.
30. V. Gómez-Verdejo, J. Arenas-García, and A. R. Figueiras-Vidal, "A dynamically adjusted mixed emphasis method for building boosting ensembles," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 3-17, Jan. 2008. (Pubitemid 351279222)
31. F. Ahmed, H. R. Ansari, and G. P. Raghava, "Prediction of guide strand of microRNAs from its sequence and secondary structure," BMC Bioinf., vol. 10, pp. 10-105, Apr. 2009.
32. J. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advances on Kernel Methods - Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 185-208.