Constrained Extreme Learning Machine: A novel highly discriminative random feedforward neural network

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2014, Pages 800-807

  Zhu, Wentao ^a   Miao, Jun ^a   Qing, Laiyun ^b  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b UNIVERSITY OF CHINESE ACADEMY OF SCIENCES   (China)

Author keywords

[No Author keywords available]

Indexed keywords

KNOWLEDGE ACQUISITION; MACHINE LEARNING; MULTILAYER NEURAL NETWORKS; NETWORK LAYERS;

ARBITRARY VECTORS; CONNECTION WEIGHTS; DIFFERENCE VECTORS; EXTREME LEARNING MACHINE; HIDDEN NEURONS; HIGH-EFFICIENCY; LEARNING MACHINES; SINGLE-HIDDEN LAYER FEEDFORWARD NEURAL NETWORKS;

FEEDFORWARD NEURAL NETWORKS;

EID: 84908473653     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2014.6889761     Document Type: Conference Paper

References (24)

1. M. Leshno, V. Ya. Lin, A. Pinkus and S. Schocken, "Multilayer feedforward networks with a nonpolynomial activation function can approximate any function", Neural Networks, vol. 6(6), pp. 861-867, 1993.
2. S. Tamura and M. Tateishi, "Capabilities of a four-layered feedforward neural network: four layers versus three", IEEE Trans. Neural Networks, vol. 8(2), pp. 251-255, 1997.
3. G.-B. Huang and H. A. Babri, "Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions", IEEE Trans. Neural Networks, vol. 9(1), pp. 224-229, 1998.
4. G.-B. Huang, Q.-Y. Zhu and C.-K. Siew, "Extreme learning machine: Theory and applications", Neurocomputing, vol. 70(1-3), pp. 489-501, Dec. 2006, [Code: http://www.ntu.edu.sg/home/egbhuang/elm-random-hidden-nodes.html].
5. G.-B. Huang, Q.-Y. Zhu and C.-K. Siew, "Extreme learning machine: A new learning scheme of feedforward neural networks", in Proceedings of International Joint Conference on Neural Networks (IJCNN2004), vol. 2, (Budapest, Hungary), pp. 985-990, 25-29 Jul., 2004.
6. P. L. Bartlett, "The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network", IEEE Trans. Inf. Theory, vol. 44(2), pp. 525-536, 1998.
7. Q.-Y. Zhu, A. K. Qin, P. N. Suganthan and G.-B. Huang, "Evolutionary extreme learning machine", Pattern Recognition, vol. 38(10), pp. 1759-1763, Oct. 2005.
8. L. Yuan, Y. C. Soh, and G.-B. Huang, "A constructive enhancement for online sequential extreme learning machine", in Proceedings of International Joint Conference on Neural Networks (IJCNN2009), pp. 1708-1713, 14-19 Jun., 2009.
9. Y. Miche, A. Sorjamaa, P. Bas, O. Simula, C. Jutten and A. Lendasse, A., "OP-ELM: optimally pruned extreme learning machine", Neural Networks, IEEE Transactions on, vol. 21(1), pp. 158-162, 2010.
10. H. J. Rong, Y. S. Ong, A. H. Tan and Z. Zhu, "A fast pruned-extreme learning machine for classification problem", Neurocomputing, vol. 72(1), pp. 359-366, 2008.
11. D. Yu and L. Deng, "Efficient and effective algorithms for training single-hidden-layer neural networks", Pattern Recognition Letters, vol. 33(5), pp. 554-558, 1 Apr. 2012.
12. K. P. Murphy, "Machine learning: a probabilistic perspective", The MIT Press, 2012.
13. Y. Su, S. Shan, X. Chen and W. Gao, "Classifiability-based discriminatory projection pursuit", IEEE Trans. Neural Networks, vol. 22(12), pp. 2050-2061, 2011.
14. O. Vinyals, Y. Jia, L. Deng and T. Darrell, "Learning with recursive perceptual representations", In Advances in Neural Information Processing Systems, pp. 2834-2842, 2012.
15. L. Deng and D. Yu, "Deep convex net: A scalable architecture for speech pattern classification", In Proceedings of the Interspeech 2011.
16. A. Krizhevsky and G. Hinton, "Learning multiple layers of features from tiny images", Master's thesis, Department of Computer Science, University of Toronto, 2009, [http://www.cs.toronto.edu/~kriz/cifar.html]
17. G.-B. Huang, X. Ding and H. Zhou, "Optimization method based extreme learning machine for classification", Neurocomputing, vol. 74(1), pp. 155-163, 2010.
18. C. L. Blake and C. J. Merz, "UCI Repository of machine learning databases", 1998, [http://www.ics.uci.edu/~mlearn/MLRepository.html]. Irvine, CA: University of California. Department of Information and Computer Science, 460.
19. Y. LeCun, L. Bottou, Y. Bengio and P. Haffner, "Gradient-based learning applied to document recognition", Proceedings of the IEEE, vol. 86(11), pp. 2278-2324, 1998, [Online]. Available: http://yann. lecun.com/exdb/mnist.
20. A. Coates and A. Ng, "The importance of encoding versus training with sparse coding and vector quantization", In Proceedings of the 28th International Conference on Machine Learning (ICML-11) (pp. 921-928), 2011.
21. W. Zhu, J. Miao and L. Qing, "Extreme support vector regression", in Proceedings of International Conference on Extreme Learning Machines (ELM2013), Beijing, China, Springer-Verlag, 15-17 Oct. 2013.
22. C. M. Bishop and N. M. Nasrabadi, N. M., "Pattern recognition and machine learning", New York: springer, 2006.
23. T. Blumensath and M. E. Davies, "On the difference between orthogonal matching pursuit and orthogonal least squares", unpublished manuscript, 2007, [http://www.see.ed.ac.uk/~tblumens/papers/BD OMPvsOLS07.pdf].
24. G. E. Hinton, S. Osindero and Y. W. Teh, "A fast learning algorithm for deep belief nets", Neural computation, vol. 18(7), pp. 1527-1554, 2006.