PR-ELM: Parallel regularized extreme learning machine based on cluster

Neurocomputing

Volumn 173, Issue , 2016, Pages 1073-1081

  Wang, Yueqing ^a   Dou, Yong ^a   Liu, Xinwang ^a   Lei, Yuanwu ^b  

^a NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^b NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

Author keywords

Cluster; Data; Extreme learning machine; Model; Parallel

Indexed keywords

ALGORITHMS; COMPUTATIONAL EFFICIENCY; EFFICIENCY; KNOWLEDGE ACQUISITION; LEARNING SYSTEMS; MESSAGE PASSING; MODELS;

CLUSTER; DATA; EXTREME LEARNING MACHINE; INCREMENTAL LEARNING; LARGE-SCALE LEARNING; MESSAGE PASSING INTERFACE; PARALLEL; TIMING PERFORMANCE;

CLUSTERING ALGORITHMS;

ARTICLE; CLUSTER ANALYSIS; COMPUTER MEMORY; DATA PARALLEL REGULARIZED EXTREME LEARNING MACHINE; DATA PROCESSING; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL COMPUTING; MODEL PARALLEL REGULARIZED EXTREME LEARNING MACHINE; PARALLEL EXTREME LEARNING MACHINE; PRIORITY JOURNAL;

EID: 84959367775     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.08.066     Document Type: Article

References (25)

1. Huang G.-B., Zhu Q.-Y., Siew C.-K. Extreme learning machine. theory and applications. Neurocomputing 2006, 70(1):489-501.
2. Huang G.-B., Zhou H., Ding X., Zhang R. Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B: Cybern. 2012, 42(2):513-529.
3. Huang G.-B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70(16):3056-3062.
4. Mohammed A.A., Minhas R., Wu Q.J., Sid-Ahmed M.A. Human face recognition based on multidimensional pca and extreme learning machine. Pattern Recognit. 2011, 44(10):2588-2597.
5. Minhas R., Mohammed A.A., Wu Q.J. A fast recognition framework based on extreme learning machine using hybrid object information. Neurocomputing 2010, 73(10):1831-1839.
6. Chang N.-B. Satellite-based multitemporal-change detection in urban environments 2011, SPIE, Newsroom. 10.1117/2.1201101.003502.
7. Lin J., Yin J., Cai Z., Liu Q., Li K., Leung V. A secure and practical mechanism of outsourcing extreme learning machine in cloud computing. IEEE Intell. Syst. 2013, 28(6):35-38.
8. He Q., Shang T., Zhuang F., Shi Z. Parallel extreme learning machine for regression based on mapreduce. Neurocomputing 2013, 102:52-58.
9. Wang B., Huang S., Qiu J., Liu Y., Wang G. Parallel online sequential extreme learning machine based on mapreduce. Neurocomputing 2015, 149:224-232.
10. Gropp W. Mpich2: a new start for mpi implementations. Recent Advances in Parallel Virtual Machine and Message Passing Interface 2002, 7. Springer, New York.
11. Liu X., Wang L., Huang G.-B., Zhang J., Yin J. Multiple kernel extreme learning machine. Neurocomputing 2015, 149:253-264.
12. Li Y., Zhu E., Zhu X., Yin J., Zhao J. Counting pedestrian with mixed features and extreme learning machine. Cogn. Comput. 2014, 6(3):462-476.
13. Huang G.-B., Chen L., Siew C.-K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Netw. 2006, 17(4):879-892.
14. M.A. Woodbury, Inverting modified matrices, Memorandum report 42, 1950, p. 106.
15. Liang N.-Y., Huang G.-B., Saratchandran P., Sundararajan N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Netw. 2006, 17(6):1411-1423.
16. Kasun L.L.C., Zhou H., Huang G.-B., Vong C.M. Representational learning with elms for big data. IEEE Intell. Syst. 2013, 28(6):31-34.
17. J. Tang, C. Deng, G.-B. Huang, Extreme learning machine for multilayer perceptron. IEEE Trans Neural Netw Learn Syst. 2015, . http://dx.doi.org/10.1109/TNNLS.2015.2424995.
18. Huang G.-B., Bai Z., Kasun L.L.C., Vong C.M. Local receptive fields based extreme learning machine. IEEE Comput. Intell. Mag. 2015, 10(2):18-29.
19. Dean J., Ghemawat S. Mapreduce. simplified data processing on large clusters. Commun. ACM 2008, 51(1):107-113.
20. van Heeswijk M., Miche Y., Oja E., Lendasse A. Gpu-accelerated and parallelized elm ensembles for large-scale regression. Neurocomputing 2011, 74(16):2430-2437.
21. Basu A., Shuo S., Zhou H., Lim M.H., Huang G.-B. Silicon spiking neurons for hardware implementation of extreme learning machines. Neurocomputing 2013, 102:125-134.
22. Decherchi S., Gastaldo P., Leoncini A., Zunino R. Efficient digital implementation of extreme learning machines for classification. IEEE Trans. Circuits Syst. II: Express Briefs 2012, 59(8):496-500.
23. C. Sanderson, Armadillo: an open source c++ linear algebra library for fast prototyping and computationally intensive experiments, Technical report, NICTA. URL . http://arma.sf.net.
24. E. Anderson, Z. Bai, J. Dongarra, A. Greenbaum, A. McKenney, J. Du Croz, S. Hammerling, J. Demmel, C. Bischof, D. Sorensen, Lapack: a portable linear algebra library for high-performance computers, in: Proceedings of the 1990 ACM/IEEE Conference on Supercomputing, IEEE Computer Society Press, Washington D.C., USA, 1990, pp. 2-11.
25. Z. Xianyi, W. Qian, Z. Chothia, Openblas, URL: 〈〉. http://xianyi.github.io/OpenBLAS.