Distributed learning for Random Vector Functional-Link networks

Information Sciences

Volumn 301, Issue , 2015, Pages 271-284

  Scardapane, Simone ^a   Wang, Dianhui ^b   Panella, Massimo ^a   Uncini, Aurelio ^a  

^a Military Hospital   (Italy)

^b LA TROBE UNIVERSITY   (Australia)

Author keywords

Consensus; Distributed; Distributed learning; Functional Link; Optimization; Random; Vector

Indexed keywords

COMPUTATIONAL EFFICIENCY; LEARNING SYSTEMS; OPTIMIZATION; VECTORS;

CONSENSUS; DISTRIBUTED; DISTRIBUTED LEARNING; FUNCTIONAL LINKS; RANDOM;

LEARNING ALGORITHMS;

EID: 84922746025     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2015.01.007     Document Type: Article

References (43)

1. M. Alhamdoosh, and D. Wang Fast decorrelated neural network ensembles with random weights Inf. Sci. 264 2014 104 117
2. L. Atzori, A. Iera, and G. Morabito The internet of things: a survey Comput. Networks 54 15 2010 2787 2805
3. B. Awerbuch Optimal distributed algorithms for minimum weight spanning tree, counting, leader election, and related problems Proceedings of the Nineteenth Annual ACM Symposium on Theory of Computing 1987 ACM 230 240
4. G. Bakir Predicting Structured Data 2007 MIT press
5. S. Barbarossa, S. Sardellitti, and P. Di Lorenzo Distributed detection and estimation in wireless sensor networks R. Chellapa, S. Theodoridis, E-Reference Signal Processing 2013 Elsevier 329 408
6. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein Distributed optimization and statistical learning via the alternating direction method of multipliers Found. Trends® Mach. Learn. 3 1 2011 1 122
7. L. Breiman Bagging predictors Mach. Learn. 24 2 1996 123 140
8. C.-T. Chu, S.K. Kim, Y.A. Lin, and Y.Y. Yu Map-reduce for machine learning on multicore Adv. Neural Inf. Process. Syst. 2007 281 288
9. A. Coates, A.Y. Ng, H. Lee, An analysis of single-layer networks in unsupervised feature learning, in: 14th International Conference on Artificial Intelligence and Statistics, 2011, pp. 215-223.
10. D. Comminiello, M. Scarpiniti, L.A. Azpicueta-Ruiz, J. Arenas-Garcia, and A. Uncini Functional link adaptive filters for nonlinear acoustic echo cancellation IEEE Trans. Audio Speech Lang. Process. 21 7 2013 1502 1512
11. J. Dean, and S. Ghemawat Mapreduce: simplified data processing on large clusters Commun. ACM 51 1 2008 107 113
12. J. Dean, G. Corrado, R. Monga, K. Chen, M. Devin, M. Mao, M. Ranzato, A. Senior, P. Tucker, K. Yang, Q.V.L. Le, and A.Y. Ng Large scale distributed deep networks Adv. Neural Inf. Process. Syst. 2012 1223 1231
13. O. Dekel, R. Gilad-Bachrach, O. Shamir, and L. Xiao Optimal distributed online prediction using mini-batches J. Mach. Learn. Res. 13 2012 165 202
14. P.A. Forero, A. Cano, and G.B. Giannakis Consensus-based distributed support vector machines J. Mach. Learn. Res. 11 2010 1663 1707
15. J. Friedman, T. Hastie, and R. Tibshirani The Elements of Statistical Learning second ed. 2009 Springer
16. L. Georgopoulos, and M. Hasler Distributed machine learning in networks by consensus Neurocomputing 124 2014 2 12
17. B. Igelnik, and Y.-H. Pao Stochastic choice of basis functions in adaptive function approximation and the functional-link net IEEE Trans. Neural Networks 6 6 1995 1320 1329
18. D. Jakovetic, J. Xavier, and J.M.F. Moura Fast distributed gradient methods IEEE Trans. Autom. Control 59 5 2014 1131 1146
19. A. Krizhevsky, G. Hinton, Learning multiple layers of features from tiny images, Computer Science Department, University of Toronto, Tech. Rep., 2009.
20. A. Lazarevic, and Z. Obradovic The distributed boosting algorithm Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2001 ACM 311 316
21. P. Lorenzo, and A.H. Sayed Sparse distributed learning based on diffusion adaptation IEEE Trans. Signal Process. 61 6 2013 1419 1433
22. C. Lynch Big data: how do your data grow? Nature 455 7209 2008 28 29
23. G. Mateos, J.A. Bazerque, and G.B. Giannakis Distributed sparse linear regression IEEE Trans. Signal Process. 58 10 2010 5262 5276
24. S. Melacci, and M. Belkin Laplacian support vector machines trained in the primal J. Mach. Learn. Res. 12 2011 1149 1184
25. I. Mierswa, and K. Morik Automatic feature extraction for classifying audio data Mach. Learn. 58 2-3 2005 127 149
26. A. Navia-Vázquez, D. Gutierrez-Gonzalez, E. Parrado-Hernández, and J.J. Navarro-Abellan Distributed support vector machines IEEE Trans. Neural Networks 17 4 2006 1091 1097
27. M. Newman Networks: An Introduction 2010 Oxford University Press
28. R. Olfati-Saber, J.A. Fax, and R.M. Murray Consensus and cooperation in networked multi-agent systems Proc. IEEE 95 1 2007 215 233
29. Y.-Y. Ou, H.-G. Hung, and Y.-J. Oyang A study of supervised learning with multivariate analysis on unbalanced datasets 2006 International Joint Conference on Neural Networks 2006 IEEE 2201 2205
30. Y.-H. Pao, and Y. Takefuji Functional-link net computing: theory, system architecture, and functionalities Computer 25 5 1992 76 79
31. J.B. Predd, S.R. Kulkarni, and H.V. Poor Consistency in models for distributed learning under communication constraints IEEE Trans. Inf. Theory 52 1 2006 52 63
32. J.B. Predd, S.R. Kulkarni, and H.V. Poor Distributed learning in wireless sensor networks IEEE Signal Process. Mag. 2007 56 69
33. D. Saha, and A. Mukherjee Pervasive computing: a paradigm for the 21st century Computer 36 3 2003 25 31
34. A.H. Sayed Adaptive networks Proc. IEEE 102 4 2014 460 497
35. S. Scardapane, D. Comminiello, M. Scarpiniti, and A. Uncini Music classification using extreme learning machines 2013 8th International Symposium on Image and Signal Processing and Analysis (ISPA) 2013 IEEE 377 381
36. S. Scardapane, G. Nocco, D. Comminiello, M. Scarpiniti, and A. Uncini An effective criterion for pruning reservoir's connections in echo state networks 2014 International Joint Conference on Neural Networks 2014 IEEE 1205 1212
37. W.F. Schmidt, M.A. Kraaijveld, and R.P.W. Duin Feedforward neural networks with random weights 11th IAPR International Conference on Pattern Recognition, 1992 1992 IEEE 1 4
38. K. Slavakis, G. Giannakis, and G. Mateos Modeling and optimization for big data analytics: (statistical) learning tools for our era of data deluge IEEE Signal Process. Mag. 31 5 2014 18 31
39. J.J. Thompson, M.R. Blair, L. Chen, and A.J. Henrey Video game telemetry as a critical tool in the study of complex skill learning PLoS One 8 9 2013 e75129
40. V.S. Verykios, E. Bertino, I.N. Fovino, L.P. Provenza, Y. Saygin, and Y. Theodoridis State-of-the-art in privacy preserving data mining ACM Sigmod Rec. 33 1 2004 50 57
41. L. Xiao, S. Boyd, and S. Lall A scheme for robust distributed sensor fusion based on average consensus Fourth International Symposium on Information Processing in Sensor Networks 2005 IEEE 63 70
42. H. Zhang, and Z. Chen Consensus acceleration in a class of predictive networks IEEE Trans. Neural Networks Learn. Syst. 25 10 2014 1921 1927
43. Y. Zhang, S. Li, T. Wang, and Z. Zhang Divergence-based feature selection for separate classes Neurocomputing 101 2013 32 42