Efficient digital implementation of extreme learning machines for classification

IEEE Transactions on Circuits and Systems II: Express Briefs

Volumn 59, Issue 8, 2012, Pages 496-500

  Decherchi, Sergio ^a   Gastaldo, Paolo ^b   Leoncini, Alessio ^b   Zunino, Rodolfo ^b  

^a ISTITUTO ITALIANO DI TECNOLOGIA   (Italy)

^b UNIVERSITY OF GENOA   (Italy)

Author keywords

Complex programmable logic device (CPLD); extreme learning machine (ELM); field programmable gate array (FPGA); hardware (HW) neural networks (NNs)

Indexed keywords

COMPLEX NETWORKS; COMPUTER CIRCUITS; E-LEARNING; KNOWLEDGE ACQUISITION; LOGIC GATES; MACHINE LEARNING; PROGRAMMABLE LOGIC CONTROLLERS;

COMPLEX PROGRAMMABLE LOGIC DEVICE; DIGITAL ARCHITECTURE; DIGITAL IMPLEMENTATION; EXTREME LEARNING MACHINE; IMPLEMENTATION APPROACH; NEURAL NETWORKS (NNS); PREDICTION ACCURACY; TRAINING PROCEDURES;

FIELD PROGRAMMABLE GATE ARRAYS (FPGA);

EID: 84865355028     PISSN: 15497747     EISSN: 15583791     Source Type: Journal    
DOI: 10.1109/TCSII.2012.2204112     Document Type: Article

References (18)

1. J. Mishra and I. Saha, "Artificial neural networks in hardware: A survey of two decades of progress," Neurocomputing, vol. 74, no. 1-3, pp. 239-255, Dec. 2010.
2. R. Dlugosz, T. Talaska, and W. Pedrycz, "Current-mode analog adaptive mechanism for ultra-low-power neural networks," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 58, no. 1, pp. 31-35, Jan. 2011.
3. J. Chen and T. Shibata, "A neuron-MOS-based VLSI implementation of pulse-coupled neural networks for image feature generation," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 57, no. 6, pp. 1143-1153, Jun. 2010.
4. P. Arena, L. Fortuna, M. Frasca, and L. Patané, "A CNN-based chip for robot locomotion control," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 52, no. 9, pp. 1862-1871, Sep. 2005. (Pubitemid 41488817)
5. G.-B. Huang, D. Wang, and Y. Lan, "Extreme learning machines: A survey," Int. J. Mach. Learn. Cybern., vol. 2, no. 2, pp. 107-122, 2011.
6. A. Basu, S. Shuo, H. Zhou, M. H. Lim, and G.-B. Huang, "Silicon spiking neurons for hardware implementation of extreme learning machines," Neurocomputing, to be published.
7. G.-B. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
8. V. N. Vapnik, Statistical Learning Theory. Hoboken, NJ: Wiley-Interscience, 1998.
9. L. Rosasco, E. De Vito, A. Caponnetto, M. Piana, and A. Verri, "Are loss functions all the same?" Neural Comput., vol. 16, no. 5, pp. 1063-1076, May 2004. (Pubitemid 38483051)
10. G.-X. Yuan, C.-H. Ho, and C.-J. Lin, "Recent advances of largescale linear classification," Proc. IEEE, 2012. DOI: 10.1109/JPROC. 2012.2188013, to be published.
11. S. G. Nash and A. Sofer, Linear and Non Linear Programming. New York: McGraw-Hill, 1995.
12. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Roy. Statist. Soc. B, vol. 58, no. 1, pp. 267-288, 1996.
13. M. D. Ercegovac and T. Lang, Digital Arithmetic. San Mateo, CA: Morgan Kaufmann, 2004.
14. M. T. Tommiska, "Efficient digital implementation of the sigmoid function for reprogrammable logic," Proc. Inst. Elect. Eng. Comput. Digit. Techn., vol. 150, no. 6, pp. 403-411, Nov. 2003.
15. A. Frank and A. Asuncion, UCI Repository of Machine Learning Databases, Irvine, CA, 2010. [Online]. Available: http://archive.ics.uci. edu/ml
16. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
17. [Online]. Available: http://www.xilinx.com/support/documentation/data- sheets/ds150.pdf
18. [Online]. Available: http://www.altera.com/literature/lit-max-v.jsp? ln=devices-cpld&l3=CPLDs-MAX%20V&l4=Documentation