Compact extreme learning machines for biological systems

International Journal of Computational Biology and Drug Design

Volumn 3, Issue 2, 2010, Pages 112-132

  Li, Kang ^a   Deng, Jing ^a   He, Hai Bo ^b   Du, Da Jun ^c  

^a QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

^b University of Rhode Island   (United States)

^c SHANGHAI UNIVERSITY   (China)

Author keywords

ELM; Extreme learning machine; Fast recursive algorithm; Linear in the parameter; Local regularisation; MAPK; Radial basis function; SOS response

Indexed keywords

ALGORITHM; ARTICLE; BIOLOGY; MACHINE; MACHINE LEARNING; MATHEMATICAL ANALYSIS;

EID: 77956962039     PISSN: 17560756     EISSN: 17560764     Source Type: Journal    
DOI: 10.1504/IJCBDD.2010.035238     Document Type: Article

References (50)

1. Alberts, B., Johnson, A., Lewis, J., Raff, M., Roberts, K. and Walter, P. (2002) Molecular Biology of the Cell, 4th ed., Garland Science.
2. Bishop, C.M. (1995) Neural Networks for Pattern Recognition, Clarendon Press, Oxford.
3. Chen, S., Cowan, C.F.N. and Grant, P.M. (1991) 'Orthogonal least squares learning algorithm for radial basis functions', IEEE Transactions on Neural Networks, Vol.2, pp.302-309.
4. Chng, E.S., Chen, S. and Mulgrew, B. (1996) 'Gradient radial basis function networks for nonlinear and nonstationary time series prediction', IEEE Transactions on Neural Networks, Vol.7, No.1, pp.190-194.
5. Cho, D., Cho, K. and Zhang, B. (2006) 'Identification of biochemical networks by s-tree based genetic programming', Bioinformatics, Vol.22, No.1313, p.1631.
6. Gormley, P., Li, K. and Irwin, G. (2007) 'Modelling molecular interaction pathways using a two-stage identification algorithm', Systems and Synthetic Biology, Vol.1, No.3, August, pp.145-160.
7. Hagan, M.T. and Menhaj, M.B. (1994) 'Training feedforward networks with the Marquardt algorithm', IEEE Transactions on Neural Networks, Vol.5, No.6, pp.989-993.
8. Handoko, S.D., Keong, K.C., Soon, O.Y., Zhang, G.L. and Brusic, V. (2006) 'Extreme learning machine for predicting HLA-peptide binding', Lecture Notes in Computer Science, Vol.3973, pp.716-721.
9. Huang, G-B. and Chen, L. (2007) Convex Incremental Extreme Learning Machine, Neurocomputing, (in press, available online).
10. Huang, G.B. and Chen, L. (2008) 'Enhanced random search based incremental extreme learning machine', Neurocomputing, Vol.71, pp.3460-3468.
11. Huang, G-B., Chen, L. and Siew, C-K. (2006a) 'Universal approximation using incremental constructive feedforward networks with random hidden nodes', IEEE Transactions on Neural Networks, Vol.17, No.4, pp.879-892.
12. Huang, G-B., Saratchandran, P. and Sundararajan, N. (2005) 'A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation', IEEE Transactions on Neural Networks, Vol.16, No.1, pp.57-67.
13. Huang, G-B., Zhu, Q-Y., Mao, K.Z., Siew, C-K., Saratchandran, P. and Sundararajan, N. (2006b) 'Can threshold networks be trained directly?', IEEE Transactions on Circuits and Systems II, Vol.53, No.3, pp.187-191.
14. Huang, G-B., Zhu, Q-Y. and Siew, C-K. (2006c) 'Extreme learning machine: Theory and applications', Neurocomputing, Vol.70, pp.489-501.
15. Kadirkamanathan, V. and Niranjan, M. (1993) 'A function estimation approach to sequential learning with neural networks', Neural Computation, Vol.5, pp.954-975.
16. Kholodenko, B.N. (2000) 'Negative feedback and ultrasensitivity can bring about oscillations in the mitogen-activated protein kinase cascades', European Journal of Biochemistry, Vol.267, February, pp.1583-1588.
17. Kitano, H. (2002) 'Systems biology: A brief overview', Science, Vol.295, March, pp.1662-1664.
18. Korenberg, M.J. (1988) 'Identifying nonlinear difference equation and functional expansion representations: The fast orthogonal algorithm', Annals of Biomedical Engineering, Vol.16, pp.123-142.
19. Lawson, L. and Hanson, R.J. (1974) Solving Least Squares Problem, Prentice-Hall, Englewood Cliffs, NJ.
20. Levchenko, A., Bruck, J. and Sternberg, P.W. (2000) 'Scaffold proteins may biphasically affect the levels of mitogen-activated protein kinase signaling and reduce its threshold properties', Proceedings of the National Academy of Science, Vol.97, No.11, May, pp.5818-5823.
21. Li, K., Huang, G. and Ge, S. (2011) 'A fast construction algorithm for feedforward neural networks', in Rozenberg, G., Back, T. and Kok, J.N. (Eds.): Handbook for Natural Computing, Springer-Verlag, Chapter 16.
22. Li, K., Peng, J. and Bai, E. (2009) 'Two-stage mixed discrete-continuous identification of radial basis function (RBF) neural models for nonlinear systems', IEEE Transactions on Circuits and Systems I: Regular Papers, Vol.56, No.3, March, pp.630-643.
23. Li, K., Peng, J. and Irwin, G.W. (2005a) 'A fast nonlinear model identification method', IEEE Transactions on Automatic Control, Vol.50, No.8, pp.1211-1216.
24. Li, M-B., Huang, G-B., Saratchandran, P. and Sundararajan, N. (2005b) 'Fully complex extreme learning machine', Neurocomputing, Vol.68, pp.306-314. (Pubitemid 41235768)
25. Liang, N-Y., Huang, G-B., Saratchandran, P. and Sundararajan, N. (2006a) 'A fast and accurate online sequential learning algorithm for feedforward networks', IEEE Transactions on Neural Networks, Vol.17, No.6, pp.1411-1423.
26. Liang, N-Y., Saratchandran, P., Huang, G-B. and Sundararajan, N. (2006b) 'Classification of mental tasks from EEG signals using extreme learning machine', International Journal of Neural Systems, Vol.16, No.1, pp.29-38.
27. Liu, Y., Loh, H.T. and Tor, S.B. (2005) 'Comparison of extreme learning machine with support vector machine for text classification', Lecture Notes in Computer Science, Vol.3533, pp.390-399.
28. Mao, K.Z. and Huang, G-B. (2005) 'Neuron selection for RBF neural network classifier based on data structure preserving criterion', IEEE Transactions on Neural Networks, Vol.16, No.6, pp.1531-1540.
29. Marquardt, D. (1963) 'An algorithm for least-squares estimation of nonlinear parameters', SIAM J. Appl. Math., Vol.11, pp.431-441.
30. Mendes, E.M.A.M. and Billings, S.A. (2001) 'An alternative solution to the model structure selection problem', IEEE Trans. Syst. Man Cybern-Part A., Vol.6, No.31, November, pp.597-608.
31. Miller, A.J. (1990) Subset Selection in Regression, Chapman & Hall, Victoria, Australia.
32. Musavi, M., Ahmed, W., Chan, K., Faris, K. and Hummels, D. (1992) 'On training of radial basis function classifiers', Neural Networks, Vol.5, pp.595-603.
33. Peng, J., Li, K. and Huang, D.S. 11 (2006) 'A hybrid forward algorithm for RBF neural network construction', IEEE Transactions on Neural Networks, Vol.17, No.6, pp.1439-1451.
34. Peng, J., Li, K. and Irwin, G.W. (2007) 'A novel continuous forward algorithm for rbf neural modelling', IEEE Transactions on Automatic Control, Vol.52, No.1, pp.117-122.
35. Peng, J., Li, K. and Irwin, G.W. (2008) 'A new Jacobian matrix for optimal learning of single-layer neural nets', IEEE Transactions on Neural Networks, Vol.19, No.1, pp.119-129.
36. Platt, J. (1991) 'A resource-allocating network for function interpolation', Neural Computation, Vol.3, pp.213-225.
37. Press, W.H., Teukolsky, S.A., Vetterling, W.T. and Flannery, B.P. (1992) Numerical Recipes in C: The Art of Scientific Computing, Cambridge University Press, Cambridge.
38. Rao, C.R. and Mitra, S.K. (1971) Generalized Inverse of Matrices and its Applications, John Wiley & Sons, Inc., New York.
39. Ronen, M., Rosenberg, R., Shraiman, B. and Alon, U. (2002) 'Assigning numbers to the arrows: Parameterizing a gene regulation network by using accurate expression kinetics', Proceedings of the National Academy of Sciences of the United States of America, Vol.99, No.1616, pp.10555-10560.
40. Serre, D. (2002) Matrices: Theory and Applications, Springer-Verlag Inc., New York.
41. Sutanto, E.L., Mason, J.D. and Warwick, K. (1997) 'Mean-tracking clustering algorithm for radial basis function centre selection', International Journal of Control, Vol.67, pp.961-977.
42. Wang, D. and Huang, G-B. (2005) 'Protein sequence classification using extreme learning machine', Proceedings of International Joint Conference on Neural Networks (IJCNN2005), Montreal, Canada.
43. Wang, Z., Liu, X., Liu, Y., Liang, J. and Vinciotti, V. (2009) 'An extended Kalman filtering approach to modeling nonlinear dynamic gene regulatory networks via short gene expression time series', IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), Vol.6, No.3, pp.410-419.
44. Wang, Z., Yang, F., Ho, D., Swift, S., Tucker, A. and Liu, X. (2008) 'Stochastic dynamic modeling of short gene expression time-series data', IEEE Transactions on NanoBioscience, Vol.7, No.1, pp.44-55.
45. Wolkenhauer, O., Kitano, H. and Cho, K. (2003) 'Systems biology - looking at opportunities and challenges in applying systems theory to molecular and cell biology', IEEE Control Systems Magazine, August, pp.38-48.
46. Xu, J-X., Wang, W., Goh, J.C.H. and Lee, G. (2005) 'Internal model approach for gait modeling and classification', 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), Shanghai, China.
47. Yeu, C-W.T., Lim, M-H., Huang, G-B., Agarwal, A. and Ong, Y-S. (2006) 'A new machine learning paradigm for terrain reconstruction', IEEE Geoscience and Remote Sensing Letters, Vol.3, No.3, pp.382-386.
48. Yingwei, L., Sundararajan, N. and Saratchandran, P. (1997) 'A sequential learning scheme for function approximation using minimal radial basis function (RBF) neural networks', Neural Computation, Vol.9, pp.461-478. (Pubitemid 127635401)
49. Zhang, G.L. and Billings, S.A. (1996) 'Radial basis function network configuration using mutual information and the orthogonal least squares algorithm', Neural Networks, Vol.9, pp.1619-1637.
50. Zhang, R., Huang, G-B., Sundararajan, N. and Saratchandran, P. (2006) 'Multi-category classification using an extreme learning machine for microarray gene expression cancer diagnosis', IEEE/ACM Transactions on Computational Biology and Bioinformatics, IEEE Computer Society Press, Los Alamitos, CA, USA, Vol.4, No.3, pp.485-495.