A new structure and training procedure for multi-mother wavelet networks

International Journal of Wavelets, Multiresolution and Information Processing

Volumn 8, Issue 1, 2010, Pages 149-175

  Othmani, Mohamed ^a   Bellil, Wajdi ^a   Ben Amar, Chokri ^b   Alimi, Adel M ^b  

^a UNIVERSITY OF GAFSA   (Tunisia)

^b UNIVERSITY OF SFAX   (Tunisia)

Author keywords

Approximation of 1D, 2D data; Multi mother wavelets; Training procedure; Wavelet network structure

Indexed keywords

FUNCTION APPROXIMATION; GENERALIZED CROSS VALIDATION METHOD; MOTHER WAVELETS; NEW STRUCTURES; OPTIMAL SELECTION; ORTHOGONAL LEAST-SQUARES METHOD; SELECTION OF THE BEST; SIMULATION RESULT; TRAINING PROCEDURES; TWO-DIMENSION; WAVELET NETWORK;

EID: 77951693915     PISSN: 02196913     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219691310003353     Document Type: Article

References (49)

1. A. M. Alimi, The beta-based neuro-fuzzy system: Genesis and main properties, TASK Quarterly Journal, Special Issue on "Neural Networks" eds. W. Duch and D. Rutkowska 7 (1) (2003) 23-41.
2. B. Thomas and C. E. Joseph, An improved Akaike information criterion for statespace model selection, Comput. Stat. Data Anal. 50 (10) (2006) 2635-2654.
3. B. Yevqeniy, L. Nataliya, P. Iryna and V. Olena, An adaptive learning algorithm for a wavelet neural network, Expert Systems 22 (5) (2005) 235-240. (Pubitemid 43906925)
4. C. Ben Amar, W. Bellil and A. M. Alimi, Beta function and its derivatives: A new wavelet family, Trans. Syst. Signals Devices 1 (3) (2005-2006) 275-293.
5. C. E. Vasios, G. K. Matsopoulos, E. M. Ventouras, K. S. Nikita and N. Uzunoglu, Cross-validation and neural network architecture selection for the classification of intracranial current sources, in Proc. 2004 Seventh Seminar on Neural Network Applications in Electrical Engineering, NEUREL 2004, Serbia and Montenegro (2004), pp. 151-158. (Pubitemid 40859026)
6. C.-J. Lin, Nonlinear systems control using self-constructing wavelet networks, Applied Soft Computing 9 (2009) 71-79.
7. C. Kai and H. Yoshio, An adaptive hybrid wavelet neural network and its application, in Proc. 2004 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2004, Shenyang, China (2004), pp. 73-86. (Pubitemid 41718712)
8. D. G. Luenberger, Linear and Nonlinear Programming (Addison-Wesley, 1996).
9. D. Whitley, T. Starkweather and C. Bogart, Genetic algorithms and neural networks: Optimizing connections and connectivity, Parallel Computing 14 (1990) 347-361.
10. F. Gruau and D. Whitley, Adding learning to the cellular developmental process: A comparative study, Evolutionary Computation 1 (3) (1993) 213-233.
11. F. Rossi and C. Gegout, Geometrical initialization, parametrization and control of multilayer perceptrons: Application to function approximation, in Proc. WCCI ICNN, Vol. I, Florida, USA (1994), pp. 546-550.
12. G. H. Golub and C. F. Van Loan, Matrix Computations, 2nd edn. (Johns Hopkins University Press, 1989).
13. H. Akaike, A new look at statistical model identification, IEEE Trans. Automat. Control AC-19 (6) (1974) 716-723.
14. H. M. Abbas, System identification using optimally designed functional link networks via a fast orthogonal search technique, J. Computers 4 (2) (2009) 147-153.
15. H. Min and C. Baotong, A novel learning algorithm for wavelet neural networks, in First International Conference on Natural Computation, ICNC, Changsha, China (2005), pp. 1-17.
16. H. Q. Thuan and S. Rudy, Effective neural network pruning using cross validation, in Proc. International Joint Conference on Neural Networks, Montreal, Canada (2005), pp. 972-977.
17. H. R. Karimi, B. Lohmann, B. Moshiri and P. Jabehdar Maralani, Wavelet-based identification and control design for a class of nonlinear systems, Int. J. Wavelets Multiresolut. Inf. Process. 4 (1) (2006) 213-226.
18. J. Lewalle, Field reconstruction from single scale continuous, wavelet coefficients, Int. J. Wavelets Multiresolut. Inf. Process. 7 (1) (2009) 131-142.
19. S.-J. Kim, J.-Y. Seo and H.-T. Jeon, Design of the scaling-wavelet neural network using genetic algorithm, in Proc. Int. Joint Conference on Neural Networks, Honolulu, USA (2002), pp. 2174-2179. (Pubitemid 34647968)
20. I. Daubechies, Ten Lectures on Wavelets (Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania, 1992).
21. C. G. Lim, K. Kim and E. Kim, Modeling for an adaptive wavelet network parameter learning using genetic algorithms, in Proc. Fifteenth IASTED International Conference on Modeling and Simulation, California, USA (2004), pp. 55-59. (Pubitemid 40700402)
22. L. Wessels and E. Barnard, Avoiding false local minima by proper initialisation of connections, IEEE Trans. Neural Networks 3 (6) (1992) 899-905. (Pubitemid 23580842)
23. Y. Liu, S. Luo, A. Li and H. Yu, A new model selection criterion based on information geometry, in 2004 Seventh International Conference on Signal Processing Proceedings, ICSP, Beijing, China (2004), pp. 1561-1564.
24. M. Mehra and B. V. Rathish Kumar, Error estimates for time accurate wavelet based schemes for hyperbolic partial differential equations, Int. J. Wavelets Multiresolut. Inf. Process. 5 (4) (2007) 667-678. (Pubitemid 47062145)
25. M. K. Titsias and A. C. Likas, Shared kernel model for class conditional density estimation, IEEE Trans. Neural Network 12 (5) (2001) 987-996.
26. O. Yacine and D. Gerard, Initialization by selection for wavelet network training, Neurocomputing 34 (2002) 131-143.
27. Q. Zhang and A. Benveniste, Wavelet networks, IEEE Trans. Neural Networks 3 (6) (1992) 889-898. (Pubitemid 23580843)
28. Q. Zhang, Using wavelet network in nonparametric estimation, IEEE Trans. Neural Networks 8 (2) (1997) 227-236. (Pubitemid 127765118)
29. R. Bulirsch and J. Stoer, Introduction to Numerical Analysis (Springer-Verlag, 1980).
30. R. H. Franke, A critical comparison of some methods for interpolation of scattered data, Tech. Rep. NPS-53-79-003, Dept. of Mathematics, Naval Postgraduate School, Monterey, Calif., USA (1979).
31. R. J. Renka, Multivariate interpolation of large sets of scattered data, ACM Trans. Math. Software 14 (2) (1988) 139-148.
32. R. Yan and R. X. Gao, Base wavelet selection for bearing vibration signal analysis, Int. J. Wavelets Multiresolut. Inf. Process. 7 (4) (2009) 411-426.
33. S. A. Billings and H. L. Wei, A new class of wavelet networks for nonlinear system identification, IEEE Trans. Neural Networks 16 (4) (2005) 862-874. (Pubitemid 41064318)
34. S. Haykin, Neural Networks: A Comprehensive Foundation (Macmillan, 1994).
35. Q. Sui and Y. Gao, A stepwise updating algorithm for multiresolution wavelet neural networks, in Proc. International Conference on Wavelet Analysis and Its Applications (WAA), Chongqing, China (2003), pp. 633-638.
36. V. Colla, L. M. Reyneri and M. Sgarbi, Orthogonal least squares algorithm applied to the initialization of multi-layer perceptrons, in ESANN'1999 Proc. European Symposium on Artificial Neural Networks, Bruges, Belgium (1999), pp. 363-369.
37. W. Bellil, C. Ben Amar and A. M. Alimi, Beta wavelet based image compression, International Conference on Signal, System and Design, SSD03, Vol. 1, Tunisia (2003), pp. 77-82.
38. W. Bellil, M. Othmani and C. Ben Amar, Initialization by selection for multi-library wavelet neural network training, in Proc. 3rd International Workshop on Artificial Neural Networks and Intelligent Information Processing, ANNIIP07, in conjunction with 4th International Conference on Informatics in Control, Automation and Robotics, ICINCO, Anger, France (2007), pp. 30-37.
39. Y. Akifumi, N. Mamoru and I. Makio, A note on sample size determination for Akaike information criterion (AIC) approach to clinical data analysis, Comm. Statist. Theory Methods 34 (12) (2005) 2331-2343.
40. Y. Sheng, D. Roberge and H. H. Szu, Optical wavelet transform, Optical Engr. 31 (9) (1992) 1840-1845.
41. Y. S. Wang and C.-M. Lee, Evaluation of nonstationary vehicle passing loudness based on an antinoise wavelet pre-processing neural network model, Int. J. Wavelets Multiresolut. Inf. Process. 7 (4) (2009) 459-480.
42. Z. Michalewicz, A hierarchy of evolution programs: An experimental study, Evolutionary Computation 1 (1) (1993) 51-76.
43. T. Koji, S. Masashi and M. Klaus-Robert, Subspace information criterion for nonquadratic regularizers-model selection for sparse regressors, IEEE Trans. Neural Networks 13 (1) (2002) 70-80.
44. N. Murata, S. Yoshizawa and S. Amari, Network information criterion determining the number of hidden units for an artificial neural network model, IEEE Trans. Neural Networks 5 (6) (1994) 865-872.
45. N. T. Van Der Merwe and A. J. Hoffman, Developing an efficient cross validation strategy to determine classifier performance (CVCP), in Proc. Int. Joint Vol. Conf. Neural Networks, Vol. 3, Washington D. C., USA (2001), pp. 1663-1668.
46. J. Xu and D. W. C. Ho, A constructive algorithm for wavelet neural networks, in First International Conference on Natural Computation, Changsha, China (2005), pp. 730-739. (Pubitemid 41449980)
47. J. Zhang, G. G. Walter and Y. Miao, Wavelet neural networks for function learning, IEEE Trans. Signal Process. 43 (6) (1995) 1485-1496.
48. Q. Zhang and A. Benvenist, Wavelet network, IEEE Trans. Signal Process. 13 (6) (1992) 889-898.
49. Q. Zhang, Using wavelet network in nonparameters estimation, IEEE Trans. Neural Networks 8 (1997) 227-236. (Pubitemid 127765118)