A new online data imputation method based on general regression auto associative neural network

Neurocomputing

Volumn 138, Issue , 2014, Pages 106-113

  Ravi, Vadlamani ^a   Krishna, Mannepalli ^a  

^a INSTITUTE FOR DEVELOPMENT AND RESEARCH IN BANKING TECHNOLOGY   (India)

Author keywords

Auto associative neural network; Data imputation; General regression auto associative neural network; Particle swarm optimization; Radial basis function auto associative neural network

Indexed keywords

PARTICLE SWARM OPTIMIZATION (PSO); RADIAL BASIS FUNCTION NETWORKS; REGRESSION ANALYSIS;

10-FOLD CROSS-VALIDATION; AUTOASSOCIATIVE NEURAL NETWORKS; BENCHMARK CLASSIFICATION; DATA IMPUTATION; MULTI LAYER PERCEPTRON; STATISTICAL SIGNIFICANCE; WAVELET NEURAL NETWORKS; WILCOXON SIGNED RANK TEST;

NEURAL NETWORKS;

ANALYTIC METHOD; ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER MODEL; GENERAL REGRESSION AUTO ASSOCIATIVE NEURAL NETWORK; HYBRID IMPUTATION METHOD; HYBRID MODEL; INFORMATION PROCESSING; INTERMETHOD COMPARISON; MEAN IMPUTATION METHOD; ONLINE SYSTEM; PARTICLE SWARM OPTIMIZATION BASED AUTO ASSOCIATIVE NEURAL NETWORK; PARTICLE SWARM OPTIMIZATION BASED AUTO ASSOCIATIVE WAVELET NEURAL NETWORK; PRIORITY JOURNAL; RADIAL BASIS FUNCTION AUTO ASSOCIATIVE NEURAL NETWORK; REGRESSION ANALYSIS; SEMI ONLINE METHOD; VALIDATION STUDY; WILCOXON SIGNED RANKS TEST;

EID: 84899895795     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.02.037     Document Type: Article

References (65)

1. M. Abdella, D. Marwala, The use of genetic algorithms and neural networks to approximate missing data in database, in: Proceedings of the IEEE 3rd International Conference on Computational Cybernetics (ICCC), 2005, pp. 207-212.
2. Garcia-Laencina P.J., Sancho-Gomez J.L., Figueiras-Vidal A.R. Pattern classification with missing data: a review. Neural Comput. Appl. 2010, 19:263-282.
3. Little R.J.A., Rubin D.B. Statistical Analysis with Missing Data 2002, Wiley-Interscience, Hoboken, NJ, USA. 2nd ed.
4. Little R.J.A., Rubin D.B. Statistical Analysis with Missing Data 1987, Wiley, New York.
5. Sande I.G. Hot-deck imputation procedures. Incomplete Data in Sample Surveys 1983, 3:339-349. Academic Press, New York.
6. Ford B.M. An overview of hot-deck procedures. Incomplete Data in Sample Surveys 1983, 2:185-207. Academic Press, New York.
7. Dempster A., Laird N., Rubin D. Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 1977, 39(1):1-38.
8. Rubin D.B. Multiple Imputation for Nonresponse in Surveys 1987, Wiley, New York.
9. Gupta A., Lam M.S. Estimating missing values using neural networks. J. Oper. Res. Soc. 1996, 47(2):229-238.
10. Batista G., Monard M.C. A study of K-nearest neighbor as an imputation method. Hybrid Intelligent Systems, Ser Front Artificial Intelligence Applications 2002, 251-260. IOS Press. A. Abraham (Ed.).
11. Gabrys B. Neuro-fuzzy approach to processing inputs with missing values in pattern recognition problems. Int. J. Approx. Reasoning 2002, 30:149-179.
12. Merlin P., Sorjamaa A., Maillet B., Lendasse A. X-SOM and L-SOM: a double classification approach for missing value imputation. Neuro Comput. 2010, 73:1103-1108.
13. Marseguerra M., Zoia A. The auto-associative neural network in signal analysis II, application to on-line monitoring of a simulated BWR component. Ann. Nucl. Energy 2002, 32(11):1207-1223.
14. Kline R.B. Principles and Practice of Structural Equation Modeling 1988, Guliford Press, New York.
15. Song Q., Shepperd M. A new imputation method for small software project data sets. J. Syst. Software 2007, 80(1):51-62.
16. Schafer J.L. Analysis of Incomplete Multivariate Data 1997, Chapman & Hall, Florida, USA.
17. Desarbo W.S., Rao V.R. A constrained unfolding methodology for product positioning. Market. Sci. 1986, 5(1):1-19.
18. Laird N.M. Missing data in longitudinal studies. Stat. Med. 1988, 7:305-315.
19. Samad T., Harp S.A. Self-organization with partial data network. Comput. Neural Syst. 1992, 3:205-212.
20. Sharpe P.K., Solly R.J. Dealing with missing values in neural network based diagnostic systems. Neural Comput. Appl. 1995, 3(2):73-77.
21. Nordbotten S. Neural network imputation applied to the Norwegian 1990 population census data. J. Off. Stat. 1996, 12:385-401.
22. Yoon S.Y., Lee S.Y. Training algorithm with incomplete data for feed-forward neural networks. Neural Process. Lett. 1999, 10:171-179.
23. G. Batista, M.C. Monard, Experimental Comparison of K-nearest Neighbor and Mean or Mode Imputation Methods with the Internal Strategies Used by C4.5 and CN2 to Treat Missing Data. Technical Report, University of Sao Paulo, 2003.
24. J. Jerez, I. Molina, J. Subirates, L. Franco, Missing data imputation in breast cancer prognosis, in: Proceedings of the 24th IASTED International Conference on Biomedical Engineering (BioMed'06), Anaheim, CA, USA, 2006.
25. S. Mohamed, T. Marwala, Neural network based techniques for estimating missing data in databases, in: The 16th Annual Symposium of the Pattern Recognition Association of South Africa, Langebaan, South Africa, 2005, pp. 27-32.
26. Marwala T., Chakraverty S. Fault classification in structures within complete measured data using auto associative neural networks and genetic algorithm. Curr. Sci. India 2006, 90(4):542-548.
27. F.V. Nelwamondo, T. Marwala, Fuzzy ARTMAP and neural network approach to online processing of inputs with missing values, in: Proceedings of the 17th Symposium of the Pattern Recognition Association of South Africa, 2006, pp. 177-182.
28. Marivate V.N., Nelwamondo F.V., Marwala T. Autoencoder Principal Component Analysis and Support Vector Regression for Data Imputation 2007, CoRR.
29. Nelwamondo F.V., Mohamed S., Marwala T. Missing data: a comparison of neural network and expectation maximization techniques. Curr. Sci. 2007, 93(12).
30. A.K. Mohamed, F.V. Nelwamondo, T. Marwala, Estimating missing data using neural network techniques, principal component analysis and genetic algorithms, in: Proceedings of the 18th Symposium of the Pattern Recognition Association of South Africa, 2007.
31. G. Ssali, T. Marwala, Computational intelligence and decision trees for missing data estimation, in: IJCNN, 2008, pp. 201-207.
32. J. Mistry, F.V. Nelwamondo, T. Marwala, Using principle component analysis and auto associative neural networks to estimate missing data in a database, in: Proceedings of the12th World Multi-Conference on Systemics, Cybernetics and Informatics: WMSCI, 2008.
33. M.H. Chen, Pattern recognition of business failure by auto associative neural networks in considering the missing values, in: Computer Symposium, 2010, pp. 711-715.
34. Specht D.F. A general regression neural network. IEEE Trans. Neural Networks 1991, 2(6):568-576.
35. Flores B.E. A pragmatic view of accuracy measurement in forecasting. Omega 1986, 14(2):93-98.
36. J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of the IEEE International Conference on Neural Networks, Piscataway, NJ, USA, 1995, pp. 1942-1948.
37. Paramjeet V.Ravi, Nekuri N., Raghavendrarao C. Privacy preserving data mining using particle swarm optimization trained auto-associative neural network: an application to bankruptcy prediction in banks. Int. J. Data Min. Model. Manage. 2012, 4(1):39-56.
38. Kramer M.A. Nonlinear principal component analysis using auto associative neural networks. AIChE J. 1991, 37(2):233-243.
39. Pramodh C., Ravi V. Modified great deluge algorithm based auto associative neural network for bankruptcy prediction in banks. Int. J. Comput. Intell. Res. 2007, 3(4):363-370.
40. Ravi V., Pramodh C. Non-linear principal component analysis-based hybrid classifiers: an application to bankruptcy prediction in banks. Int. J. Inf. Decis. Sci. 2010, 2(1):50-67.
41. Grossmann A., Morlet J. Decomposition of Hardi functions into square integrable wavelets of constant shape. SIAM J. Math. Anal. 1984, 15:725-736.
42. retrieved in 2013. http://mathworld.wolfram.com/Wavelet.html.
43. Zhang Q., Benvniste A. Wavelet networks. IEEE Trans. Neural Networks 1992, 3(6):889-898.
44. Zhang Q. Using wavelet network in nonparametric estimation. IEEE Trans. Neural Networks 1997, 8(2):227-236.
45. Zhang X., Qi J., Zhang R., Liu M., Hu Z., Xue H. Prediction of programmed-temperature retention values of naphtha[U+05F3]s by wavelet neural networks. Comput. Chem. 2001, 25(2):25-133.
46. Avci E. An expert system based on wavelet neural network-adaptive norm entropy for scale invariant texture classification. Expert Syst. Appl. 2007, 32(3):919-926.
47. Dimoulas C., Kalliris G., Papanikolaou G., Petridis V., Kalampakas A. Bowel-sound pattern analysis using wavelets and neural networks with application to long-term unsupervised, gastrointestinal motility monitoring. Expert Syst. Appl. 2008, 34(1):26-41.
48. Dong L., Xiao D., Liang Y., Liu Y. Rough set and fuzzy wavelet neural network integrated with least square weighted fusion algorithm based fault diagnosis research for power transformers. Electric Power Syst. Res. 2008, 78(1):129-136.
49. Vinaykumar K., Ravi V., Carr M., Rajkiran N. Software cost estimation using wavelet neural networks. Syst. Software 2008, 81(11):1853-1867.
50. N. Rajkiran, V. Ravi, Software reliability prediction using wavelet neural networks, in: International conference on computational intelligence and multimedia applications, Sivakasi, Tamilnadu, India, 2007.
51. Ravi V., Ravikumar P., Ravisrinivas E., Kasabov N.K., Semi-Online Training A. Algorithm for the radial basis function neural networks: applications to bankruptcy prediction in banks. Advances in Banking Technology and Management: Impacts of ICT and CRM 2007, 243-260.
52. Kasabov N.K., Song Q. DENFIS: dynamic, evolving neural-fuzzy inference systems and its application for time-series prediction. IEEE Trans. Fuzzy Syst. 2002, 10(2):144-154.
53. last retrieved in 2013. http://archive.ics.uci.edu/ml/datasets.html.
54. last retrieved in 2013. http://sci2s.ugr.es/keel/datasets.php.
55. Canbas S., Caubak A., Kilic S.B. Prediction of commercial bank failure via multivariate statistical analysis of financial structures: the Turkish case. Eur. J. Oper. Res. 2005, 166:528-546.
56. last retrieved in 2013. http://www.tbb.org.tr/english/bulten/yillik/2000/ratios.xls.
57. Olmeda I., Fernandez E. Hybrid classifiers for financial multi criteria decision making: the case of bankruptcy prediction. Comput. Econ. 1997, 10:317-335.
58. Beynon M.J., Peel M.J. Variable precision rough set theory and data discretization: an application to corporate failure prediction. Omega 2001, 29:561-576.
59. Thomas L.C., Edelman D.B., Crook J.N. Credit Scoring and Its Applications 2002, SIAM, Philadelphia, USA.
60. last retrieved in 2013. http://www.neuroshell.com.
61. last retrieved in 2013. https://www.msu.edu/user/sw/statrev/strv50.htm?Q.
62. Wilcoxon F. Individual comparisons by ranking methods. Biom. Bull. 1945, 1:80-83.
63. Siegel S. Non-parametric Statistics for the Behavioral Sciences 1956, 75-83. McGraw Hill, New York.
64. R. Lowry, Concepts and Applications of Inferential Statistics, 2013. Retrieved from. http://vassarstats.net/textbook/ch12a.html.
65. N. Ankaiah, V. Ravi, A novel soft computing hybrid for data imputation, in: Proceedings of the 7th International Conference on Data Mining (DMIN), Las Vegas, USA, 2011.