Counter propagation auto-associative neural network based data imputation

Information Sciences

Volumn 325, Issue , 2015, Pages 288-299

  Gautam, Chandan ^a,b   Ravi, Vadlamani ^a  

^a INSTITUTE FOR DEVELOPMENT AND RESEARCH IN BANKING TECHNOLOGY   (India)

^b UNIVERSITY OF HYDERABAD   (India)

Author keywords

Auto associative neural network; Counter propagation auto associative neural network (CPAANN); Data imputation; Grey system theory (GST)

Indexed keywords

BACKPROPAGATION; NETWORK ARCHITECTURE; SYSTEM THEORY;

AUTOASSOCIATIVE NEURAL NETWORKS; COMPETITIVE LEARNING; COUNTER PROPAGATION; DATA IMPUTATION; GLOBAL APPROXIMATION; GREY SYSTEM THEORY; LOCAL LEARNING; WILCOXON SIGNED RANK TEST;

NEURAL NETWORKS;

EID: 84941569673     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2015.07.016     Document Type: Article

References (97)

1. M. Abdella, T. Marwala The use of genetic algorithms and neural networks to approximate missing data in database IEEE 3rd International Conference on Computational Cybernetics vol. 3 2005 207 212
2. N. Ankaiah, V. Ravi A novel soft computing hybrid for data imputation Proceedings of the 7th International Conference on Data Mining (DMIN) Las Vegas, USA 2011
3. M. Arakawa, K. Hasegawa, K. Funatsu QSAR study of anti-HIV HEPT analogues based on multi-objective genetic programming and counter-propagation neural network Chemo. Intell. Lab. Syst. 83 2006 91 98
4. P.C. Austin, M.D. Escobar Bayesian modeling of missing data in clinical research Comput. Statics Data Anal. 49 3 2005 821 836
5. B. Aydilek, A. Arslan A hybrid method for imputation of missing vlaues using optimized fuzzy c-means with support vector regression and a genetic algorithm Informat. Sci. 233 2013 25 35
6. D. Ballabio, V. Consonni, R. Todeschini The Kohonen and CP-ANN toolbox: a collection of MATLAB modules for self-organizing maps and counterpropagation artificial neural networks Chemo. Intell. Lab. Syst. 98 2009 115 122
7. D. Ballabio, R. Kokkinofta, R. Todeschini, C.R. Theocharis Characterization of the traditional Cypriot spirit Zivania by means of counterpropagation artificial neural networks Chemo. Intell. Lab. Syst. 87 2007 52 58
8. D. Ballabio, M. Vasighi, V. Consonni, M. Kompany-Zareh Genetic algorithms for architecture optimisation of counter-propagation artificial neural networks Chemom. Intell. Lab. Syst. 105 2011 56 64
9. G. Batista, M.C. Monard et al. A study of K-nearest neighbor as an imputation method Abraham A. Hybrid Intelligent Systems, Ser Front Artificial Intelligence Applications 2002 IOS Press 251 260
10. G. Batista, M.C. Monard Experimental Comparison of K-Nearest Neighbor and Mean or Mode Imputation Methods with the Internal Strategies used by C4.5 and CN2 to Treat Missing Data 2003 University of Sao Paulo Technical Report
11. M.J. Beynon, M.J. Peel Variable precision rough set theory and data discretisation: an application to corporate failure prediction Omega 29 2001 561 576
12. D. Brodnjak-Vončina, J.C. Kodba, M. Novic Multivariate data analysis in classification of vegetable oils characterized by the content of fatty acids Chemom. Intell. Lab. Syst. 75 2005 31 43
13. P. Broersen, S. de Waele, R. Bos Autoregressive spectral analysis when observations are missing Automatica 40 9 2004 1495 1504
14. S. Canbas, A. Caubak, S.B. Kilic Prediction of commercial bank failure via multivariate statistical analysis of financial structures: the Turkish case Eur. J. Oper. Res. 166 2005 528 546
15. G. Carpenter, S. Grossberg A massively parallel architecture for a self-organizing neural pattern recognition machine Comput. Verion. Graph. Image Process. 37 1987 54 115
16. C-Y. Chang, H-J. Wang, S-J. Su Copyright authentication for images with a full counter-propagation neural network Expert Syst. Appl. 37 12 2010 7639 7647
17. J. Chen, H. Huang, F. Tian, S. Tian A selective Bayes Classifier for classifying incomplete data based on gain ratio Knowl. Based Syst. 21 7 2008 530 534
18. M.P. Cooke, A. Morris, P.D. Green Recognising occluded speech ESCA Tutorial and Workshop on the Auditory Basis of Speech Perception, Keele University 1996 15 19
19. P. Dempster, N.M. Laird, D.B. Rubin Maximum-likelihood from incomplete data via the EM algorithm J. Roy. Stat. Soc. 39 1 1977 1 38
20. J.L. Deng Control problems of grey system Syst. Control Lett. 1 1982 288 294
21. W.S. Desarbo, V.R. Rao A constrained unfolding methodology for product positioning Market. Sci. 5 1 1986 1 19
22. L.L. Doove, S.V. Buuren, E. Dusseldorp Recursive partitioning for missing data imputation in the presence of interaction effects Comput. Stat. Data Anal. 72 2013 92 104
23. M. Duma, T. Marwala, B. Twala, F. Nelwamondo Partial imputation of unseen records to improve classification using a hybrid multi-layered artificial immune system and genetic algorithm Appl. Soft Comput. 13 2013 4461 4480
24. A. Elshorbagy, S.P. Simonovic, U.S. Panu Estimation of missing stream flow data using the principles of chaos theory J. Hydrol. 255 1 2002 123 133
25. M.A. Ferro Missing data in longitudinal studies: cross-sectional multiple imputation provides similar estimates to full-information maximum likelihood Ann. Epidemiol. 24 2014 75 77
26. E. Flores A pragmatic view of accuracy measurement in forecasting Omega 14 2 1986 93 98
27. B. Gabrys Neuro-fuzzy approach to processing inputs with missing values in pattern recognition problems Int. J. Approx. Reason. 30 2002 149 179
28. J.C.F. García, D. Kalenatic, C.A.L. Bello Missing data imputation in multivariate data by evolutionary algorithms Comput. Hum. Behav. 27 2011 1468 1474
29. P.J. Garcia-Laencina, J. Sancho-Gomez, A.R. Figueiras-Vidal Classifying patterns with missing values using multi-task learning perceptrons Expert Syst. Appl. 40 2013 1333 1341
30. C. Gautam, V. Ravi Evolving clustering based data imputation Proceedings of the 3rd International Conference on Circuits, Power and Computing Technologies (ICCPCT) 2013
31. C. Gautam, V. Ravi Data imputation via evolutionary computation, clustering and a neural network Neurocomputing 156 2015 134 142
32. M.P. Gómez-Carracedo, J.M. Andrade, P. López-Mahía, S. Muniategui, D. Prada A practical comparison of single and multiple imputation methods to handle complex missing data in air quality datasets Chemom. Intell. Lab. Syst. 134 2014 23 33
33. A. Gupta, M.S. Lam Estimating missing values using neural networks J. Oper. Res. Soc. 47 2 1996 229 238
34. R. Hecht-Nielsen Counterpropagation networks Appl. Opt. 26 1987 4979 4984
35. S. Henley The problem of missing data in geoscience databases Comput. Geosci. 32 2006 1368 1377
36. http://www.cis.hut.fi/projects/somtoolbox/, 2015 (accessed 18.07.15).
37. http://www.disat.unimib.it/chm, 2014 (accessed 11.11.14).
38. E. Ramos, D. Donoho, Auto MPG dataset retrieved from http://archive.ics.uci.edu/ml/machine-learning-databases/auto-mpg/auto-mpg.data, StatLib library, Carnegie Mellon University, 2015 (accessed 18.07.15).
39. P. Cortez, A. Morais, Forest Fire dataset retrieved from http://archive.ics.uci.edu/ml/machine-learning-databases/forest-fires/forestfires.csv, 2014 (accessed 11.11.14).
40. D. Harrison, D.L. Rubinfeld, Boston Housing dataset retrieved from http://archive.ics.uci.edu/ml/machine-learning-databases/housing/housing.data, 2015 (accessed 18.07.15).
41. R.A. Fisher, Iris dataset retrieved from http://archive.ics.uci.edu/ml/machine-learning-databases/iris/iris.data, 2015 (accessed 18.07.15).
42. Owner of dataset: National Institute of Diabetes and Digestive and Kidney Diseases, Pima Indian Diabetes dataset retrieved from http://archive.ics.uci.edu/ml/datasets/Pima+Indians+Diabetes, 2014 (accessed 11.11.14).
43. K.J. Cios, L.A. Kurgan, L.S. Goodenday, Spectf Heart dataset retrieved from http://archive.ics.uci.edu/ml/machine-learning-databases/spect, 2015 (accessed 18.07.15).
44. Wine dataset retrieved from http://archive.ics.uci.edu/ml/machine-learning-databases/wine/wine.data, 2015 (accessed 18.07.15).
45. R.W. Johnson, Bodyfat dataset retrieved from http://lib.stat.cmu.edu/datasets/bodyfat, StatLib library, Carnegie Mellon University, 2015 (accessed 18.07.15).
46. Spanish dataset retrieved from http://www.tbb.org.tr/english/bulten/yillik/2000/ratios.xls, 2015 (accessed 18.07.15).
47. J.V. Hulse, T.M. Khoshgoftaar Incomplete-case nearest neighbor imputation in software measurement data Inform. Sci. 259 2014 596 610
48. J. Jerez, I. Molina, J. Subirates, L. Franco Missing data imputation in breast cancer prognosis Proceedings of the 24th IASTED International Conference on Biomedical Engineering (BioMed'06), Anaheim, CA, USA 2006
49. W.L. Junger, A.P. Leon Imputation of missing data in time series for air pollutants Atmos. Environ. 102 2015 96 104
50. P. Kang Locally linear reconstruction based missing value imputation for supervised learning Neurocomputing 118 2013 65 78
51. R.B. Kline Principles and Practice of Structural Equation Modeling 1988 Guliford Press New York
52. T. Kohonen Self-Organization and Associative Memory 1988 Springer Verlag Berlin
53. M. Krishna, V. Ravi Particle swarm optimization and covariance matrix based data imputation IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), Enathi 2013 1 6
54. I. Kuzmanovski, M. Novic Counter-propagation neural networks in MATLAB Chemo. Intell. Lab. Syst. 90 2008 84 91
55. Y.Y. Li, L.E. Parker Classification with missing data in a wireless sensor network IEEE Southeast Conference, Huntsville, Alabama 2008 533 538
56. Y.Y. Li, L.E. Parker Nearest neighbour imputation using spatial-temporal correlations in wireless sensor networks Informat. Fusion 15 2014 64 79
57. H. Liu, S. Zhang Noisy data elimination using mutual k-nearest neighbor for classification mining J. Syst. Softw. 85 5 2012 1067 1074
58. M. Marseguerra, A. Zoia The auto-associative neural network in signal analysis II. Application to on-line monitoring of a simulated BWR component Ann. Nuclear Energy 32 11 2002 1207 1223
59. T. Marwala, S. Chakraverty Fault classification in structures with incomplete measured data using auto associative neural networks and genetic algorithm Current Sci. India 90 4 2006 542 548
60. MATLAB version 7.10.0. Natick, Massachusetts: The MathWorks Inc., 2010.
61. K. Mehrotra, C.K. Mohan, S. Ranka Elements of Artificial Neural Networks 1996 MIT Press Cambridge, MA, USA
62. P. Merlin, A. Sorjamaa, B. Maillet, A. Lendasse X-SOM and L-SOM: a double classification approach for missing value imputation Neurocomputing 73 2010 1103 1108
63. F.V. Nelwamondo, D. Golding, T. Marawala A dynamic programming approach to missing data estimation using neural networks Informat. Sci. 237 2013 49 58
64. K.J. Nishanth, V. Ravi A computational intelligence based online data imputation method: an application for banking J. Inform. Process. Syst. 9 4 2013 633 650
65. K.J. Nishanth, V. Ravi, N. Ankaiah, I. Bose Soft computing based imputation and hybrid data and text mining: the case of predicting the severity of phishing alerts Expert Syst. Appl. 39 12 2012 10583 10589
66. T.R. Nkuna, J.O. Odiyo Filling of missing rainfall data in Luvuvhu river catchment using artificial neural networks Phys. Chem. Earth A/B/C 36 14-15 2011 830 835
67. S. Nordbotten Neural network imputation applied to the Norwegian 1990 population census data J. Off. Stat. 12 1996 385 401
68. G.D. Nuovo Missing data analysis with fuzzy C-Means: A study of its application in a psychological scenario Expert Syst. Appl. 38 6 2011 6793 6797
69. I. Olmeda, E. Fernandez Hybrid classifiers for financial multicriteria decision making: the case of bankruptcy prediction Comput. Econom. 10 1997 317 335
70. Z. Qiu, X. Chen, Y. Zhou A kernel-assisted imputation estimating method for the additive hazards model with missing censoring indicator Stat. Probab. Lett. 98 2015 89 97
71. A. Ragel, B. Cremilleux MVC - a preprocessing method to deal with missing values Knowl. Based Syst. 12 1999 285 291
72. Md.G. Rahman, Md.Z. Islam Missing value imputation using decision trees and decision forests by splitting and merging records: two novel techniques Knowl. Based Syst. 53 2013 51 65
73. K. Rajer-Kanduč, J. Zupan, N. Majcen Separation of data on the training and test set for modelling: a case study for modelling of five colour properties of a white pigment Chemom. Intell. Lab. Syst. 65 2003 221 229
74. P.M.V. Rancoita, M. Zaffalon, E. Zucca, F. Bertoni, C.P. Campos Bayesian network data imputation with application to survival tree analysis Comput. Stat. Data Anal. 98 2015 89 97
75. P.J. Rathouz Missing data: weighting and imputation Encyclopaedia of Health Economics 2014 Elsevier 292 298
76. V. Ravi, M. Krishna A new online data imputation method based on general regression auto associative neural network Neurocomputing 138 2014 207 212
77. T. Samad, S.A. Harp Self-organization with partial data network Comput. Neural Syst. 3 1992 205 212
78. J.L. Schafer Analysis of Incomplete Multivariate Data 1997 Chapman & Hall Florida, USA
79. D.H. Schoellhamer Singular spectrum analysis for time series with missing data Geophys. Res. Lett. 28 16 2001 3187 3190
80. P.K. Sharpe, R.J. Solly Dealing with missing values in neural network based diagnostic systems Neural Comput. Appl. 3 2 1995 73 77
81. S. Siegel Non-Parametric Statistics for the Behavioral Sciences 1956 McGraw-Hill New York 75 83
82. E.L. Silva-Ramírez, R. Pino-Mejías, M. López-Coello, M.D. Cubiles-de-la-Vega Missing value imputation on missing completely at random data using multilayer perceptrons Neural Netw. 24 1 2011 121 129
83. E. Silva-Ramírez, R. Pino-Mejías, M. López-Coello Single imputation with multilayer perceptron and multiple imputation combining multilayer perceptron and k-nearest neighbours for monotone patterns Appl. Soft Comput. 29 2015 65 74
84. Q. Song, M. Shepperd A new imputation method for small software project data sets J. Syst. Software 80 1 2007 51 62
85. J. Tang, G. Zhang, Y. Wang, H. Wang, F. Liu A hybrid approach to integrate fuzzy C-means based imputation method with genetic algorithm for missing traffic volume data estimation Transp. Res. Part C: Emerg. Technol. 51 2015 29 40
86. L.C. Thomas, D.B. Edelman, J.N. Crook Credit Scoring and its Applications SIAM, Philadelphia 2002
87. J. Tian, B. Yu, D. Yu, S. Ma "Missing data analyses: a hybrid multiple imputation algorithm using grey system theory and entropy based on clustering Appl. Intell. 40 2013 1 13
88. O. Troyanskaya, M. Cantor, G. Sherlock, P. Brown, T. Hastie, R. Tibshirani, D. Botstein, R.B. Altman Missing value estimation methods for DNA microarrays Bioinformatics 17 2001 520 525
89. J. Twisk, W.D. Vente Attrition in longitudinal studies: How to deal with missing data J. Clinical Epidemiol. 55 2002 329 337
90. J. Vesanto SOM-based data visualization methods Intell. Data Anal. 3 1999 111 126
91. J. Vesanto, J. Himberg, E. Alhoniemi, J. Parhankangas SOM Toolbox for Matlab 5 2000 Helsinki University of Technology Technical Report A57
92. F. Wilcoxon Individual comparisons by ranking methods Biometrics Bull 1 1945 80 83
93. Retrieved from www.sussex.ac.uk/Users/grahamh/RM1web/WilcoxonTable2005.pdf, 2015 (accessed 18.07.15).
94. S.Y. Yoon, S.Y. Lee Training algorithm with incomplete data for feed-forward neural networks Neural Process. Lett. 10 1999 171 179
95. S. Zhang Nearest neighbor selection for iteratively kNN imputation J. Syst. Softw. 85 11 2012 2541 2552
96. J. Zupan, M. Novic, I. Ruisánchez Kohonen and counterpropagation artificial neural networks in analytical chemistry Chemom. Intell. Lab. Syst. 38 1997 1 23
97. J. Zupan, M. Novic, J. Gasteiger Neural networks with counter-propagation learning strategy used for modelling Chemom. Intell. Lab. Syst 27 1995 175 187