Classifying patterns with missing values using Multi-Task Learning perceptrons

Expert Systems with Applications

Volumn 40, Issue 4, 2013, Pages 1333-1341

  García Laencina, Pedro J ^a   Sancho Gómez, José Luis ^b   Figueiras Vidal, Aníbal R ^c  

^a Centro Universitario de la Defensa de San Javier   (Spain)

^b TECHNICAL UNIVERSITY OF CARTAGENA   (Spain)

^c UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Imputation; Missing values; Multi Layer Perceptron; Multi Task Learning; Pattern classification

Indexed keywords

ALTERNATIVE APPROACH; DATA SETS; EXPERIMENTAL COMPARISON; IMPUTATION; IMPUTATION ALGORITHM; IMPUTATION OF MISSING VALUES; INCOMPLETE DATA; MISSING DATA PROBLEM; MISSING VALUES; MULTI LAYER PERCEPTRON; MULTITASK LEARNING; ROBUSTNESS PROPERTIES;

ALGORITHMS; CLASSIFICATION (OF INFORMATION); LINEARIZATION; PATTERN RECOGNITION; PATTERN RECOGNITION SYSTEMS;

PROBLEM SOLVING;

EID: 84870248476     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2012.08.057     Document Type: Article

References (47)

1. Archambeau, C.; Valle, M.; Assenza, A.; Verleysen, M. (2006). Assessment of probability density estimation methods: Parzen window and finite Gaussian mixtures. In IEEE intl. symp. on circuits and systems (ISCAS) (pp. 3245-3248). Island of Kos, Greece.
2. G.E. Batista, and M.C. Monard An analysis of four missing data treatment methods for supervised learning Applied Artificial Intelligence 17 2003 519 533
3. C.M. Bishop Neural networks for pattern recognition 1995 Oxford University Press Oxford, UK
4. E. Bonilla, K.M. Chai, and C. Williams Multi-task gaussian process prediction J. Platt, D. Koller, Y. Singer, S. Roweis, Advances in neural information processing systems 20 2008 MIT Press Cambridge, MA 153 160
5. S. Bull Analysis of attitudes toward workplace smoking restrictions N. Lange, L. Ryan, L. Billard, D. Brillinger, L. Conquest, J. Greenhouse, Case studies in biometry 1994 Wiley New York, NY 249 271
6. Caruana, R. (1997). Multitask learning. Ph.D. Thesis, School of Computer Science, Carnegie Mellon University.
7. J. Cid-Sueiro, J.I. Arribas, S. Urbán-Munoz, and A.R. Figueiras-Vidal Cost functions to estimate a posteriori probabilities in multiclass problems IEEE Transactions on Neural Networks 10 1999 645 656
8. Delalleau, O.; Courville, & A.; Bengio, Y. (2008). Gaussian mixtures with missing data: An efficient EM training algorithm. In Proc. of computing res. association conf. (p. 155). Snowbird, UT.
9. T. Evgeniou, C. Micchelli, and M. Pontil Learning multiple tasks with kernel methods Journal of Machine Learning Research 6 2005 615 637
10. F. Fessant, and S. Midenet Self-organising map for data imputation and correction in surveys Neural Computing and Applications 10 2002 300 310
11. Frank, A.; Asuncion, A. (2010). UCI machine learning repository. < http://archive.ics.uci.edu/ml >.
12. García-Laencina, P. J.; Sancho-Gómez, J. -L.; Figueiras-Vidal, A. R. (2006). Pattern classification with missing values using multitask learning. In Proc. intl. joint conf. on neural networks (IJCNN) (pp. 3594-3601). Vancouver, Canada.
13. García-Laencina, P. J.; Serrano-García, J.; Figueiras-Vidal, A. R.; Sancho-Gómez, J. -L. (2007). Multi-task neural networks for dealing with missing inputs. In Proc. intl. work-conf. on the interplay between natural and artificial computation (IWINAC) (Vol. 4527, pp. 282-291). Murcia, Spain: LNCS. La Manga del Mar Menor.
14. García-Laencina, P. J.; Figueiras-Vidal, A. R.; Sancho-Gómez, J. -L. (2008). Incomplete pattern classification using a multi-task approach. In e-Proceedings of the 12th world multi-conference on systemics, cybernetics and informatics (pp. 1-6). Orlando, Florida, USA.
15. P.J. García-Laencina, J.L. Sancho-Gómez, and A. Figueiras-Vidal Pattern classification with missing data: a review Neural Computing & Applications 19 2010 263 282
16. P.J. García-Laencina, J.-L. Sancho-Gómez, A.R. Figueiras-Vidal, and M. Verleysen K-Nearest neighbours with mutual information for simultaneous classification and missing data imputation Neurocomputing 72 7-9 2009 1483 1493
17. Ghahramani, Z.; Jordan, M. I. (1993). Supervised learning from incomplete data via an EM approach. In J.D. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in neural information proc. sys (vol. 6, pp. 120-127). Denver, CO.
18. J. Ghosn, and Y. Bengio Bias learning, knowledge sharing IEEE Transactions on Neural Networks 14 2003 748 765
19. A. Gupta, and M.S. Lam Estimating missing values using neural networks Journal of the Operational Research Society 47 1996 229 238
20. W. Härdle, M. Müller, S. Sperlich, and A. Werwatz Nonparametric and semiparametric models 2004 Springer Berlin
21. P.J. Huber Robust statistics 2nd ed. 2009 Wiley Hoboken, NJ
22. J.M. Jerez, I. Molina, P.J. García-Laencina, E. Alba, N. Ribelles, and M. Martín Missing data imputation using statistical and machine learning approaches in a real breast cancer problem Artificial Intelligence in Medicine 50 2010 105 115
23. Ji, C.; Elwalid, A. (2000). Measurement-based network monitoring: Missing data formulation and scalability analysis. In Proc. IEEE intl. symp. on information theory ((pp. 78)). Sorrento, Italy.
24. N. Kwak, and C.-H. Choi Input feature selection by mutual information based on Parzen window IEEE Transactions on Pattern Analysis and Machine Intelligence 24 2002 1667 1671
25. K. Lakshminarayan, S. Harp, and T. Samad Imputation of missing data in industrial databases Applied Intelligence 11 2004 259 275
26. Latif, B. A.; Mercier, G. (2010). Self-organizing maps. In Tech open, self-organizing maps for processing of data with missing values and outliers: Application to remote sensing images (pp. 189-210).
27. C.-P. Lim, J.-H. Leong, and M.-M. Kuan A hybrid neural network system for pattern classification tasks with missing features IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 648 653
28. R.J.A. Little, and D.B. Rubin Statistical analysis with missing data 2nd Edition 2002 Wiley Hoboken, NJ
29. Mallinson, H.; Gammerman, A. (2003). Support vector machine imputation methodology. Tech. rep.; Euredit Project WP 5.6, University of London.
30. Markey, M.; Patel, A. (2004). Impact of missing data in training artificial neural networks for computer-aided diagnosis. In Proc. intl. conf. on machine learning and applications (pp. 351-354). Louisville, KY.
31. Moller, M. F. (1993). Efficient training of feed-forward neural networks. Ph.D. Thesis, Computer Science Dept.; Aarhus University.
32. I.T. Nabney NETLAB: Algorithms for pattern recognition 2002 Springer London, UK
33. K.J. Nishanth, V. Ravi, N. Ankaiah, and I. Bose Soft computing based imputation and hybrid data and text mining: The case of predicting the severity of phishing alerts Expert Systems with Applications 39 12 2012 10583 10589
34. S.K. Pal, and D.D. Majumder Fuzzy sets and decision making approaches in vowel and speaker recognition IEEE Transactions on Systems, Man and Cybernetics 7 1977 625 629
35. E. Parzen On estimation of a probability density function and mode Annals of Mathematical Statistics 33 1962 1065 1076
36. H. Peng, F. Long, and C.H.Q. Ding Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 1226 1238
37. L. Prechelt Automatic early stopping using cross validation: Quantifying the criteria Neural Networks 11 4 1998 761 767
38. Quinlan, J. R. (1993). C4.5: Programs for machine learning. Morgan Kaufmann, San Mateo, CA.
39. B.D. Ripley Pattern recognition and neural networks 1996 Cambridge University Press New York, NY < http://www.stats.ox.ac.uk/pub/PRNN/ >
40. M. Saar-Tsechansky, and F. Provost Handling missing values when applying classification models Journal of Machine Learning Research 8 2007 1623
41. J.-L. Sancho-Gómez, P.J. García-Laencina, and A.R. Figueiras-Vidal Combining missing data imputation and pattern classification in a multi-layer perceptron Intelligent Automation and Soft Computing, Special issue on Soft Computing & Signal Processing 15 2009 539 553
42. J.L. Schafer Analysis of incomplete multivariate data 1997 Chapman & Hall Boca Raton, FL
43. E.-L. Silva-Ramírez, R. Pino-Mejías, M. López-Coello, and M.-D. Cubiles-de-la Vega Missing value imputation on missing completely at random data using multilayer perceptrons Neural Networks 24 1 2011 121 129
44. Silver, D. L. (2000). Selective transfer of neural network task knowledge. Ph.D. Thesis, Canada: Department of Computer Science, University of Western Ontario.
45. O. Troyanskaya, M. Cantor, O. Alter, G. Sherlock, P. Brown, and D. Botstein Missing value estimation methods for DNA microarrays Bioinformatics 17 2001 520 525
46. S.-Y. Yoon, and S.-Y. Lee Training algorithm with incomplete data for feed-forward neural networks Neural Processing Letters 10 1999 171 179
47. M.D. Zio, U. Guarnera, and O. Luzi Imputation through finite gaussian mixture models Computational Statistics & Data Analysis 51 11 2007 5305 5316