Inductive learning models with missing values

Mathematical and Computer Modelling

Volumn 44, Issue 9-10, 2006, Pages 790-806

  Fortes, I ^a   Mora Lopez L ^a   Morales, R ^a   Triguero, F ^a  

^a UNIVERSITY OF MÁLAGA   (Spain)

Author keywords

Data mining; Decision theory; Decision tree; Machine learning; Missing values

Indexed keywords

DATA MINING; DECISION MAKING; DECISION THEORY; LEARNING ALGORITHMS; PARAMETER ESTIMATION;

MISSING VALUES;

LEARNING SYSTEMS;

EID: 33745977819     PISSN: 08957177     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.mcm.2006.02.013     Document Type: Article

References (40)

1. Little R.J.A., and Rubin D.B. Statistical Analysis with Missing Data (1987), John Wiley & Sons Inc
2. Mitchell T.M. Machine Learning (1997), MacGraw-Hill
3. Kryszkiewicz M. Rough set approach to incomplete information systems. Inform. Sci. 112 (1998) 39-49
4. Kryszkiewicz M. Rules in incomplete information systems. Inform. Sci. 113 (1999) 271-292
5. Kryszkiewicz M. Rough set approach to rules generation from incomplete information systems. Encyclopedia Comput. Sci. Technol. 44 (2001) 319-346
6. J.W. Grzymala-Busse, Rough set strategies to data with missing attribute values, in: Proceedings of the Workshop on Foundations and New Directions in Data Mining, associated with the third IEEE International Conference on Data Mining, 19-22 November, Melbourne, FL, USA, 2003, pp. 56-63
7. J.W. Grzymala-Busse, S. Siddhaye, Rough set approaches to rule induction from incomplete data, in: Proceedings of the IPMU'2004, the 10th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, 4-9 July, Perugia, Italy, vol. 2, 2004, pp. 923-930
8. J.W. Grzymala-Busse, Three approaches to missing attribute values. A rough set perspective, in: Workshop on Foundations of Data Mining, associated with the fourth IEEE International Conference on Data Mining, 1-4 November, Brighton, UK, 2004
9. Grzymala-Busse J.W., and Hu M. A comparison of several approaches to missing values in data mining. In: Ziarko W., and Yao Y.Y. (Eds). Rough Sets and Current Trends in Computing. Lecture Notes in Computer Science vol. 2005 (2001), Springer
10. Hu M., Salvucci S.M., and Cohen M.P. Evaluation of some popular imputation algorithms. Section on Survey Research Methods (2000), American Statistical Association
11. Scheffer J. Dealing with missing data. Res. Lett. Inf. Math. Sci. 3 (2002) 153-160
12. Schafer J.L. Analysis of Incomplete Multivariate Data (1997), Chapman & Hall, London
13. W. Liu, A. White, S. Thompson, M. Bramer, Techniques for dealing with missing values in classification, in: International Symposium on Intelligent Data Analysis, 1997
14. Quinlan J. Unknown attribute values in induction. Proceedings of the Sixth International Machine Learning Workshop (1989), Morgan Kaufmann, San Mateo, CA 164-168
15. Hunt E.B., Marin J., and Stone P.J. Experiments in Induction (1966), Academic Press, New York
16. Quinlan J. Discovering rules by induction from large collections of examples. In: Michie D. (Ed). Expert Systems in the Micro Electronic Age (1979)
17. Quinlan J. Learning efficient classification procedures. In: Michlaski R.S., Carbonell J.G., and Mitchell T.M. (Eds). Machine Learning: An Artificial Intelligence Approach (1983), Tioga Press, Palo Alto, CA
18. Quinlan J. Induction of decision trees. Mach. Learn. 1 (1986) 81-106
19. Breiman L., Friedman J.H., Olshen R.A., and Stone C.J. Classification and Regression Trees (1984), Wadsworth, Belmont, CA
20. Quinlan J. The effect of noise on concept learning. In: Michlaski R.S., Carbonell J.G., and Mitchell T.M. (Eds). Machine Learning: An Artificial Intelligence Approach vol. 2 (1986), Morgan Kaufmann, San Mateo, CA
21. Cestnik B., and Kononenko I. ASSISTANT 86: A knowledge-elicitation tool for sophisticated users. In: Bratko I., and Lavrac N. (Eds). Progress in Machine Learning (1987), Sigma Press, Wilmslow, UK
22. Quinlan J. C4.5: Programs for Machine Learning (1992), Morgan Kaufmann, Los Gatos, CA
23. Farhangfar A., Kurgan L., and Pedrycz W. Experimental analysis of methods for imputation of missing values in databases. In: Priddy Kevin L. (Ed). Intelligent Computing: Theory and Applications II. Proceedings of the SPIE vol. 5421 (2004) 172-182
24. Cios K.J., and Kurgan L.A. Hybrid inductive machine learning: An overview of CLIP algorithms. In: Jain L.-C.-, and Kacprzyk J. (Eds). New Learning Paradigms in Soft Computing (2001), Physica-Verlag, Springer 276-322
25. Cios K.J., and Kurgan L.A. CLIP4: Hybrid inductive machine learning algorithm that generates inequality rules. Inform. Sci. 163 1-3 (2004) 37-83
26. Duda R.O., and Hart P.E. Pattern Classification and Scene Analysis (1977), John Wiley
27. Shannon C.E. A Mathematical theory of communication. Bell Syst. Tech. J. 27 (1948) 379-423
28. Zheng Z., and Low B.T. Classifying unseen cases with many missing values. In: Zhong N., and Zhou L. (Eds). PAKDD 99. LNAI 1574 (1999) 370-375
29. I. Kononenko, I. Bratko, E. Rokar, Experiments in automatic learning of medical diagnostic rules, ISSEK Workshop, Bled, 1984
30. I. Fortes, R. Morales-Bueno, Ll. Mora, F. Triguero, A decision theory approach to work with missing attribute values in inductive learning algorithms, in: Proc. of COMPSTAT2000 (14th Conference of the International Association for Statistical Computing), Utrecht, 2000
31. G. Ramos, R. Morales, Formalizacion de los Algoritmos TDIDT y CIDIM, Techn. Report LCC-ITI 99/01, Dept. Computer Science, Malaga University, 1999
32. G. Ramos, R. Morales, A. Villalba, CIDIM. Control of Induction of Sample Division Method), Una mejora de los algoritmos TDIDT, Techn. Report LCC-ITI 97/08, Dept. Computer Science, Malaga University, 2000
33. Berger J.O. Statistical Decision Theory and Bayesian Analysis (1988), Springer Verlag, New York
34. Hyalf L., and Rivest R.L. Constructing optimal binary decision trees is NP-complete. Inf. Process. Lett. 5 1 (1976) 15-17
35. Wilson D.R., and Martinez T.R. Improved heterogeneous distance functions. J. Artificial Intelligence Res. 6 1 (1997) 1-34
36. Friedman J.H. A recursive partitioning decision rule for non-parametric classification. IEEE Trans. Comput. (1977) 404-408
37. Holte R.C. Very simple classification rules perform well on most commonly used datasets. Mach. Learn. 11 (1993) 63-91
38. C. Blake, E. Keogh, C.J. Merz, UCI repository of machine learning databases, University of California, Irvine, Dept. of Information and Computer Sciences, http://www.ics.uci.edu/mlearn/MLRepository.html, 1998
39. G. Ramos, Nuevos Desarrollos en Aprendizaje Inductivo, Tesis Doctoral, Departamento de Lenguajes y Ciencias de la Computación, Universidad de Málaga, 2001
40. G. Ramos, R. Morales, A new method for induction decision trees by sampling, Neurocolt Workshop on Applications of Learning Theory Bellaterra, Barcelona, 2000