Rough neuro-fuzzy structures for classification with missing data

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 39, Issue 6, 2009, Pages 1334-1347

  Nowicki, R ^a,b  

^a CZESTOCHOWA UNIVERSITY OF TECHNOLOGY   (Poland)

^b Wyzsza Szkola Humanistyczno Ekonomiczna w Lodzi   (Poland)

Author keywords

Approximation methods; Classification; Fuzzy set theory; Fuzzy sets; Missing data; Neuro fuzzy architectures; Rough sets; Set theory

Indexed keywords

APPROXIMATION METHODS; CLASSIFICATION; MISSING DATA; NEURO-FUZZY ARCHITECTURES; ROUGH SETS;

APPROXIMATION THEORY; CLASSIFIERS; FUZZY LOGIC; FUZZY SETS; LEARNING SYSTEMS;

ROUGH SET THEORY;

EID: 70349622013     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2012504     Document Type: Article

References (77)

1. D. Boixader, J. Jacas, and J. Recasens, "Upper and lower approximation of fuzzy sets," Int. J. Gen. Syst., vol. 29, pp. 555-568, 2000.
2. P. M. T. Broersen and R. Bos, "Time-series analysis if data are randomly missing," IEEE Trans. Instrum. Meas., vol. 55, no. 1, pp. 79.84, Feb. 2006.
3. P. M. T. Broersen, S. deWaele, and R. Bos, "Application of autoregressive spectral analysis to missing data problems," IEEE Trans. Instrum. Meas. vol. 53, no. 4, pp. 981-986, Aug. 2004.
4. L. S. Chan and O. J. Dun, "Alternative approaches to missing values in discriminant analysis," J. Amer. Stat. Assoc., vol. 71, pp. 842-844, 1976.
5. M. Cooke, P. Green, L. Josifovski, and A. Vizinho, "Robust automatic speech recognition with missing and unreliable acoustic data," Speech Commun., vol. 34, no. 3, pp. 267-285, Jun. 2001.
6. O. Cordon, M. J. del Jesus, and F. Herrera, "A proposal on reasoning methods in fuzzy rule-based classification systems," Int. J. Approx. Reason., vol. 20, no. 1, pp. 21-45, Jan. 1999.
7. E. Czogacca and J. Łcêski, Fuzzy and Neuro-Fuzzy Intelligent Systems. Heidelberg, Germany: Physica-Verlag, 2000.
8. E. Czogala and H. Roderer, "On the control of allpass components using conventional, fuzzy and rough fuzzy controllers," in Proc. IEEE Int. Conf. Fuzzy Syst., Int. Joint Conf. 4th IEEE Int. Conf. Fuzzy Syst. 2nd Int. Fuzzy Eng. Symp., 1995, vol. 3, pp. 1405-1412.
9. J. K. Dixon, "Pattern recognition with partly missing data," IEEE Trans. Syst., Man, Cybern., vol. SMC-9, no. 10, pp. 617.621, Oct. 1979.
10. D. Dubois and H. Prade, "Rough fuzzy sets and fuzzy rough sets," Int. J. Gen. Syst., vol. 17, no. 2/3, pp. 191-209, 1990.
11. D. Dubois and H. Prade, "Putting rough sets and fuzzy sets together," in Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory, R. Słowiñski, Ed. Dordrecht, The Netherlands: Kluwer, 1992, pp. 203-232.
12. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York: Wiley-Interscience, 2001.
13. J. C. Fodor, "On fuzzy implication," Fuzzy Sets Syst., vol. 42, no. 3, pp. 293-300, Aug. 1991.
14. T. R. Gabriel and M. R. Berthold, "Missing values in fuzzy rule induction," in Proc. IEEE Int. Conf. Syst., Man Cybern., 2005, vol. 2, pp. 1473-1476.
15. S. Greco, B. Matarazzo, and R. Słowiñski, "Rough set processing of vague information using fuzzy similarity relations," in Finite Versus Infinite - Contributions to an Eternal Dilemma, C. S. Calude and G. Paun, Eds. London, U.K.: Springer-Verlag, 2000, pp. 149-173.
16. J. W. Grzymala-Busse, "An overview of the LERS1 learning systems," in Proc. 2nd Int. Conf. Ind. Eng. Appl. Artif. Intell. Expert Syst., 1989, pp. 838-844.
17. J. W. Grzymala-Busse, "LERS -_A system for learning from examples based on rough sets," in Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory, R. Slowinski, Ed. Dordrecht, The Netherlands: Kluwer, 1992, pp. 3-18.
18. H. Ishibuchi, A. Miyazaki, K. Kwon, and H. Tanaka, "Learning form incomplete training data with missing values and medical application," in Proc. IJCNN, Nagoya, Japan, 1993, vol. 2, pp. 1871-1874.
19. H. Ishibuchi, T. Nakashima, and M. Nii, Classification and Modeling With Linguistic Information Granules: Advances Approaches to Linguistic Data Mining. Berlin, Germany: Springer-Verlag, Nov. 2004.
20. H. Ishibuchi, K. Nozaki, and H. Tanaka, "Distributed representation of fuzzy rules and its application to pattern classification," Fuzzy Sets Syst., vol. 52, no. 1, pp. 21-32, Nov. 1992.
21. R. Jensen and Q. Shen, "Fuzzy rough sets for descriptive dimensionality reduction," in Proc. IEEE Int. Conf. Fuzzy Syst., 2002, vol. 1, pp. 29-34.
22. R. Jensen and Q. Shen, "Semantics-preserving dimensionality reduction: Rough and fuzzy-rough-based approaches," IEEE Trans. Knowl. Data Eng., vol. 16, no. 12, pp. 1457-1471, Dec. 2004.
23. R. Jensen and Q. Shen, "Fuzzy-rough sets assisted attribute selection," IEEE Trans. Fuzzy Syst., vol. 15, no. 1, pp. 73-89, Feb. 2007.
24. N. Kasabov, Foundations of Neural Networks, Fuzzy Systems and Knowledge Engineering. Cambridge, MA: MIT Press, 1996, p. 550.
25. N. Kasabov, "Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems," Fuzzy Sets Syst., vol. 82, no. 2, pp. 135-149, Sep. 1996.
26. V. Kecman, Learning and Soft Computing, Support Vector Machines, Neural Networks and Fuzzy Logic Models. Cambridge, MA: MIT Press, 2001.
27. E. P. Klement, R. Mesiar, and E. Pap, Triangular Norms. Dordrecht, The Netherlands: Kluwer, 2000.
28. L. I. Kuncheva, Fuzzy Classifier Design. Studies in Fuzziness and Soft Computing. Heidelberg, Germany: Physica-Verlag, 2000.
29. K. M. Lee and D. H. Kwang, "A fuzzy neural network model for fuzzy inference and rule tuning," Int. J. Uncertain. Fuzziness Knowl.-Based Syst., vol. 2, no. 3, pp. 265-277, 1994.
30. L. Lei, W. Naijun, and L. Peng, "Applying sensitivity analysis to missing data in classifiers," in Proc. ICSSSM, 2005, vol. 2, pp. 1051-1056.
31. C.-T. Lin and C. S. G. Lee, "Neural-network-based fuzzy logic control and decision system," IEEE Trans. Comput., vol. 40, no. 12, pp. 1320-1336, Dec. 1991.
32. R. J. A. Little and D. B. Rubin, Statistical Analysis With Missing Data, 2nd ed. New York: Wiley-Interscience, 2002.
33. J.-X. Luo and H.-H. Shao, "A neurofuzzy system based on rough set theory and genetic algorithms," in Proc. Int. Conf. Mach. Learn. Cybern., 2003, vol. 2, pp. 1147-1152.
34. J. M. Mendel, Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions. Upper Saddle River, NJ: Prentice-Hall, 2001.
35. C. J. Mertz and P. M.Murphy, UCI Respository of Machine Learning Databases. [Online]. Available: http://www.ics.uci.edu/pub/ machinelearning-databases
36. R. L. Morin and D. E. Raeside, "A reappraisal of distance-weighted k-nearest neighbor classification for pattern recognition with missing data," IEEE Trans. Syst., Man, Cybern., vol. SMC-11, no. 3, pp. 241-243, Mar. 1981.
37. A. Nakamura, "Fuzzy rough sets," Note Multiple-Valued Logic Jpn. vol. 9, no. 8, pp. 1-8, 1988.
38. D. Nauck, F. Klawonn, and R. Kruse, Foundations of Neuro-Fuzzy Systems. New York: Wiley, 1997.
39. D. Nauck and R. Kruse, "Learning in neuro-fuzzy systems with symbolic attributes and missing values," in Proc. 6th ICONIP, 1999, vol. 1, pp. 142-147.
40. R. Nowicki, Rough Sets in the Neuro-Fuzzy Architectures Based on Monotonic Fuzzy Implications, vol. 3070. Berlin, Germany: Springer-Verlag, 2004, pp. 510-517.
41. R. Nowicki, Rough Sets in the Neuro-Fuzzy Architectures Based on Non-Monotonic Fuzzy Implications, vol. 3070. Berlin, Germany: Springer-Verlag, 2004, pp. 518-525.
42. R. Nowicki, "On combining neuro-fuzzy architectures with the rough set theory to solve classification problems with incomplete data," IEEE Trans. Knowl. Data Eng., vol. 20, no. 9, pp. 1239-1253, Sep. 2008.
43. R. Nowicki and A. Pokropińska, "Information Criterions Applied to Neuro-Fuzzy Architectures Design," in Lecture Notes in Artificial Intelligence, vol. 3070. Berlin, Germany: Springer-Verlag, 2004, pp. 332-337.
44. R. Nowicki and A. Pokropińska, "On Designing of Neuro-Fuzzy Systems," in Lecture Notes in Computer Science, vol. 3019. Berlin, Germany: Springer-Verlag, 2004, pp. 641-649.
45. R. Nowicki and D. Rutkowska, "Fuzzy inference neural networks based on destructive and constructive approaches and their application to classification," in Proc. 4th Conf. Neural Netw. Appl., Czeçstochowa, Poland, 1999, pp. 294-301.
46. R. Nowicki and D. Rutkowska, "Competitive learning of neuro-fuzzy systems," in Proc. 9th Zittau Fuzzy Colloq., Zittau, Germany, Sep. 17-19, 2001, pp. 207-213.
47. R. Nowicki, R. Scherer, and L. Rutkowski, "A method for learning of hierarchical fuzzy systems," in Intelligent Technologies - Theory and Applications, P. Siněák, J. Vaščák, V. Kvasniěka, and J. Pospíchal, Eds. Amsterdam, The Netherlands: IOS, 2002, vol. 76, pp. 124-129.
48. M. Pawlak, "Kernel classification rules from missing data," IEEE Trans. Inf. Theory, vol. 39, no. 3, pp. 979-988, May 1993.
49. Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning About Data Dordrecht, The Netherlands: Kluwer, 1991.
50. W. Pedrycz and A. Bargiela, "Granular clustering: A granular signature of data," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 2, pp. 212-224, Apr. 2002.
51. W. Pedrycz and F. Gomide, "An Introduction to Fuzzy Sets. Analysis and Design," in A Bradford Book. Cambridge, MA: MIT Press, 1998.
52. L. Peng, L. Lei, and W. Naijun, "A quantitative study of the effect of missing data in classifiers," in Proc. 5th Int. Conf. CIT, 2005, pp. 28-33.
53. L. Polkowski, Rough Sets. Mathematical Foundation. Heidelberg, Germany: Physica-Verlag, 2002.
54. Y. Qiang, C. Ling, C. Xiaoyong, and P. Rong, "Test-cost sensitive classification on data with missing values," IEEE Trans. Knowl. Data Eng., vol. 18, no. 5, pp. 626-638, May 2006.
55. A. M. Radzikowska and E. E. Kerre, "A comparative study of fuzzy rough sets," Fuzzy Sets Syst., vol. 126, no. 2, pp. 137-155, Mar. 2002.
56. C. Renz, J. C. Rajapakse, K. Razvi, and S. K. C. Liang, "Ovarian cancer classification with missing data," in Proc. 9th ICONIP, 2002, vol. 2, pp. 809-813.
57. T. J. Ross, Fuzzy Logic With Engineering Applications. New York: Wiley, 2004.
58. D. Rutkowska and R. Nowicki, "Constructive and destructive approach to neuro fuzzy systems," in Proc. EUROFUSE SIC. Budapest, Hungary, 1999, pp. 100-105.
59. D. Rutkowska and R. Nowicki, "Implication-based neuro-fuzzy architectures," Int. J. Appl. Math. Comput. Sci., vol. 10, no. 4, pp. 675-701, 2000.
60. L. Rutkowski, Flexible Neuro-Fuzzy Systems: Structures, Learning and Performance Evaluation. Norwell, MA: Kluwer, 2004.
61. L. Rutkowski and K. Cpalka, "Designing and learning of adjustable quasitriangular norms with applications to neuro-fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 13, no. 1, pp. 140-151, Feb. 2005.
62. M. Sarkar, "Rough-fuzzy functions in classification," Fuzzy Sets Syst., vol. 132, no. 2, pp. 353-369, Dec. 2002.
63. M. Sarkar and B. Yegnanarayana, "Rough fuzzy set theoretic approach to evaluate the importance of input features in classification," in Proc. ICNN, Houston, TX, Jun. 1997, pp. 1590-1595.
64. M. Sarkar and B. Yegnanarayana, "Application of fuzzy-rough sets in modular neural networks," in Proc. IEEE World Congr. Comput. Intell. Anchorage, AK, May 1998, pp. 741-746.
65. M. Sarkar and B. Yegnanarayana, "Fuzzy-rough neural networks for vowel classification," in Proc. IEEE Int. Conf. Syst., Man, Cybern., San Diego, CA, Oct. 1998, pp. 11-14.
66. M. Sarkar and B. Yegnanarayana, "Rough-fuzzy membership functions," in Proc. IEEE World Congr. Comput. Intell., Anchorage, AK, May 1998, pp. 796-801.
67. R. Scherer, Boosting Ensemble of Relational Neuro-Fuzzy Systems, vol. 4029. Berlin, Germany: Springer-Verlag, 2006, pp. 310-317.
68. G. Shafer, A Mathematical Theory of Evidence. Princeton, NJ: Princeton Univ. Press, 1976.
69. Z. Shichao, Z. Qin, C. X. Ling, and S. Sheng, "Missing is useful': Missing values in cost-sensitive decision trees," IEEE Trans. Knowl. Data Eng., vol. 17, no. 12, pp. 1689-1693, Dec. 2005.
70. M. Tanaka, Y. Kotokawa, and T. Tanino, "Pattern classification by stochastic neural network with missing data," in Proc. IEEE Int. Conf. Syst., Man Cybern., 1996, vol. 1, pp. 690-695.
71. H. Thiele, "Fuzzy rough sets versus rough fuzzy sets - An interpretation and a comparative study using concepts of modal logics," in Proc. EUFIT, 1997, pp. 159-167.
72. L. X. Wang, Adaptive Fuzzy Systems and Control. Englewood Cliffs, NJ: Prentice-Hall, 1994.
73. L. X. Wang and J. M. Mendel, "Generating fuzzy rules by learning from examples," IEEE Trans. Syst., Man, Cybern., vol. 22, no. 6, pp. 1414-1427, Nov./Dec. 1992.
74. D. S. Yeung, D. Chen, E. C. C. Tsang, J. W. T. Lee, and W. Xizhao, "On the generalization of fuzzy rough sets," IEEE Trans. Fuzzy Syst., vol. 13, no. 3, pp. 343-361, Jun. 2005.
75. L. A. Zadeh, "Fuzzy sets," Inf. Control, vol. 8, pp. 338-353, 1965.
76. W. Zhu and F. Y. Wang, "Reduction and axiomization of covering generalized rough sets," Inf. Sci., vol. 152, no. 1, pp. 217-230, Jun. 2003.
77. W. Zhu and F. Y. Wang, "On three types of covering-based rough sets," IEEE Trans. Knowl. Data Eng., vol. 19, no. 8, pp. 1131-1144, Aug. 2007.