A Compact Evolutionary Interval-Valued Fuzzy Rule-Based Classification System for the Modeling and Prediction of Real-World Financial Applications with Imbalanced Data

IEEE Transactions on Fuzzy Systems

Volumn 23, Issue 4, 2015, Pages 973-990

  Sanz, Jose Antonio ^a   Bernardo, Dario ^b   Herrera, Francisco ^c,d   Bustince, Humberto ^a   Hagras, Hani ^b  

^a PUBLIC UNIVERSITY OF NAVARRE   (Spain)

^b UNIVERSITY OF ESSEX   (United Kingdom)

^c UNIVERSITY OF GRANADA   (Spain)

^d KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Evolutionary algorithms; financial applications; interval valued fuzzy rule based classification systems; intervalvalued fuzzy sets (IVFSs).

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; DECISION TREES; EVOLUTIONARY ALGORITHMS; FINANCE; FORECASTING; FUZZY RULES; LINGUISTICS; TREES (MATHEMATICS);

ECONOMIC OPPORTUNITIES; FINANCIAL APPLICATIONS; FUZZY RULE BASED CLASSIFICATION SYSTEMS; IMBALANCED DATA-SETS; INTER-VALVALUED FUZZY SETS; MODELING AND PREDICTIONS; PREPROCESSING TECHNIQUES; SYNTHETIC MINORITY OVER-SAMPLING TECHNIQUES;

FUZZY INFERENCE;

EID: 84938795155     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2014.2336263     Document Type: Article

References (66)

1. N. Japkowicz and S. Stephen, "The class imbalance problem:Asystematic study, " Intell. Data Anal., vol. 6, no. 5, pp. 429-450, 2002.
2. C. Phua, D. Alahakoon, and V. Lee, "Minority report in fraud detection: Classification of skewed data, " SIGKDD Explor. Newslett., vol. 6, no. 1, pp. 50-59, 2004.
3. N. V. Chawla, K.W. Bowyer, L. O. Hall, andW. P. Kegelmeyer, "SMOTE: Synthetic minority over-sampling technique, " J. Artif. Intell. Res., vol. 16, pp. 321-357, 2002.
4. J. Wang, M. Xu, H. Wang, and J. Zhang, "Classification of imbalanced data by using the SMOTE algorithm and locally linear embedding, " in Proc. 8th Int. Conf. Signal Process., vol. 3, 2006, pp. 1815-1818.
5. K.Kim, "Financial time series forecasting using support vectormachines, " Neurocomput., vol. 55, no. 1/2, pp. 307-319, 2003.
6. H. S. Kim and S. Y. Sohn, "Support vector machines for default prediction of SMEs based on technology credit, " Eur. J. Oper. Res., vol. 201, no. 3, pp. 838-846, 2010.
7. E. Giacomini, "Neural networks in quantitative finance, " Master thesis, Humboldt-Universität zu Berlin, Berlin, Germany, Inst. Statist. Econometr., 2003.
8. R. Lawrence, "Using neural networks to forecast stock market prices, " Dept. Comput. Sci., Univ. Manitoba, Winnipeg, MB. Canada, Dec. 12, 1997.
9. K. Kwong, "Financial forecasting using neural network or machine learning techniques, " Elect. Eng. Thesis Project, Univ. Queensland, Sch. Inform. Technol. Elect. Eng., Oct. 2001.
10. A. Garcia-Almanza and E. Tsang, "Forecasting stock prices using genetic programming and chance discovery, " in Proc. 12th Int. Conf. Comput. Economics Finance, 2006.
11. A. Garcia-Almanza and E. Tsang, "Evolving decision rules to predict investment opportunities, " Int. J. Autom. Comput., vol. 5, no. 1, pp. 22-31, 2008.
12. A. Garcia-Almanza, "New classification methods for gathering patterns in the context of genetic programming, " Ph.D. dissertation, Dept. Comput. Electron. Syst., Univ. Essex, Colchester, U.K., 2008.
13. R. Nogueira, S. M. Vieira, and J. M. C. Sousa, "The prediction of bankruptcy using fuzzy classifiers, " in Proc. ICSC Congr. Comput. Intell. Methods Appl., 2005, pp. 95-100.
14. V. Snásel, P. Krömer, J. Platos, and A. Abraham, "The evolution of fuzzy classifier for data mining with applications, " in Proc. 8th Int. Conf. Simulated Evol. Learn., 2010, pp. 349-358.
15. Z. Yang and G. Gan, "Application of fuzzy classification in bankruptcy prediction, " in Proc. 4th Int. Conf. Intell. Comput.: Adv. Intell. Comput. Theories Appl.-Aspects Theor. Methodol. Issues, 2008, pp. 921-928.
16. P. Bonissone, "Development and maintenance of fuzzy models in financial applications, " in Soft Methodology and Random Information Systems, M. Lopez-Diaz, M. Gil, P. Grzegorzwski, O. Hyrniewicz, and J. Lawry, Eds. Berlin, Germany: Springer-Verlag, 2004, pp. 50-66.
17. L. Angstenberger, Dynamic Fuzzy Pattern Recognition With Applications to Finance and Engineering. Norwell, MA, USA: Kluwer, 2001.
18. D. Bernardo, H. Hagras, and E. Tsang "An interval type-2 fuzzy logic based system for model generation and summarization of arbitrage opportunities in stock markets" in Proc. 12th U.K. Workshop Comput. Intell., 2012, pp. 1-7.
19. J. Sanz, A. Fernández, H. Bustince, and F. Herrera, "Improving the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets and genetic amplitude tuning, " Inf. Sci., vol. 180, no. 19, pp. 3674-3685, 2010.
20. J. Sanz, A. Fernández, H. Bustince, and F. Herrera, "A genetic tuning to improve the performance of fuzzy rule-based classification systems with interval-valued fuzzy sets: Degree of ignorance and lateral position, " Int. J. Approx. Reason., vol. 52, no. 6, pp. 751-766, 2011.
21. R. Sambuc, "Function-flous, application a l'aide au diagnostic en pathologie thyroidienne, " These de Doctorat en Medicine, Univ. Marseille, Marseille, France, 1975.
22. J. Sanz, A. Fernández, H. Bustince, and F. Herrera, "IVTURS: A linguistic fuzzy rule-based classification system based on a new interval-valued fuzzy reasoning method with tuning and rule selection, " IEEE Trans. Fuzzy Syst., vol. 21, no. 3, pp. 399-411, Jun. 2013.
23. M. Galar, J. Fernandez, G. Beliakov, and H. Bustince, "Interval-valued fuzzy sets applied to stereo matching of color images, " IEEE Trans. Image Process., vol. 20, no. 7, pp. 1949-1961, Jul. 2011.
24. A. Jurio, M. Pagola, D. Paternain, C. Lopez-Molina, and P. Melo-Pinto, "Interval-valued restricted equivalence functions applied on clustering techniques, " in Proc. Joint Int. Fuzzy Syst. Assoc. World Congr. Eur. Soc. Fuzzy Logic Technol. Conf., 2009, pp. 831-836.
25. J. Quinlan, "C4.5: Programs for machine learning, " San Mateo, CA, USA: Morgan Kaufmann, 1993.
26. K. M.Ting, "An instance-weightingmethod to induce cost-sensitive trees, " IEEE Trans. Knowl. Data Eng., vol. 14, no. 3, pp. 659-665, May/Jun. 2002.
27. J. Hühn and E. Hüllermeier, "FURIA: An algorithm for unordered fuzzy rule induction, " Data Mining Knowl. Discovery, vol. 19, no. 3, pp. 293-319, 2009.
28. L. A. Zadeh, "Fuzzy sets, " Inf. Control, vol. 8, no. 3, pp. 338-353, 1965.
29. H. Wong and B. Q. Hu, "Application of interval clustering approach to water quality evaluation, " J. Hydrol., vol. 491, no. 29, pp. 1-12, 2013.
30. J. Sanz, A. Fernández, H. Bustince, and F. Herrera, "IIVFDT: Ignorance functions based interval-valued fuzzy decision tree with genetic tuning, " Int. J. Uncertainty, Fuzziness Knowl.-Based Syst., vol. 20, no. Suppl. 2, pp. 1-30, 2012.
31. M. B. Gorlzakczany, "A method of inference in approximate reasoning based on interval-valued fuzzy sets, " Fuzzy Sets Syst., vol. 21, pp. 1-17, 1987.
32. I. B. Turksen, "Interval valued fuzzy sets based on normal forms, " Fuzzy Sets Syst., vol. 20, no. 2, pp. 191-210, 1986.
33. H. Bustince, E. Barrenechea, and M. Pagola, "Generation of intervalvalued fuzzy and atanassov's intuitionistic fuzzy connectives from fuzzy connectives and from K operators: Laws for conjunctions and disjunctions, amplitude, " Int. J. Intell. Syst., vol. 23, no. 6, pp. 680-714, 2008.
34. H. Bustince, M. Galar, B. Bedregal, A. Kolesarova, and R.Mesiar, "A new approach to interval-valued Choquet integrals and the problem of ordering in interval-valued fuzzy sets applications, " IEEE Trans. Fuzzy Syst., vol. 21, no. 6, pp. 1150-1162, Dec. 2013.
35. H. Bustince, J. Fernandez, A. Kolesárová, and R. Mesiar, "Generation of linear orders for intervals by means of aggregation functions, " Fuzzy Sets Syst., vol. 220, pp. 69-77, 2013.
36. Z. S. Xu and R. R.Yager, "Some geometric aggregation operators based on intuitionistic fuzzy sets, " Int. J. General Syst., vol. 35, no. 4, pp. 417-433, 2006.
37. L. Stefanini, "A generalization of Hukuhara difference and division for interval and fuzzy arithmetic, " Fuzzy Sets Syst., vol. 161, no. 11, pp. 1564-1584, 2010.
38. G. Deschrijver, C. Cornelis, and E. Kerre, "On the representation of intuitionistic fuzzy t-norms and t-conorms, " IEEE Trans. Fuzzy Syst., vol. 12, no. 1, pp. 45-61, Feb. 2004.
39. H. Bustince, E. Barrenechea, andM. Pagola, "Restricted equivalence functions, " Fuzzy Sets Syst., vol. 157, no. 17, pp. 2333-2346, 2006.
40. Q. Yang and X. Wu, "10 challenging problems in data mining research, " Int. J. Inf. Technol. Decision Making, vol. 5, no. 4, pp. 597-604, 2006.
41. V. López, A. Fernández, S. Garcá, V. Palade, and F. Herrera, "An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics, " Inf. Sci., vol. 250, pp. 113-141, 2013.
42. G. M. Weiss, "Mining with rarity: A unifying framework, " SIGKDD Explorations, vol. 6, no. 1, pp. 7-19, 2004.
43. M. Kubat, R. C. Holte, and S.Matwin, "Machine learning for the detection of oil spills in satellite radar images, " Mach. Learn., vol. 30, no. 2-3, pp. 195-215, 1998.
44. J. Alcalá-Fdez, R. Alcala, and F. Herrera, "A fuzzy association rulebased classification model for high-dimensional problems with genetic rule selection and lateral tuning, " IEEE Trans. Fuzzy Syst., vol. 19, no. 5, pp. 857-872, Oct. 2011.
45. J. Han and M. Kamber, Data Mining: Concepts and Techniques, 2nd Ed. San Francisco, CA, USA: Morgan Kaufmann, 2006.
46. C. Zhang and S. Zhang, "Association rule mining: Models and algorithms series, " in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2002.
47. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York, NY, USA: Wiley, 2001.
48. H. Ishibuchi and T. Yamamoto, "Rule weight specification in fuzzy rulebased classification systems, " IEEE Trans. Fuzzy Syst., vol. 13, no. 4, pp. 428-435, Aug. 2005.
49. R. Alcalá, J. Alcalá-Fdez, and F. Herrera, "A proposal for the genetic lateral tuning of linguistic fuzzy systems and its interaction with rule selection, " IEEE Trans. Fuzzy Syst., vol. 15, no. 4, pp. 616-635, Aug. 2007.
50. F. Herrera and L. Martnez, "A 2-tuple fuzzy linguistic representation model for computing with words, " IEEE Trans. Fuzzy Syst., vol. 8, no. 6, pp. 746-752, Dec. 2000.
51. O. Cordón, M. J. del Jesus, and F. Herrera, "Aproposal on reasoning methods in fuzzy rule-based classification systems, " Int. J. Approx. Reason., vol. 20, no. 1, pp. 21-45, 1999.
52. J. Alcalá-Fdez, L. Sánchez, S. Garcá, M. J. del Jesus, S. Ventura, J. Garrell, J. Otero, C. Romero, J. Bacardit, V. Rivas, J. C. Fernández, and F. Herrera, "KEEL: A software tool to assess evolutionary algorithms for data mining problems, " Soft Comput., vol. 13, no. 3, pp. 307-318, 2009.
53. O. Cordón, F. Gomide, F. Herrera, F. Hoffmann, and L. Magdalena, "Ten years of genetic fuzzy systems: Current framework and new trends, " Fuzzy Sets Syst., vol. 141, no. 1, pp. 5-31, 2004.
54. F. Herrera, "Genetic fuzzy systems: Taxonomy, current research trends and prospects, " Evol. Intell., vol. 1, pp. 27-46, 2008.
55. L. Eshelman, "The CHC adaptive search algorithm: How to have safe search when engaging in nontraditional genetic recombination, " in Foundations of Genetic Algorithms. San Mateo, CA, USA: Morgan Kaufman, 1991, pp. 265-283.
56. J. Huang and C. X. Ling, "Using AUC and accuracy in evaluating learning algorithms, " IEEE Trans. Knowl. Data Eng., vol. 17, no. 3, pp. 299-310, Mar. 2005.
57. F. Herrera, M. Lozano, and A.M. Sánchez, "A taxonomy for the crossover operator for real-coded genetic algorithms: An experimental study, " Int. J. Intell. Syst., vol. 18, no. 3, pp. 309-338, 2003.
58. L. J. Eshelman and J. Schafffer, "Real coded genetic algorithms and interval schemata, " in Foundations of Genetic Algorithms. San Mateo, CA, USA: Morgan Kaufman, 1993, pp. 187-202.
59. A. Orriols-Puig and E. Bernadó-Mansilla, "Evolutionary rule-based systems for imbalanced datasets, " Soft Comput., vol. 13, no. 3, pp. 213-225, 2009.
60. J. Demar, "Statistical comparisons of classifiers over multiple data sets, " J. Mach. Learn. Res., vol. 7, pp. 1-30, 2006.
61. S. Garcá, A. Fernández, J. Luengo, and F. Herrera, "Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power, " Inf. Sci., vol. 180, no. 10, pp. 2044-2064, 2010.
62. J. L. Hodges and E. L. Lehmann, "Ranks methods for combination of independent experiments in analysis of variance, " Ann. Math. Statist., vol. 33, pp. 482-497, 1962.
63. S. Holm, "A simple sequentially rejective multiple test procedure, " Scandinavian J. Statist., vol. 6, pp. 65-70, 1979.
64. M. Galar, A. Fernández, E. Barrenechea, H. Bustince, and F. Herrera, "An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes, " Pattern Recog., vol. 44, no. 8, pp. 1761-1776, 2011.
65. A. Fernández, V. López, M. Galar, M. J. del Jesus, and F. Herrera, "Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approaches, " Knowl.-Based Syst., vol. 42, pp. 97-110, 2013.
66. M.Wózniak, M. Graña, and E. Corchado, "A survey of multiple classifier systems as hybrid systems, " Inf. Fusion, vol. 16, pp. 3-17, 2014.