Online entropy-based discretization for data streaming classification

Future Generation Computer Systems

Volumn 86, Issue , 2018, Pages 59-70

  Ramirez Gallego S ^a   Garcia S ^a   Herrera, F ^a,b  

^a UNIVERSITY OF GRANADA   (Spain)

^b KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

Author keywords

Concept drift; Data preprocessing; Data reduction; Data stream; Discretization; Online learning

Indexed keywords

DATA REDUCTION;

CONCEPT DRIFTS; DATA PREPROCESSING; DATA STREAM; DISCRETIZATIONS; ONLINE LEARNING;

DATA MINING;

EID: 85044115449     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2018.03.008     Document Type: Article

References (34)

1. García, S., Luengo, J., Herrera, F., Data Preprocessing in Data Mining. 2015, Springer.
2. García, S., Luengo, J., Herrera, F., Tutorial on practical tips of the most influential data preprocessing algorithms in data mining. Knowl.-Based Syst. 98 (2016), 1–29.
3. Liu, H., Hussain, F., Tan, C.L., Dash, M., Discretization: An enabling technique. Data Mining Knowl. Discov. 6:4 (2002), 393–423.
4. Ramírez-Gallego, S., García, S., Mouriño Talín, H., Martínez-Rego, D., Bolón-Canedo, V., Alonso-Betanzos, A., Benítez, J.M., Herrera, F., Data discretization: Taxonomy and big data challenge. Wiley Interdiscip. Rev.: Data Mining Knowl. Discov. 6:1 (2016), 5–21.
5. Chen, H., Li, T., Luo, C., Horng, S.J., Wang, G., A rough set-based method for updating decision rules on attribute values; coarsening and refining. IEEE Trans. Knowl. Data Eng. 26:12 (2014), 2886–2899.
6. Yang, Y., Webb, G.I., Discretization for Naive-Bayes learning: Managing discretization bias and variance. Mach. Learn. 74:1 (2009), 39–74.
7. Wang, X., He, Y., Wang, D.D., Non-naive bayesian classifiers for classification problems with continuous attributes. IEEE Trans. Cybern. 44:1 (2014), 21–39.
8. Wu, Q., Bell, D., McGinnity, M., Prasad, G., Qi, G., Huang, X., Improvement of decision accuracy using discretization of continuous attributes. Proceedings of the Third International Conference on Fuzzy Systems and Knowledge Discovery, FSKD'06, 2006, Springer-Verlag, Berlin, Heidelberg, 674–683.
9. Lu, J., Zhao, P., Hoi, S.C.H., Online passive-aggressive active learning. Mach. Learn. 103:2 (2016), 141–183.
10. Gama, J., Knowledge Discovery from Data Streams. 2010, Chapman & Hall/CRC.
11. Aufaure, M.-A., Chiky, R., Curé, O., Khrouf, H., Kepeklian, G., From business intelligence to semantic data stream management. Future Gener. Comput. Syst. 63:Supplement C (2016), 100–107 Modeling and Management for Big Data Analytics and Visualization.
12. Ramírez-Gallego, S., Fernández, A., García, S., Chen, M., Herrera, F., Big data: Tutorial and guidelines on information and process fusion for analytics algorithms with MapReduce. Inform. Fusion 42:Supplement C (2018), 51–61.
13. Pears, R., Sakthithasan, S., Koh, Y.S., Detecting concept change in dynamic data streams. Mach. Learn. 97:3 (2014), 259–293.
14. Gama, J., Zliobaite, I., Bifet, A., Pechenizkiy, M., Bouchachia, A., A survey on concept drift adaptation. ACM Comput. Surveys 46:4 (2014), 44:1–44:37.
15. Ramírez-Gallego, S., Krawczyk, B., García, S., Woniak, M., Herrera, F., A survey on data preprocessing for data stream mining: Current status and future directions. Neurocomputing 239 (2017), 39–57.
16. García, S., Luengo, J., Sáez, J.A., López, V., Herrera, F., A survey of discretization techniques: Taxonomy and empirical analysis in supervised learning. IEEE Trans. Knowl. Data Eng. 25:4 (2013), 734–750.
17. Chlebus, B.S., Nguyen, S.H., On finding optimal discretizations for two attributes. Polkowski, L., Skowron, A., (eds.) Rough Sets and Current Trends in Computing: First International Conference, RSCTC'98 Warsaw, Poland, June 22–26, 1998 Proceedings, 1998, Springer Berlin Heidelberg, Berlin, Heidelberg, 537–544.
18. Elomaa, T., Rousu, J., General and efficient multisplitting of numerical attributes. Mach. Learn. 36 (1999), 201–244.
19. Zighed, D.A., Rabaséda, S., Rakotomalala, R., FUSINTER: A method for discretization of continuous attributes. Internat. J. Uncertain. Fuzziness Knowledge-Based Systems 6:3 (1998), 307–326.
20. Gaber, M.M., Advances in data stream mining. Wiley Interdiscip. Rev.: Data Mining Knowl. Discov. 2:1 (2012), 79–85.
21. Tennant, M., Stahl, F.T., Rana, O., Gomes, J.B., Scalable real-time classification of data streams with concept drift. Future Gener. Comput. Syst. 75 (2017), 187–199.
22. Sakthithasan, S., Pears, R., Bifet, A., Pfahringer, B., Use of ensembles of fourier spectra in capturing recurrent concepts in data streams. 2015 International Joint Conference on Neural Networks IJCNN, 2015, 1–8.
23. Krawczyk, B., Minku, L.L., Gama, J., Stefanowski, J., Woźniak, M., Ensemble learning for data stream analysis: A survey. Inform. Fusion 37 (2017), 132–156.
24. Krawczyk, B., Woźniak, M., One-class classifiers with incremental learning and forgetting for data streams with concept drift. Soft Comput. 19:12 (2015), 3387–3400.
25. Webb, G., Contrary to popular belief incremental discretization can be sound, computationally efficient and extremely useful for streaming data. IEEE International Conference on Data Mining, ICDM, 2014, 1031–1036.
26. Ramírez-Gallego, S., García, S., Benítez, J.M., Herrera, F., Multivariate discretization based on evolutionary cut points selection for classification. IEEE Trans. Cybern. 46:3 (2016), 595–608.
27. J. Gama, C. Pinto, Discretization from data streams: Applications to histograms and data mining, in: Proceedings of the 2006 ACM Symposium on Applied Computing, SAC ’06, 2006, pp. 662–667.
28. Lehtinen, P., Saarela, M., Elomaa, T., Online ChiMerge Algorithm. Holmes, D.E., Jain, L.C., (eds.), 2012, Springer Berlin Heidelberg, Berlin, Heidelberg, 199–216.
29. T. Elomaa, P. Lehtinen, Maintaining optimal multi-way splits for numerical attributes in data streams, in: Advances in Knowledge Discovery and Data Mining, 12th Pacific-Asia Conference, PAKDD 2008, Osaka, Japan, May 20–23, 2008 Proceedings, 2008, pp. 544–553.
30. Bifet, A., Holmes, G., Kirkby, R., Pfahringer, B., MOA: Massive online analysis. J. Mach. Learn. Res. 11 (2010), 1601–1604.
31. G. Hulten, L. Spencer, P. Domingos, Mining time-changing data streams, in: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’01, 2001, pp. 97–106.
32. Bifet, A., Kirkby, R., Data Stream Mining: A Practical Approach., 2009, The University of Waikato.
33. García, S., Fernández, A., Luengo, J., Herrera, F., Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power. Inform. Sci. 180:10 (2010), 2044–2064 Special Issue on Intelligent Distributed Information Systems.
34. A. Benavoli, G. Corani, F. Mangili, M. Zaffalon, F. Ruggeri, A bayesian wilcoxon signed-rank test based on the dirichlet process, in: Proceedings of the 31th International Conference on Machine Learning, ICML 2014, 21–26, 2014, pp. 1026–1034.