Rule Based Systems for Big Data: A Machine Learning Approach

Rule Based Systems for Big Data: A Machine Learning Approach

Volumn 13, Issue , 2015, Pages 1-121

  Liu, Han ^a   Gegov, Alexander ^a   Cocea, Mihaela ^a  

^a UNIVERSITY OF PORTSMOUTH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BIG DATA; EXPERT SYSTEMS; LEARNING SYSTEMS;

ENSEMBLE LEARNING; EXPERT KNOWLEDGE; INTERPRETABILITY; MACHINE LEARNING APPROACHES; RULE GENERATION; RULE REPRESENTATION; UNIFIED FRAMEWORK;

EDUCATION;

EID: 84955415014     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-319-23696-4     Document Type: Book

References (170)

1. Partridge, D., Hussain, K.M.: Knowledge Based Information Systems. Mc-Graw Hill, London (1994)
2. Quinlan, J.R.: C 4.5: Programs for Machine Learning. Morgan Kaufman, San Mateo (1993)
3. Furnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3-54 (1999)
4. Cendrowska, J.: PRISM: an algorithm for inducing modular rules. Int. J. Man Mach. Stud. 27, 349-370 (1987)
5. Schaffer, C.: Overfitting avoidance as bias. Mach. Learn. 10, 153-178 (1993)
6. Wolpert, D.H.: On Overfitting Avoidance as Bias. Santa Fe, NM (1993)
7. Smyth, P., Rodney, G.M.: An information theoretic approach to rule induction from databases. IEEE Trans. Knowl. Data Eng. 4(4), 301-316 (1992)
8. Brain, D.: Learning From Large Data: Bias, Variance, Sampling, and Learning Curves. Deakin University, Victoria (2003)
9. Kerber, R.: ChiMerge: discretization of numeric attribute. In Proceeding of the 10th National Conference on Artificial Intelligence (1992)
10. Altman, N.S.: An introduction to kernel and nearest-neighbour nonparametric regression. Am. Stat. 46(3), 175-185 (1992)
11. Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson Education Inc, New Jersey (2006)
12. Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Section 16.5. support vector machines. In Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press, New York (2007)
13. Jolliffe, I.T.: Principal component analysis. Springer, New York (2002)
14. Yu, H., Yang, J.: A direct LDA algorithm for high diomensional data-with application to face recognition. Pattern Recogn. 34(10), 2067-2069 (2001)
15. Azhagusundari, B., Thanamani, A.S.: Feature selection based on information gain. Int. J. Innovative Technol Exploring Eng. 2(2), 18-21 (2013)
16. Yates, D.S., David, S.M., Daren, S.S.: The Practice of Statistics, 3rd edn. Freeman, New York (2008)
17. Deming, W.E.: On probability as a basis for action. Am. Stat. 29(4), 146-152 (1975)
18. Kerry and Bland: Statistics notes: the intracluster correlation coefficient in cluster randomisation. Br. Med. J. 316, 1455-1460 (1998)
19. Higgins, C.M.: Classification and Approximation with Rule-Based Networks. California Institute of Technology, California (1993)
20. Uttley, A.M.: The design of conditional probability computers. Inf. Control 2, 1-24 (1959)
21. Kononenko, I.: Baysain neural networks. Biol. Cybern. 61, 361-370 (1989)
22. Rosenblatt, F.: Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms. Spartan Books, Washington, DC (1962)
23. Ekeberg, O., Lansner, A.: Automatic generation of internal representations in a probabilistic artificial neural network. In Proceedings of First European Conference on Neural Networks (1988)
24. Liu, H., Gegov, A., Stahl, F.: Categorization and construction of rule based systems. In 15th International Conference on Engineering Applications of Neural Networks, Sofia (2014)
25. Gegov, A.: Fuzzy Networks for Complex Systems: A Modular Rule Base Approach. Springer, Berlin (2010)
26. Kononenko, I., Kukar, M.: Machine Learning and Data Mining: Introduction to Principles and Algorithms. Horwood Publishing Limited, Chichester, West Sussex (2007)
27. Ross, T.J.: Fuzzy logic with engineering applications, 2nd edn. Wiley, West Sussex (2004)
28. Schneider, S.: The B-Method: an introduction. Palgrave Macmillian, Basingstoke, New York (2001)
29. Aho, A.V., Hopcroft, J.E., Ullman, J.D.: Data structures and algorithms. Addison-Wesley, Boston (1983)
30. Murdoch, J., Barnes, J.A.: Statistics: problems and solutions. The Macmillan Press Ltd, London and Basingstoke (1973)
31. Hazewinkel, M. (ed.): Bayes formula. Springer, Berlin (2001)
32. Gegov, A.: Advanced computation models for rule based networks, Portsmouth (2013)
33. Shannon, C.: A mathematical theory of communication. Bell Syst. Tech. J. 27(3), 379-423 (1948)
34. Smyth, P., Rodney, G.M.: An information theoretic approach to rule induction from databases. IEEE Trans. Knowl. Data Eng. 4(4), 301-316 (1992)
35. Blachman, N.M.: The amount of information that y gives about X. IEEE Transcations. Inf. Theory. 14(1), 27-31 (1968)
36. Agrawal, R., Imilielinski, T., Swami, A.: Mining association rules between sets of items in large databases. In: Proceedings of ACM SIGMOD International Conference on Management of Data, Washington D.C (1993)
37. Brin, S., Motwani, R., Ullman, J.D., Tsur, S.: Dynamic itemset counting and implication rules for market basket data. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, Tucson, Arizona (1997)
38. Hahsler, M.: A proabalistic comparison of commonly used interest measures for association rules. Available: http://michael.hahsler.net/research/association_rules/measures.html (2015) (Online)
39. Piatetsky-Shapiro, G.: Discovery, analysis, and presentation of strong rules. In:Piatetsky-Shapiro, G., Frawley, W.J. (eds.) Knowledge Discovery in Databases. MA, AAAI/MIT Press, Cambridge (1991)
40. Tan, P.-N., Kumar, V., Srivastava, J.: Selecting the right objective measure for association analysis. Inf. Syst. 29(4), 293-313 (2004)
41. Geng, L., Hamilton, H.J.: Interestingness measures for data mining: a survey. ACM Computing Surveys, vol. 38, no. 3 (2006)
42. Liu, H., Gegov, A., Stahl, F.: Unified framework for construction of rule based classification systems. In: Pedrycz, W., Chen, S. (eds.) Inforamtion Granularity, Big Data and Computational Intelligence, vol. 8, pp. 209-230. Springer, Berlin (2015)
43. Furnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3-54 (1999)
44. Stichweh, R.: Systems theory. In: Badie, B.E.A. (ed.) International Encyclopaedia of Political Science, New York, Sage (2011)
45. Liu, H., Gegov, A.: Collaborative decision making by ensemble rule based classification systems. In: Pedrycz, W., Chen, S. (eds.) Granular Computing and Decision-Making:Interactive and Iterative Approaches, vol. 10, pp. 245-264. Springer, Berlin (2015)
46. Breiman, L.: Random forests. Mach. Learn. 45(1), 5-32 (2001)
47. Kononenko, I., Kukar, M.: Machine Learning and Data Mining: Introduction to Principles and Algorithms. Horwood Publishing Limited, Chichester, West Sussex (2007)
48. Li, J., Liu, Y., Liao, W.-K., Choudhary, A.: Parallel data mining algorithms for association rules and clustering. CRC Press, Boca Raton (2006)
49. Parthasarathy, S., Zaki, M.J., Ogihara, M., Li, W.: Parallel data mining for association rules on shared-memory systems. Knowl. Inf. Syst. 3, 1-29 (2001)
50. Giannella, C., Bhargava, R., Kargupta, H.: Multi-agent systems and distributed data mining. In: Cooperative Information Agents VIII, Berlin (2004)
51. Datta, S., Bhaduri, K., Giannella, C., Wolff, R., Kargupta, H.: Distributed data mining in peer-to-peer networks. IEEE. Internet. Comput. 10(4), 18-26 (2006)
52. Gaber, M.M., Stahl, F., Gomes, J.B.: Pocket data mining: big data on small devices, vol. 2. Springer, Switzerland (2014)
53. Gaber, M.: Pocket data mining: the next generation in predictive analytics. In: Predictive Analytics Innovation Summit, London (2012)
54. Kononenko, I., Kukar, M.: Machine Learning and Data Mining: Introduction to Principles and Algorithms. Horwood Publishing Limited, Chichester, West Sussex (2007)
55. Han, J., Kamber, M.: Data Mining: Concept and Techniques, 2nd edn. Morgan Kaufmann Publishers, San Francisco (2006)
56. Quinlan, R.: Induction of decision trees. Mach. Learn. 1, 81-106 (1986)
57. Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and Regression Trees. Wadsworth International Group, Belmont (1984)
58. Cendrowska, J.: PRISM: an algorithm for inducing modular rules. Int. J. Man Mach. Stud. 27, 349-370 (1987)
59. Liu, H., Gegov, A.: Induction of modular classification rules by information entropy based rule generation. In: Sgurev, V., Yager, R., Kacprzyk, J., Jotsov, V. (eds.) Innovative Issues in Intelligent Systems. Springer, Berlin (in press)
60. Lichman, M.: UCI machine learning repository, University Of California, School of Information and Computer Science. http://archive.ics.uci.edu/ml 2013. Accessed 12 May 2015 (online)
61. Deng, X.: A covering-based algorithm for classification: PRISM, SK (2012)
62. Liu, H., Gegov, A., Cocea, M.: Network based rule representation for knowledge discovery and predictive modelling. In: IEEE International Conference on Fuzzy Systems, Istanbul (2015)
63. Liu, H., Gegov, A., Stahl, F.: Unified framework for construction of rule based classification systems. In: Pedrycz, W., Chen, S. (eds.) Information Granularity, Big Data and Computational Intelligence, vol. 8, pp. 209-230. Springer, Berlin (2015)
64. Liu, H., Gegov, A.: Collaborative decision making by ensemble rule based classification systems. In: Pedrycz, W., Chen, S. (eds.) Granular Computing and Decision-Making:Interactive and Iterative Approaches, vol. 10, pp. 245-264. Springer, Berlin (2015)
65. Liu, H., Gegov, A., Stahl, F.: Categorization and construction of rule based systems. In: 15th International Conference on Engineering Applications of Neural Networks, Sofia (2014)
66. Higgins, C.M.: Classification and Approximation with Rule-Based Networks. California (1993)
67. Smyth, P., Rodney, G.M.: An information theoretic approach to rule induction from databases. IEEE Trans. Knowl. Data Eng. 4(4), 301-316 (1992)
68. Liu, H., Gegov, A., Stahl, F.: J-measure based hybrid pruning for complexity reduction in classification rules. WSEAS Trans. Syst. 12(9), 433-446 (2013)
69. Kononenko, I., Kukar, M.: Machine Learning and Data Mining: Introduction to Principles and Algorithms, Chichester. Horwood Publishing Limited, West Sussex (2007)
70. Furnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3-54 (1999)
71. Cendrowska, J.: PRISM: an algorithm for inducing modular rules. Int. J. Man Mach. Stud. 27, 349-370 (1987)
72. Deng, X.: A covering-based algorithm for classification: PRISM, SK (2012)
73. Gegov, A.: Complexity Management in Fuzzy Systems. Springer, Berlin (2007)
74. Furnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3-54 (1999)
75. Quinlan, J.R.: C 4.5: Programs for Machine Learning. Morgan Kaufman, San Mateo (1993)
76. Holland, A.: Lecture 2: Rules Based Systems (2010)
77. Higgins, C.M.: Classification and Approximation with Rule-Based Networks. California (1993)
78. Liu, H., Gegov, A., Cocea, M.: Network based rule representation for knowledge discovery and predictive modelling. In: IEEE International Conference on Fuzzy Systems, Istanbul (2015)
79. Liu, H., Gegov, A., Stahl, F.: Unified framework for construction of rule based classification systems. In: Pedrycz, W., Chen, S. (eds.) Information Granularity, Big Data and Computational Intelligence, vol. 8, pp. 209-230. Springer (2015)
80. Breiman, L.: Bagging predictors. Mach. Learn. 24(2), 123-140 (1996)
81. Kononenko, I., Kukar, M.: Machine Learning and Data Mining: Introduction to Principles and Algorithms, Chichester. Horwood Publishing Limited, West Sussex (2007)
82. Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson Education Inc, New Jersey (2006)
83. Breiman, L.: Random forests. Mach. Learn. 45(1), 5-32 (2001)
84. Li, J., Wong, L.: Rule based data mining methods for classification problems in biomedical domains. In: 15th European Conference on Machine Learning and 8th European Conference on Principles and Practice of Knowledge Discovery in Databases, Pisa (2004)
85. Liu, H., Gegov, A.: Collaborative decision making by ensemble rule based classification systems. In: Pedrycz, W., Chen, S. (eds.) Granular Computing and Decision-Making:Interactive and Iterative Approaches, vol. 10, pp. 245-264. Springer, (2015)
86. Freund, Y., Schapire, R.E.: A short introduction to boosting. J. Japan. Soc. Artif. Intell. 14(5), 771-780 (1999)
87. Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55(1), 119-139 (1997)
88. Freund, Y., Schapire, R.E.: Experiments with a new boosting algorithm. In: Machine Learning: Proceedings of the Thirteenth International Conference, Bari (1996)
89. Liu, H., Gegov, A., Cocea, M.: Hybrid ensemble learning approach for generation of classification rules. In: International Conference on Machine Learning and Cybernetics, Guangzhou (2015)
90. Stahl, F., Jordanov, I.: An overview on the use of neural networks for data mining. WIREs Data Min. Knowl. Disc. 3(2), 193-208 (2012)
91. Furnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3-54 (1999)
92. What is Big Data.: SAS Institute Inc, (Online). Available: http://www.sas.com/big-data/. (Accessed 17 May 2015)
93. Master Data Management for Big Data.: IBM, (Online). Available: http://www-01.ibm.com/ software/data/infosphere/mdm-big-data/. (Accessed 17 May 2015)
94. Levine, P.: Machine Learning + Big Data. WorldPress, (Online). Available: http://a16z.com/ 2015/01/22/machine-learning-big-data/. (Accessed 15 May 2015)
95. Tan, P.N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson Education Inc, New Jersey (2006)
96. Machine Learning on Big Data.: EBTIC, 19 August 2014. (Online). Available: http://www. ebtic.org/pages/ebtic-view/ebtic-view-details/machine-learning-on-big-data-d/687. (Accessed 15 May 2015)
97. Banko, M., Brill, E.: Scaling to very very large corpora for natural language disambiguation. In: Proceedings of the 39th Annual Meeting on Association for Computational Linguistics (2001)
98. Li, J., Liu, H.: Kent Ridge Bio-medical Dataset, I2R Data Mining Department, 2003. (Online). Available: http://datam.i2r.a-star.edu.sg/datasets/krbd/. (Accessed 18 May 2015)
99. Lichman, M.: UCI Machine Learning Repository. University of California, School of Information and Computer Science, 2013. (Online). Available: http://archive.ics.uci.edu/ml. (Accessed 12 May 2015)
100. Vlachos, P.: StatLib-Datasets Archive. Carnegie Mellon University, 19 July 2005. (Online). Available: http://lib.stat.cmu.edu/datasets/. (Accessed 18 May 2015)
101. Lim, T.-S. Loh, W.-Y., Shih, Y.-S.: A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms. Mach. Learn. 40:203-229 (2000)
102. Schlimmer, J.: Concept Acquisition Through Representational Adjustment. Irvine, CA (1987)
103. Shapiro, A.D.: Structured Induction in Expert Systems. Turing Institute Press in association with, Addison-Wesley (1987)
104. Muggleton, S.: Structuring knowledge by asking questions. In: Bratko, I., Lavrac, N. (eds.) Progress in Machine Learning, pp. 218-229. Sigma Press, Wilmslow (1987)
105. Holte, R.C., Acker, L., Porter, B.W.: Concept learning and the problem of small disjuncts. In:International Joint Conference on Artificial Intelligence, Detroit (1989)
106. Horto, P., Nakai, K.: A Probablistic classification system for predicting the cellular localization sites of proteins. Intell. Syst. Mol. Biol. St. Louis. 4:109-115 (1996)
107. Bareiss, R.E., Porter, B.: Protos: an exemplar-based learning apprentice. In: The 4th International Workshop on Machine Learning, Irvine, CA (1987)
108. Bohanec, M., Rajkovic, V.: Knowledge acquisition and explanation for multi-attribute decision making. In: 8th International Workshop on Expert Systems and their Applications, Avignon (1988)
109. Zupan, B., Bohanec, M., Bratko, I., Demsar, J.: Machine learning by function decomposition. In: International Conference on Machine Learning, Nashville (1997)
110. Kaynak, C.: Methods of Combining Multiple Classifiers and Their Applications to Handwritten Digit Recognition (1995)
111. Alpaydin, E., Kaynak, C.: Cascaded classifiers. Kybernetika 34, 369-374 (1998)
112. Evett, I.W., Spiehler, E.J.: Rule Induction in Forensic Science. Reading (1987)
113. Cestnik, G., Konenenko, I., Bratko, I.: Assistant-86: A knowledge-elicitation tool for sophisticated users. In: Bratko, I., Lavrac, N. (eds.) Progress in Machine Learning, pp. 31-45. Sigma Press, New York (1987)
114. Clark, P., Niblett, T.: Induction in noisy domains. In: Progress in Machine Learning, pp. 11-30. Sigma Press, UK (1987)
115. Michalski, R., Mozetic, I., Hong, J., Lavrac, N.: The multi-purpose incremental learning system AQ15 and its testing applications to three medical domains. In The Fifth National Conference on Artificial Intelligence, Philadelphia, PA (1986)
116. Nakai, K., Kanehisa, M.: Expert system for predicting protein localization sites in gram-negative bacteria. PROTEINS Struct. Funct. Genet. 11, 95-110 (1991)
117. Nakai, K., Kanehisa, M.: A knowledge base for predicting protein localization sites in eukaryotic cells. Genomics 14, 897-911 (1992)
118. Simonoff, J.S.: Analyzing Categorical Data. Springer, New York (2003)
119. Greaney, V., Kelleghan, T.: Equality of Opportunity in Irish. Educational Company, Dublin (1984)
120. Raftery, A.E., Hout, M.: Does Irish education approach the meritocratic ideal? A logistic analysis. Econ. Soc. Rev 16, 115-140 (1985)
121. Raftery, A.E., Hout, M.: Maximally maintained inequality: expansion, reform and opportunity in Irish schools. Sociol. Educ. 66, 41-62 (1993)
122. Quinlan, J.R.: C 4.5: Programs for Machine Learning, Morgan Kaufman, San Mateo (1993)
123. Ross, Q.: Simplifying decision trees. Int. J. Man-Mach. Stud. 51:221-234 (27 December 1987)
124. Diaconis, P., Efron, B.: Computer-Intensive Methods in Statistics, vol. 248. Scientific American, Pasadena, CA (1983)
125. Hong, Z.Q., Yang, J.Y.: Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recogn. 24(4), 317-324 (1991)
126. Wolberg, W.H., Mangasarian, O.L.: Multisurface method of pattern separation for medical diagnosis applied to breast cytology. In: The National Academy of Sciences, USA (1990)
127. Zhang, J.: Selecting typical instances in instance-based learning. In: The 9th International Conference on Machine Learning, Aberdeen, Scotland (1992)
128. Bergadano, F., Matwin, S., Michalski, R., Zhang, J.: Measuring quality of concept descriptions. In: The 3rd European Working Sessions on Learning, Glasgow (1988)
129. Bergadano, F., Matwin, S., Michalski, R., Zhang, J.: Representing and acquiring imprecise and context-dependent concepts in knowledge-based systems. In: International Symposium on Methodologies for Intelligent Systems, North Holland (1988)
130. Detrano, R., Janosi, A., Steinbrunn, W., Pfisterer, M., Schmid, J., Sandhu, S., Guppy, K., Lee, S., Froelicher, V.: International application of a new probability algorithm for the diagnosis of coronary artery disease. Am. J. Cardiol. 64, 304-310 (1989)
131. Liu, H., Gegov, A., Cocea, M.: Hybrid ensemble learning approach for generation of classification rules. In: Internation Conference on Machine Learning and Cybernetics, Guangzhou (2015)
132. Biggs, N., Lloyd, E., Wilson, R.: Graph Theory. Oxford University Press, Oxford (1986)
133. Bondy, J.A., Murty, U.S.R.: Graph Theory. Springer, Berlin (2008)
134. Aho, A.V., Hopcroft, J.E., Ullman, J.D.: Data structures and algorithms. Addison-Wesley, Boston (1983)
135. Johnsonbaugh, R.: Discrete Mathematics. Prentice Hall, USA (2008)
136. Battram, A.: Navigating Complexity: The Essential Guide to Complexity Theory in Business and Management. Spiro Press, London (2002)
137. Schlager, J.: Systems engineering: key to modern development. IRE Trans. EM. 3(3), 64-66 (1956)
138. Sage, A.P.: Systems Engineering, San Francisco. Wiley IEEE, CA (1992)
139. Hall, A.D.: A Methodology for Systems Engineering. Van Nostrand Reinhold, New York (1962)
140. Goode, H.H., Machol, R.E.: Systems Engineering: An Introduction to the Design of Large-scale Systems. McGraw-Hill, New York (1957)
141. Aksoy, M.S.: A review of rules family of algorithms. Math. Compu. Appl. 1(13), 51-60 (2008)
142. Liu, W.Z., White, A. P.: A review of inductive learning. In: Research and Development in Expert Systems VIII, Cambridge (1991)
143. Mrozek, A.: A new method for discovering rules from examples in expert systems. Int. J. Man Mach. Stud. 36, 127-143 (1992)
144. Hart, A.: Knowledge Acquisition for Expert systems. Chapman and Hall, London (1989)
145. Quinlan, R.: Induction, knowledge and expert systems. In: Artificial Intelligence Developments and Applications Amsterdam (1988)
146. Quinlan, R.: Inductive knowledge acquisition: a case study. In: Quinlan, R. (ed.) Applications of Expert Systems, pp. 157-173. Turing Institute Press, UK (1987)
147. Michalski, R., Mozetic, I., Hong, J., Lavrac, N.: The multi-purpose incremental learning system AQ15 and its testing applications to three medical domains. In: The Fifth National Conference on Artificial Intelligence, Philadelphia, PA 1986
148. Wooldridge, M.: An Introduction to Multi-Agent Systems. Wiley, New Jersey (2002)
149. Langley, P.: Elements of Machine Learning, San Francisco. Morgan Kaufmann Publishers Inc, CA (1995)
150. Mitchell, T.: Machine Learning. McGraw Hill, New York (1997)
151. Alpaydin, E.: Introduction to Machine Learning (Adaptive Computation and Machine Learning). MIT Press, Massachusetts (2004)
152. Stichweh, R.: Systems Theory. In: Badie, B.E.A. (ed.) International Encyclopaedia of Political Science. Sage, New York (2011)
153. Jech, T.: Set Theory, Thrid Millennium edn. Berlin, New York: Springer (2003)
154. Gegov, A.: Fuzzy Networks for Complex Systems: A Modular Rule Base Approach. Springer, Berlin (2010)
155. Gegov, N. Petrov, N., Vatchova, B.: Advance modelling of complex processed by rule based networks. In: 5th IEEE International Conference on Intelligent Systems, London (2010)
156. Gegov, A., Petrov, N., Vatchova, B., Sanders, D.: Advanced modelling of complex processes by fuzzy networks. WSEAS Trans. Circ. Syst. 10(10), 319-330 (2011)
157. Bengio, Y.: Learning deep architectures for AI. Found. Trends. Mach. Learn. 2(1), 1-127 (2009)
158. Freedman, D.A.: Statistical Models: Theory and Practice. Cambridge University Press, Cambridge (2005)
159. Armstrong, J.S.: Illusions in regression analysis. Int. J. Forecast. 28(3), 689 (2012)
160. Okafor, A.: Entropy Based Techniques with Applications in Data Mining. Florida (2005)
161. Aitken, A.C.: Statistical Mathematics, 8th edn. Oliver & Boyd (1957)
162. Shannon, C.: A mathematical theory of communication. Bell Syst. Tech. J. 27(3), 379-423 (1948)
163. Azhagusundari, B., Thanamani, A.S.: Feature selection based on information gain. Int. J. Inno. Tech. Exploring. Eng. 2(2), 18-21 (2013)
164. Jolliffe, I.T.: Principal component analysis. Springer, New York (2002)
165. Yu, H., Yang, J.: A direct LDA algorithm for high diomensional data-with application to face recognition. Pattern Recogn. 34(10), 2067-2069 (2001)
166. Yates, D. S., David, S. M., Daren, S. S.: The Practice of Statistics, 3rd edn. Freeman (2008)
167. Deming, W.E.: On probability as a basis for action. Am. Stat. 29(4), 146-152 (1975)
168. Kerry, Bland.: Statistics notes: the intracluster correlation coefficient in cluster randomisation. Br. Med. J. 316, 1455-1460 (1998)
169. Kerber, R.: ChiMerge: discretization of numeric attribute. In: Proceeding of the 10th National Conference on Artificial Intelligence (1992)
170. Ross, T.J.: Fuzzy logic with engineering applications, 2nd edn. Wiley, West Sussex (2004)