A novel hybrid classification model of artificial neural networks and multiple linear regression models

Expert Systems with Applications

Volumn 39, Issue 3, 2012, Pages 2606-2620

  Khashei, Mehdi ^a   Zeinal Hamadani, Ali ^a   Bijari, Mehdi ^a  

^a ISFAHAN UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Artificial neural networks (ANNs); Classification; Discriminant analysis (DA); Multiple linear regression models (MLR); Pattern recognition

Indexed keywords

BUSINESS DECISIONS; CLASSIFICATION ACCURACY; CLASSIFICATION MODELS; DATA SETS; EMPIRICAL RESULTS; FORECASTING ACCURACY; HYBRID CLASSIFICATION; HYBRID MODEL; K-NEAREST NEIGHBORS; LINEAR DISCRIMINANT ANALYSIS; MULTIPLE LINEAR REGRESSION MODELS; PREDICTIVE PERFORMANCE; QUADRATIC DISCRIMINANT ANALYSIS; REAL-WORLD APPLICATION;

BENCHMARKING; DECISION MAKING; DISCRIMINANT ANALYSIS; LINEAR REGRESSION; PATTERN RECOGNITION; PROBLEM SOLVING; SUPPORT VECTOR MACHINES;

NEURAL NETWORKS;

EID: 80255123447     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.08.116     Document Type: Article

References (71)

1. U. Acharya, P. Bhat, S.S. Iyengar, A. Rao, and S. Dua Classification of heart rate data using artificial neural network and fuzzy equivalence relation Pattern Recognition 36 2003 61 68
2. M. Aci, C. Inan, and M. Avci A hybrid classification method of k nearest neighbor Bayesian methods and genetic algorithm Expert Systems with Applications 37 2010 5061 5067
3. J.C. Amanda Combining artificial neural nets: Ensemble and modular multinet systems 1999 Springer London
4. M. Amasyali, and O. Ersoy Cline: A new decision-tree family IEEE Transactions on Neural Networks 19 2 2008 356 363 (Pubitemid 351359300)
5. Asuncion, A.; & Newman, D. (2007). UCI machine learning repository. Irivine, CA: University of California, School of Information and Computer Science, 2007.
6. A. Banerjee, K. Kiran, U. Murty, and Ch. Venkateswarlu Classification and identification of mosquito species using artificial neural networks Computational Biology and Chemistry 32 2008 442 447
7. P.G. Benardos, and G.C. Vosniakos Optimizing feed-forward artificial neural network architecture Engineering Applications of Artificial Intelligence 20 2007 365 382 (Pubitemid 46366649)
8. V. Berardi, and G.P. Zhang The effect of misclassification costs on neural network classifiers Decision Sciences 30 3 1999 659 668
9. L. Berrueta, R. Alonso-Salces, and K. Heberger Supervised pattern recognition in food analysis Journal of Chromatography A 1158 2007 196 214 (Pubitemid 47021153)
10. S. Billings, and K. Lee Nonlinear Fisher discriminant analysis using a minimum squared error cost function and the orthogonal least squares algorithm Neural Networks 15 2 2002 262 270
11. L. Breiman Prediction games and arcing algorithm Neural Computation 11 1999 1493 1517
12. Brown, M.; Grundy, W.; Lin, D.; Cristianini, N.; Sugnet, C.; Furey, T.; et al. (2000). Knowledge-based analysis of microarray gene expression data by using support vector machines. Proceedings of the National Academy of Sciences of the United States of America 97(1), 262-267. (Pubitemid 30055819)
13. M. Castellani, and H. Rowlands Evolutionary artificial neural network design and training for wood veneer classification Engineering Applications of Artificial Intelligence 22 2009 732 741
14. S. Chakraborty Simultaneous cancer classification and gene selection with Bayesian nearest neighbor method: An integrated approach Computational Statistics and Data Analysis 53 2009 1462 1474
15. W. Chaovalitwongse On the time series k-nearest neighbor classification of abnormal brain activity IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 37 6 2007
16. Chen, S.; Lin, S.; & Chou, S. (2010). Enhancing the classification accuracy by scatter-search-based ensemble approach. Applied Soft Computing xxx, xxx-xxx, 2010.
17. N. Christianini, and J. Shawe-Taylor An introduction to support vector machines 2000 Cambridge University Press
18. S. Chu The transcriptional program of sporulation in budding yeast Science 282 1998 699 705 (Pubitemid 28489376)
19. Connolly, J.; Granger, E.; & Sabourin, R. (2010). An adaptive classification system for video-based face recognition. Information Sciences xxx, xxx-xxx.
20. S. Curram, and J. Mingers Neural networks decision tree induction and discriminant analysis: An empirical comparison The Journal of the Operational Research Society 45 4 1994 440 450
21. M. Dubois, G. Bohling, and S. Chakrabarti Comparison of four approaches to a rock facies classification problem Computers & Geosciences 33 2007 599 617 (Pubitemid 46523792)
22. R. Duda, P. Hart, and D. Stork Pattern classification 2001 John Wiley & Sons, Inc. New York
23. G. Enas, and S. Choi Choice of the smoothing parameter and efficiency of k-nearest neighbor Computers and Mathematics with Applications 12 1986 235 244
24. R.A. Fisher The use of multiple measurements in taxonomic problems Annals of Eugenics 7 1936 465 475
25. Fix, E.; & Hodges, J. (1951). Discriminatory analysis - Nonparametric discrimination: Consistency properties. Project No. 21-49-004, Report No. 4, Contract No. AF 41(128)-31, USAF School of Aviation, Randolph Field, Texas.
26. Fix, E.; & Hodges, J. (1952). Discriminatory analysis - Nonparametric discrimination: Small sample performance. Project No. 21-49-004, Report No. 11, Contract No. AF 41(129)-31, USAF School of Aviation, Randolph Field, Texas.
27. M. Ghiassi, and C. Burnley Measuring effectiveness of a dynamic artificial neural network algorithm for classification problems Expert Systems with Applications 37 2010 3118 3128
28. A.K. Ghosh On optimum choice of K in nearest neighbor classification Computational Statistics & Data Analysis 50 2006 3113 3123 (Pubitemid 43729105)
29. A. Guven, and S. Kara Classification of electro-oculogram signals using artificial neural network Expert Systems with Applications 31 2006 199 205 (Pubitemid 43344278)
30. H. Hosseini, D. Luo, and K.J. Reynolds The comparison of different feed forward neural network architectures for ECG signal diagnosis Medical Engineering & Physics 28 2006 372 378
31. J. Hur, and J. Kim A hybrid classification method using error pattern modeling Expert Systems with Applications 34 2008 231 241 (Pubitemid 46756253)
32. K. Kaczmarczyk, A. Wit, M. Krawczyk, and J. Zaborski Gait classification in post-stroke patients using artificial neural networks Gait & Posture 30 2009 207 210
33. S. Kara, and M. Okandan Atrial fibrillation classification with artificial neural networks Pattern Recognition 40 2007 2967 2973 (Pubitemid 46990446)
34. A. Karci, and M. Demir Estimation of protein structures by classification of angles between a-carbons of amino acids based on artificial neural networks Expert Systems with Applications 36 2009 5541 5548
35. Khashei, M. (2005). Forecasting the Esfahan steel company production price in Tehran metals exchange using artificial neural networks (ANNs). Master of Science Thesis, Isfahan University of Technology, 2005.
36. M. Khashei, and M. Bijari An artificial neural network (p, d, q) model for time series forecasting Expert Systems with Applications 37 2010 479 489
37. M. Khashei, M. Bijari, and GH A. Raissi Improvement of auto-regressive integrated moving average models using fuzzy logic and artificial neural networks (ANNs) Neurocomputing 72 2009 956 967
38. M. Khashei, S.R. Hejazi, and M. Bijari A new hybrid artificial neural networks and fuzzy regression model for time series forecasting Fuzzy Sets and Systems 159 2008 769 786 (Pubitemid 351240997)
39. N. Kim, N. Kehtarnavaz, M. Yeary, and S. Thornton DSP-based hierarchical neural network modulation signal classification IEEE Transactions on Neural Networks 14 5 2003 1065 1071
40. D. Kruzlicova, J. Mocak, B. Balla, J. Petka, M. Farkova, and J. Havel Classification of Slovak white wines using artificial neural networks and discriminant techniques Food Chemistry 112 2009 1046 1052
41. J. Lee, and O. Ersoy Consensual and hierarchical classification of remotely sensed multispectral images IEEE Transactions on Geoscience and Remote Sensing 45 9 2007 2953 2963 (Pubitemid 47331322)
42. Y. Liang, and A. Keleman Temporal gene expression classification with regularised neural network International Journal of Bioinformatics Research and Applications 14 2005 399 413
43. M. Malhotra, S. Sharma, and S. Nair Decision making using multiple models European Journal of Operational Research 114 1999 1 14
44. S. Marks, and O. Dunn Discriminant functions when covariance matrices are unequal Journal of the American Statistical Association 69 1974 555 559
45. U. Maulik, and A. Mukhopadhyay Simulated annealing based automatic fuzzy clustering combined with ANN classification for analyzing microarray data Computers & Operations Research 37 2010 1369 1380
46. M. Muezzinoglu, and J. Zurada RBF-based neurodynamic nearest neighbor classification in real pattern space Pattern Recognition 39 2006 747 760 (Pubitemid 43276093)
47. K. Nagaty Fingerprints classification using artificial neural networks: a combined structural and statistical approach Neural Networks 14 2001 1239 1305
48. T. olmez, and Z. Dokur Classification of heart sounds using an artificial neural network Pattern Recognition Letters 24 2003 617 629 (Pubitemid 36080800)
49. R. Ostermark A hybrid genetic fuzzy neural network algorithm designed for classification problems involving several groups Fuzzy Sets and Systems 114 2000 311 324
50. P. Pendharkar An empirical study of design and testing of hybrid evolutionary-neural approach for classification Omega 29 2001 361 374 (Pubitemid 33628761)
51. P.C. Pendharkar A threshold-varying artificial neural network approach for classification and its application to bankruptcy prediction problem Computers & Operations Research 32 2005 2561 2582 (Pubitemid 40219761)
52. K. Polat, and S. Gunes A novel hybrid intelligent method based on C4.5 decision tree classifier and one-against-all approach for multi-class classification problems Expert Systems with Applications 36 2009 1587 1592
53. W. Porter, and W. Liu Fuzzy HMC classifiers Information Sciences 94 1996 151 178
54. X. Qiu, N. Tao, Y. Tan, and X. Wu Constructing of the risk classification model of cervical cancer by artificial neural network Expert Systems with Applications 32 2007 1094 1099 (Pubitemid 44821798)
55. K. Rajan, V. Ramalingam, M. Ganesan, S. Palanivel, and B. Palaniappan Automatic classification of Tamil documents using vector space model and artificial neural network Expert Systems with Applications 36 2009 10914 10918
56. B. Ripley Neural networks and related methods for classification Journal of the Royal Statistical Society Series B - Methodological 56 3 1994 409 456
57. D. Rumelhart, and J. McClelland Parallel distributed processing 1986 MIT Press, Cambridge, MA
58. G. Sahoo, S. Schladow, and J. Reuter Forecasting stream water temperature using regression analysis, artificial neural network, and chaotic non-linear dynamic models Journal of Hydrology 378 2009 325 342
59. S. Satapathy, J. Murthy, P. Prasad Reddy, B. Misra, P. Dash, and G. Panda Particle swarm optimized multiple regression linear model for data classification Applied Soft Computing 9 2009 470 476
60. L. Silva, J. Marques, and L.A. Alexandre Data classification with multilayer perceptrons using a generalized error function Neural Networks 21 2008 1302 1310
61. S.K. Sinha, and P.W. Fieguth Neuro-fuzzy network for the classification of buried pipe defects Automation in Construction 15 2006 73 83 (Pubitemid 41436347)
62. C.A. Smith Some examples of discrimination Annals of Eugenics 13 1947 272 282
63. J. Song, and H. Tang Support vector machines for classification of homo-oligomeric proteins by incorporating subsequence distributions Journal of Molecular Structure: THEOCHEM 722 2005 97 101 (Pubitemid 40623178)
64. M. Tagluk, M. Akin, and N. Sezgin Classification of sleep apnea by using wavelet transform and artificial neural networks Expert Systems with Applications 37 2010 1600 1607
65. C. Tsai Financial decision support using neural networks and support vector machines Expert Systems 25 4 2008 380 393
66. V. Vapnik Statistical learning theory 1998 Wiley New York
67. S. Viaene, R. Derrig, B. Baesens, and G. Dadene A comparison of state-of-the art classification techniques for expert automobile insurance claim fraud detection The Journal of Risk and Insurance 69 3 2002 373 421 (Pubitemid 40830725)
68. S. Wang, X. Li, S. Zhang, J. Gui, and D. Huang Tumor classification by combining PNN classifier ensemble with neighborhood roughest based gene reduction Computers in Biology and Medicine 40 2010 179 189
69. Yildiz, T.; Yildirim, S.; & Altilar, D. (2008). Spam filtering with parallelized KNN algorithm. Akademik Bilisim, 2008.
70. G.P. Zhang An investigation of neural networks for linear time-series forecasting Computers and Operations Research 28 2001 1112 1183
71. G. Zhang, B.E. Patuwo, and M.Y. Hu Forecasting with artificial neural networks: The state of the art International Journal of Forecasting 14 1998 35 62 (Pubitemid 128340470)