A new data mining scheme using artificial neural networks

Sensors

Volumn 11, Issue 5, 2011, Pages 4622-4647

  Kamruzzaman, S M ^a   Jehad Sarkar, A M ^a  

^a Hankuk University of Foreign Studies   (South Korea)

Author keywords

Clustering; Constructive algorithm; Data mining; Neural networks; Pruning; Rule extraction; Symbolic rules; Weight freezing

Indexed keywords

ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; DATA MINING; METHODOLOGY;

ARTIFICIAL INTELLIGENCE; DATA MINING; NEURAL NETWORKS (COMPUTER);

EID: 79957755334     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s110504622     Document Type: Article

References (55)

1. Wang, L.; Sui, T.Z. Application of data mining technology based on neural network in the engineering. In Proceedings of International Conference on Wireless Communications, Networking and Mobile Computing, Shanghai, China, 21-25 September 2007; pp. 5544-5547.
2. Nirkhi, S. Potential use of artificial neural network in data mining. In Proceedings of International Conference on Computer and Automation Engineering, Singapore, 26-28 February 2010; pp. 339-343.
3. Andrews, R.; Diederich, J.; Tickle, A.B. Survey and critique of techniques for extracting rules from trained artificial neural networks. Knowl. Based Syst. 1995, 8, 373-389.
4. Setiono, R. Extracting rules from neural networks by pruning and hidden-unit splitting. Neural Comput. 1997, 9, 205-225.
5. Darbari, A. Rule Extraction from Trained ANN: A Survey; Technical Report; Department of Computer Science, Dresden University of Technology, Dresden, Germany, 2000.
6. Biryulev, C.; Yakymiv, Y.; Selemonavichus, A. Research of artificial neural networks usage in data mining and semantic integration. In Proceedings of International Conference on Perspective Technologies and Methods in MEMS Design, Lviv, Ukraine, 20-23 April 2010; pp. 144-149.
7. Ni, X. Research of data mining based on neural networks. World Academy Sci. Eng. Tech. 2008, 39, 381-384.
8. Vesely, A. Neural networks in data mining. Agric. Econ. 2003, 49, 427-431.
9. Singh, Y.; Chauhan, A.S. Neural networks in data mining. J. Theo. and App. Inf. Tech. 2009, 5, 37-42.
10. Baesens, B.; Setiono, R.; Mues, C.; Vanthienen, J. Using neural network rule extraction and decision tables for credit-risk evaluation. Manage. Sci. 2003, 49, 312-329.
11. Jacobsson, H. Rule extraction from recurrent neural networks: A taxonomy and review. Neural Comput. 2005, 17, 1223-1263.
12. Kahramanli, H.; Allahverdi, N. Rule extraction from trained adaptive neural networks using artificial immune systems. Expert Syst. Appl. 2009, 36, 1513-1522.
13. Setiono, R.; Baesens, B.; Mues, C. A note on knowledge discovery using neural networks and its application to credit screening, Eur. J. Operation. Res. 2009, 192, 326-332.
14. Tickle, A.B.; Andrews, R.; Golea, M.; Diederich, J. The truth will come to light: Directions and challenges in extracting the knowledge embedded within trained artificial neural networks. IEEE Trans. Neural Netw. 1998, 9, 1057-1067.
15. Setiono, R.; Leow, W.K. FERNN: An algorithm for fast extraction of rules from neural networks. Appl. Intell. 2000, 12, 15-25.
16. Setiono, R.; Liu, H. Symbolic representation of neural networks. IEEE Comput. 1996, 29, 71-77.
17. Odajima, K.; Hayashi, Y.; Gong, T.; Setiono, R. Greedy rule generation from discrete data and its use in neural network rule extraction. Neural Netw. 2008, 21, 020-1028.
18. Setiono, R.; Liu, H.; Lu, H. Effective data mining using neural networks. IEEE Trans. Knowl. Data En. 1996, 8, 957-961.
19. Craven, M.; Shavlik, J. Using neural networks for data mining. Future Gener. Comput. Syt. 1997, 13, 211-229.
20. Anbananthen, S.K; Sainarayanan, G.; Chekima, A.; Teo, J. Data mining using pruned artificial neural network tree (ANNT). In Proceedings of IEEE International Conference on Information & Communication Technologies, Damascus, Syria, 24-28 April 2006; pp. 1350-1357.
21. Saito, K.; Nakano, R. Medical diagnosis expert system based on PDP model. In Proceedings of IEEE International Conference on Neural Networks, San Diego, CA, USA, 24-27 July 1988; pp. 1255-1262.
22. Towell, G.G.; Shavlik, J.W. Extracting refined rules from knowledge-based neural networks. Mach. Learn. 1993, 13, 71-101.
23. Fu, L. Rule learning by searching on adapted nets. In Proceedings of National Conference on Artificial Intelligence, Anaheim, CA, USA, 1991; pp. 590-595.
24. Towell, G.G; Shavlik, J.W. Knowledge-based artificial neural networks. Artif. Intell. 1994, 70, 119-165.
25. Liu, H.; Tan, S.T. X2R: A fast rule generator. In Proceedings of IEEE International Conference on Systems, Man and Cybernetics, Vancouver, BC, Canada, 22-25 October 1995; pp. 1631-1635.
26. Liu, H. A family of efficient rule generators. In Encyclopedia of Computer Science and Technology; Marcel Dekker Inc.: New York, NY, USA, 1998; Volume 39, pp. 15-28.
27. Setiono, R. Extracting M-of-N rules from trained neural networks. IEEE Trans. Neural Netw. 2000, 11, 512-519.
28. Kamruzzaman, S.M.; Islam, M.M. An algorithm to extract rules from artificial neural networks for medical diagnosis problems. Int. J. Inf. Tech. 2006, 12, 41-59.
29. Jin, Y.; Sendhoff, B. Pareto-based multiobjective machine learning: An overview and case studies. IEEE Trans. Syst. Man Cybern. C Appl. Rev. 2008, 38, 397-415.
30. Wang, J.; Zhang, W.; Qin, B.; Shi, W. Research on rules extraction from neural network based on linear insertion. In Proceedings of WASE International Conference on Information Engineering, Beidaihe, Hebei, China, 14-15 August 2010; pp. 33-36.
31. Kwok, T.Y.; Yeung, D.Y. Constructive algorithms for structured learning in feedforward neural networks for regression problems. IEEE Trans. Neural Netw. 1997, 8, 630-645.
32. Islam, M.M.; Yao, X.; Murase, K. A constructive algorithm for training cooperative neural network ensembles. IEEE Trans. Neural Netw. 2003, 14, 820-834.
33. Parekh, R.; Yang, J.; Honavar, V. Constructive neural network learning algorithms for pattern classification. IEEE Trans. Neural Netw. 2000, 11, 436-451.
34. Ash, T. Dynamic node creation in backpropagation networks. Connect. Sci. 1989, 1, 365-375.
35. Fahlman, S.E.; Lebiere, C. The cascade-correlation learning architecture. Adv. Neural Inf. Proc. Syst. 1990, 2, 524-532.
36. Setiono, R.; Hui, L.C.K. Use of quasi-Newton method in a feedforward neural network construction algorithm. IEEE Trans. Neural Netw. 1995, 6, 273-277.
37. Kamruzzaman, S.M.; Hasan, A.R.; Siddiquee, A.B.; Mazumder, M.E.H. Medical diagnosis using neural network. In Proceedings of International Conference on Electrical and Computer Engineering, Dhaka, Bangladesh, 28-30 December 2004; pp. 537-540.
38. Islam, M.M.; Akhand, M.A.H.; Rahman, M.A.; Murase, K. Weight freezing to reduce training time in designing artificial neural networks. In Proceedings of International Conference on Computer and Information Technology, Dhaka, Bangladesh, 27-28 December 2002; pp. 132-136.
39. Sietsma, J.; Dow, R.J.F. Neural net pruning-why and how? In Proceedings of IEEE International Conference on Neural Networks, San Diego, CA, USA, 24-27 July 1988; pp. 325-333.
40. Ooyen, A.; Nienhuis, B. Improving the convergence of backpropagation algorithm. Neural Netw. 1992, 5, 465-471.
41. Reed, R. Pruning algorithms-A survey. IEEE Trans. Neural Netw. 1993, 4, 740-747.
42. Jiawei, H.; Kamber, M. Data Mining: Concepts and Techniques; Morgan Kaufmann: San Fransisco, CA, USA, 2001.
43. Kaufman, L.; Rousseeuw, P.J. Finding Groups in Data: An Introduction to Cluster Analysis, John Wiley & Sons: New York, NY, USA, 2005.
44. Raymond, T.N.; Han, J. Efficient and effective clustering methods for spatial data mining. In Proceedings of International Conference on Very Large Data Bases, Santiago de Chile, Chile, 12-15 September 1994; pp. 144-155.
45. Islam, M.M.; Murase, K. A new algorithm to design compact two hidden-layer artificial neural networks. Neural Netw. 2001, 4, 1265-1278.
46. Quinlan, J.R. C4.5: Programs for Machine Learning; Morgan Kaufmann: San Fransisco, CA, USA, 1993.
47. Agrawal, R.; Imielinski, T.; Swami, A. Database mining: A performance perspective. IEEE Trans. Knowl. Data Eng. 1993, 5, 914-925.
48. Yen, S.-J.; Chen, A.L.P. An efficient algorithm for deriving compact rules from databases. In Proceedings of International Conference on Database Systems for Advanced Applications, Singapore, 11-13 April 1995; pp. 364-371.
49. Murphy, P.M.; Aha, D.W. UCI Repository of Machine Learning Databases, (Machine-Readable Data Repository); Department of Information and Computer Science, University of California, Irvine, CA, USA, 1998. Available online: http://archive.ics.uci.edu/ml/ (accessed on 12 April 2011).
50. Prechelt, L. PROBEN1-A Set of Neural Network Benchmark Problems and Benchmarking Rules; Technical Report 21/94; Fakultat fur Informatik, Universitat Karlsruhe, Karlsruhe, Germany, 1994.
51. Setiono, R. Techniques for extracting rules from artificial neural networks. In Proceedings of International Conference on Soft Computing and Information Systems, Iizuka, Japan, 16-20 October 1998.
52. Breiman, L.; Friedman, J.; Olshen, R.; Stone, C. Classification and Regression Trees; Wadsworth and Brooks: Monterey, CA, USA, 1984.
53. Pham, D.T.; Aksoy, M.S. RULES: A simple rule extraction system. Expert Syst. Appl. 1995, 8, 59-65.
54. Pham, D.T.; Aksoy, M.S. An algorithm for automatic rule induction. Artif. Intell. Eng. 1994, 8, 277-282.
55. Cendrowska, J. PRISM: An algorithm for inducting modular rules. Int. J. Man Mach. Stud. 1987, 27, 349-370.