Incorporating domain knowledge into data mining classifiers: An application in indirect lending

Decision Support Systems

Volumn 46, Issue 1, 2008, Pages 287-299

  Sinha, Atish P ^a   Zhao, Huimin ^a  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

Author keywords

Classification; Data mining; Domain knowledge; Expert system; Supervised learning

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; APPLICATIONS; COST BENEFIT ANALYSIS; DATA MINING; DECISION SUPPORT SYSTEMS; DECISION TABLES; DECISION THEORY; DECISION TREES; EXPERT SYSTEMS; INFORMATION MANAGEMENT; KNOWLEDGE MANAGEMENT; LEARNING SYSTEMS; MINING; MULTILAYER NEURAL NETWORKS; NEURAL NETWORKS; STATISTICAL TESTS; SUPPORT VECTOR MACHINES; TREES (MATHEMATICS);

APPLICATION DOMAINS; AREA UNDER THE CURVES; BANKRUPTCY PREDICTIONS; CLASSIFICATION; CLASSIFICATION DECISIONS; CLASSIFICATION METHODS; CLASSIFICATION PERFORMANCES; CREDIT SCORING; DATA MINING METHODS; DATA MINING TECHNIQUES; DO-MAINS; DOMAIN KNOWLEDGE; DOMAIN KNOWLEDGES; FRAUD DETECTIONS; FUTURE DIRECTIONS; HUMAN EXPERTS; K-NEAREST NEIGHBORS; KNOWLEDGE-BASED; LOGISTIC REGRESSIONS; MINING CLASSIFICATIONS; MISCLASSIFICATION COSTS; NAIVE BAYES; PERFORMANCE MEASURES; SUPPORT VECTORS;

KNOWLEDGE BASED SYSTEMS;

EID: 56049111065     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dss.2008.06.013     Document Type: Article

References (56)

1. Aha D., and Kibler D. Instance-based learning algorithms. Machine Learning 6 1 (1991) 37-66
2. Ambrosino R., and Buchanan B.G. The use of physician domain knowledge to improve the learning of rule-based models for decision-support. Proceedings of the Annual Fall Symposium of the American Medical Informatics Association, Washington DC. (1999) 192-196
3. Barakat N.H., and Bradley A.P. Rule extraction from support vector machines: a sequential covering approach. IEEE Transactions on Knowledge and Data Engineering 19 6 (2007) 729-741
4. Bradley A.P. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition 30 7 (1997) 1145-1159
5. Buchanan B.G., and Shortliffe E.H. Rule-Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project (1984), Addison-Wesley, Reading, MA
6. Chauvin Y., and Rumelhart D.E. Backpropagation: Theory, Architectures, and Applications (1995), Lawrence Erlbaum Assoc., Hillsdale, NJ
7. Chung H.M., and Tam K.Y. A comparative analysis of inductive learning algorithms, Intelligent Systems in Accounting. Finance and Management 2 1 (1993) 3-18
8. Daniels H., Feelders A., and Velikova M. Integrating economic knowledge in data mining algorithms. Proceedings of the 8th International Conference on Society for Computational Economics: Computing in Economics and Finance, Aix-en-Provence, France (2002)
9. Doumpos M., Kosmidou K., Baourakis G., and Zopounidis C. Credit risk assessment using a multicriteria hierarchical discrimination approach: a comparative analysis. European Journal of Operational Research 138 2 (2002) 392-412
10. Dybowski R., Laskey K.B., Myers J.W., and Parsons S. Introduction to the special issue on the fusion of domain knowledge with data for decision support. Journal of Machine Learning Research 4 (2003) 293-294
11. Elkan C. The foundations of cost-sensitive learning. Proceedings of the 17th International Joint Conference on Artificial Intelligence, Seattle, WA (2001) 973-978
12. Fan W., Gordon M.D., and Pathak P. An integrated two-stage model for intelligent information routing. Decision Support Systems 42 1 (2006) 362-374
13. Fan W., Pathak P., and Wallace L. Nonlinear ranking function representations in genetic programming-based ranking discovery for personalized Web search. Decision Support Systems 42 3 (2006) 1338-1349
14. Fayyad U., Piatetsky-Shapiro G., and Smyth P. From data mining to knowledge discovery in databases. AI Magazine 17 3 (1996) 37-54
15. Fawcett T. ROC graphs: notes and practical considerations for data mining researchers. HPL-2003-4, Intelligent Enterprise Technologies Lab, Hewlett-Packard, Palo Alto, CA (2003)
16. Hand D., Mannila H., and Smyth P. Principles of Data Mining (2001), MIT Press, Cambridge, MA
17. Hanley J.A., and McNeil B.J. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology 148 (1983) 839-843
18. In: Hayes-Roth F., Waterman D.A., and Lenat D. (Eds). Building Expert Systems (1983), Addison-Wesley
19. Hirsh H., and Noordewier M. Using background knowledge to improve inductive learning: a case study in molecular biology. IEEE Expert 10 (1994) 3-6
20. Hoffman R.R. The problem of extracting the knowledge of experts from the perspective of experimental psychology. AI Magazine (1987) 53-67
21. Hosmer D.W., and Lemeshow S. Applied Logistic Regression. second edition (2000), John Wiley & Sons, Inc.
22. Huang Z., Chen H., Hsu C., Chen W., and Wu S. Credit rating analysis with support vector machines and neural networks: a market comparative study. Decision Support Systems 37 4 (2004) 543-558
23. Huang J., and Ling C.X. Using AUC and accuracy in evaluating learning algorithms. IEEE Transactions on Knowledge and Data Engineering 17 3 (2005) 299-310
24. John G.H., and Langley G.H. Estimating continuous distributions in Bayesian classifiers. In: Besnard P., and Hanks S. (Eds). Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence (1995), Morgan Kaufmann, San Mateo 338-345
25. Johnson P.E. What kind of expert should a system be?. Journal of Medicine and Philosophy 8 1 (1983) 77-97
26. Keerthi S.S., Shevade S.K., Bhattacharyya C., and Murthy K.R.K. Improvements to Platt's SMO algorithm for SVM classifier design. Technical Report CD-99-14. Control Division, Dept of Mechanical and Production Engineering, National University of Singapore (1999)
27. Kim C.N., and McLeod R. Expert, linear models, and nonlinear models of expert decision making in bankruptcy prediction: a lens model analysis. Journal of Management Information Systems 16 1 (1999) 189-206
28. Kohavi R. The power of decision tables. In: Lavrae N., and Wrobel S. (Eds). Proceedings of the European Conference on Machine Learning (1995), Springer Verlag, Berlin, Heidelberg New York
29. Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Mellish C.S. (Ed). Proceedings of the 14th International Joint Conference on Artificial Intelligence (1995), Morgan Kaufmann, San Mateo, CA 1137-1143
30. Kopanas I., Avouris N.M., and Daskalaki S. The role of domain knowledge in a large scale data mining project. In: Vlahavas I.P., and Spyropoulos C.D. (Eds). Applications of Artificial Intelligence, Lecture Notes in AI, no. 2308 (2002), Springer-Verlag, Berlin, Germany 288-299
31. Lam M. Neural network techniques for financial performance prediction: integrating fundamental and technical analysis. Decision Support Systems 37 4 (2004) 567-581
32. Langseth H., and Nielsen H. Fusion of domain knowledge with data for structural learning in object oriented domains. Journal of Machine Learning Research 4 (2003) 339-368
33. Murthy S.K. Automatic construction of decision trees from data: a multi-disciplinary survey. Data Mining and Knowledge Discovery 2 4 (1998) 345-389
34. Pazzani M., and Kibler D. The utility of knowledge in inductive learning. Machine Learning 9 1 (1992) 57-94
35. Pazzani M., Merz C., Murphy P., Ali K., Hume T., and Brunk C. Reducing misclassification costs. Proceedings of the 11th Conference on Machine Learning. Rutgers Univ., New Brunswick, NJ (1994) 217-225
36. Platt J. Fast training of support vector machines using sequential minimal optimization. In: Schölkopf B., Burges C., and Smola A. (Eds). Advances in Kernel Methods - Support Vector Learning (1998), MIT Press 185-208
37. Pohle C. Integrating and updating domain knowledge with data mining. In: Scholl M.H., and Grust T. (Eds). Proceedings of the VLDB 2003 PhD Workshop (electronic edn.), Berlin, Germany (2003)
38. Provost F., and Fawcett T. Robust classification for imprecise environments. Machine Learning 42 3 (2001) 203-231
39. Provost F., Fawcett T., and Kohavi R. The case against accuracy estimation for comparing induction algorithms. Proceedings of the 15th International Conference on Machine Learning, Madison, WI (1998) 445-453
40. Quinlan J.R. Induction of decision trees. Machine Learning 1 1 (1986) 81-106
41. Quinlan J.R. C4.5: Programs for Machine Learning (1993), Morgan Kaufmann
42. Rumelhart D.E., Hinton G.E., and Williams R.J. Learning internal representations by error propagation. In: Rumelhart D.E., and McClelland J.L. (Eds). Parallel Distributed Processing (1986), MIT Press, Cambridge, MA 318-362
43. Russell S., and Norvig P. Artificial Intelligence: A Modern Approach (1995), Prentice Hall, Englewood Cliffs, NJ
44. Ryu Y.U., and Yue W.T. Firm bankruptcy prediction: experimental comparison of isotonic separation and other classification approaches. IEEE Transactions on Systems, Man and Cybernetics, Part A 35 5 (2005) 727-737
45. Siegel S. Nonparametric Statistics for the Behavioral Sciences (1956), McGraw-Hill, New York, NY
46. Sinha A.P., and May J.H. Evaluating and tuning predictive data mining models using receiver operating characteristic curves. Journal of Management Information Systems 21 3 (2005) 253-284
47. Sung T.K., Chang N., and Lee G. Dynamics of modeling in data mining: interpretive approach to bankruptcy prediction. Journal of Management Information Systems 16 1 (1999) 63-85
48. Waterman D.A. A Guide to Expert Systems (1986), Addison-Wesley, Reading, MA
49. Weiss S.M., Buckley S.J., Kapoor S., and Damgaard S. Knowledge-based data mining. Proceedings of the 9th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Washington D.C. (2003) 456-461
50. Weiss S.M., and Indurkhya N. Predictive Data Mining: A Practical Guide (1998), Morgan Kaufmann, San Francisco, CA
51. Weiss S.M., and Kulikowski C.A. Computer Systems that Learn: Classification and Prediction Methods from Statistics, Neural Nets, Machine Learning, and Expert Systems (1991), Morgan Kaufmann, San Mateo, CA
52. Weiss G.M., and Provost F. The effect of class distribution on classifier learning: an empirical study. Technical Report ML-TR-44, Dept. of Computer Science, Rutgers Univ. (2001)
53. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques (2005), Morgan Kaufmann, San Francisco, CA
54. Zhao H., and Ram S. Constrained cascade generalization of decision trees. IEEE Transactions on Knowledge and Data Engineering 16 6 (2004) 727-739
55. Zhao H., and Sinha A.P. An efficient algorithm for generating generalized decision forests. IEEE Transactions on Systems, Man, and Cybernetics, Part A 35 5 (2005) 754-762
56. Zhu D., Premkumar G., Zhang X., and Chu C. Data mining for network intrusion detection: a comparison of alternative methods. Decision Sciences 32 4 (2001) 635-660