An empirical evaluation of the comprehensibility of decision table, tree and rule based predictive models

Decision Support Systems

Volumn 51, Issue 1, 2011, Pages 141-154

  Huysmans, Johan ^a   Dejaeger, Karel ^a   Mues, Christophe ^b   Vanthienen, Jan ^a   Baesens, Bart ^a,b,c  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^c VLERICK BUSINESS SCHOOL   (Belgium)

Author keywords

Classification; Comprehensibility; Data mining; Decision tables; Knowledge representation

Indexed keywords

CLASSIFICATION; COMPREHENSIBILITY; EASE OF USE; EMPIRICAL EVALUATIONS; EMPIRICAL STUDIES; END USERS; INTERPRETABILITY; LITTLE RESEARCH; PREDICTIVE MODELS; PRIOR KNOWLEDGE; RESPONSE TIME; RULE BASED;

BINARY TREES; CLASSIFICATION (OF INFORMATION); DATA MINING; DECISION TREES; KNOWLEDGE REPRESENTATION; PREDICTIVE CONTROL SYSTEMS;

DECISION TABLES;

EID: 79951515446     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dss.2010.12.003     Document Type: Article

References (63)

1. R. Andrews, J. Diederich, and A. Tickle Survey and critique of techniques for extracting rules from trained artificial neural networks Knowledge Based Systems 8 6 1995 373 389
2. B. Baesens, T. Van Gestel, S. Viaene, M. Stepanova, J. Suykens, and J. Vanthienen Benchmarking state of the art classification algorithms for credit scoring Journal of the Operational Research Society 54 6 2003 627 635
3. I. Benbasat, and R.N. Taylor Behavioral aspects of information processing for the design of management information systems IEEE Transactions on Systems, Man, and Cybernetics 12 4 1982 439 450
4. I. Benbasat, A.S. Dexter, and P. Todd An experimental program investigating color-enhanced and graphical information presentation: An integration of the findings Communications of the ACM 29 11 1986 1094 1105 (Pubitemid 17497528)
5. L. Breiman, J. Friedman, R. Olsen, and C. Stone Classification and Regression Trees 1984 Wadsworth and Brooks
6. D. Campbell Task Complexity: A Review and Analysis Academy of Management Journal 13 1 1988 40 52
7. E. Cantú-Paz, and C. Kamath Inducing oblique decision trees with evolutionary algorithms IEEE Transactions on Evolutionary Computation 7 1 2003 54 68
8. A. Chandra, and R. Krovi Representational congruence and information retrieval: Towards an extended model of cognitive fit Decision Support Systems 25 1999 271 288
9. F. Chen Learning accurate and understandable rules from SVM classifiers 2004 Simon Fraser University Master's thesis
10. P. Clark, and T. Niblett The CN2 induction algorithm Machine Learning 3 4 1989 261 283
11. W. Cohen Fast effective rule induction A. Prieditis, S. Russell, Proc. the 12th International Conference on Machine Learning 1995 Morgan Kaufmann Tahoe City 115 123
12. R.A. Coll, J.H. Coll, and G. Thakur Graphs and tables: A four-factor experiment Communications of the ACM 37 4 1994 76 86
13. R. Colomb Representation of propositional expert systems as partial functions Artificial Intelligence 109 1-2 1999 187 209
14. A. Dennis, and T. Carte Using geographic information systems for decision making: extending cognitive fit theory to map-based presentations Information Systems Research 9 2 1998 194 203
15. G. DeSanctis Computer grapics as decision aids: directions for research Desicion Sciences 15 4 1984 463 487
16. G.W. Dickson, G. DeSanctis, and D.J. McBride Understanding the effectiveness of computer graphics for decision support: A cumulative experimental approach Communications of the ACM 29 1 1986 40 47 (Pubitemid 16474575)
17. Equal Credit Opportunity Act. United States Code, 1974.
18. A. Feelders, H. Daniels, and M. Holsheimer Methodological and practical aspects of data mining Information & Management 37 2000 271 281
19. A.A. Freitas Are we really discovering "interesting" knowledge from data? expert update The BCS-SGAI Magazine 9 1 2006 41 47
20. C. Frownfelter-Lohrke The effects of differing information presentations of general purpose financial statements on users' decisions Journal of Information Systems 12 4 1998 99 107
21. D. Gilmore, and T. Green Comprehension and recall of miniature programs International Journal of Man-Machine Studies 21 1 1984 31 48 (Pubitemid 15103096)
22. D. Goodhue, and R. Thompson Task-technology fit and individual performance MIS Quarterly 19 2 1995 213 236
23. R. Halverson An empirical investigation comparing if-then rules and decision tables for programming rule-based expert systems Proceedings of 26th Hawaii International Conference on System Sciences 1993 316 323
24. J. Huysmans, B. Baesens, and J. Vanthienen ITER: an algorithm for predictive regression rule extraction 8th International Conference on Data Warehousing and Knowledge Discovery DaWaK 2006 4081 2006 Springer Verlag 270 279 (Pubitemid 44811901)
25. J. Huysmans, B. Baesens, and J. Vanthienen Using rule extraction to improve the comprehensibility of predictive models, FETEW research report KBI 0612 Technical report 2006 Katholieke Universiteit Leuven
26. S. Jarvenpaa, and G. Dickson Graphics and managerial decisionmaking: Research based guidelines Communications of the ACM 31 6 1988 764 774 (Pubitemid 18626369)
27. U. Johansson, R. König, and L. Niklasson Automatically balancing accuracy and comprehensibility in predictive modeling Proceedings of the 8th International Conference on Information Fusion 2005
28. R. Kohavi The power of decision tables N. Lavrac, S. Wrobel, Proceedings of the European Conference on Machine Learning Lecture Notes in Artificial Intelligence 914 1995 Springer Verlag Berlin, Heidelberg, New York 174 189
29. J.H. Larkin, and H.A. Simon Why a diagram is (sometimes) worth ten thousand words Cognitive Sience 11 1987 65 99
30. C.-C. Lee, H. Cheng, and H.-H. Cheng An empirical study of mobile commerce in insurance industry: Task-technology fit and individual differences Decision Support Systems 43 2007 95 110 (Pubitemid 46073230)
31. H. Lucas An experimental investigation of the use of computer based graphics in decision-making Management Science 27 7 1981 757 768
32. D. Martens, B. Baesens, T. Van Gestel, and J. Vanthienen Comprehensible credit scoring models using rule extraction from support vector machines European Journal of Operational Research 183 3 2007 1466 1476 (Pubitemid 47039190)
33. D. Martens, B. Baesens, and T. Van Gestel Decompositional rule extraction from support vector machines by active learning IEEE Transactions on Knowledge and Data Engineering 21 2 2009 178 191
34. J. McGrath Groups: Interaction and Performance 1984 Prentice Hall Englewood Cliffs, NY
35. M. Pazzani Knowledge discovery from data? IEEE Intelligent Systems 15 2 2000 10 13 (Pubitemid 30587670)
36. J. Quinlan Simplifying decision trees International journal of man-machine studies 27 3 1987 221 234 (Pubitemid 18089906)
37. J. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann Publishers Inc San Francisco, CA, USA
38. W. Remus A study of graphical and tabular displays and their interaction with environmental complexity Management Science 33 9 1987 1200 1204
39. L. Santos-Gomez, and M. Darnell Empirical evaluation of decision tables for constructing and comprehending expert systems Knowledge Acquisition 4 4 1992 427 444
40. R. Setiono, and W.K. Leow Pruned neural networks for regression R. Miziguchi, J. Slaney, Proceedings of the 6th Pacific Rim Conference on Artificial Intelligence PRICAI 2000 2000 Springer Melbourne, Australia 500 509
41. R. Setiono, and H. Liu Neurolinear: From neural networks to oblique decision rules Neural Computing 17 1 1997 1 24 (Pubitemid 27433442)
42. R. Setiono, and J. Thong An approach to generate rules from neural networks for regression problems European Journal of Operational Research 155 1 2004 239 250
43. T. Shaft, and I. Vessey The role of cognitive fit in the relationship between software comprehension and modification MIS Quarterly 30 1 2006 29 55 (Pubitemid 44971424)
44. D.J. Sheskin Handbook of Parametric and Nonparametric Statistical Procedures 1997 CRC Press
45. A.P. Sinha, and H. Zhao Incorporating domain knowledge into data mining classifiers: An application in indirect lending Decision Support Systems 46 2008 287 299
46. C. Speier The influence of information presentation formats on complex task decision-making performance International Journal of Human-Computer Studies 64 11 2006 1115 1131 (Pubitemid 44403125)
47. G. Subramanian, J. Nosek, S. Raghunathan, and S. Kanitkar A comparison of the decision table and tree Communications of the ACM 34 1 1992 89 94
48. J. Swait, and W. Adamowicz The influence of task complexity on consumer choice: a latent class model of decision strategy switching Journal of Consumer Research 28 2001 135 148
49. J. Sweller Cognitive load during problem solving: Effects on learning Cognitive Science 12 2 1988 257 285
50. I. Taha, and J. Ghosh Symbolic interpretation of artificial neural networks IEEE Transactions on Knowledge and Data Engineering 11 3 1999 448 463
51. D. Tegarden Business information visualisation Communications of AIS 1 4 1999 1 37
52. E. Tufte The Visual Display of Quantitative Information 2001 Graphics Press Chesire, CT
53. N. Umanath, and I. Vessey Multiattribute data presentation and human judgement: a cognitive fit perspective Decision Sciences 25 5 1994 795 825
54. J. Vanthienen A more general comparison of the decision table and tree: A response Communications of the ACM 37 2 1994 109 113
55. J. Vanthienen, and G. Wets From decision tables to expert system shells Data and Knowledge Engineering 13 3 1994 265 282
56. J. Vanthienen, C. Mues, and A. Aerts An illustration of verification and validation in the modelling phase of KBS development Data and Knowledge Engineering 27 3 1998 337 352 (Pubitemid 128433765)
57. I. Vessey Cognitive fit: A theory-based analysis of the graphs versus tables literature Decision Sciences 22 2 1991 219 240
58. I. Vessey The effect of information presentation on decision making: a cost-benefit analysis Information & Management 27 1994 103 119
59. I. Vessey, and R. Weber Structured tools and conditional logic: An empirical investigation Communications of the ACM 29 1 1986 48 57 (Pubitemid 16474576)
60. S. Viaene, R. Derrig, B. Baesens, and G. Dedene A comparison of state-of-the-art classification techniques for expert automobile insurance fraud detection Journal of Risk and Insurance (Special Issue on Fraud Detection) 69 3 2002 433 443
61. C. Ware Information Visualisation: Perception for Design 2000 Academic Press San Diego, CA
62. R. Wood Task complexity: definition of the construct Organizational Behavior and Human Decision Processes 37 1986 60 82
63. Z.-H. Zhou, Y. Jiang, and S.-F. Chen Extracting symbolic rules from trained neural network ensembles AI Communications 16 1 2003 3 15