Data mining methods for discovering interesting exceptions from an unsupervised table

Journal of Universal Computer Science

Volumn 12, Issue 6, 2006, Pages 627-653

  Suzuki, Einoshin ^a  

^a KYUSHU UNIVERSITY   (Japan)

Author keywords

Data mining; Exception; Instance; Interestingness; Pattern; Rule; Unexpectedness

Indexed keywords

EID: 33746820611     PISSN: 0958695X     EISSN: 09486968     Source Type: Journal    
DOI: None     Document Type: Article

References (82)

1. [Aggarwal and Yu 2001] Aggarwal, C. C., Yu, P. S.: "Outlier Detection for High Dimensional Data", Proc. 2001 ACM SIGMOD Int'l Conf. on Management of Data (SIGMOD) (2000), 37-46.
2. [Aggarwal 2001] Aggarwal, C. C.: "Re-designing Distance Functions and Distance-Based Applications for High Dimensional Data", SIGMOD Record. 30, 1 (2001), 13-18.
3. [Agrawal et al. 1996] Agrawal, R., Mannila, H., Srikant, R., Toivonen, H., Verkamo, A. I.: "Fast Discovery of Association Rules," Advances in Knowledge Discovery and Data Mining, AAAI/MIT Press, Menlo Park, Calif. (1996), 307-328.
4. [Angiulli et al. 2004] Angiulli, F., Greco, G., Palopoli, L.: "Detecting Outliers via Logical Theories and its Data Complexity", Discovery Science, Lecture Notes in Artificial Intelligence 9245 (DS-2004), Springer-Verlag (2004), 101-113.
5. [Arning et al. 1995] Arning, A., Agrawal, R., Raghavan, P.: "A Linear Method for Deviation Detection in Large Databases", Proc. Second Int'l Conf. Knowledge Discovery and Data Mining (KDD), AAAI Press, Menlo Park, Calif. (1996), 164-169.
6. [Aumann and Lindell 1999] Aumann, Y. and Lindell, Y.: "A Statistical Theory for Quantitative Association Rules", Proc. Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (1999), 261-270.
7. [Bay and Schwabacher 2003] Bay, S. D., Schwabacher, M. : "Mining distance-based outliers in near linear time with randomization and a simple pruning rule", Proc. Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2003), 29-38.
8. [Bennett et al. 1998] Bennett, C.H., Gács, P., Li, M., Vitányi, P., Zurek, W.: "Information Distance", IEEE Trans. Inform. Theory, 44, 4 (1998), 1407-1423.
9. [Berka 2003] Berka, P.: ECML/PKDD 2003 Discovery Challenge, Download Data about Hepatitis, http://lisp.vse.cz/challenge/ecmlpkdd2003/ (current April 26th, 2003).
10. [Beyer 1999] Beyer, K. S., Goldstein, J., Ramakrishnan, R., Shaft, U.: "When is "Nearest Neighbor" Meaningful?", Proc. Seventh International Conference on Database Theory (ICDT) (1999), 217-235.
11. [Blake 1999] Blake, C., Merz, C.J., Keogh, E.: "UCI Repository of Machine Learning Databases", http://www.ics.uci.edu/~mlearn/MLRepository. ktml, Univ. of Calif. Irvine, Dept. Information and CS (current May 5, 1999).
12. [Breunig et al. 2000] Breunig, M. M., Kriegel, H.-P., Ng, R. T., Sander, J. G: "LOF: Identifying Density-Based Local Outliers", Proc. 2000 ACM SIGMOD International Conference on Management of Data (2000), 93-104.
13. [Burge and Shawe-Taylor 1997] Burge, P. and Shawe-Taylor, J.: "Detecting Cellular Fraud Using Adaptive Prototypes", AAAI-97 Workshop on AI Approaches to Fraud Detection and Risk Management (1997), 1-8.
14. [Burge and Shawe-Taylor 2001] Burge, P. and Shawe-Taylor, J.: "Unsupervised Neural Network Approach to Profiling the Behavior of Mobile Phone Users for Use in Fraud Detection", J. Parallel and Distributed Computing, 61 (2001), 915-925.
15. [Chakrabarti et al. 1998] Chakrabarti, S., Sarawagi, S., Dom., B.: "Mining Surprising Patterns using temporal description Length", Proc. 24th VLDB Conf. (1998), 606-617.
16. [Chan and Stolfo 1998] Chan, P. K., Stolfo, S. J.: "Toward Scalable Learning with Non-Uniform Class and Cost Distributions: A Case Study in Credit Card Fraud Detection" Proc. Fourth Int'l Conf. on Knowledge Discovery and Data Mining (KDD), (1998), 164-168.
17. [Dumouchel et al. 1999] DuMouchel, W. et al.: "Squashing Flat Files Flatter", Proc. Fifth ACM Int'l Conf. on Knowledge Discovery and Data Mining (KDD) (1999), 6-15.
18. [Elkan 2001] Elkan, C.: "The Foundation of Cost-sensitive Learning", Proc. Seventeenth Intl. Joint Conf. on Artificial Intelligence (IJCAI) (2001), 973-978.
19. [Ester et al. 1995] Ester, M., Kriegel, H.-P., Xu, X.: "A Database Interface for Clustering in Large Spatial Databases", Proc. First International Conference on Knowledge Discovery and Data Mining (KDD-95) (1995), 94-99.
20. [Freund and Schapire 1996] Freund, Y., Schapire, R. E.: "Experiments with a New Boosting Algorithm", Proc. Thirteenth Int'l Conf. on Machine Learning (ICML) (1996), 148-156.
21. [Fayyad et al. 1996] Fayyad, U. M., Piatetsky-Shapiro, G., Smyth, P.: "From Data Mining to Knowledge Discovery: An Overview", Advances in Knowledge Discovery and Data Mining, eds. U. M. Fayyad et al., AAAI/MIT Press, Menlo Park, Calif. (1996), 1-34.
22. [Fawcett and Provost 1997] Fawcett, T., Provost, F.: "Adaptive Fraud Detection", Data Mining and Knowledge Discovery. 1, 3 (1997), 291-316.
23. [Frawley et al. 1991] Frawley, W. J., Piatetsky-Shapiro, G., Matheus, C. J.: "Knowledge Discovery in Databases: An Overview", Knowledge Discovery in Databases, AAAI/MIT Press, Menlo Park, Calif. (1991), 1-27.
24. [Gamberger and Lavrač 2002a] Gamberger, D., Lavrač, N.: "Descriptive Induction through Subgroup Discovery: A Case Study in a Medical Domain", Proc. Nineteenth Int'l Conf. on Machine Learning (ICML) (2002), 163-170.
25. [Gamberger and Lavrač 2002b] Gamberger, D., Lavrač, N.: "Generating Actionable Knowledge by Expert-guided Subgroup Discovery", Principles of Data Mining and Knowledge Discovery, LNAI 2431 (PKDD), Springer (2002), 163-174.
26. [Guha et al. 1998] Guha, S., Rastogi, R., Shim, K.: "CURE: An Efficient Clustering Algorithm for Large Databases" Proc. ACM SIGMOD International Conference on Management of Data (SIGMOD 1998) (1998), 73-84.
27. [Hand et al. 2001] Hand, D., Mannila, H., Smyth, P.: Principles of Data Mining, MIT Press (2001).
28. [Hawkins 1980] Hawkins, D.M.: The Identification of Outliers. Chapman and Hall. London (1980).
29. [Hoschka and Klösgen 1991] Hoschka, P., Klösgen, W.: "A Support System for Interpreting Statistical Data", Knowledge Discovery in Databases, AAAI/MIT Press, Menlo Park, Calif. (1991), 325-345.
30. [Jaroszewicz and Simovici 2004] Jaroszewicz, S., Simovici, D. A.: "Interestingness of Frequent Itemsets using Bayesian Networks as Background Knowledge", Proc. Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2004), 178-186.
31. [Jaroszewicz and Scheffer 2005] Jaroszewicz, S., Scheffer, T.: "Fast Discovery of Unexpected Patterns in Data, Relative to a Bayesian Network", Proc. Eleventh ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2005), 118-127.
32. [Jin et al. 2001] Jin, W., Tung, A. K. H., Han, J.: "Mining Top-n Local Outliers in Large Databases", Proc. Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2001), 293-298.
33. [Jumi et al. 2004] Jumi, M., Suzuki, E., Ohshima, M., Zhong, N., Yokoi, H., Takabayashi, K.: "Spiral Discovery of a Separate Prediction Model from Chronic Hepatitis Data", Proc. Third International Workshop on Active Mining (AM) (2004), 1-10.
34. [Jumi et al. 2005] Jumi, M., Suzuki, E., Ohshima, M., Zhong, N., Yokoi, H., Takabayashi, K.: "Multi-strategy Instance Selection in Mining Chronic Hepatitis Data", Foundations of Intelligent Systems, Lecture Notes in Artificial Intelligence 3488 (ISMIS-2005), Springer-Verlag (2005), 475-484.
35. [Klösgen 1996] Klösgen, W.: "Explora,: A Multipattern and Multistrategy Discovery Approach", Advances in Knowledge Discovery and Data Mining, eds. U. M. Fayyad et al., AAAI/MIT Press, Menlo Park, Calif. (1996), 249-271.
36. [Knorr and Ng 1998] Knorr, E. M., Ng, R. T.: "Algorithms for Mining Distance-Based Outliers in Large Datasets", Proc. 24th International Conference on Very Large Data Bases (VLDB'98) (1998), 392-403.
37. [Knorr and Ng 1999] Knorr, E. M., Ng, R. T.: "Finding Intensional Knowledge of Distance-Based Outliers", Proc. 25th International Conference on Very Large Data Bases (VLDB'99) (1999), 211-222.
38. [Knorr et al. 2000] Knorr, E. M., Ng, R. T., Tucakov, V.: "Distance-Based Outliers: Algorithms and Applications", VLDB J., 8, 3-4 (2000), 237-253.
39. [Lee et al. 1998] Lee, W., Stolfo, S. J., Mok, K. W.: "Mining Audit Data to Build Intrusion Detection Models", Proc. Fourth Int'l Conf. on Knowledge Discovery and Data Mining (KDD) (1998), 66-72.
40. [Liu et al. 1997] Liu, B., Hsu, W., Chen, S.: "Using General Impressions to Analyze Discovered Classification Rules", Proc. Third Int'l Conf. on Knowledge Discovery and Data Mining (KDD) (1997), 31-36.
41. [Liu et al. 1999a] Liu, B. et al.: "Finding Interesting Patterns Using User Expectations", IEEE Trans. Knowledge and Data Eng., 11, 6 (1999), 817-832.
42. [Liu et al. 1999b] Liu, B., Hsu, W., and Ma, Y.: "Pruning and Summarizing the Discovered Associations", Proc. Fifth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD) (1999), 125-134.
43. [Liu et al. 1999c] Liu, B., Hsu, W., Ma, Y., and Chen, S.: "Mining Interesting Knowledge using DM-II", Proc. Fifth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD) (1999), 430-434.
44. [Liu et al. 2001] Liu, B., Ma, Y., Yu, P. S.: "Discovering unexpected information from your competitors' web sites", Proc. Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2001), 144-153.
45. [McCarthy 1980] J. McCarthy: "Circumscription - a form of nonmonotonic reasoning", Artificial Intelligence, 13, (1980), 27-39.
46. [Mitchell 1999] T.M. Mitchell, Machine Learning and Data Mining, CACM 42 (1999), 31-36.
47. [Ng and Han 1994] Ng, R. T., Han, J.: "Efficient and Effective Clustering Methods for Spatial Data Mining", Proc. 20th International Conference on Very Large Data Bases (VLDB'94) (1994), 144-155.
48. [Okada 1999] Okada, T.: "Rule Induction in Cascade Model Based on Sum of Squares Decomposition", Principles of Data Mining and Knowledge Discovery (PKDD). LNAI1704, Springer-Verlag (1999), 468-474.
49. [Okada 2000] Okada, T.: "Efficient Detection of Local Interactions in the Cascade Model", Knowledge Discovery and Data Mining, Lecture Notes in Artificial Intelligence 1805 (PAKDD-2000), Springer-Verlag (2000), 193-203.
50. [Padmanabhan 1998] Padmanabhan, B., Tuzhilin, A.: "A Belief-Driven Method for Discovering Unexpected Patterns", Proc. Fourth Int'l Conf. Knowledge Discovery and Data Mining (KDD), AAAI Press, Menlo Park, Calif. (1998), 94-100.
51. [Padmanabhan 2000] Padmanabhan, B., Tuzhilin, A.: "Small is Beautiful: Discovering the Minimal Set of Unexpected Patterns", Proc. Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) (2000), 54-63.
52. [Pitman 1979] Pitman, E.: Some Basic Theory for Statistical Inference, London, Chapman and Hall (1979).
53. [Quinlan 1993] Quinlan, J. R.: C4-5: Programs for Machine Learning, San Mateo, Calif., Morgan Kaufmann (1993).
54. [Ramaswamy et al. 2000] Ramaswamy, S., Rastogi, R., Shim, K.: "Efficient Algorithms for Mining Outliers from Large Data Sets", Proc. 2000 ACM SIGMOD Int'l Conf. on Management of Data (SIGMOD) (2000), 427-438.
55. [Sarawagi et al. 1998] Sarawagi, S., Agrawal, R., Megiddo, N.: "Discovery-Driven Exploration of OLAP Data Cubes", Proc. Sixth International Conference on Extending Database Technology (EDBT'98), LNCS 1377, Springer (1998), 168-182.
56. [Schölkopf 2001] Schölkopf, B., Platt, J., Shawe-Taylor, J., Smola, A. J., Williamson, R. C.: "Estimating the support of a high-dimensional distribution", Neural Computation, 13 (2001), 1443-1472.
57. [Silberschatz and Tuzhilin 1996] Silberschatz, A., Tuzhilin, A.: "What Makes Patterns Interesting in Knowledge Discovery Systems", IEEE Trans. Knowledge and Data Eng., 8, 6 (1996), 970-974.
58. [Smyth and Goodman 1992] Smyth, P., Goodman, R. M.: "An Information Theoretic Approach to Rule Induction from Databases", IEEE Trans. Knowledge and Data Eng., 4 (1992), 301-316.
59. [Spenke 2001] Spenke, M.: "Visualization and Interactive Analysis of Blood Parameters with InfoZoom", Artificial Intelligence in Medicine, 22, 2 (2001), 159-172.
60. [Sugaya et al. 2001] Sugaya, S., Suzuki, E., Tsumoto, S.: "Instance Selection Based on Support Vector Machine for Knowledge Discovery in Medical Database", Instance Selection and Construction for Data Mining, H. Liu and H. Motoda (eds.), Kluwer, Norwell, Mass. (2001), 395-412.
61. [Suzuki and Shimura 1996] Suzuki, E., Shimura, M.: "Exceptional Knowledge Discovery in Databases Based on Information Theory", Proc. Second Int'l Conf. Knowledge Discovery and Data Mining (KDD), AAAI Press, Menlo Park, Calif. (1996), 275-278.
62. [Suzuki 1996] Suzuki, E.: "Discovering Unexpected Exceptions: A Stochastic Approach", Proc. Fourth International Workshop on Rough Sets. Fuzzy Sets, and Machine Discovery (RSFD) (1996), 225-232.
63. [Suzuki 1997] Suzuki, E.: "Autonomous Discovery of Reliable Exception Rules", Proc. Third Int'l Conf. Knowledge Discovery and Data Mining (KDD), AAAI Press, Menlo Park, Calif. (1997), 259-262.
64. [Suzuki and Kodratoff 1998] Suzuki, E., Kodratoff, Y.: "Discovery of Surprising Exception Rules Based on Intensity of Implication", Principles of Data Mining and Knowledge Discovery, LNAI 1510 (PKDD), Springer (1998), 10-18.
65. [Suzuki and Tsumoto 2000] Suzuki, E., Tsumoto, S.: "Evaluating Hypothesis-Driven Exception-Rule Discovery with Medical Data Sets", Knowledge Discovery and Data Mining, LNAI 1805 (PAKDD), Springer, Berlin (2000), 208-211.
66. [Suzuki 2000a] Suzuki, E. (ed.): Proc. Int'l Workshop of KDD Challenge on Real-world Data (KDD Challenge 2000) (2000).
67. [Suzuki 2000b] Suzuki, E.: "Mining Bacterial Test Data with Scheduled Discovery of Exception Rules", Proc. Int'l Workshop of KDD Challenge on Real-world Data (KDD Challenge), Kyoto, Japan (2000), 34-40.
68. [Suzuki and Zytkow 2000] Suzuki, E., Żytkow, J. M.: "Unified Algorithm for Undirected Discovery of Exception Rules", Principles of Data Mining and Knowledge Discovery, LNAI 1910 (PKDD), Springer (2000), 169-180.
69. [Suzuki 2002] Suzuki, E.: "Undirected Discovery of Interesting Exception Rules", International Journal of Pattern Recognition and Artificial Intelligence, 16, 8 (2002), 1065-1086.
70. [Suzuki 2004a] Suzuki, E.: "Discovering Interesting Exception Rules with Rule Pair", Proc. ECML/PKDD-2004 Workshop W8 on Advances in Inductive Rule Learning (2004), 163-178.
71. [Suzuki 2004b] Suzuki, E.: "Evaluation Scheme for Exception Rule/Group Discovery", Intelligent Technologies for Information Analysis, Springer, Berlin (2004), 89-108.
72. [Suzuki and Zytkow 2005] Suzuki, E., Zytkow, J. M.: "Unified Algorithm for Undirected Discovery of Exception Rules", International Journal of Intelligent Systems, 20, 7 (2005), 673-691.
73. [Tuzhilin and Liu 2002] Tuzhilin, A. and Liu, B.: "Querying Multiple Sets of Discovered Rules", Proc. Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2002), 52-60.
74. [Wrobel 1997] Wrobel, S.: "An Algorithm for Multi-relational Discovery of Subgroups", Principles of Data Mining and Knowledge Discovery (PKDD), LNCS 1263, Springer-Verlag (1997), 78-87.
75. [Yamada, et al. 2003] Yamada, Y., Suzuki, E., Yokoi, H., Takabayashi, K.: "Decision-tree Induction from Time-series Data Based on a Standard-example Split Test", Proc. Twentieth International Conference on Machine Learning (ICML), (erratum http://www.slab.dnj.ynu.ac.jp/erratumicml2003.pdf) (2003), 840-847.
76. [Yamanishi et al. 2000] Yamanishi, K., Takeuchi J., Williams, G. and Milne, P.: "Online unsupervised outlier detection using finite mixtures with discounting learning algorithms", Proc. Sixth ACMInt'l Conf. on Knowledge Discovery and Data Mining (KDD) (2000), 320-324.
77. [Yamanishi and Takeuchi 2001] Yamanishi, K., Takeuchi, J.: "Discovering Outlier Filtering Rules from Unlabeled Data: Combining a Supervised Learner with an Unsupervised Learner", Proc. Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2001), 389-394.
78. [Yamanishi and Takeuchi 2002] Yamanishi, K., Takeuchi, J.: "A Unifying Framework for Detecting Outliers and Change Points from Non-stationary Time Series Data", Proc. Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data mining (KDD) (2002), 676-681.
79. [Yugami et al. 2000] Yugami, N., Ohta, Y., Okamoto, S.: "Fast Discovery of Interesting Rules", Knowledge Discovery and Data Mining. LNAI 1805 (PAKDD), Springer, Berlin (2000), 17-28.
80. [Zhang et al. 1996] Zhang, T., Ramakrishnan, R., Livny, M.: "BIRCH: An Efficient Data, Clustering Method for Very Large Databases", Proc. 1996 ACM SIGMOD Int'l Conf. on Management of Data (SIGMOD) (1996), 103-114.
81. [Zhong et al. 1999] Zhong, N., Yao, Y. Y., Ohsuga, S.: "Peculiarity Oriented Multi-Database Mining", Principles of Data Mining and Knowledge Discovery (PKDD), LNAI 1704, Springer-Verlag (1999), 136-146.
82. [Zhong et al. 2003] Zhong, N., Yao, Y. Y., Ohshima, M.: "Peculiarity Oriented Multi-Database Mining", IEEE Transaction on Knowledge and Data Engineering, 15, 4 (2003), 952-960.