An iterative hypothesis-testing strategy for pattern discovery

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2003, Pages 49-58

  Bolton, Richard J ^a   Adams, Niall M ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Data mining; Outlier detection; Residual analysis; Statistical models; Uncertainty

Indexed keywords

DATA ANALYSTS; DATA STORAGE; HYPOTHESIS TESTING; ITERATIVE STRATEGY; LARGE DATASETS; OUTLIER DETECTION; OUTLIER DISCOVERY; PATTERN DISCOVERY; REAL DATA SETS; RESIDUAL ANALYSIS; SCALING-UP; STATISTICAL FRAMEWORK; STATISTICAL MODELS; TESTING STRATEGIES;

PHILOSOPHICAL ASPECTS; UNCERTAINTY ANALYSIS;

DATA MINING;

EID: 12244272849     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/956750.956760     Document Type: Conference Paper

References (25)

1. Agrawal, R., Imielinski, T., and Swami, A. (1993) Mining association rules between sets of items in large databases, SIGMOD Record (ACM Special Interest Group on Management of Data), 22:207-216.
2. Bellman, R. E. Adaptive control processes: a guided tour. Princeton, N. J.: Princeton University Press, 1961.
3. Bolton, R. J. and Krzanowski, W. J. (1999) A characterization of principal components for projection pursuit, American Statistician, 53:108-109.
4. Bolton, R. J. and Hand, D. J. Significance tests for patterns in continuous data, in Proceedings of the 2001 IEEE International Conference on Data Mining, 29 November - 2 December 2001, San Jose, California, USA, N. Cercone, T. Y. Lin, and X. Wu, Eds.: IEEE Computer Society Press, 2001, pp. 67-74.
5. Bolton, R. J., Hand, D. J., and Adams, N. M. Determining Hit Rate in Pattern Search, in Pattern Detection and Discovery, ESF Exploratory Workshop, London, UK, Proceedings, LNAI 2447, D. J. Hand, N. M. Adams, and R. J. Bolton, Eds. Berlin: Springer, 2002, pp. 36-48.
6. Breiman, L. (2001) Statistical modeling: The two cultures, Statistical Science, 16:199-215.
7. Chudova, D. and Smyth, P. Pattern discovery in sequences under a Markov assumption, Proceedings of Eighth International Conference on Knowledge Discovery and Data Mining, Edmonton, Canada, 2002.
8. Cook, R. D. and Weisberg, S. Residuals and Influence in Regression. New York: Chapman and Hall, 1982.
9. DuMouchel, W. (1999) Bayesian data mining in large frequency tables, with an application to the FDA spontaneous reporting system (with discussion), The American Statistician, 53:177-202.
10. DuMouchel, W. and Pregibon, D. Empirical Bayes Screening For Multi-Item Associations In Massive Datasets, in Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco, CA: ACM Press, 2001, pp. 67-76.
11. Hand, D. J. (1998) Data mining - reaching beyond statistics, Research in Official Statistics, 2.
12. Hand, D. J., Blunt, G., Kelly, M. G., and Adams, N. M. (2000) Data mining for fun and profit, Statistical Science, 15:111-126.
13. Hand, D. J. and Blunt, G. (2001) Prospecting for gems in credit card data, IMA Journal of Management Mathematics, 12:173-200.
14. Hand, D. J., Mannila, H., and Smyth, P. Principles of Data Mining. Cambridge, MA: MIT Press, 2001.
15. Hand, D. J. and Bolton, R. J. (2002) Pattern Discovery, Imperial College Technical Report.
16. Ingrassia, S. (1992) A comparison between the simulated annealing and the EM algorithms in normal mixture decompositions, Statistics and Computing, 2:203-211.
17. Liu, B., Hsu, W., Mun, L.-F., and Lee, H. (1999) Finding Interesting Patterns using User Expectations, IEEE Transactions on Knowledge and Data Engineering, 11:817-832.
18. Morik, K. Detecting Interesting Instances, in Pattern Detection and Discovery, ESF Exploratory Workshop, London, UK, Proceedings, LNAI 2447, D. J. Hand, N. M. Adams, and R. J. Bolton, Eds. Berlin: Springer, 2002, pp. 13-23.
19. Padmanabhan, B. and Tuzhilin, A. A belief-driven method for discovering unexpected patterns, in Proceedings of the Fourth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1998, pp. 94-110.
20. Padmanabhan, B. and Tuzhilin, A. (2002) Knowledge refinement based on the discovery of unexpected patterns in data mining, Decision Support Systems, 33:309-321.
21. Pigeot, I. (2000) Basic concepts of multiple tests - a survey, Statistical Papers, 41:3-36.
22. Redner, R. A. and Walker, H. F. (1984) Mixture densities, maximum likelihood and the EM algorithm, SIAM Review, 26:195-239.
23. Schonlau, M., DuMouchel, W., Ju, W.-H., Karr, A. F., Theus, M., and Vardi, Y. (2001) Computer intrusion: detecting masquerades, Statistical Science, 16:1-17.
24. Silberschatz, A. and Tuzhilin, A. (1996) What makes patterns interesting in knowledge discovery systems, IEEE Transactions on Knowledge and Data Engineering, 8:970-974.
25. Venables, W. N. and Ripley, B. D. Modern applied statistics with S-PLUS. New York: Springer-Verlag, 1999.