Mining statistically significant substrings using the chi-square statistic

Proceedings of the VLDB Endowment

Volumn 5, Issue 10, 2012, Pages 1052-1063

  Sachan, Mayank ^a   Bhattacharya, Arnab ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY KANPUR   (India)

Author keywords

[No Author keywords available]

Indexed keywords

CRYPTOGRAPHY; INTRUSION DETECTION;

AUTOMATED MONITORING SYSTEMS; CHI SQUARE STATISTIC; COMPUTATIONAL BIOLOGY; EMPIRICAL DISTRIBUTIONS; INTRUSION DETECTION SYSTEMS; QUANTITATIVE MEASURES; SIGNIFICANT PATTERNS; STATISTICAL SIGNIFICANCE;

SATELLITES;

EID: 84873152625     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: 10.14778/2336664.2336677     Document Type: Article

References (27)

1. M. Abramowitz and I. Stegun. Handbook of Mathematical Functions. Wiley, 1964.
2. S. Agarwal. On finding the most statistically significant substring using the chi-square measure. Master's thesis, Indian Institute of Technology, Kanpur, 2009.
3. M. Atallah, R. Gwadera, and W. Szpankowski. Detection of significant sets of episodes in event sequences. In ICDM, pages 3-10, 2004.
4. G. Box, W. Hunter, and J. Hunter. Statistics for Experimenters. Wiley, 1978.
5. H. Chernoff and E. Lehmann. The use of maximum likelihood estimates in chi-square tests for goodness of fit. The Annals of Mathematical Statistics, 25(3):579-586, 1954.
6. P. Cootner. The Random Character of Stock Market Prices. MIT, 1964.
7. A. Denise, M. Régnier, and M. Vandenbogaert. Assessing the statistical significance of overrepresented oligonucleotides. In WABI, pages 537-552, 2001.
8. R. Durrett. Probability: Theory and Examples. Cambridge University Press, 2010.
9. S. Dutta and A. Bhattacharya. Most significant substring mining based on chi-square measure. In PAKDD, pages 319-327, 2010.
10. S. Dutta and A. Bhattacharya. Mining statistically significant substrings based on the chi-square measure. In Pattern Discovery Using Sequence Data Mining: Applications and Studies, pages 73-82. IGI Global, 2012.
11. H. Frommer and F. Frommer. Red Sox vs Yankees: The Great Rivalry. Sports Publishing LLC, 2004.
12. O. Goldreich. Modern cryptography, probabilistic proofs and pseudorandomness. Springer-Verlag, 1999.
13. R. Goonatilake, A. Herath, S. Herath, S. Herath, and J. Herath. Intrusion detection using the chi-square goodness-of-fit test for information assurance, network, forensics and software security. J. Computing Sciences, 23(1):255-263, 2007.
14. D. Gusfield. Algorithms on strings, trees, and sequences. Cambridge University Press, 1997.
15. R. Gwadera, M. Atallah, and W. Szpankowski. Reliable detection of episodes in event sequences. Knowl. Inf. Syst., 7(4):415-437, 2005.
16. W. Hoeffding. Probability inequalities for sums of bounded random variables. J. American Statistical Association, 58(301):13-30, 1963.
17. M. Kaboudan. Genetic programming prediction of stock prices. Computational Economics, 16(3):207-236, 2000.
18. I. Kuznetsov and S. Rackovsky. Identification of non-random patterns in structural and mutational data: the case of prion protein. In CSB, pages 604-608, 2003.
19. H. Mannila, H. Toivonen, and A. Verkamo. Discovering frequent episodes in sequences. In KDD, pages 210-215, 1995.
20. D. Panchenko. 23 Lecture. In Statistics for Applications. MIT Open Course Ware, 2003.
21. H. Patel. Quality control methods for multivariate binomial and poisson distributions. Technometrics, 15(1):103-112, 1973.
22. R. Povinelli. Identifying temporal patterns for characterization and prediction of financial time series events. IEEE Trans. Knowl. Data Eng., 15(2):339-352, 2003.
23. S. Rahmann. Dynamic programming algorithms for two statistical problems in computational biology. In WABI, pages 151-164, 2003.
24. T. Read and N. Cressie. Goodness-of-Fit Statistics for Discrete Multivariate Data. Springer, 1988.
25. M. Régnier and M. Vandenbogaert. Comparison of statistical significance criteria. J. Bioinformatics and Computational Biology, 4(2):537-551, 2006.
26. N. Ye and Q. Chen. An anomaly detection technique based on a chi-square statistic for detecting intrusions into information systems. Quality and Reliability Engineering International, 17:105-112, 2001.
27. N. Ye, X. Li, Q. Chen, S. Emran, and M. Xu. Probabilistic techniques for intrusion detection based on computer audit data. IEEE Transactions on Systems, Man, and Cybernetics, 31(4):266-274, 2001.