A cusum change-point detection algorithm for non-stationary sequences with application to data network surveillance

Journal of Systems and Software

Volumn 83, Issue 7, 2010, Pages 1288-1297

  Montes De Oca, Veronica ^a   Jeske, Daniel R ^b   Zhang, Qi ^c   Rendon, Carlos ^d   Marvasti, Mazda ^e  

^a United Behavioral Health   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c Minn   (United States)

^d SYMANTEC RESEARCH LABS   (United States)

^e Integrien Corporation   (United States)

Author keywords

Cusum algorithm; Network surveillance; On line detection; Screening

Indexed keywords

CHANGE POINT DETECTION; CUSUM ALGORITHMS; DATA NETWORK; NETWORK SURVEILLANCE; NON-PARAMETRIC; NONSTATIONARY; ON-LINE DETECTION; ROOT CAUSE ANALYSIS; TIME SLOTS; TIME-VARYING DISTRIBUTION;

MONITORING; SIGNAL DETECTION;

ALGORITHMS;

EID: 77953130221     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2010.02.006     Document Type: Article

References (26)

1. Androulidakis G., Chatzigiannakis V., Papavassiliou S., Grammatikou M., and Maglaris V. Understanding and evaluating the impact of sampling on anomaly detection techniques. Military Communications Conference (2006) 1-7
2. Basseville M., and Nikiforov I.V. Detection of Abrupt Changes: Theory and Application (1993), Prentice-Hall, Englewood Cliffs, NJ
3. Brodsky B.E., and Darkhovsky B.S. Nonparametric methods in change-point problems (1993), Kluwer Academic Publishers, Dordrecht, The Netherlands
4. Brook D., and Evans D.A. An approach to the probability distribution of cusum run length. Biometrika 59 (1972) 539-549
5. Chen J., and Gupta A.K. On change-point detection and estimation. Communication in Statistics - Simulation and Computation 30 (2001) 665-697
6. Csorgo M., and Horvath L. Nonparametric tests for the change-point problem. Journal of Statistical Planning and Inference 17 (1987) 1-9
7. Ewan W.D., and Kemp K.W. Sampling inspection of continuous processes with no autocorrelation between successive results. Biometrika 47 (1960) 363-380
8. Hajji H. Statistical analysis of network traffic for adaptive faults detection. IEEE Transactions on Neural Networks 16 (2005) 1053-1063
9. Hariz S.B., and Wylie J.J. Rates of convergence for the change-point estimator for long-range dependent sequences. Statistics and Probability Letters 73 (2005) 155-164
10. Hariz S.B., Wylie J.J., and Zhang Q. Optimal rate of convergence for nonparametric change-point estimators for nonstationary sequences. The Annals of Statistics 35 (2007) 1802-1826
11. Hellerstein J.L., Zhang F., and Shahabuddin P. A statistical approach to predictive detection. Computer Networks 35 (2001) 77-95
12. Kim S., Alexopoulos C., Tsui K., and Wilson J.R. A distribution-free tabular CUSUM chart for autocorrelated data. IIE Transactions 39 (2007) 317-330
13. Lai T.L. Sequential change-point detection in quality control and dynamical systems. Journal of the Royal Statistical Society, Series B 57 (1995) 613-658
14. Lambert D., and Liu C. Adaptive thresholds: Monitoring streams of network counts. Journal of the American Statistical Association 101 (2006) 78-88
15. Lucas J.M., and Crosier R.B. Fast initial response for CUSUM quality control schemes: give your CUSUM a head start. Technometrics 24 (1982) 199-205
16. McDonald D. A cusum procedure based on sequential ranks. Navel Research Logistics 37 (1990) 627-646
17. Montes De Oca, V., (2008). Nonparametric Cusum Algorithms with Applications to Network Surveillance. Ph.D. Thesis, University of California, Riverside, California.
18. Montgomery D.C. Introduction to Statistical Quality Control (1991), John Wiley and Sons, New York, NY
19. Page E.S. Continuous inspection schemes. Biometrika 41 (1954) 100-115
20. Thottan M., and Ji C. Anomaly detection in IP networks. IEEE Transactions on Signal Processing 51 8 (2003) 2191-2204
21. Van Dobben De Bruyn C.S. Cumulative sum tests: theory and practice. In: Stuart A. (Ed). Griffins Statistical Monographs and Courses (1968), Hafner, New York
22. Wang Y. Jump and sharp cusp detection by wavelets. Biometrika 82 (1995) 385-397
23. Willemain T.R., and Runger G.C. Designing control charts using an empirical reference distribution. Journal of Quality Technology 28 (1996) 31-38
24. Wolfe D.A., and Schechtman E. Nonparametric statistical procedures for the change-point problem. Journal of Statistical Planning and Inference 9 (1984) 389-396
25. Woodall W.H. The distribution of the run length of one-sided CUSUM procedures for continuous random variables. Technometrics 25 (1983) 295-301
26. Woodall W.H. On the Markov chain approach to the two-sided CUSUM procedure. Technometrics 26 (1984) 41-46