Using labeled data to evaluate change detectors in a multivariate streaming environment

Signal Processing

Volumn 89, Issue 12, 2009, Pages 2529-2536

  Kim, Albert Y ^a   Marzban, Caren ^a   Percival, Donald B ^a   Stuetzle, Werner ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Block bootstrap; Change point detection; Time series analysis

Indexed keywords

BLOCK BOOTSTRAP; CHANGE DETECTION; CHANGE DETECTORS; CHANGE POINT DETECTION; DATA STREAM; DETECTION ALGORITHM; DETECTOR SIGNALS; FALSE ALARM RATE; IMAGE STREAMS; INPUT VECTOR; LABELED DATA; MULTIVARIATE DATA; RECEIVER OPERATING CHARACTERISTIC CURVES; TRAINING DATA; UNIVARIATE;

ALARM SYSTEMS; ALGORITHMS; DATA COMMUNICATION SYSTEMS; LABELS; SIGNAL DETECTION; TIME SERIES; TIME SERIES ANALYSIS; VISUAL COMMUNICATION;

DETECTORS;

EID: 67651119911     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2009.04.011     Document Type: Article

References (25)

1. T.W. Anderson, Sampling permutations for nonparametric methods, in: B. Ranneby (Ed.), Statistics in Theory and Practice: Essays in Honour of Bertil Matérn, Swedish University of Agricultural Sciences, Umeå, Sweden, 1982, pp. 43-52.
2. Aslan B., and Zech G. New test for the multivariate two-sample problem based on the concept of minimum energy. Journal of Statistical Computation and Simulation 75 (2005) 109-119
3. Bélisle P., Joseph L., MacGibbon B., Wolfson D.B., and du Berger R. Change-point analysis of neuron spike train data. Biometrics 54 (1998) 113-123
4. Bühlmann P. Bootstraps for time series. Statistical Science 17 (2002) 52-72
5. Efron B., and Tibshirani R.J. An Introduction to the Bootstrap (1993), Chapman & Hall, New York
6. Fawcett T. An introduction to ROC analysis. Pattern Recognition Letters 27 (2006) 861-874
7. Frisén M. Statistical surveillance. Optimality and methods. International Statistical Review 71 (2003) 403-434
8. M. Grimm, K. Kroschel (Eds.), Robust Speech Recognition and Understanding, I-Tech Education and Publishing, Vienna, Austria, 2007.
9. Hesterberg T., Moore D.S., Monaghan S., Clipson A., and Epstein R. Bootstrap Methods and Permutation Tests. second ed. (2005), W.H. Freeman, New York
10. Moore D.S., and McCabe G.P. Introduction to the Practice of Statistics. fifth ed. (2005), W.H. Freeman, New York. http://bcs.whfreeman.com/ips5e/content/cat_080/pdf/moore14.pdf 〈http://bcs.whfreeman.com/ips5e/content/cat_080/pdf/moore14.pdf〉 (Chapter 14 in online version)
11. D. Kifer, S. Ben-David, J. Gehrke, Detecting change in data streams, in: Proceedings of the 30th Very Large Data Base (VLDB) Conference, Toronto, Canada, 2004, pp. 180-191.
12. Lahiri S.N. Resampling Methods for Dependent Data (2003), Springer, New York
13. Lai T.L. Sequential changepoint detection in quality control and dynamical systems. Journal of the Royal Statistical Society, Series B (Methodological) 57 (1995) 613-658
14. Lehmann E.L., and Romano J.P. Testing Statistical Hypotheses. third ed. (2005), Springer, New York
15. Li F., Runger G.C., and Tuv E. Supervised learning for change-point detection. International Journal of Production Research 44 (2006) 2853-2868
16. S.A. Macskassy, F. Provost, Confidence bands for ROC curves: methods and an empirical study, in: First Workshop on ROC Analysis in AI, ECAI-2004, Spain, 2004.
17. Markou M., and Singh S. Novelty detection: a review-part 1: statistical approaches. Signal Processing 83 (2003) 2481-2497
18. Markou M., and Singh S. Novelty detection: a review-part 2: neural network based approaches. Signal Processing 83 (2003) 2499-2521
19. Pievatolo A., and Rotondi R. Analysing the interevent time distribution to identify seismicity phases: a Bayesian nonparametric approach to the multiple-changepoint problem. Applied Statistics 49 (2000) 543-562
20. Politis D.N., Romano J.P., and Wolf M. Subsampling (1999), Springer, New York
21. R. Rubinfeld, R. Servedio, Testing monotone high-dimensional distributions, in: Proceedings of the 37th Annual Symposium on Theory of Computing (STOC), 2005, pp. 147-156.
22. Runger G.C., and Testik M.C. Multivariate extensions to cumulative sum control charts. Quality and Reliability Engineering International 20 (2004) 587-606
23. G.J. Székely, Potential and kinetic energy in statistics, in: Lecture Notes, Budapest Institute of Technology, Technical University, 1989.
24. G.J. Székely, E-statistics: energy of statistical samples, Technical Report No. 03-05, Bowling Green State University, Department of Mathematics and Statistics, 2000.
25. G.J. Székely, M.L. Rizzo, Testing for equal distributions in high dimension, InterStat, 2004.