Signature-based detection of notable transitions in numeric data streams

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 12, 2013, Pages 2867-2879

  Cherniak, Andrii ^a   Zadorozhny, Vladimir I ^a  

^a UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Coherency portrait; Data streams; Notable transitions

Indexed keywords

CHANGE DETECTION; COHERENCY PORTRAIT; DATA STREAM; FREQUENCY COMPONENTS; PROCESS CONDITION; PROCESS DYNAMICS; PROCESS FLUCTUATIONS; RANDOM FLUCTUATION;

PROCESS MONITORING; RANDOM PROCESSES;

DATA COMMUNICATION SYSTEMS;

EID: 84887912724     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.241     Document Type: Article

References (63)

1. C.C. Aggarwal, "A Framework for Diagnosing Changes in Evolving Data Streams," Proc. ACM SIGMOD Int'l Conf. Management Data (SIGMOD '03), pp. 575-586, 2003.
2. J. Agrawal, Y. Diao, D. Gyllstrom, and N. Immerman, "Efficient Pattern Matching over Event Streams," Proc. ACM SIGMOD Int'l Conf. Management Data (SIGMOD '08), pp. 147-160, 2008.
3. J. Allan, J. Carbonell, G. Doddington, J. Yamron, and Y. Yang, "Topic Detection and Tracking Pilot Study Final Report," Proc. DARPA Broadcast News Transcription and Understanding Workshop, 1998.
4. R.S. Anderssen and P. Bloomfield, "Numerical Differentiation Procedures for Non-Exact Data," Numerische Mathematik, vol. 22, no. 3, pp. 157-182, 1972.
5. R.J. Bayardo Jr., "Efficiently Mining Long Patterns from Databases," Proc. ACM SIGMOD Int'l Conf. Management Data (SIGMOD '98), pp. 85-93, 1998. (Pubitemid 128655959)
6. A. Bifet and R. Gavalda, "Learning from Time-Changing Data with Adaptive Windowing," Proc. SIAM Int'l Conf. Data Mining, 2007.
7. J. Borges and M. Levene, "Evaluating Variable-Length Markov Chain Models for Analysis of User Web Navigation Sessions," IEEE Trans. Knowledge and Data Eng., vol. 19, no. 4, pp. 441-452, Apr. 2007.
8. Z.I. Botev, J.F. Grotowski, and D.P. Kroese, "Kernel Density Estimation via Diffusion," The Annals Statistics, vol. 38, no. 5, pp. 2916-2957, Nov. 2010.
9. G.E.P. Box, G.M. Jenkins, and G.C. Reinsel, Time Series Analysis: Forecasting and Control. John & Wiley, 2008.
10. D. Brewer, M. Barenco, R. Callard, M. Hubank, and J. Stark, "Fitting Ordinary Differential Equations to Short Time Course Data," Philosophical Trans. A Math. Physical Eng. Sciences, vol. 366, no. 1865, pp. 519-544, 2008.
11. G. Casella and R.L. Berger, Statistical Inference, second ed. Duxbury Press, 2001.
12. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly Detection: A Survey," ACM Computing Surveys, vol. 41, no. 3, pp. 1-72, July 2009.
13. B. Chandramouli, J. Goldstein, and D. Maier, "High-Performance Dynamic Pattern Matching over Disordered Streams," Proc. VLDB Endowment, vol. 3, pp. 220-231, Sept. 2010.
14. A.W. chee Fu, E. Keogh, L.Y.H. Lau, and C.A. Ratanamahatana, "Scaling and Time Warping in Time Series Querying," Proc. 31st Int'l Conf. Very Large Data Bases (VLDB '05), pp. 649-660, 2005. (Pubitemid 43991041)
15. S. Chen, H. Wang, S. Zhou, and P.S. Yu, "Stop Chasing Trends: Discovering High Order Models in Evolving Data," Proc. IEEE 24th Int'l Conf. Data Eng., pp. 923-932, 2008.
16. B. Chiu, E. Keogh, and S. Lonardi, "Probabilistic Discovery of Time Series Motifs," Proc. Ninth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '03), pp. 493-498, 2003.
17. D. Dasgupta and S. Forrest, "Novelty Detection in Time Series Data Using Ideas from Immunology," Proc. Int'l Conf. Intelligent Systems, 1995.
18. T. Dasu, S. Krishnanand, D. Lin, S. Venkatasubramanian, and K. Yi, "Change (Detection) You Can Believe in: Finding Distributional Shifts in Data Streams," Proc. Eighth Int'l Symp. Intelligent Data Analysis: Advances in Intelligent Data Analysis VIII (IDA '09), pp. 21-34, 2009.
19. R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, second ed. Wiley-Interscience, 2000.
20. C. Faloutsos, H. Jagadish, A. Mendelzon, and T. Milo, "A Signature Technique for Similarity-Based Queries," Proc. Compression and Complexity of Sequences (SEQUENCES '97), pp. 2-20, 1997.
21. A. Floratou, S. Tata, and J.M. Patel, "Efficient and Accurate Discovery of Patterns in Sequence Data Sets," Proc. IEEE 26th Int'l Conf. Data Eng. (ICDE), pp. 461-472, Mar. 2010.
22. R. Fujimaki, T. Yairi, and K. Machida, "An Approach to Spacecraft Anomaly Detection Problem Using Kernel Feature Space," Proc. 11th ACM SIGKDD Int'l Conf. Knowledge Discovery in Data Mining (KDD '05), pp. 401-410, 2005. (Pubitemid 43218302)
23. C. Gazen, J. Carbonell, and P. Hayes, "Novelty Detection in Data Streams: A Small Step Towards Anticipating Strategic Surprise," Proc. Novel Intelligence from Massive Data (NIMD) PI Meeting, 2005.
24. A. Graps, "An Introduction to Wavelets," http://www.amara.com/ IEEEwave/IEEEwavelet.html, 2013.
25. X. Gu and H. Wang, "Online Anomaly Prediction for Robust Cluster Systems," Proc. IEEE 25th Int'l Conf. Data Eng. (ICDE '09), pp. 1000-1011, 2009.
26. J. Han, J. Pei, and Y. Yin, "Mining Frequent Patterns without Candidate Generation," ACM SIGMOD Record, vol. 29, pp. 1-12, May 2000.
27. H. Hoffmann, "Kernel PCA for Novelty Detection," Pattern Recognition, vol. 40, pp. 863-874, Mar. 2007.
28. Y. Kawahara and M. Sugiyama, "Change-Point Detection in Time-Series Data by Direct Density-Ratio Estimation," Proc. SIAM Int'l Conf. Data Mining (SDM), pp. 389-400, 2009.
29. Y. Kawahara and M. Sugiyama, "Sequential Change-Point Detection Based on Direct Density-Ratio Estimation," Statistical Analysis and Data Mining, vol. 5, no. 2, pp. 114-127, 2012.
30. E. Keogh and C.A. Ratanamahatana, "Exact Indexing of Dynamic Time Warping," Knowledge Information Systems, vol. 7, pp. 358-386, Mar. 2005. (Pubitemid 40347209)
31. B. Krishnamurthy, S. Sen, Y. Zhang, and Y. Chen, "Sketch-Based Change Detection: Methods, Evaluation, and Applications," Proc. Third ACM SIGCOMM Conf. Internet Measurement (IMC '03), pp. 234-247, 2003. (Pubitemid 40730656)
32. D. Kifer, S. Ben-David, and J. Gehrke, "Detecting Change in Data Streams," Proc. 30th Int'l Conf. Very Large Data Bases (VLDB '04), vol. 30, pp. 180-191, 2004.
33. L. Li, B.A. Prakash, and C. Faloutsos, "Parsimonious Linear Fingerprinting for Time Series," Proc. VLDB Endowment, vol. 3, pp. 385-396, Sept. 2010.
34. M. Markou and S. Singh, "Novelty Detection: A Review? Part 1: Statistical Approaches," Signal Processing, vol. 83, no. 12, pp. 2481-2497, Dec. 2003.
35. "MATLAB: Digital Filter," http://www.mathworks.com/, 2013.
36. J.H. Miller and S.E. Page, Complex Adaptive Systems: An Introduction to Computational Models of Social Life. Princeton Univ. Press, Mar. 2007.
37. A. Moore, G. Cooper, R. Tsui, and M. Wagner, "Summary of Biosurveillance-Relevant Statistical and Data Mining Technologies," RODS Laboratory technical report, Feb. 2002.
38. S. Muthukrishnan, E. van den Berg, and W. Yihua, "Sequential Change Detection on Data Streams," Proc. IEEE Seventh Int'l Conf. Data Mining Workshops (ICDM Workshops), pp. 551-550, Oct. 2007.
39. D.B. Neill, "Expectation-Based Scan Statistics for Monitoring Spatial Time Series Data," Int'l J. Forecasting, vol. 25, pp. 498-517, 2009.
40. D.B. Neill and W.-K. Wong, "Tutorial on Event Detection," Proc. Int'l Conf. Knowledge Discovery Data Mining (KDD), 2009.
41. C.C. Noble and D.J. Cook, "Graph-Based Anomaly Detection," Proc. Ninth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '03), pp. 631-636, 2003.
42. A. Oppenheim, R.W. Schafer, and J.R. Buck, Discrete-Time Signal Processing, Signal Processing Series, second ed. Prentice-Hall, 1999.
43. J.M. Ponte and W.B. Croft, "Text Segmentation by Topic," Proc. First European Conf. Research and Advanced Technology for Digital Libraries, pp. 120-129, 1997.
44. A. Prakash, N. Valler, D. Andersen, M. Faloutsos, and C. Faloutsos, "BGP-Lens: Patterns and Anomalies in Internet Routing Updates," Proc. 15th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '09), 2009.
45. B.A. Prakash, H. Tong, N. Valler, M. Faloutsos, and C. Faloutsos, "Virus Propagation on Time-Varying Networks: Theory and Immunization Algorithms," Proc. European Conf. Machine Learning and Knowledge Discovery Databases: Part III (ECML PKDD '10), pp. 99-114, 2010.
46. L. Saitta, A. Giordana, and A. Cornujols, Phase Transitions in Machine Learning, first ed. Cambridge Univ. Press, 2011.
47. B. Schoelkopf and A.J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, 2002.
48. M. Severo and J. Gama, "Change Detection with Kalman Filter and CUSUM," Ubiquitous Knowledge Discovery, Springer-Verlag, 2010.
49. C. Shing Perng, H. Wang, S.R. Zhang, and D.S. Parker, "Landmarks: A New Model for Similarity-Based Pattern Querying in Time Series Databases," Proc. 16th Int'l Conf. Data Eng., p. 33, 2000.
50. E.J. Spinosa, A.P. de Leon, F. de'Carvalho, and J.a. Gama, "Novelty Detection with Application to Data Streams," Intelligent Data Analysis, vol. 13, pp. 405-422, Aug. 2009.
51. R. Steinert and D. Gillblad, "Long-Term Adaptation and Distributed Detection of Local Network Changes," Proc. IEEE GLOBECOM '10, Dec. 2010.
52. J.-i. Takeuchi and K. Yamanishi, "A Unifying Framework for Detecting Outliers and Change Points from Time Series," IEEE Trans. Knowledge and Data Eng., vol. 18, no. 4, pp. 482-492, Apr. 2006. (Pubitemid 43327098)
53. H. Wang, W. Fan, P.S. Yu, and J. Han, "Mining Concept-Drifting Data Streams Using Ensemble Classifiers," Proc. Ninth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining (KDD '03), pp. 226-235, 2003.
54. P. Wang, H. Wang, W. Wangf, "Finding Semantics in Time Series," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '11), pp. 385-396, 2011.
55. E. Weisstein, "Bifurcation," From MathWorld-A Wolfram Web Resource, http://mathworld.wolfram.com/Bifurcation.html, 2013.
56. E. Weisstein, "Gibbs Phenomenon," From MathWorld-A Wolfram Web Resource, http://mathworld.wolfram.com/GibbsPhenome non.html, 2013.
57. E. Weisstein, "Logistic Equation," From MathWorld-A Wolfram Web Resource, http://mathworld.wolfram.com/LogisticEquation.html, 2013.
58. E. Weisstein, "Fold Bifurcation," From MathWorld-A Wolfram Web Resource, http://mathworld.wolfram.com/FoldBifurcation.html, 2013.
59. E. Weisstein, "Parseval's Theorem," From MathWorld-A Wolfram Web Resource, http://mathworld.wolfram.com/ParsevalsTheor em.html, 2013.
60. E. Wu, Y. Diao, and S. Rizvi, "High-Performance Complex Event Processing Over Streams," Proc. ACM SIGMOD Int'l Conf. Management of Data (SIGMOD '06), pp. 407-418, 2006. (Pubitemid 46957508)
61. B. Xiang, D. Jiang, J. Pei, X. Sun, E. Chen, and H. Li, "Context-Aware Ranking in Web Search," Proc. 33rd Int'l ACM SIGIR Conf. Research and Development Information Retrieval (SIGIR '10), pp. 451-458, 2010.
62. K. Yamanishi, J.-i. Takeuchi, G. Williams, and P. Milne, "On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms," Data Mining and Knowledge Discovery, vol. 8, pp. 275-300, 2004. (Pubitemid 39019964)
63. Y. Yang, X. Wu, and X. Zhu, "Combining Proactive and Reactive Predictions for Data Streams," Proc. 11th ACM SIGKDD Int'l Conf. Knowledge Discovery Data Mining (KDD '05), pp. 710-715, 2005. (Pubitemid 43218344)