Change (detection) you can believe in: Finding distributional shifts in data streams

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5772 LCNS, Issue , 2009, Pages 21-34

  Dasu, Tamraparni ^a   Krishnan, Shankar ^a   Lin, Dongyu ^b   Venkatasubramanian, Suresh ^c   Yi, Kevin ^d  

^a AT AND T LABS RESEARCH   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c UNIVERSITY OF UTAH   (United States)

^d HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

DATA STREAM; HYPOTHESIS TESTING; KULLBACK-LEIBLER DISTANCE; MODEL ASSUMPTIONS; MULTIDIMENSIONAL DATA; NON-PARAMETRIC; REAL-LIFE APPLICATIONS; RELATIVE ENTROPY; SLIDING WINDOW; STATISTICAL APPROACH; STATISTICAL DISTANCE; STATISTICAL THEORY; SYNTHETIC DATA;

WINDOWS;

DATA COMMUNICATION SYSTEMS;

EID: 70349852947     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-03915-7_3     Document Type: Conference Paper

References (22)

1. Aggarwal, C.C.: A framework for diagnosing changes in evolving data streams. In: Proceedings of the ACM SIGMOD International Conference on Management of Data, pp. 575-586 (2003)
2. Babcock, B., Datar, M., Motwani, R.: Sampling from a moving window over streaming data. In: SODA, pp. 633-634 (2002)
3. Chawathe, S.S., Abiteboul, S., Widom, J.: Representing and querying changes in semistructured data. In: ICDE 1998, pp. 4-13 (1998)
4. Cover, T.M., Thomas, J.A.: Elements of Information Theory. John Wiley and Sons, Inc., Chichester (1991)
5. Csiszár, I., Körner, J.: Information Theory: Coding Theorems for Discrete Memoryless Systems. Academic Press, London (1981)
6. Dasu, T., Krishnan, S., Venkatasubramanian, S., Yi, K.: An information-theoretic approach to detecting changes in multi-dimensional data streams. In: Interface 2006 (2006)
7. Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman and Hall, Boca Raton (1993)
8. Fleiss, J.L., Levin, B., Paik, M.: Statistical Methods for Rates and Proportions, 3rd edn. John Wiley and Sons, New York (2003)
9. Ganti, V., Gehrke, J., Ramakrishnan, R., Loh, W.-Y.: A framework for measuring differences in data characteristics. pp. 126-137 (1999)
10. Gutman, M.: Asymptotically optimal classificatioin for multiple tests with empirically observed statistics. IEEE Trans. Inf. Theory 35, 401-408 (1989)
11. Hulten, G., Spencer, L., Domingos, P.: Mining time-changing data streams. In: KDD, pp. 97-106 (2001)
12. Johnson, D., Gruner, C.: Information-theoretic analysis of neural coding. Journal of Computational Neuroscience 10, 47-69 (2001)
13. Keogh, E., Lonardi, S., Chiu, B.Y.: Finding surprising patterns in a time series database in linear time and space. In: KDD, pp. 550-556 (2002)
14. Kifer, D., Ben-David, S., Gehrke, J.: Detecting changes in data streams. In: Proceedings of the 30th International Conference on Very Large Databases, pp. 180-191 (2004)
15. Kleinberg, J.: Bursty and hierarchical structure in streams. Data Mining and Knowledge Discovery 7(4), 373-397 (2003)
16. Krichevsky, R.E., Troffmov, V.K.: The performance of universal encoding. IEEE Trans. Inf. Theory 27, 199-207 (1981)
17. Pereira, F., Tishby, N., Lee, L.: Distributional clustering of English words. In: 31st Annual Meeting of the ACL, pp. 183-190 (1993)
18. Pietra, S.D., Pietra, V.D., Lafferty, J.: Inducing features of random fields. IEEE Trans. Pattern Analysis and Machine Intelligence 19, 380-393 (1995)
19. Shibata, R.: Bootstrap estimate of Kullback-Liebler information for model selection. Statistica Sinica 7, 375-394 (1997)
20. Song, X., Wu, M., Jermaine, C., Ranka, S.: Statistical change detection for multidimensional data. In: ACM SIGKDD 2007, pp. 667-676 (2007)
21. Subramaniam, S., Palpanas, T., Papadopoulos, D., Kalogeraki, V., Gunopulos, D.: Online outlier detection in sensor data using non-parametric models. In: VLDB 2006, pp. 187-198 (2006)
22. Vitter, J.S.: Random sampling with a reservoir. ACM Transactions on Mathematical Software 11, 37-57 (1985)