Pattern discovery in data streams under the time warping distance

VLDB Journal

Volumn 22, Issue 3, 2013, Pages 295-318

  Toyoda, Machiko ^a   Sakurai, Yasushi ^a   Ishikawa, Yoshiharu ^b  

^a Nippon Telegraph and Telephone Corporation   (Japan)

^b NAGOYA UNIVERSITY   (Japan)

Author keywords

Data streams; Dynamic time warping; Subsequence matching

Indexed keywords

DATA STREAM; DATA STREAM PROCESSING; DYNAMIC TIME WARPING; EXPERIMENTAL EVALUATION; SIMILARITY MEASURE; STRAIGHT-FORWARD METHOD; STREAMING ALGORITHM; SUBSEQUENCE MATCHING;

ALGORITHMS; DATA COMMUNICATION SYSTEMS;

DATA MINING;

EID: 84877876319     PISSN: 10668888     EISSN: 0949877X     Source Type: Journal    
DOI: 10.1007/s00778-012-0289-3     Document Type: Article

References (75)

1. Abadi, D. J., Carney, D., Cetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S. B.: Aurora: a new model and architecture for data stream management. VLDB J. 12(2), 120-139 (2003).
2. Agrawal, R., Faloutsos, C., Swami, A. N.: Efficient similarity search in sequence databases. In: FODO, pp. 69-84 (1993).
3. Arasu, A., Babcock, B., Babu, S., McAlister, J., Widom, J.: Char acterizing memory requirements for queries over continuous data streams. In: PODS, pp. 221-232 (2002).
4. Assent, I., Wichterich, M., Krieger, R., Kremer, H., Seidl, T.: Anticipatory dtw for efficient similarity search in time series databases. PVLDB 2(1), 826-837 (2009).
5. Athitsos, V., Papapetrou, P., Potamias, M., Kollios, G., Gunopulos, D.: Approximate embedding-based subsequence matching of time series. In: SIGMOD Conference, pp. 365-378 (2008).
6. Babcock, B., Babu, S., Datar, M., Motwani, R.: Chain: operator scheduling for memory minimization in data stream systems. In: SIGMOD Conference, pp. 253-264. San Diego, California (2003).
7. Babcock, B., Datar, M., Motwani, R.: Sampling from a moving window over streaming data. In: SODA, pp. 633-634. San Francisco, CA (2002).
8. Beckmann, N., Kriegel, H. P., Schneider, R., Seeger, B.: The r*-tree: an efficient and robust access method for points and rectangles. In: SIGMOD Conference (1990).
9. Berndt, D. J., Clifford, J.: Finding patterns in time series: a dynamic programming approach. In: Advances in Knowledge Discovery and Data Mining, pp. 229-248 (1996).
10. Cao, H., Wolfson, O., Trajcevski, G.: Spatio-temporal data reduction with deterministic error bounds. VLDB J. 15(3), 211-228 (2006).
11. Carney, D., Cetintemel, U., Rasin, A., Zdonik, S. B., Cherniack, M., Stonebraker, M.: Operator scheduling in a data stream manager. In: VLDB, pp. 838-849. Berlin, Germany (2003).
12. Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M. J., Hellerstein, J. M., Hong, W., Krishnamurthy, S., Madden, S., Raman, V., Reiss, F., Shah, M. A.: Telegraphcq: continuous dataflow processing for an uncertain world. In: CIDR. Asilomar (2003).
13. Chandrasekaran, S., Franklin, M. J.: Remembrance of streams past: overload-sensitive management of archived streams. In: VLDB, pp. 348-359 (2004).
14. Chen, L., Ng, R. T.: On the marriage of lp-norms and edit distance. In: VLDB, pp. 792-803 (2004).
15. Chen, L., Özsu, M. T., Oria, V.: Robust and fast similarity search for moving object trajectories. In: SIGMOD Conference, pp. 491-502 (2005).
16. Chen, Y., Nascimento, M. A., Ooi, B. C., Tung, A. K. H.: Spade: on shape-based pattern detection in streaming time series. In: ICDE, pp. 786-795 (2007).
17. Cormode, G., Datar, M., Indyk, P., Muthukrishnan, S.: Comparing data streams using hamming norms (how to zero in). In: VLDB, pp. 335-345. Hong Kong, China (2002).
18. Cormode, G., Korn, F., Tirthapura, S.: Time-decaying aggregates in out-of-order streams. In: PODS, pp. 89-98 (2008).
19. Cranor, C. D., Johnson, T., Spatscheck, O., Shkapenyuk, V.: Gigascope: a stream database for network applications. In: SIGMOD Conference, pp. 647-651. San Diego, California (2003).
20. Das, A., Gehrke, J., Riedewald, M.: Approximate join processing over data streams. In: SIGMOD Conference, pp. 40-51. San Diego, California (2003).
21. Datar, M., Gionis, A., Indyk, P., Motwani, R.: Maintaining stream statistics over sliding windows. In: SODA, pp. 635-644. San Fran cisco, CA (2002).
22. Ding, H., Trajcevski, G., Scheuermann, P., Wang, X., Keogh, E. J.: Querying and mining of time series data: experimental comparison of representations and distance measures. PVLDB 1(2), 1542-1552 (2008).
23. Dobra, A., Garofalakis, M. N., Gehrke, J., Rastogi, R.: Processing complex aggregate queries over data streams. In: SIGMOD Conference, pp. 61-72. Madison, Wisconsin (2002).
24. Eckmann, J. P., Kamphorst, S. O., Ruelle, D.: Recurrence plots of dynamical systems. Europhys. Lett. (epl) 4, 973-977 (1987).
25. Faloutsos, C., Ranganathan, M., Manolopoulos, Y.: Fast subsequence matching in time-series databases. In: SIGMOD Conference, pp. 419-429 (1994).
26. Fiscus, J. G., Ajot, J., Garofolo, J. S.: The rich transcription 2007 meeting recognition evaluation. In: Multimodal Technologies for Perception of Humans, International Evaluation Workshops CLEAR 2007 and RT 2007, Lecture Notes in Computer Science, vol. 4625, pp. 373-389. Springer, Berlin (2008).
27. Ganguly, S., Garofalakis, M. N., Rastogi, R.: Processing set expressions over continuous update streams. In: SIGMOD Conference, pp. 265-276. San Diego, CA (2003).
28. Gehrke, J. E., Korn, F., Srivastava, D.: On computing correlated aggregates over continual data streams. In: SIGMOD Conference. Santa Barbara, California (2001).
29. Gilbert, A. C., Guha, S., Indyk, P., Muthukrishnan, S., Strauss, M.: Near-optimal sparse fourier representations via sampling. In: STOC, pp. 152-161 (2002).
30. Gilbert, A. C., Kotidis, Y., Muthukrishnan, S., Strauss, M.: Surfing wavelets on streams: one-pass summaries for approximate aggregate queries. In: VLDB, pp. 79-88. Rome, Italy (2001).
31. Han, W. S., Lee, J., Moon, Y. S., Jiang, H.: Ranked subsequence matching in time-series databases. In: VLDB, pp. 423-434 (2007).
32. Jang, J. S. R., Lee, H. R.: Hierarchical filtering method for content-based music retrieval via acoustic input. In: ACM Multimedia, pp. 401-410 (2001).
33. Kanth, K. V. R., Agrawal, D., Singh, A. K.: Dimensionality reduction for similarity searching in dynamic databases. In: SIGMOD Conference, pp. 166-176 (1998).
34. Kawasaki, H., Yatabe, T., Ikeuchi, K., Sakauchi, M.: Automatic modeling of a 3d city map from real-world video. In: ACM Multimedia, vol. 1, pp. 11-18 (1999).
35. Keogh, E. J.: Exact indexing of dynamic time warping. In: VLDB, pp. 406-417 (2002).
36. Keogh, E. J., Chakrabarti, K., Mehrotra, S., Pazzani, M. J.: Locally adaptive dimensionality reduction for indexing large time series databases. In: SIGMOD Conference, pp. 151-162 (2001).
37. Korn, F., Muthukrishnan, S., Wu, Y.: Modeling skew in data streams. In: SIGMOD Conference, pp. 181-192 (2006).
38. Lange, R., Farrell, T., Dürr, F., Rothermel, K.: Remote real-time trajectory simplification. In: PerCom, pp. 1-10 (2009).
39. Lathi, B. P.: Signal Processing and Linear Systems. Oxford University Press, Oxford (1998).
40. Li, L., McCann, J., Pollard, N. S., Faloutsos, C.: DynaMMo: mining and summarization of coevolving sequences with missing values. In: KDD, pp. 507-516 (2009).
41. Madden, S., Shah, M. A., Hellerstein, J. M., Raman, V.: Continuously adaptive continuous queries over streams. In: SIGMOD Conference, pp. 49-60. Madison, Wisconsin (2002).
42. Matsubara, Y., Sakurai, Y., Faloutsos, C., Iwata, T., Yoshikawa, M.: Fast mining and forecasting of complex time-stamped events. In: KDD, pp. 271-279 (2012).
43. Mokbel, M. F., Aref, W. G.: SOLE: scalable on-line execution of continuous queries on spatio-temporal data streams. VLDB J. 17(5), 971-995 (2008).
44. Motwani, R., Widom, J., Arasu, A., Babcock, B., Babu, S., Datar, M., Manku, G. S., Olston, C., Rosenstein, J., Varma, R.: Query processing, approximation, and resource management in a data stream management system. In: CIDR. Asilomar (2003).
45. Mount, D. W.: Bioinformatics: Sequence and Genome Analysis. Cold Spring Harbor Laboratory, New York (2000).
46. Mueen, A., Keogh, E. J.: Online discovery and maintenance of time series motifs. In: KDD, pp. 1089-1098 (2010).
47. Mueen, A., Nath, S., Liu, J.: Fast approximate correlation for massive time-series data. In: SIGMOD Conference, pp. 171-182 (2010).
48. Nasraoui, O., Rojas, C., Cardona, C.: A framework for mining evolving trends in web data streams using dynamic learning and retrospective validation. Comput. Netw. 50(10), 1488-1512 (2006).
49. Ogras, Ü. Y., Ferhatosmanogl, H.: Online summarization of dynamic time series data. VLDB J. 15(1), 84-98 (2006).
50. Papadimitriou, S., Brockwell, A., Faloutsos, C.: Adaptive, hands-off stream mining. In: VLDB, pp. 560-571 (2003).
51. Papadimitriou, S., Sun, J., Faloutsos, C.: Streaming pattern discovery in multiple time-series. In: VLDB, pp. 697-708 (2005).
52. Papadimitriou, S., Yu, P. S.: Optimal multi-scale patterns in time series streams. In: SIGMOD Conference, pp. 647-658 (2006).
53. Popivanov, I., Miller, R. J.: Similarity search over time-series data using wavelets. In: ICDE, pp. 212-224 (2002).
54. Rabiner, L., Juang, B. H.: Fundamentals of Speech Recognition. Prentice Hall, Englewood Cliffs (1993).
55. Rakthanmanon, T., Campana, B., Mueen, A., Batista, G., Westover, B., Zhu, Q., Zakaria, J., Keogh, E.: Searching and mining trillions of time series subsequences under dynamic time warping. In: KDD, pp. 262-270 (2012).
56. Reeves, G., Liu, J., Nath, S., Zhao, F.: Managing massive time series streams with multi-scale compressed trickles. PVLDB 2(1), 97-108 (2009).
57. Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans. Acoust. Speech Signal Process. 26(1), 43-49 (1978).
58. Sakurai, Y., Faloutsos, C., Yamamuro, M.: Stream monitoring under the time warping distance. In: ICDE, pp. 1046-1055 (2007).
59. Sakurai, Y., Li, L., Matsubara, Y., Faloutsos, C.: WindMine: fast and effective mining of web-click sequences. In: SDM, pp. 759-770 (2011).
60. Sakurai, Y., Papadimitriou, S., Faloutsos, C.: BRAID: stream min ing through group lag correlations. In: SIGMOD Conference, pp. 599-610 (2005).
61. Sakurai, Y., Yoshikawa, M., Faloutsos, C.: FTW: fast similarity search under the time warping distance. In: PODS, pp. 326-337 (2005).
62. Silva, Y. N., Aref, W. G., Ali, M. H.: Similarity group-by. In: ICDE, pp. 904-915 (2009).
63. Smith, T. F., Waterman, M. S.: Identification of common molecular subsequences. J. Mol. Biol. 147, 195-197 (1981).
64. Tatbul, N., Cetintemel, U., Zdonik, S. B., Cherniack, M., Stonebraker, M.: Load shedding in a data stream manager. In: VLDB, pp. 309-320. Berlin, Germany (2003).
65. Toyoda, M., Sakurai, Y.: Discovery of cross-similarity in data streams. In: ICDE, pp. 101-104 (2010).
66. Toyoda, M., Sakurai, Y., Ichikawa, T.: Identifying similar subsequences in data streams. In: DEXA Lecture Notes in Computer Science, vol. 5181, pp. 210-224 (2008).
67. Vlachos, M., Gunopulos, D., Kollios, G.: Discovering similar multidimensional trajectories. In: ICDE, pp. 673-684 (2002).
68. Wu, H., Salzberg, B., Zhang, D.: Online event-driven subsequence matching over financial data streams. In: SIGMOD Conference, pp. 23-34 (2004).
69. Yankov, D., Keogh, E., Lonardi, S., Fu, A. W. C.: Dot plots for time series analysis. In: ICTAI, pp. 159-168 (2005).
70. Yi, B. K., Faloutsos, C.: Fast time sequence indexing for arbitrary lp norms. In: VLDB, pp. 385-394 (2000).
71. Yi, B. K., Jagadish, H. V., Faloutsos, C.: Efficient retrieval of similar time sequences under time warping. In: ICDE, pp. 201-208 (1998).
72. Zhou, M., Wong, M. H.: Efficient online subsequence searching in data streams under dynamic time warping distance. In: ICDE, pp. 686-695 (2008).
73. Zhu, Y., Shasha, D.: Statstream: Statistical monitoring of thousands of data streams in real time. In: VLDB, pp. 358-369 (2002).
74. Zhu, Y., Shasha, D.: Efficient elastic burst detection in data streams. In: KDD, pp. 336-345 (2003).
75. Zhu, Y., Shasha, D.: Warping indexes with envelope transforms for query by humming. In: SIGMOD Conference, pp. 181-192 (2003).