Efficient discovery of unusual patterns in time series

New Generation Computing

Volumn 25, Issue 1, 2006, Pages 61-93

  Lonardi, Stefano ^a   Lin, Jessica ^b   Keogh, Eamonn ^a   Chiu, Bill ^a  

^a University of California Riverside   (United States)

^b George Mason University   (United States)

Author keywords

Anomaly detection; Feature extraction; Markov model; Novelty detection; Suffix tree; Time series

Indexed keywords

DATA STRUCTURES; DATABASE SYSTEMS; FEATURE EXTRACTION; MARKOV PROCESSES; PROBLEM SOLVING; QUERY LANGUAGES;

ANOMALY DETECTION; DATASETS; NOVELTY DETECTION; SUFFIX TREE;

TIME SERIES ANALYSIS;

EID: 33846289625     PISSN: 02883635     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00354-006-0004-2     Document Type: Article

References (62)

1. Agrawal, R., Faloutsos, C., and Swami, A, "Efficient Similarity Search in Sequence Databases," in Proc. of the 4th Int'l Conference on Foundations of Data Organization and Algorithms, pp. 69-84, Chicago, IL, 1993.
2. Andre-Jonsson, H. and Badal D.Z., "Using Signature Files for Querying Time-series Data," in Proc. of Principles of Data Mining and Knowledge Discovery, 1st European Symposium, pp. 211-220, Trondheim, Norway, 1997.
3. Apostolico, A., Bock, M.E. and Lonardi, S., "Monotony of Surprise and Large-scale Quest for Unusual Words," J. Comput. Bio., 10, 3-4, pp. 283-311, 2003.
4. Apostolico, A., Bock, M. E., Lonardi, S. and Xu, X., "Efficient Detection of Unusual Words," J. Comput. Bio., 7, 1/2, pp. 71-94, Jan., 2000.
5. Bailey, T.L. and Elkan, C., "Unsupervised Learning of Multiple Motifs in Biopolymers Using Expectation Maximization," Machine Learning, 21, 1/2, pp. 51-80, 1995.
6. Blockeel, H., Furnkranz, J., Prskawetz, A. and Billari, F.C., "Detecting Temporal Change in Event Sequences: An Application to Demographic Data," in Proc. Principles of Data Mining and Knowledge Discovery, pp. 29-41, 2001.
7. Borisyuk, R., Denham, M., Hoppensteadt, F., Kazanovich, Y. and Vinogradova, O., "An Oscillatory Neural Network Model of Sparse Distributed Memory and Novelty Detection," BioSystems, 58, pp. 265-272, Jan., 2000.
8. Brutlag, J.D., "Aberrant Behavior Detection in Time Series for Network Service Monitoring," in Proc. of the 14th Systems Administration Conference, Berkeley, CA, Dec., 3-8, 2000, pp. 139-146, The USENIX Association.
9. Celly, B., Ratanamahatana, C.A., and Zordan, V., "A Novel Technique for Indexing Video Surveillance Data," submitted for publication, 2003.
10. Chakrabarti, S., Sarawagi, S., and Dom, B., "Mining Surprising Patterns Using Temporal Description Length," in Proc. 24th Int. Conf. Very Large Data Bases, pp. 606-617, 1998.
11. Chan, K., and Fu, A.W., "Efficient Time Series Matching by Wavelets," in Proc. of the 15th IEEE Int'l Conference on Data Engineering, pp. 126-133, 1999.
12. Das, G., Lin, K.-I., Mannila, H., Renganathan, G., and Smyth, P., "Rule Discovery from Time Series," in Proc. of the 4th International Conference of Knowledge Discovery and Data Mining, AAAI Press, pp. 16-22, 1998.
13. Dasgupta, D., and Forrest, S., "Novelty Detection in Time Series Data Using Ideas from Immunology," in Proc. of The International Conference on Intelligent Systems, 1999.
14. Daw, C.S., Finney, C.E.A. and Tracy, E.R., "Symbolic Analysis of Experimental Data," Review of Scientific Instruments, 2001.
15. Decoste, D., "Mining Multivariate Time-series Sensor Data to Discover Behavior Envelopes," in Proc. Knowledge Discovery and Data Mining, pp. 151-154, 1997.
16. Faloutsos, C., Ranganathan, M., and Manolopoulos, Y., "Fast Subsequence Matching in Time-series Databases," SIGMOD Record (ACM Special Interest Group on Management of Data), 23, 2, pp. 419-429, June, 1994.
17. Farach, M., "Optimal Suffix Tree Construction with Large Alphabets," in Proc. 38th Annual Symposium on Foundations of Computer Sciencepp, pp. 137-143, Oct., 1997.
18. Fawcett, T., and Provost, F., "Activity Monitoring: Noticing Interesting Changes in Behavior," in Proc. Fifth ACM SIGKDD International Conference, on Knowledge Discovery and Data Mining, pp. 53-62, 1999.
19. Feller, W., An Introduction to Probability Theory and its Applications, Wiley, New York, 1968.
20. Forsyth, D. and Ponce, J., Computer Vision: A Modern Approach, Prentice-Hall, 2001.
21. Ge, X. and Smyth. P., "Deformable Markov Model Templates for Time-series Pattern Matching," in Proc. of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-00), pp. 81-90, 2000.
22. Gusfield, D., Algorithms on Strings, Trees, and Sequences: Computer Science and Computational Biology, Cambridge University Press, 1997.
23. Hawkins, D.M., Identification of Outliers, Monographs on Applied Probability & Statistics, Chapman and Hall, London, 1980.
24. Huang, Y.-W. and Yu, P., "Adaptive Query Processing for Time-series Data," in Proc. Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (S. Chaudhuri and D. Madigan eds.), pp. 282-286. ACM Press, Aug., 1999.
25. Hui, L.C.K., "Color Set Size Problem with Applications to String Matching," in Proc. of the, 3rd Annual Symposium on Combinatorial Pattern Matching (Tucson, AZ, 1992), (A. Apostolico, M. Crochemore, Z. Galil and U. Manber, eds.), LNCS644, Springer-Verlag, Berlin, pp. 230-243.
26. Jagadish, H.V., Kapitskaia, O., Ng, R.T. and Srivastava, D., "One-dimensional and Multi-dimensional Substring Selectivity Estimation," VLDB Journal 9, 3, pp. 214-230, 2000.
27. Jagadish, H.V., Koudas, N. and Muthukrishnan, S. "Mining Deviants in a Time Series Database," in Proc. 25th International Conference on Very Large Data Bases, pp. 102-113, 1999.
28. Jagadish, H.V.. Ng. R.T. and Srivastava, D., "Substring Selectivity Estimation," in Proc. of PODS, pp. 249-260, 1999.
29. Kalpakis, K., Gada, D. and Puttagunta, V., "Distance Measures for Effective Clustering of Arima Time-series," in Proc. of the 2001 IEEE International Conference on Data Mining, pp. 273-280, San Jose, CA, 2001.
30. Keich, U. and Pevzner, P.A., "Finding Motifs in the Twilight Zone," in Annual International Conference on Computational Molecular Biology, pp. 195-204, Washington, DC, Apr., 2002.
31. Keogh, E., Chakrabarti, K., Pazzani, M. and Mehrotra, S., "Dimensionality Reduction for Fast Similarity Search in Large Time Series Databases," Journ. of Knowledge and Information Systems, 3, 3, pp. 263-286, 2000.
32. Keogh, E., Chakrabarti, K., Pazzani, M. and Mehrotra, S., "Locally Adaptive Dimensionality Reduction for Indexing Large Time Series Databases," SIGMOD Record (ACM Special Interest Group on Management of Data), 30, pp. 2151 162, June, 2001.
33. Keogh, E. and Kasetty, S., "On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration," in ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 102-111, Edmonton, Alberta, Canada, 2002.
34. Keogh, E., Lonardi, S. and Chiu, B., "Finding Surprising Patterns in a Time Series Database in Linear Time and Space," in Proc. of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'02), pp. 550-556, Edmonton, Alberta, Canada, July, 2002.
35. Keogh, E., Lonardi, S. and Ratanamahatana, C.A., "Towards Parameter-free Data Mining," in Proc. of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'04), pp. 206-215, Seattle,WA, 2004.
36. Keogh, E. and Pazzani, M., "An Enhanced Representation of Time Series Which Allows Fast and Accurate Classifcation, Clustering and Relevance Feedback, in Proc. 4th International Conference on Knowledge Discovery and Data Mining, pp. 239-241, 1998.
37. Kleinberg, J., "Bursty and Hierarchical Structure in Streams," in Proc. of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'02), Edmonton, Alberta, Canada, July, 2002.
38. Kotsakis, E. and Wolski, A., "Maps: A Method for Identifying and Predicting Aberrant Behaviour in Time Series," in Proc. 14th Internat. Conf. on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, 2001.
39. Krishnan, P., Vitter, J.S. and Iyer, B., Estimating Alphanumeric Selectivity in the Presence of Wildcards," in Proc. of SIGMOD, pp. 282-293, 1996.
40. Lawrence, C.E., Altschul, S.F., Boguski, M.S., Liu, J.S., Neuwald, A.F. and Wootton, J.C., "Detecting Subtle Sequence Signals: A Gibbs Sampling Strategy for Multiple Alignment," Science, 262, pp. 208-214, Oct., 1993.
41. Lin, J., Keogh, E., Lonardi, S. and Chiu, B., "A Symbolic Representation of Time Series with Implications for Streaming Algorithms," in Proc. of the 8th ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, pp. 2-11, San Diego, CA, 2003.
42. Lonardi, S., "Global Detectors of Unusual Words: Design, Implementation, and Applications to Pattern Discovery in Biosequences," Ph.D. thesis, Department of Computer Sciences, Purdue University, August 2001.
43. Ma, J. and Perkins, S., "Online Novelty Detection on Temporal Sequences," in Proc. International Conference on Knowledge Discovery and Data Mining (KDD'03), Washington, DC, 2003.
44. Mccreight, E.M., "A Space-economical Suffix Tree Construction Algorithm," J. Assoc. Comput. Mach., 23, 2, pp. 262-272, Apr. 1976.
45. Moody, G., Muldrow, W. and Mark, R.G., "A Noise Stress Test for Arrhythmia Detectors," Computers in Cardiology 11, pp. 381-384, 1984.
46. Pavesi, G., Mauri, G. and Pesole, G., "An Algorithm for Finding Signals of Unknown Length in DNA Sequences," in Proc. of the International Conference on Intelligent Systems for Molecular Biology, pp. S207-S214, AAAI press, Menlo Park, CA, 2001.
47. Perng, C., Wang, H., Zhang, S. and Parker, S., "Landmarks: A New Model for Similarity-based Pattern Querying in Time Series Databases," in Proc. of 16th International Conference on Data Engineering, 2000.
48. Pevzner, P.A. and Sze, S.-H., "Combinatorial Approaches to Finding Subtle Signals in DNA Sequences, in Proc. of the International Conference on Intelligent Systems for Molecular Biology, pp. 269-278, AAAI press, Menlo Park, CA, 2000.
49. Reinert, G., Schbath, S. and Waterman, M.S., "Probabilistic and Statistical Properties of Words: An Overview," J. Comput. Bio., 7, pp. 1-46, 2000.
50. Rigoutsos, I. and Floratos, A., "Combinatorial Pattern Discovery in Biological Sequences: The TEIRESIAS Algorithm," Bioinformatics, 14, 1, pp. 55-67, 1998.
51. Shahabi, C., Tian, X. and Zhao, W., "Tsa-tree: A Wavelet-based Approach to Improve the Efficiency of Multi-level Surprise and Trend Queries," in Proc. 12th International Conference on Scientific and Statistical Database Management, 2000.
52. Struzik, Z.R.. and Siebes, "A. Measuring Time Series Similarity through Large Singular Features Revealed with Wavelet Transformation,". in Proc. of the 10th International Workshop on Database & Expert Systems Applications, pp. 162-166, 1999.
53. Tompa, M. and Buhler, J., "Finding Motifs Using Random Projections," in Annual International Conference on Computational Molecular Biology, pp. 67 74, Montreal, Canada, Apr., 2001.
54. Ukkonen, E., "On-line Construction of Suffix Trees," Algorithmic, 14, 3, pp. 249-260, 1995.
55. Van Wijk, J.J. and Van Selow, E.R., "Cluster and Calendar-based Visualization of Time Series Data," in Proc. IEEE Symposium on Information Visualization, pp. 4-9, Oct., 25-26, 1999.
56. Vlachos, M., Kollios, G. and Gunopulos, D., "Discovering Similar Trajectories," in 18th IEEE International Conf. on Data Engineering, San Jose, CA, 2002.
57. Weiner, P., "Linear Pattern Matching Algorithm," in Proc. of the 14th Annual IEEE Symposium on Switching and Automata Theory, pp. 1-11, Washington. DC, 1973.
58. Whitehead, B. and Hoyt, W.A., "A Function Approximation Approach to Anomaly Detection in Propulsion System Test Data," in Proc. AIAA/SAE/ASME/ASEE 29th Joint Propulsion Conference, Monterey, CA, June 1993.
59. Yairi, T., Kato, Y. and Hori, K., "Fault Detection by Mining Association Rules from House-keeping Data," in Proc. of International Symposium on Artificial Intelligence, Robotics and Automation in Space, 2001.
60. Yang, J., Wang, W. and Yu, P., "Info-miner: Mining Surprising Periodic Patterns," in Proc. of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 395-400, 2001.
61. Yi, B.K. and Faloutsos, C., "Fast Time Sequence Indexing for Arbitrary Lp Norms,". in Proc. of the 26st Intl. Conference on Very Large Databases, pp. 385-394, 2000.
62. Zhu. Y. and Shasha, D., Efficient Elastic. Burst Detection in Data Streams.