On general purpose time series similarity measures and their use as kernel functions in support vector machines

Information Sciences

Volumn 281, Issue , 2014, Pages 478-495

  Pree, Helmuth ^a   Herwig, Benjamin ^a   Gruber, Thiemo ^a   Sick, Bernhard ^a   David, Klaus ^a   Lukowicz, Paul ^b  

^a UNIVERSITY OF KASSEL   (Germany)

^b GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

Kernel function; Support vector machine; Temporal data mining; Time series classification

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; TIME SERIES;

APPLICATION-SPECIFIC KNOWLEDGE; CLASSIFICATION ACCURACY; DYNAMIC TIME WARPING; KERNEL FUNCTION; LONGEST COMMON SUBSEQUENCES; NEAREST NEIGHBOR CLASSIFIER; TEMPORAL DATA MINING; TIME SERIES CLASSIFICATIONS;

SUPPORT VECTOR MACHINES;

EID: 84904624823     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.05.025     Document Type: Article

References (41)

1. R. Agrawal, K.-I. Lin, H.S. Sawhney, K. Shim, Fast similarity search in the presence of noise, scaling, and translation in time-series databases, in: Proceedings of the 21th International Conference on Very Large Data Bases, Zurich, Switzerland, 1995, pp. 490-501.
2. A. Bagnall, L.M. Davis, J. Hills, J. Lines, Transformation based ensembles for time series classification, in: Proceedings of the Twelfth SIAM International Conference on Data Mining, Anaheim, CA, USA, 2012, pp. 307-318.
3. A. Bagnall, E. Keogh. < http://www.cs.ucr.edu/eamonn/time-series-data/ WekaOnTimeSeries.xls > (last access 04.14.14).
4. N. Beckmann, H.-P. Kriegel, R. Schneider, B. Seeger, The R*-tree: an efficient and robust access method for points and rectangles, in: Proceedings of the ACM SIGMOD International Conference on Management of Data, Atlantic City, NJ, USA, 1990, pp. 322-331.
5. D.J. Berndt, J. Clifford, Using dynamic time warping to find patterns in time series, in: Knowledge Discovery in Databases: Papers from the 1994 AAAI Workshop, Seattle, WA, USA, 1994, pp. 359-370.
6. C.-C. Chang, and C.-J. Lin LIBSVM: a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 2011 27:1 27:27 < http://www.csie.ntu. edu.tw/cjlin/libsvm > (last access 04.14.14)
7. P.-H. Chen, R.-E. Fan, and C.-J. Lin A study on SMO-type decomposition methods for support vector machines Trans. Neural Networks 17 4 2006 893 908
8. J. Demšar Statistical comparison of classifiers over multiple data sets J. Mach. Learn. Res. 7 2006 1 30
9. H. Deng, G. Runger, E. Tuv, and M. Vladimir A time series forest for classification and feature extraction Inform. Sci. 239 2013 142 153
10. H. Ding, G. Trajcevski, P. Scheuermann, X. Wang, and E. Keogh Querying and mining of time series data: Experimental comparison of representations and distance measures Proc. VLDB Endowment 1 2 2008 1542 1552
11. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2001 Wiley & Sons, Inc. New York, NY, USA
12. P. Esling, and C. Agon Time-series data mining ACM Comput. Surv. 45 2012 12:1 12:34
13. D. Fisch, B. Kühbeck, B. Sick, and S.J. Ovaska So near and yet so far: new insight into properties of some well-known classifier paradigms Inform. Sci. 180 18 2010 3381 3401
14. E. Fuchs, T. Gruber, J. Nitschke, and B. Sick On-line motif detection in time series with SwiftMotif Pattern Recognit. 42 11 2009 3015 3031
15. E. Fuchs, T. Gruber, J. Nitschke, and B. Sick On-line segmentation of time series based on polynomial least-squares approximations IEEE Trans. Pattern Anal. Mach. Intell. 32 12 2010 2232 2245
16. E. Fuchs, T. Gruber, H. Pree, and B. Sick Temporal data mining using shape space representations of time series Neurocomputing 74 1-3 2010 379 393
17. C. Gruber, T. Gruber, S. Krinninger, and B. Sick Online signature verification with support vector machines based on LCSS kernel functions IEEE Trans. Syst. Man Cybernet. Part B 40 4 2010 1088 1100
18. C. Gruber, T. Gruber, and B. Sick Online signature verification with new time series kernels for support vector machines D. Zhang, A.K. Jain, Advances in Biometrics Lecture Notes in Computer Science vol. 3832 2005 Springer Berlin Heidelberg 500 508
19. B. Haasdonk, and C. Bahlmann Learning with distance substitution kernels C.E. Rasmussen, H.H. Bülthoff, B. Schölkopf, M.A. Giese, Pattern Recognition: Proceedings of the 26th DAGM Symposium for Pattern Recognition Lecture Notes in Computer Science vol. 3175 2004 Springer Berlin Heidelberg 220 227
20. L. Jacob, Structured Priors for Supervised Learning in Computational Biology, Ph.D. Thesis, École des Mines de Paris, 2009.
21. E. Keogh, The UCR Time Series Classification/Clustering Page. < http://www.cs.ucr.edu/eamonn/time-series-data/ > (last access 04.14.14).
22. E. Keogh, and S. Kasetty On the need for time series data mining benchmarks: a survey and empirical demonstration Data Min. Knowl. Discov. 7 4 2003 349 371
23. H.-T. Lin, C.-J. Lin, A Study on Sigmoid Kernels for SVM and the Training of Non-PSD Kernels by SMO-type Methods, Tech. Rep., Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan, 2003.
24. K.-P. Lin, P.-F. Pai, Y.-M. Lu, and P.-T. Chang Revenue forecasting using a least-squares support vector regression model in a fuzzy environment Inform. Sci. 220 2013 196 209
25. J. Lines, A. Bagnall, Ensembles of elastic distance measures for time series classification, in: Proceedings of the 14th SIAM International Conference on Data Mining, Philadelphia, PA, USA, 2014, pp.524-532.
26. D. Maier The complexity of some problems on subsequences and supersequences J. ACM 25 2 1978 322 336
27. P.-F. Marteau Time warp edit distance with stiffness adjustment for time series matching IEEE Trans. Pattern Anal. Mach. Intell. 31 2 2009 306 318
28. P.-F. Marteau, S. Gibet, On Recursive Edit Distance Kernels with Application to Time Series Classification, 2013. < http://arxiv.org/abs/1005. 5141v6 > (last access 04.14.14).
29. F.M. McNeill, A Rich Collection of Squashing Functions, 2003. < http://www.fuzzysys.com/squash2.pdf > (last access 04.14.14).
30. C.S. Ong, X. Mary, S. Canu, A.J. Smola, Learning with non-positive kernels, in: Proceedings of the 21st International Conference on Machine Learning, Banff, Alberta, Canada, 2004, pp. 639-646.
31. J.C. Platt, Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines, Tech. Rep. MSR-TR-98-14, Microsoft Research, 1998.
32. T. Rakthanmanon, B. Campana, A. Mueen, G. Batista, B. Westover, Q. Zhu, J. Zakaria, E. Keogh, Searching and mining trillions of time series subsequences under dynamic time warping, in: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Beijing, China, 2012, pp. 262-270.
33. K. Rieck, and P. Laskov Linear-time computation of similarity measures for sequential data J. Mach. Learn. Res. 9 2008 23 48
34. H. Sakoe, and S. Chiba Dynamic programming algorithm optimization for spoken word recognition IEEE Trans. Acoust. Speech Signal Process. 26 1 1978 43 49
35. B. Schölkopf, A. Smola, and K.-R. Müller Nonlinear component analysis as a kernel eigenvalue problem Neural Comput. 10 5 1998 1299 1319
36. A. Stefan, V. Athitsos, and G. Das The move-split-merge metric for time series IEEE Trans. Knowl. Data Eng. 25 6 2013 1425 1438
37. D.H. Wolpert, and W.G. Macready No free lunch theorems for optimization IEEE Trans. Evol. Comput. 1 1 1997 67 82
38. G. Wu, E.Y. Chang, Z. Zhang, Learning with non-metric proximity matrices, in: Proceedings of the 13th Annual ACM International Conference on Multimedia, Singapore, 2005, pp. 411-414.
39. D. Zhang, W. Zuo, D. Zhang, H. Zhang, Time series classification using support vector machine with Gaussian elastic metric kernel, in: International Conference on Pattern Recognition, Istanbul, Turkey, 2010, pp. 29-32.
40. X. Zhang, J. Wu, and X. Yang A novel pattern extraction method for time series classification Optim. Eng. 10 2 2008 253 271
41. Y.-P. Zhao, J.-G. Sun, Z.-H. Du, Z.-A. Zhang, and Y.-B. Li Online independent reduced least squares support vector regression Inform. Sci. 201 2012 37 52