An approach to dimensionality reduction in time series

Information Sciences

Volumn 260, Issue , 2014, Pages 15-36

  Krawczak, MacIej ^a   Szkatuła, Grazyna ^b  

^a WARSAW SCHOOL OF INFORMATION TECHNOLOGY   (Poland)

^b SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

Data series; Dimensionality reduction; Discretization; Envelopes; Essential attributes; Nominal attributes

Indexed keywords

DATA SERIES; DIMENSIONALITY REDUCTION; DISCRETIZATIONS; ENVELOPES; ESSENTIAL ATTRIBUTES; NOMINAL ATTRIBUTES;

MULTILAYER NEURAL NETWORKS; TIME SERIES;

DATA REDUCTION;

EID: 84891741991     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.10.037     Document Type: Article

References (79)

1. R.J. Alcock, Y. Manolopoulos (1999) < http://kdd.ics.uci.edu/ databases/synthetic-control/synthetic-control.data.html >.
2. R.J Alcock, Y. Manolopoulos, Time-series similarity queries employing a feature-based approach, in: 7th Hellenic Conference on Informatics, August 27-29, 1999, Ioannina, Greece.
3. K.J. Astrom On the choice of sampling rates in parametric identification of time series Information Sciences 1 3 1969 273 278
4. M. Azzouzi, I.T. Nabney, Analyzing time series structure with Hidden Markov Models, in: Proceedings of the IEEE Conference on Neural Networks and Signal Processing, 1998, 402-408.
5. A. Bagnall, C.A. Ratanamahatana, E. Keogh, S. Lonardi, and G.A. Janacek Bit level representation for time series data mining with shape based similarity Data Mining and Knowledge Discovery 13 1 2006 11 40
6. K. Beyer, J. Goldstein, R. Ramakrishnan, U. Shaft, When is "Nearest Neighbor" Meaningful?, in: Proceedings of the 7th International Conference on Database Theory - ICDT'99, 1999, pp. 217-235.
7. K.P. Chan, A.C. Fu, Efficient time series matching by wavelets, in: Proceedings of the 15th IEEE International Conference on Data Engineering, 1999, pp. 126-133.
8. L. Chen, M.S. Kamel, Design of multiple classifier systems for time series data, in: Proceedings of 6th International Workshop MCS Multiple Classifier Systems, Seaside, USA, 2005, pp. 216-225.
9. L. Chen, M.T. Ozsu, V. Oria, Using multi-scale histograms to answer pattern existence and shape match queries, in: Proceedings of 17th International Conference on Scientific and Statistical Database Management, 2005, pp. 217-226.
10. F.L. Chung, T.C. Fu, R. Luk, V. Ng, Flexible time series pattern matching based on perceptually important points, in: International Joint Conference on Artificial Intelligence Workshop on Learning from Temporal and Spatial Data, 2005, pp. 1-7.
11. G. Cybenko Approximations by superpositions of sigmoidal functions Mathematics of Control, Signals, and Systems 2 4 1989 303 314
12. G. Dreyfus Neural Networks Methodology and Applications 2005 Springer Berlin, Germany
13. J. Elder IV, and D. Pregibon A statistical perspective on knowledge discovery in databases U.M. Fayyad, G. Shapiro, P. Smyth, R. Uthurusamy, Advances in Knowledge Discovery and Data Mining 1996 AAAI Press Menlo Park, CA 83 113
14. C. Faloutsos, M. Ranganathan, and Y. Manolopulos Fast subsequence matching in time-series databases SIGMOD Record 23 1994 519 529
15. H. Frohlich, O. Chapelle, and B. Scholkopf Feature selection for support vector machines by means of genetic algorithms ICTAI 2003 42 148
16. T.C. Fu A review on time series data mining Engineering Applications of Artificial Intelligence 24 2011 164 181
17. P. Geurts, Pattern extraction for time series classification, in: Proceedings of 5th European Conference on Principles of Data Mining and Knowledge Discovery, Freiburg, Germany, 2001, pp. 115-127.
18. I. Guyon, M. Gunn, M. Nikravesh, and l. Zadeh Feature Extraction Foundations and Applications 2005 Springer Berlin, Germany
19. M. Hall, and G. Holmes G. Benchmarking attribute selection techniques for discrete class data mining IEEE Transactions on Knowledge Data Engineering 15 6 2003 1437 1447
20. A. Inselberg Parallel Coordinates: VISUAL Multidimensional Geometry and its Applications 2009 Springer
21. I. T Jolliffe Principal Component Analysis 2002 Springer Berlin, Germany
22. S.C. Johnson Hierarchical clustering schemes Psychometrika 2 1967 241 254
23. J. Kacprzyk, and G. Szkatuła An inductive learning algorithm with a preanalysis data International Journal of Knowledge - Based Intelligent Engineering Systems 3 1999 135 146
24. J. Kacprzyk, and G. Szkatuła An integer programming approach to inductive learning using genetic and greedy algorithms L.C. Jain, J. Kacprzyk, New Learning Paradigms in Soft Computing Studies in Fuzziness and Soft Computing 2002 Physica-Verlag Heidelberg 323 367
25. J. Kacprzyk, and G. Szkatuła A softened formulation of inductive learning and its use for coronary disease data Lecture Notes in Artificial Intelligence 3488 2005 200 209
26. J. Kacprzyk, and G. Szkatuła An inductive learning algorithm with a partial completeness and consistence via a modified set covering problem Lecture Notes in Computer Science 3697 2005 661 666
27. J. Kacprzyk, and G. Szkatuła Inductive learning: a combinatorial optimization J. Koronacki, Z.W. Ras, S.T. Wierzchoń, J. Kacprzyk, Advances in Machine Learning, Studies in Computational Intelligence vol. 262 2010 Springer
28. E. Keogh, Fast similarity search in the presence of longitudinal scaling in time series databases, in: Proceedings of the Ninth IEEE International Conference on Tools with Artificial Intelligence, 1997, pp. 578-584.
29. E. Keogh, K. Chakrabarti, M. Pazzani, and S. Mehrotra Dimensionality reduction for fast similarity search in large time series databases Journal of Knowledge Information Systems 3 3 2000 263 286
30. E. Keogh, K. Chakrabarti, S. Mehrotra, M. Pazzani, Locally adaptive dimensionality reduction for indexing large time series databases, in: Proceedings of the 2001 ACM SIGMOD International Conference on Management of Data, 2001, pp. 151-163.
31. E. Keogh, K. Chakrabarti, M. Pazzani, Locally adaptive dimensionality reduction for indexing large time series databases, in: Proceedings of ACM SIGMOD Conference on Management of Data, Santa Barbara, May 21-24, 2001, pp. 151-162.
32. E. Keogh, S. Kasetty, On the need for time series data mining benchmarks: A survey and empirical demonstration, in: Proceeding of the 8 ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2002, pp. 102-111.
33. E. Keogh, M. Pazzani, Derivative dynamic time warping, in: Proceedings of the First SIAM International Conference on Data Mining, Chicago, USA, 2001.
34. E. Keogh, P.A. Smyth, Probabilistic approach to fast pattern matching in time series databases, in: Proceedings of the Third ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1997, pp. 24-30.
35. R. Kohavi, D. Sommerfield, Feature subset selection using the wrapper method: overfitting and dynamic search space topology, in: Proceedings of the First International Conference on Knowledge Discovery and Data Mining, 1995, pp. 192-197.
36. M. Krawczak, Multilayer Neural Systems and Generalized Net Models, Ac. Publ. House EXIT, Warsaw, 2003.
37. M. Krawczak Heuristic dynamic programming - learning as control problem L. Rutkowski, J. Kacprzyk, Neural Networks and Soft Computing 2003 Physica Verlag Heidelberg 218 223
38. M. Krawczak, G. Szkatuła, On decision rules application to time series classification, in: K.T. Atanassov, et al. (Eds.), Advances in Fuzzy Sets, Intuitionistic Fuzzy Sets, Generalized Nets and Related Topics, Ac. Publ. House EXIT, 2008.
39. M. Krawczak, G. Szkatuła, Time series envelopes for classification, in: IEEE Intelligent Systems Conference, London, July 7-9, 2010.
40. M. Krawczak, G. Szkatuła, On time series envelopes for classification problems, in: K.T. Atanassov, et al. (Eds.), Developments in Fuzzy Sets, Intuitionistic Fuzzy Sets, Generalized Nets and Related Topics. II, SRI PAS, Warsaw, 2010.
41. M. Krawczak, G. Szkatuła, Dimensionality reduction for time series, in: Case studies of the Polish Association of Knowledge, vol. 31, 2010, pp. 32-45.
42. M. Krawczak, and G. Szkatuła A hybrid approach for dimension reduction in classification Control and Cybernetics 40 2 2011 527 552
43. M. Krawczak, and G. Szkatuła A clustering algorithm based on distinguishability for nominal attributes Lecture Notes in Artificial Intelligence vol. 7268 2012 Springer-Verlag 120 127
44. M. Krawczak, G. Szkatuła, Dimension reduction of time series for the clustering problem, in: K.T. Atanassov, W. Homenda, O. Hryniewicz, J. Kacprzyk, M. Krawczak, Z. Nahorski, E. Szmidt, S. Zadrozny (Eds.), New Developments in Fuzzy Sets, Intuitionistic Fuzzy Sets, Generalized Nets and Related Topics, Applications, vol. II, SRI PAS, Warsaw, 2012, pp. 101-110.
45. M. Krawczak, G. Szkatuła, Nominal time series representation for the clustering problem, in: IEEE 6th International Conference, Intelligent Systems, Sofia, 2012, pp. 182-187.
46. M. Krawczak, and G. Szkatuła On perturbation measure of clusters - application 12th International Conference on Artificial Intelligence and Soft Computing Lecture Notes in Artificial Intelligence vol. 7895 2013 Springer-Verlag 176 183
47. M. Krawczak, G. Szkatuła, A new measure of groups perturbation, in: IFSA World Congress, 2013, pp. 1291-1296.
48. K. Lavangnananda, P. Sawasdimongkol, Neural network classifier of time series: a case study of symbolic representation preprocessing for control chart patterns, in: 8th International Conference on Natural Computation, 2012, pp. 351-356.
49. K. Lavangnananda, and P. Sawasdimongkol Utilizing symbolic representation in synergistic neural networks classifier of control chart patterns Lecture Notes in Computer Science 7666 2012 313 321
50. K. Lavangnananda, C. Wongwattanakarn, Utilizing symbolic representation and evolutionary computation in classification of control chart patterns, in: Proceedings of the 2007 IEEE Three-Rivers Workshop on Soft Computing in Industrial Applications (SMCia/07), August, Passau, Germany, 2007, pp. 79-84.
51. S. Lee, D. Kwon, and S. Lee Dimensionality reduction for indexing time series based on the minimum distance Journal of Information Science and Engineering 19 2003 697 711
52. J. Lin, E.J. Keogh, S. Lonardi, B. Chiu, A symbolic representation of time series, with implications for streaming algorithms, in: Proceedings of 8th ACM SIGMOD Workshop on Research Issues in Data Mining and Knowledge Discovery, 13 June, San Diego, CA, USA, 2003.
53. J. Lin, E. Keogh, P. Patel, S. Lonardi, Finding motifs in time series, in: 2nd Workshop on Temporal Data Mining, the 8th ACM International Conference on Knowledge Discovery and Data Mining, Edmonton, Canada, 2002, pp. 53-68.
54. J. Lin, E. Keogh, L. Wei, and S. Lonardi Experiencing SAX: a novel symbolic representation of time series Journal Data Mining and Knowledge Discovery 15 2 2007 107 144
55. J. Loughrey, P. Cunningham, Using Early-Stopping to Avoid Overfitting in Wrapper-Based Feature Selection Employing Stochastic Search, Technical Report TCD-CS-2005-37, Department of Computer Science, Trinity College Dublin, Dublin, Ireland, 2005.
56. O. Maimon, and L. Rokach Data Mining and Knowledge Discovery Handbook 2010 Springer
57. C. Matheus, and L. Rendell Constructive induction on decision trees Proceedings of the Eleventh International Joint Conference on Artificial Intelligence 1989 Morgan Kaufmann Mateo, CA
58. A. Nanopoulos, R. Alcock, and Y. Manolopoulos Feature-based classification of time-series data International Journal of Computer Research 2001 49 61
59. E. Oja Principal components, minor components and linear neural networks Neural Networks 5 1992 927 935
60. C.A. Ratanamahatana, E. Keogh, A.J. Bagnall, S. Lonardi, Novel bit level time series representation with implications for similarity search and clustering, in: Proceedings of the Ninth Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2005, pp. 771-777.
61. J.J. Rodriguez, C.J. Alonso, H. Boström, Learning first order logic time series classifiers: rules and boosting, in: Principles of Data Mining and Knowledge Discovery: 4th European Conference, LNAI, vol. 1910, 2000, pp. 299-308.
62. J.J. Rodríguez, C.J. Alonso, Interval and dynamic time warping-based decision trees, in: Proceedings of the 2004 ACM Symposium on Applied Computing (SAC), 2004, pp. 548-552.
63. C. Shahabi, X. Tian, W. Zhao, TSA-tree: a wavelet-based approach to improve the efficiency of multi-level surprise and trend queries, in: Proceedings of the 12th International Conference on Scientific and Statistical Database Management, Berlin, 2000, pp. 55-68.
64. H. Shatkay, S. Zdonik, Approximate queries and representations for large data sequences, in: Proceedings of the 12th IEEE International Conference on Data Engineering, 1996, pp. 536-545.
65. P. Smyth, E. Keogh, Clustering and mode classification of engineering time series data, in: Proceedings of the Third ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1997, pp. 24-30.
66. G. Szkatuła, Machine Learning From Examples Under Errors in Data, (In Polish), Ph.D. Thesis, SRI PAS Warsaw, Poland, 1995.
67. G. Szkatuła, Application of modified covering problem in machine learning, in: J. Gutenbaum (Ed.), Automatics Control Management, SRI PAS, Warsaw, 2002, pp. 431-445.
68. G. Szkatuła, J. Kacprzyk, An inductive learning algorithm with a partial completeness and consistency, in: M. Dramiński, P. Grzegorzewski, T. Trojanowski, S. Zadrozny (Eds.), Issues in Intelligent Systems, Models and Techniques, EXIT, Warszawa, 2005, pp. 229-246.
69. Tak-chung Fu A review on time series data mining Engineering Applications of Artificial Intelligence 24 2011 164 181
70. X. Xi, E. Keogh, C. Shelton, L. Wei, C.A. Ratanamahatana, Fast time series classification using numerosity reduction, in: Proceedings of the 23rd International Conference on Machine Learning, 2006, pp. 1033-1040.
71. O. Yang, W. Jia, P. Zhou, X. Meng, X. A New approach to transforming time series into symbolic sequences, in: Proceedings of the First Joint Conference between the Biomedical Engineering Society and Engineers in Medicine and Biology, vol. 974, 1999.
72. K. Yang, C. Shahabi, On the stationarity of multivariate time series for correlation-based data analysis, in: Proceedings of the Fifth IEEE International Conference on Data Mining, pp. 805-808.
73. Q. Yang, and X. Wu 10 Challenging problems in data mining research International Journal of Information Technology and Decision Making 5 4 2005 597 604
74. Z. Yang, G. Zhao, Application of symbolic techniques in detecting determinism In time series, in: Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 20(5), 1998, pp. 2670-2673.
75. p norms, in: Proceedings of International Conference on Very Large Data Bases, Cairo, Egypt, 2000.
76. H. Yoon, K. Yang, and C. Shahabi Feature subset selection and feature ranking for multivariate time series IEEE Transactions on Knowledge and Data Engineering, Special Issue on Intelligent Data Preparation 17 9 2005 1186 1198
77. B. Wang, A new clustering algorithm on nominal data sets, in: Proceedings of International MultiConference of Engineers and Computer Scientists IMECS 2010, Hong Kong, March 17-19, 2010.
78. J. Wnek, and R.S. Michalski Hypothesis-driven constructive induction in AQ17-HCI: a method and experiments Machine Learning 14 1994 139 168
79. Y. Wu, E.Y. Chang, Distance-function design and fusion for sequence data. in: CIKM'04, 2004, pp. 324-333.