Multivariate time series anomaly detection: A framework of Hidden Markov Models

Applied Soft Computing Journal

Volumn 60, Issue , 2017, Pages 229-240

  Li, Jinbo ^a   Pedrycz, Witold ^a,b,c   Jamal, Iqbal ^d  

^a UNIVERSITY OF ALBERTA   (Canada)

^b KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

^c SYSTEMS RESEARCH INSTITUTE   (Poland)

^d AQL Management Consulting Inc   (Canada)

Author keywords

Anomaly detection; Fuzzy C means; Fuzzy integral; Hidden Markov Model (HMM); Multivariate time series

Indexed keywords

FUZZY SYSTEMS; INTEGRAL EQUATIONS; MARKOV PROCESSES; SIGNAL DETECTION; TIME SERIES;

ANOMALY DETECTION; FUZZY C MEAN; FUZZY C MEANS CLUSTERING; FUZZY INTEGRAL; MULTIVARIATE TIME SERIES; TRANSFORMATION METHODS; TRANSFORMATION TECHNIQUES; UNIVARIATE TIME SERIES;

HIDDEN MARKOV MODELS;

EID: 85021878692     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2017.06.035     Document Type: Article

References (47)

1. Chen, S.-M., Chen, S.-W., Fuzzy forecasting based on two-factors second-order fuzzy-trend logical relationship groups and the probabilities of trends of fuzzy logical relationships. IEEE Trans. Cybern. 45:3 (2015), 391–403.
2. Reinsel, G.C., Elements of Multivariate Time Series Analysis. 2003, Springer, New York.
3. Cheng, S.-H., Chen, S.-M., Jian, W.-S., Fuzzy time series forecasting based on fuzzy logical relationships and similarity measures. Inform. Sci. 327 (2016), 272–287.
4. Lahmiri, S., A variational mode decompoisition approach for analysis and forecasting of economic and financial time series. Expert Syst. Appl. 55 (2016), 268–273.
5. Rosas-Romero, R., Díaz-Torres, A., Etcheverry, G., Forecasting of stock return prices with sparse representation of financial time series over redundant dictionaries. Expert Syst. Appl. 57 (2016), 37–48.
6. Gong, X., Si, Y.-W., Fong, S., Biuk-Aghai, R.P., Financial time series pattern matching with extended UCR Suite and Support Vector Machine. Expert Syst. Appl. 55 (2016), 284–296.
7. Maciel, L., Ballini, R., Gomide, F., Evolving granular analytics for interval time series forecasting. Gran. Comput. 1 (2016), 1–12.
8. Wang, L., Wang, Z., Liu, S., An effective multivariate time series classification approach using echo state network and adaptive differential evolution algorithm. Expert Syst. Appl. 43 (2016), 237–249.
9. Heydari, G., Vali, M., Gharaveisi, A.A., Chaotic time series prediction via artificial neural square fuzzy inference system. Expert Syst. Appl. 55 (2016), 461–468.
10. Heydari, A., Tavakoli, M., Salim, N., Detection of fake opinions using time series. Expert Syst. Appl. 58 (2016), 83–92.
11. Lingras, P., Haider, F., Triff, M., Granular meta-clustering based on hierarchical, network, and temporal connections. Gran. Comput. 1:1 (2016), 71–92.
12. Cheng, H., Tan, P.-N., Potter, C., Klooster, S.A., Detection and characterization of anomalies in multivariate time series. Proceedings of the SIAM International Conference on Data Mining (SDM), Sparks, Nevada, SIAM vol. 9 (2009), 413–424.
13. Zheng, D., Li, F., Zhao, T., Self-adaptive statistical process control for anomaly detection in time series. Expert Syst. Appl. 57 (2016), 324–336.
14. Helliker, B.R., Richter, S.L., Subtropical to boreal convergence of tree-leaf temperatures. Nature 454:7203 (2008), 511–514.
15. Chen, M.-H., Kim, W.G., Kim, H.J., The impact of macroeconomic and non-macroeconomic forces on hotel stock returns. Int. J. Hosp. Manag. 24:2 (2005), 243–258.
16. Hayes, M.A., Contextual Anomaly Detection Framework for Big Sensor Data, Thesis. 2014, The University of Western Ontario, Ontario, Canada.
17. Takeishi, N., Yairi, T., Anomaly detection from multivariate time-series with sparse representation. Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on, San Diego, USA, IEEE, 2014, 2651–2656.
18. Idé, T., Papadimitriou, S., Vlachos, M., Computing correlation anomaly scores using stochastic nearest neighbors. Proceedings of the 7th IEEE International Conference on Data Mining (ICDM), Omaha, USA, IEEE, 2007, 523–528.
19. Qiu, H., Liu, Y., Subrahmanya, N.A., Li, W., Granger causality for time-series anomaly detection. Proceedings of the 12th IEEE International Conference on Data Mining (ICDM), Brussels, Belgium, IEEE, 2012, 1074–1079.
20. Gan, M., Chen, C.P., Li, H.-X., Chen, L., Gradient radial basis function based varying-coefficient autoregressive model for nonlinear and nonstationary time series. IEEE Signal Process Lett. 22:7 (2015), 809–812.
21. Bisht, K., Kumar, S., Fuzzy time series forecasting method based on hesitant fuzzy sets. Expert Syst. Appl. 64 (2016), 557–568.
22. Jones, M., Nikovski, D., Imamura, M., Hirata, T., Exemplar learning for extremely efficient anomaly detection in real-valued time series. Data Mining Knowl. Discov., 2016, 1–28.
23. Xu, Z., Gou, X., An overview of interval-valued intuitionistic fuzzy information aggregations and applications. Gran. Comput. 1 (2016), 1–27.
24. Ben-Gal, I., Outlier detection. Data Mining and Knowledge Discovery Handbook, 2005, Springer, 131–146.
25. Filzmoser, P., A multivariate outlier detection method. Proceedings of the Seventh International Conference on Computer Data Analysis and Modeling, Minsk, Belarus, 2004, 18–22.
26. Rabiner, L.R., A tutorial on Hidden Markov Models and selected applications in speech recognition. Proc. IEEE 77:2 (1989), 257–286.
27. Elliott, R.J., Siu, T.K., Fung, E.S., A double HMM approach to altman Z-scores and credit ratings. Expert Syst. Appl. 41:4 (2014), 1553–1560.
28. Li, Z., Fang, H., Huang, M., Diversified learning for continuous Hidden Markov Models with application to fault diagnosis. Expert Syst. Appl. 42:23 (2015), 9165–9173.
29. Fu, R., Wang, H., Zhao, W., Dynamic driver fatigue detection using Hidden Markov Model in real driving condition. Expert Syst. Appl. 63 (2016), 397–411.
30. Cao, Y., Li, Y., Coleman, S., Belatreche, A., McGinnity, T.M., Adaptive hidden Markov model with anomaly states for price manipulation detection. IEEE Trans. Neural Netw. Learn. Syst. 26:2 (2015), 318–330.
31. Soualhi, A., Clerc, G., Razik, H., Guillet, F., Hidden Markov Models for the prediction of impending faults. IEEE Trans. Ind. Electron. 63:5 (2016), 3271–3281.
32. Forney, G.D., The Viterbi algorithm. Proc. IEEE 61:3 (1973), 268–278.
33. Chen, L., Chen, C.P., Lu, M., A multiple-kernel fuzzy C-means algorithm for image segmentation. IEEE Trans. Syst. ManCybernet. B (Cybernet.) 41:5 (2011), 1263–1274.
34. Pal, N.R., Bezdek, J.C., On cluster validity for the Fuzzy C-means model. IEEE Trans. Fuzzy Syst. 3:3 (1995), 370–379.
35. Zhou, J., Chen, C.P., Chen, L., Li, H.-X., A collaborative fuzzy clustering algorithm in distributed network environments. IEEE Trans. Fuzzy Syst. 22:6 (2014), 1443–1456.
36. Tahani, H., Keller, J.M., Information fusion in computer vision using the fuzzy integral. IEEE Trans. Syst. Man Cybernet. 20:3 (1990), 733–741.
37. Wu, J., Chen, F., Nie, C., Zhang, Q., Intuitionistic fuzzy-valued Choquet integral and its application in multicriteria decision making. Inform. Sci. 222 (2013), 509–527.
38. Hwang, C.-M., Yang, M.-S., Hung, W.-L., Lee, M.-G., A similarity measure of intuitionistic fuzzy sets based on the Sugeno integral with its application to pattern recognition. Inform. Sci. 189 (2012), 93–109.
39. Liou, J.J., Chuang, Y.-C., Tzeng, G.-H., A fuzzy integral-based model for supplier evaluation and improvement. Inform. Sci. 266 (2014), 199–217.
40. Yoo, B.-S., Kim, J.-H., Fuzzy integral-based gaze control of a robotic head for human robot interaction. IEEE Trans. Cybern. 45:9 (2015), 1769–1783.
41. Abdallah, A.C.B., Frigui, H., Gader, P., Adaptive local fusion with fuzzy integrals. IEEE Trans. Fuzzy Syst. 20:5 (2012), 849–864.
42. Murofushi, T., Sugeno, M., An interpretation of fuzzy measures and the Choquet integral as an integral with respect to a fuzzy measure. Fuzzy Sets Syst. 29:2 (1989), 201–227.
43. Onisawa, T., Sugeno, M., Nishiwaki, Y., Kawai, H., Harima, Y., Fuzzy measure analysis of public attitude towards the use of nuclear energy. Fuzzy Sets Syst. 20:3 (1986), 259–289.
44. Wang, H.-C., Lee, C.-S., Ho, T.-H., Combining subjective and objective QoS factors for personalized web service selection. Expert Syst. Appl. 32:2 (2007), 571–584.
45. Chi, Y., Zhang, T., Study on optimum fusion algorithms of IKONOS high spatial resolution remote sensing image. Proceedings of the International Conference on Multimedia Technology (ICMT), Hangzhou, China, IEEE, 2011, 761–764.
46. (2003, Jul.). DataMarket − Time Series Data Library. [Online]. Available: http://robjhyndman.com/tsdldata.
47. A. Asuncion, D. Newman, UCI Machine Learning Repository (Online), 2007, Available from: http://archive.ics.uci.edu/ml/.