On-line anomaly detection and resilience in classifier ensembles

Pattern Recognition Letters

Volumn 34, Issue 15, 2013, Pages 1916-1927

  Sagha, Hesam ^a   Bayati, Hamidreza ^a   Millán, José Del R ^a   Chavarriaga, Ricardo ^a  

^a EPFL   (Switzerland)

Author keywords

Anomaly detection; Classifier ensemble; Decision fusion; Human activity recognition

Indexed keywords

INFORMATION THEORY; MONITORING; PATTERN RECOGNITION;

ANOMALY DETECTION; CLASSIFIER ENSEMBLES; DECISION FUSION; ENSEMBLE OF CLASSIFIERS; GENERALIZED LIKELIHOOD RATIO; HUMAN ACTIVITY RECOGNITION; ONE-CLASS SUPPORT VECTOR MACHINES (OCSVM); SENSOR CONFIGURATIONS;

CLASSIFICATION (OF INFORMATION);

EID: 84885079530     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2013.02.014     Document Type: Article

References (67)

1. Alippi, C., Roveri, M., 2006a. An adaptive cusum-based test for signal change detection. In: IEEE Internat. Symposium on Circuits and Systems (ISCAS). IEEE.
2. Alippi, C., Roveri, M., 2006b. A computational intelligence-based criterion to detect non-stationarity trends. In: Internat. Joint Conf. on Neural Networks (IJCNN), pp. 5040-5044. (Pubitemid 351370016)
3. Alippi, C., Roveri, M., 2008. Just-in-time adaptive classifiers. Part I: Detecting nonstationary changes. IEEE Trans. Neural Networks 19, 1145-1153.
4. Anderson, J., 2008. A generalized likelihood ratio test for detecting land mines using multispectral images. IEEE Geosci. Remote Sens. Lett. 5, 547-551.
5. Andrieu, C., Doucet, A., Singh, S.S., Tadic, V.B., 2004. Particle methods for change detection, system identification, and control. Proc. IEEE 92, 423-438. (Pubitemid 40890751)
6. Balzano, L.K., 2007. Addressing fault and calibration in wireless sensor networks. Master's Thesis, University of California Los Angeles.
7. Basseville, M., Nikiforov, I.V., 1993. Detection of Abrupt Changes: Theory and Application. Prentice-Hall.
8. Betta, G., Pietrosanto, A., 1998. Instrument fault detection and isolation: state of the art and new research trends. In: IEEE Conference Proceedings Instrumentation and Measurement Technology Conference, pp. 483-489.
9. Boisgontier, H., Noblet, V., Heitz, F., Rumbach, L., Armspach, J.P., 2009. Generalized likelihood ratio tests for change detection in diffusion tensor images. In: IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp. 811-814.
10. Bolton, R.J., Hand, D.J., H, D.J., 2002. Statistical fraud detection: A review. Statist. Sci. 17, 235-255.
11. Bosc, M., Heitz, F., Armspach, J.P., Namer, I., Gounot, D., Rumbach, L., 2003 Automatic change detection in multimodal serial MRI: Application to multiple sclerosis lesion evolution. NeuroImage 20, 643-656. (Pubitemid 37268094)
12. Brotherton, T., Johnson, T., 2001. Anomaly detection for advanced military aircraft using neural networks. In: IEEE Proceedings of Aerospace Conference, pp. 3113-3123.
13. Calatroni, A., Roggen, D., Tröster, G., 2011. Automatic transfer of activity recognition capabilities between body-worn motion sensors: Training newcomers to recognize locomotion. In: 8th Internat. Conf. on Networked Sensing Systems (INSS), Penghu, Taiwan.
14. Camps-Valls, G., Gomez-Chova, L., Munoz-Mari, J., Rojo-Alvarez, J., Martinez-Ramon, M., 2008. Kernel-based framework for multitemporal and multisource remote sensing data classification and change detection. IEEE Transactions on Geoscience and Remote Sensing 46, 1822-1835. (Pubitemid 351711220)
15. Chandola, V., Banerjee, A., Kumar, V., 2009. Anomaly detection: A survey. ACM Comput. Surv. 41, 1-58.
16. Chang, C.C., Lin, C.J., 2011. LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 27:1-27:27, Software available at: .
17. Chavarriaga, R., Sagha, H., Millán, J.d.R., 2011. Ensemble creation and reconfiguration for activity recognition: An information theoretic approach. In: IEEE Internat. Conf. on Systems, Man, and Cybernetics.
18. Chavarriaga, R., Bayati, H., Millán, J.d.R., 2013a. Unsupervised adaptation for acceleration-based activity recognition: robustness to sensor displacement and rotation. Pers. Ubiquitous Comput. 17, 479-490.
19. Chavarriaga, R., Sagha, H., Calatroni, A., Digumarti, S.T., Tröster, G., Millán, J.d.R., Roggen, D., 2013b. The opportunity challenge: A benchmark database for onbody sensor-based activity recognition. Pattern Recognition Lett. this issue.
20. Chen, J., Kher, S., Somani, A., 2006. Distributed fault detection of wireless sensor networks. In: Proc. Workshop on Dependability Issues in Wireless ad Hoc Networks and Sensor Networks. ACM, New York, NY, USA, pp. 65-72.
21. Das, K., Bhaduri, K., Votava, P., 2011. Distributed anomaly detection using 1-class SVM for vertically partitioned data. Statist. Anal. Data Min. 4, 393-406.
22. Demirbas, M., 2004. Scalable design for fault-tolerance for wireless sensor networks. Ph.D. Thesis, Ohio State University, Computer and Information Science.
23. Ding, S., 2008. Model-Based Fault Diagnosis Techniques. Springer.
24. El Falou, W., Khalil, M., Duchene, J., 2000. AR-based method for change detection using dynamic cumulative sum. In: 7th IEEE Internat. Conf. on Electronics, Circuits and Systems, ICECS, vol.1, pp. 157-160.
25. Förster, K., Brem, P., Roggen, D., Tröster, G., 2009. Evolving discriminative features robust to sensor displacement for activity recognition in body area sensor networks. In: 5th Internat. Conf. on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), pp. 43-48.
26. Fu, Y., Cao, L., Guo, G., Huang, T.S., 2008. Multiple feature fusion by subspace learning. In: Proc. Internat. Conf. on Content-Based Image and Video Retrieval. ACM, New York, NY, USA, pp. 127-134.
27. Gage, J., Murphy, R.R., 2010. Sensing assessment in unknown environments: A survey. IEEE Trans. Syst. Man Cybernet. Part A: Syst. Humans 40, 1-12.
28. Hwang, I., Kim, S., Kim, Y., Seah, C.E., 2010. A survey of fault detection, isolation, and reconfiguration methods. IEEE Trans. Control Syst. Technol. 18, 636-653.
29. Ide, T., Papadimitriou, S., Vlachos, M., 2007. Computing correlation anomaly scores using stochastic nearest neighbors. In: 7th IEEE Internat. Conf. on Data Mining, ICDM, pp. 523-528.
30. Jakubek, S., Strasser, T., 2002. Fault-diagnosis using neural networks with ellipsoidal basis functions. In: Proc. American Control Conference, pp. 3846-3851.
31. Koushanfar, F., Potkonjak, M., Sangiovanni-Vincentelli, A., 2002. On-line fault detection of sensor measurements. In: IEEE Sensors, pp. 69-85.
32. Krishnamachari, B., Iyengar, S.S., 2003. Efficient and fault-tolerant feature extraction in wireless sensor networks. In: Proc. 2nd Internat. Workshop on Information Processing in Sensor Networks.
33. Kuncheva, L.I., Bezdek, J.C., Duin, R.P.W., 2001. Decision templates for multiple classifier fusion: An experimental comparison. Pattern Recognition 34, 299-314. (Pubitemid 32871876)
34. Kunze, K., Lukowicz, P., 2008. Dealing with sensor displacement in motion-based onbody activity recognition systems. In: Proc. 10th Internat. Conf. on Ubiquitous Computing. ACM, New York, NY, USA, pp. 20-29.
35. Kurz, M., Hölzl, G., Ferscha, A., Calatroni, A., Roggen, D., Tröster, G., 2011a. Real-time transfer and evaluation of activity recognition capabilities in an opportunistic system. In: 3rd Internat. Conf. on Adaptive and Self-Adaptive Systems and Applications, pp. 73-78.
36. Kurz, M., Hölzl, G., Ferscha, A., Sagha, H., Millán, J.d.R., Chavarriaga, R., 2011b. Dynamic quantification of activity recognition capabilities in opportunistic systems. In: Fourth Conference on Context Awareness for Proactive Systems: CAPS.
37. Lane, T., Brodley, C.E., 1998. Approaches to online learning and concept drift for user identification in computer security. In: KDD. AAAI Press, pp. 259-263.
38. Li, W., Raghavan, H., Shah, S., 2003. Subspace identification of continuous time models for process fault detection and isolation. J. Process Control 13, 407-421.
39. Lorden, G., 1971. Procedures for reacting to a change in distribution. Ann. Math. Statist. 42, 1897-1908.
40. Lukashevich, H., Nowak, S., Dunker, P., 2009. Using one-class SVM outliers detection for verification of collaboratively tagged image training sets. In: IEEE Internat. Conf. on Multimedia and Expo, ICME 2009, pp. 682-685.
41. Luo, X., Dong, M., Huang, Y., 2006. On distributed fault-tolerant detection in wireless sensor networks. IEEE Trans. Comput. 55, 58-70. (Pubitemid 46488997)
42. Page, E.S., 1954. Continuous inspection schemes. Biometrika 41, 100-115.
43. Rajasegarar, S., Leckie, C., Palaniswami, M., Bezdek, J., 2007. Quarter sphere based distributed anomaly detection in wireless sensor networks. In: IEEE Internat. Conf. on Communications, ICC, pp. 3864-3869. (Pubitemid 351146132)
44. Rajasegarar, S., Leckie, C., Palaniswami, M., Bezdek, J.C., 2006. Distributed anomaly detection in wireless sensor networks. In: 10th IEEE Singapore Internat. Conf. on Communication systems, ICCS, pp. 1-5.
45. Roggen, D., Förster, K., Calatroni, A.G.T., 2011. The adARC pattern analysis architecture for adaptive human activity recognition systems. J. Ambient Intell. Human. Comput., 1-18.
46. Roggen, D., Förster, K., Calatroni, A., Holleczek, T., Fang, Y., Tröster, G., Lukowicz, P., Pirkl, G., Bannach, D., Kunze, K., Ferscha, A., Holzmann, C., Riener, A., Chavarriaga, R., Millán, J.d.R., 2009. OPPORTUNITY: Towards opportunistic activity and context recognition systems. In: 3rd IEEE WoWMoM Workshop on Autonomic and Opportunistic Communications.
47. Ruiz, L.B., Siqueira, I.G., Oliveira, L.B.e., Wong, H.C., Nogueira, J.M.S., Loureiro, A.A.F., 2004. Fault management in event-driven wireless sensor networks. In: Proc. 7th ACM Internat. Symposium on Modeling, Analysis and Simulation of Wireless and Mobile Systems. ACM, New York, NY, USA, pp. 149-156. (Pubitemid 41563743)
48. Ruta, D., Gabrys, B., 2000. An overview of classifier fusion methods. Comput. Inform. Syst. J. 7, 1-10.
49. Sagha, H., Chavarriaga, R., Millán, J.d.R., 2010. A probabilistic approach to handle missing data for multi-sensory activity recognition. In: 12th ACM Internat. Conf. on Ubiquitous Computing. Copenhagen, Denmark.
50. Sagha, H., Millán, J.d.R., Chavarriaga, R., 2011a. Detecting and rectifying anomalies in opportunistic sensor networks. In: Internat. Conf. on Body Sensor Networks (BSN).
51. Sagha, H., Millán, J.d.R., Chavarriaga, R., 2011b. Detecting anomalies to improve classification performance in an opportunistic sensor network. In: 7th IEEE Internat. Workshop on Sensor Networks and Systems for Pervasive Computing, PerSens, Seattle.
52. Sannen, D., Lughofer, E., Van Brussel, H., 2010. Towards incremental classifier fusion. Intell. Data Anal. 14, 3-30.
53. Schonlau, M., DuMouchel, W., Ju, W.H., Karr, A.F., Theus, M., Vardi, Y., 2001 Computer intrusion: detecting masquerades. Statist. Sci. 16, 58-74. (Pubitemid 33632847)
54. Severo, M., Gama, J., 2010. Change detection with kalman filter and cusum. In: May, M., Saitta, L. (Eds.), Ubiquitous Knowledge Discovery, Lecture Notes in Computer Science, vol. 6202. Springer, pp. 148-162.
55. Shannon, C.E., 2001. A mathematical theory of communication. ACM SIGMOBILE Mobile Comput. and Comm. Rev. 5, 3-55.
56. Sheth, A., Hartung, C., Han, R., 2005. A decentralized fault diagnosis system for wireless sensor networks. In: IEEE Internat. Conf. on Mobile Adhoc and Sensor Systems Conference.
57. Smyth, P., 1994. Hidden markov models for fault detection in dynamic systems. Pattern Recognition 27, 149-164. (Pubitemid 124017399)
58. Snoussi, H., Richard, C., 2007. Distributed Bayesian fault diagnosis of jump Markov systems in wireless sensor networks. Internat. J. Sensor Networks 2, 118-127.
59. Steinhoff, U., Schiele, B., 2010. Dead reckoning from the pocket - an experimental study. In: IEEE Internat. Conf. on Pervasive Computing and Communications (PerCom), pp. 162-170.
60. Stiefmeier, T., Roggen, D., Ogris, G., Lukowicz, P., Tröster, G., 2008. Wearable activity tracking in car manufacturing. IEEE Pervasive Comput. Mag., 42-50. (Pubitemid 351575121)
61. Wang, T.Y., Han, Y.S., Varshney, P.K., Chen, P.N., 2005. Distributed fault-tolerant classification in wireless sensor networks. IEEE J. Sel. Areas Comm. 23, 724-734.
62. Wei, T., Huang, Y., Chen, C., 2009. Adaptive sensor fault detection and identification using particle filter algorithms. IEEE Trans. Syst. Man Cybernet. Part C: Appl. Rev. 39, 201-213.
63. Wu, B., Chen, L., 2006. Use of partial cumulative sum to detect trends and change periods for nonlinear time series. J. Econ. Manage. 2, 123-145.
64. Xie, J., Yan, G., Xie, K., Lin, T.Y., 2007. Neuro-fuzzy model-based cusum method application in fault detection on an autonomous vehicle. In: Proceedings of the 2007 IEEE Internat. Conf. on Granular Computing. IEEE Computer Society, Washington, DC, USA, p. 548.
65. Xu, L., Li, J., 2007. Iterative generalized-likelihood ratio test for MIMO radar. IEEE Trans. Signal Process. 55, 2375-2385. (Pubitemid 46851609)
66. Yao, Y., Sharma, A., Golubchik, L., Govindan, R., 2010. Online anomaly detection for sensor systems: A simple and efficient approach. Perform. Eval. 67, 1059-1075.
67. Zhuang, L., Dai, H., 2006. Parameter optimization of kernel-based one-class classifier on imbalance text learning. In: Proc. 9th Pacific Rim Internat. Conf. on Artificial Intelligence. Springer-Verlag, Berlin, Heidelberg, pp. 434-443. (Pubitemid 44531824)