Novelty detection: A review - Part 1: Statistical approaches

Signal Processing

Volumn 83, Issue 12, 2003, Pages 2481-2497

  Markou, Markos ^a   Singh, Sameer ^a  

^a UNIVERSITY OF EXETER   (United Kingdom)

Author keywords

Clustering; Gaussian mixture models; Hidden Markov models; KNN; Novelty detection review; Parzen density estimation; Statistical approaches; String matching

Indexed keywords

COMPUTER VISION; DATA MINING; IDENTIFICATION (CONTROL SYSTEMS); LEARNING SYSTEMS; NEURAL NETWORKS; PATTERN RECOGNITION; ROBOTICS; STATISTICAL METHODS;

STRING MATCHING;

SIGNAL DETECTION;

EID: 0142063407     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2003.07.018     Document Type: Article

References (64)

1. L.D. Baker, T. Hofmann, A.K. McCallum, Y. Yang, A hierarchical probabilistic model for novelty detection in text, Technical Report, 1999.
2. Barnett V., Lewis T. Outliers in Statistical Data. 1994;Wiley, NY, USA.
3. J.C. Bezdek, R. Ehrlich, W. Full, FCM: the fuzzy c-means clustering algorithm, Computers and Geosciences, Vol. 10, 1984, pp. 191-203.
4. C. Bishop, Novelty detection and neural network validation, Proceedings of the IEE Conference on Vision and Image Signal Processing, 1994, pp. 217-222.
5. T. Brotherton, T. Johnson, G. Chadderdon, Classification and novelty detection using linear models and a class dependent - elliptical basis function neural network, Proceedings of the IJCNN Conference, Anchorage, May 1998.
6. Campbell C., Bennett K.P. A linear programming approach to novelty detection. Advances in NIPS. Vol. 14:2001;MIT Press, Cambridge, MA, USA.
7. G.A. Carpenter, M.A. Rubin, W.W. Streilein, ARTMAP-FD: familiarity discrimination applied to radar target recognition, Proceedings of the International Conference on Neural Networks, Vol. III, Houston, TX, 1997, pp. 1459-1464.
8. Chow C.K. On optimum recognition error and reject tradeoff. IEEE Trans. Inform. Theory. IT-16(1):January 1970;41-46.
9. Cordella L.P., De Stefano C., Tortorella F., Vento M. A method for improving classification reliability of multilayer perceptrons. IEEE Trans. Neural Networks. 6(5):1995;1140-1147.
10. Cover T., Hart P. Nearest neighbor pattern classification. IEEE Trans. Inform. Theory. 13:1967;21-27.
11. Dasgupta D., Forrest S. Novelty-detection in time series data using ideas from immunology, Proceedings of the International Conference on Intelligent Systems. 1996;Reno, Nevada.
12. D. Dasgupta, F.A. Gonzalez, An immunogenetic approach to intrusion detection, Division of Computer Science, University of Memphis, Technical Report CS-01-001, 2001.
13. D. Dasgupta, N.S. Majumdar, Anomaly detection in multidimensional data using negative selection algorithm, Proceedings of the IEEE Conference on Evolutionary Computation, Hawaii, May 2002, pp. 1039-1044.
14. D. Dasgupta, F. Nino, A comparison of negative and positive selection algorithms in novel pattern detection, Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Vol. 1, Nashville, TN, 2000, pp. 125-130.
15. M.J. Desforges, P.J. Jacob, J.E. Cooper, Applications of probability density estimation to the detection of abnormal conditions in engineering, Proceedings of the Institute of Mechanical Engineers, Vol. 212, 1998, pp. 687-703.
16. Duda R.O., Hart P.E., Stork D.G. Pattern Classification. 2001;Wiley, NY, USA.
17. Elad M., Hel-Or Y., Keshet R. Rejection based classifier for face detection. Pattern Recognition Lett. 23:2002;1459-1471.
18. Fisher R.A., Tippett L.H.C. Limiting forms of the frequency distribution of the largest and smallest member of a sample. Proc. Camb. Philos. Soc. 24:1928;180-190.
19. Foggia P., Sansone C., Tortorella F., Vento M. Multiclassification. reject criteria for the Bayesian combiner Pattern Recognition. 32:1999;1435-1447.
20. S. Forrest, A.S. Perelson, L. Allen, R. Cherukuri, Self-non-self discrimination in a computer, Proceedings of the IEEE Symposium on Research in Security and Privacy, Oakland, CA, USA, May 1994, pp. 202-212.
21. Fumera G., Roli F., Giacinto G. Reject option with multiple thresholds. Pattern Recognition. 33:2000;2099-2101.
22. Guh R.S., Zorriassatine F., Tannock J.D.T. On-line control chart pattern detection and discrimination - a neural network approach. Artificial Intell. Eng. 13:1999;413-425.
23. S.E. Guttormsson, R.J. Marks II, M.A. El-Sharkawi, Elliptical novelty grouping for on-line short-turn detection of excited running rotors, IEEE Trans. Energy Conversion 14(1) (March 1999).
24. Hansen L.K., Liisberg C., Salamon P. The error-reject tradeoff. Open Systems Inform. Dynamics. 4:1997;159-184.
25. L.K. Hansen, S. Sigurdsson, T. Kolenda, F.A. Nielson, U. Kjems, J. Larsen, Modelling text with generalizable Gaussian mixtures, Proceedings of IEEE ICASSP '2000, Vol. 6, Istanbul, Turkey, 2000, pp. 3494-3497.
26. Hellman M.E. The nearest neighbour classification with a reject option. IEEE Trans. Systems Sci. Cybernet. 6(3):July 1970;179-185.
27. S.J. Hickinbotham, J. Austin, Neural networks for novelty detection in airframe strain data, Proceedings of IEEE IJCNN, Como, Italy, 2000.
28. N. Japkowicz, C. Myers, M. Gluck, A novelty detection approach to classification, Proceedings of the 14th IJCAI Conference, Montreal, 1995, pp. 518-523.
29. Jiang M.F., Tseng S.S., Su C.M. Two-phase clustering algorithm for outliers detection. Pattern Recognition Lett. 22:2001;691-700.
30. S.P. King, D.M. King, P. Anuzis, K. Astley, L. Tarassenko, P. Hayton, S. Utete, The use of novelty detection techniques for monitoring high-integrity plant, Proceedings of the 2002 International Conference on Control Applications, Vol. 1, Cancum, Mexico, 2002, pp. 221-226.
31. Knorr E.M., Ng R.T., Tucakov V. Distance-based outliers. algorithms and applications VLDB J. 8(3-4):2000;237-253.
32. M. Lauer, A mixture approach to novelty detection using training data with outliers, in: L. De Raedt, P. Flach (Eds.), Proceedings of the 12th European Conference on Machine Learning, Springer, Freiburg, Germany, 2001, pp. 300-311.
33. J. Laurikkala, M. Juhola, E. Kentala, Informal identification of outliers in medical data, Intelligent Data Analysis in Medicine and Pharmacology (IDAMAP-2000), Berlin, August 2000.
34. C. Manikopoulos, S. Papavassiliou, Network intrusion and fault detection: a statistical anomaly approach, IEEE Comm. Mag. 40 (October 2002).
35. G. Manson, Identifying damage sensitive, environment insensitive features for damage detection, Proceedings of the IES Conference, Swansea, UK, 2002.
36. G. Manson, G. Pierce, K. Worden, On the long-term stability of normal condition for damage detection in a composite panel, Proceedings of the 4th International Conference on Damage Assessment of Structures, Cardiff, UK, June 2001.
37. G. Manson, G. Pierce, K. Worden, T. Monnier, P. Guy, K. Atherton, Long term stability of normal condition data for novelty detection, Proceedings of the 7th International Symposium on Smart Structures and Materials, California, USA, 2000.
38. A. Nairac, T. Corbett-Clark, R. Ripley, N. Townsend, L. Tarassenko, Choosing an appropriate model for novelty detection, Proceedings of the 5th IEEE International Conference on Artificial Neural Networks, Cambridge, 1997, pp. 227-232.
39. Nairac A., Townsend N., Carr R., King S., Cowley P., Tarassenko L. A system for the analysis of jet engine vibration data. Integrated Comput. Aided Eng. 6:1999;53-65.
40. T. Odin, D. Addison, Novelty detection using neural network technology, Proceedings of the COMADEN Conference, Houston, TX, 2000.
41. Parra L., Deco G., Miesbach S. Statistical independence and novelty detection with information preserving non-linear maps. Neural Comput. 8(2):1995;260-269.
42. Pizzi N.J., Vivanco R.A., Somorjai R.L. EvIdent. a functional magnetic resonance image analysis system Artif. Intell. Med. 21:2001;263-269.
43. Roberts S.J. Novelty detection using extreme value statistics. IEE Proc. Vision, Image Signal Process. 146(3):1999;124-129.
44. S.J. Roberts, Extreme value statistics for novelty detection in biomedical signal processing, Proceedings of the 1st International Conference on Advances in Medical Signal and Information Processing, 2002, pp. 166-172.
45. Roberts S., Tarassenko L. A probabilistic resource allocating network for novelty detection. Neural Comput. 6:1994;270-284.
46. R. Ruotolo, C. Surace, A statistical approach to damage detection through vibration monitoring, Proceedings of the 5th Pan American Congress of Applied Mechanics, Puerto, Rico, 1997.
47. R. Saunders, J.S. Gero, The importance of being emergent, Proceedings of the Artificial Intelligence in Design, 2000.
48. G. Scarth, M. McIntyre, B. Wowk, R. Somorjai, Detection of novelty in functional images using fuzzy clustering, Proceedings of the 3rd Meeting ISMRM, Nice, France, 1995, p. 238.
49. S. Singh, M. Markou, An approach to novelty detection applied to the classification of image regions, IEEE Trans. Knowledge Data Eng., 2003, in press.
50. C. Spence, L. Parra, P. Sajda, Detection, synthesis and compression in mammographic image analysis with a hierarchical image probability model, IEEE Workshop on Mathematical Methods in Biomedical Image Analysis, MMBIA 2001, Kauai, HI, 2001, pp. 3-10.
51. Stefano C.D., Sansone C., Vento M. To reject or not to reject. that is the question - an answer in case of neural classifiers IEEE Trans. Systems, Man Cybernet. Part C. 30(1):2000;84-94.
52. A.O. Tarakanov, V.A. Skormin, Pattern recognition by immunocomputing, Proceedings of the 2002 Congress on Evolutionary Computation, CEC '02., Vol. 1, Honolulu, HI, 2002, pp. 938-943.
53. L. Tarassenko, Novelty detection for the identification of masses in mammograms, Proceedings of the 4th IEE International Conference on Artificial Neural Networks, Vol. 4, Cambridge, UK, 1995, pp. 442-447.
54. L. Tarassenko, A. Nairac, N. Townsend, P. Cowley, Novelty detection in jet engines, IEE Colloquium on Condition Monitoring, Imagery, External Structures and Health, Birmingham, UK, 1999, pp. 41-45.
55. D.M.J. Tax, R.P.W. Duin, Outlier detection using classifier instability, in: Advances in Pattern Recognition, the Joint IAPR International Workshops, Sydney, Australia, 1998, pp. 593-601.
56. D.M.J. Tax, R.P.W. Duin, Data description in subspaces, International Conference on Pattern Recognition, Vol. 2, Barcelona, 2000.
57. Webb A. Statistical Pattern Recognition. 1999;Arnold, Paris.
58. F. Wei, M. Miller, S.J. Stolfo, L. Wenke, P.K. Chan, Using artificial anomalies to detect unknown and known network intrusions, Proceedings of the IEEE International Conference on Data Mining, ICDM 2001, San Jose, CA, 2001, pp. 123-130.
59. K. Yamanishi, J. Takeuchi, G. Williams, On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms, Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, MA, USA, August 2000, pp. 320-324.
60. Y. Yang, X. Liu, A re-examination of text categorization methods, Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, 1999, pp. 42-49.
61. Y. Yang, T. Pierce, J. Carbonell, A study on retrospective and on-line event detection, Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval, Melbourne, Australia, 1998, pp. 28-36.
62. Y. Yang, J. Zhang, J. Carbonell, C. Jin, Topic-conditioned novelty detection International Conference on Knowledge Discovery and Data Mining, July 2002.
63. D.Y. Yeung, C. Chow, Parzen window network intrusion detectors, Proceedings of the International Conference on Pattern Recognition, Quebec, Canada, 2002.
64. Yeung D.Y., Ding Y. Host-based intrusion detection using dynamic and static behavioral models. Pattern Recognition. 36:2002;229-243.