Unsupervised active learning based on hierarchical graph-theoretic clustering

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 39, Issue 5, 2009, Pages 1147-1161

  Hu, Weiming ^a   Hu, Wei ^a   Xie, Nianhua ^a   Maybank, Steve ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Active learning; Dominant set clustering; Image and video classification; Network intrusion detection; Spectral clustering

Indexed keywords

ACTIVE LEARNING; DOMINANT-SET CLUSTERING; IMAGE AND VIDEO CLASSIFICATION; NETWORK INTRUSION DETECTION; SPECTRAL CLUSTERING;

AUTOMATIC INDEXING; EDUCATION; IMAGE ANALYSIS; IMAGE CLASSIFICATION; INTERNET; INTRUSION DETECTION; SEMANTICS;

CLUSTERING ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTER SIMULATION; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 67649410207     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2013197     Document Type: Article

References (50)

1. M. Almgren and E. Jonsson, "Using active learning in intrusion detection," in Proc. 17th IEEE Comput. Security Found. Workshop, 2004, pp. 88-98.
2. J. G. Auguston and J. Minker, "An analysis of some graph theoretical clustering techniques," J. Assoc. Comput. Mach., vol. 17, no. 4, pp. 571-588, Oct. 1970.
3. F. R. Bach and M. I. Jordan, "Learning spectral clustering," in Proc. Neural Inf. Process. Syst., Cambridge, MA: MIT Press, 2004, vol. 16, pp. 305-312.
4. Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N. L. Roux and M. Ouimet, "Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps, and spectral clustering," in Proc. Neural Inf. Process. Syst., Cambridge, MA, MIT Press, 2004, vol. 16, pp. 177-184.
5. R. C. Dubes and A. K. Jain, "Clustering methodologies in exploratory data analysis," J. Advances Comput., vol. 19, pp. 113-228, 1980.
6. S. C. H. Hoi and M. R. Lyu, "A semi-supervised active learning framework for image retrieval," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2005, vol. 2, pp. 20-25.
7. W. M. Hu, W. Hu, and S. Maybank, "AdaBoost-based algorithm for network intrusion detection," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 2, pp. 577-583, Apr. 2008.
8. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice-Hall, 1988.
9. R. Jenssen, T. Eltoft, and J. C. Principe, "Information theoretic spectral clustering," in Proc. IEEE Int. Conf. Multimedia Expo, 2004, vol. 1, pp. 25-29.
10. F. Jing, M. Li, H. J. Zhang, and B. Zhang, "A unified framework for image retrieval using keyword and visual features," IEEE Trans. Image Process., vol. 14, no. 7, pp. 979-989, Jul. 2005.
11. L. Zelnik-Manor and P. Perona, "Self-tuning spectral clustering," in Proc. Neural Inf. Process. Syst., Cambridge, MA: MIT Press, 2005, vol. 17, pp. 1601-1608.
12. U. Luxburg, O. Bousquet and M. Belkin, "Limits of spectral clustering," in Proc. Neural Inf. Process. Syst., Cambridge, MA: MIT Press, 2005, vol. 17, pp. 857-864.
13. M. Pavan and M. Pelillo, "A new graph-theoretic approach to clustering and segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. 2003, vol. 1, pp. 18-20.
14. M. Pavan and M. Pelillo, "Efficient out-of-sample extension of dominant-set clusters," in Proc. Neural Inf. Process. Syst., Cambridge, MA: MIT Press, 2005, vol. 17, pp. 1057-1064.
15. Y. Rong and A. Hauptmann, "Multi-class active learning for video semantic feature extraction," in Proc. IEEE Int. Conf. Multimedia Expo, 2004, vol. 1, pp. 27-30.
16. J. Shi and J. Malik, "Normalized cuts and image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905, Aug. 2000.
17. G. Tur, R. E. Schapire, and D. Hakkani-Tur, "Active learning for spoken language understanding," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2003, vol. 1, pp. 6-10.
18. L. Wang, K. L. Chan, and Y. P. Tan, "Image retrieval with SVM active learning embedding Euclidean search," in Proc. Int. Conf. Image Process., 2003, vol. 1, pp. 14-17.
19. Z. Wu and R. Leahy, "An optimal graph theoretic approach to data clustering: Theory and its application to image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 15, no. 11, pp. 1101-1113, Nov. 1993.
20. R. Yan, J. Yang, and A. Hauptmann, "Automatically labeling video data using multi-class active learning," in Proc. IEEE Int. Conf. Comput. Vis., 2003, vol. 1, pp. 516-523.
21. S. X. Yu and J. Shi, "Multiclass spectral clustering," in Proc. IEEE Int. Conf. Comput. Vis., 2003, vol. 1, pp. 313-319.
22. C. T. Zahn, "Graph-theoretic methods for detecting and describing gestalt clusters," IEEE Trans. Comput., vol. C-20, no. 1, pp. 68-86, Jan. 1971.
23. C. Zhang and T. Chen, "An active learning framework for content-based information retrieval," IEEE Trans. Multimedia, vol. 4, no. 2, pp. 260-268, Jun. 2002.
24. D.-Q. Zhang, C.-Y. Lin, S.-F. Chang, and J. R. Smith, "Semantic video clustering across sources using bipartite spectral clustering," in Proc. IEEE Int. Conf. Multimedia Expo, 2004, vol. 1, pp. 117-120.
25. Y. G. Liu, K. F. Chen, X. F. Liao, and W. Zhang, "A genetic clustering method for intrusion detection," Pattern Recognit., vol. 37, no. 5, pp. 927-942, May 2004.
26. S. T. Sarasamma, Q. A. Zhu, and J. Huff, "Hierarchical Kohonen net for anomaly detection in network security," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 2, pp. 302-312, Apr. 2005.
27. E. Eskin, A. Arnold, M. Prerau, L. Portnoy, and S. Stolfo, "A geometric framework for unsupervised anomaly detection: Detecting intrusions in unlabeled data," in Applications of Data Mining in Computer Security D. Barbara and S. Jajodia, Eds. Norwell, MA: Kluwer, 2002, ch. 4.
28. C. Elkan, "Results of the kdd99 classifier learning contest," SIGKDD Explorations, vol. 1, no. 2, pp. 63-64, 2000.
29. B. Pfahringer, "Winning the kdd99 classification cup: Bagged boosting," SIGKDD Explorations, vol. 1, no. 2, pp. 65-66, 2000.
30. D. Song, M. I. Heywood, and A. N. Zincir-Heywood, "Training genetic programming on half a million patterns: An example from anomaly detection," IEEE Trans. Evol. Comput., vol. 9, no. 3, pp. 225-239, Jun. 2005.
31. J. Huang, S. R. Kumar, M. Mitra, W.-J. Zhu, and R. Zabih, "Image indexing using color correlogram," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 1997, pp. 762-768.
32. T.-K. Huang, R. C. Weng, and C.-J. Lin, "Generalized Bradley-Terry models and multi-class probability estimates," J. Mach. Learn. Res. vol. 7, pp. 85-115, Jan. 2006.
33. P. Muneesawang and L. Guan, "iARM - An interactive video retrieval system," in Proc. IEEE Int. Conf. Multimedia Expo, Jun. 2004, vol. 1, pp. 285-288.
34. A. Y. Ng, M. I. Jordan, and Y. Weiss, "On spectral clustering: Analysis and an algorithm," in Advances in Neural Information Processing System, vol. 14, T. Dietterich, S. Becker, and Z. Ghahramani, Eds. Cambridge, MA: MIT Press, 2001, pp. 849-856.
35. D. Angluin, "Queries and concept learning," Mach. Learn., vol. 2, no. 4, pp. 319-342, Apr. 1988.
36. D. Lewis and J. Catlett, "Heterogeneous uncertainty sampling for supervised learning," in Proc. Int. Conf. Mach. Learn., 1994, pp. 148-156.
37. H. S. Seung, M. Opper, and H. Sompolinsky, "Query by committee," in Proc. ACM Workshop Comput. Learn. Theory, 1992, pp. 287-294.
38. S. Fine, R. Gilad-Bachrach, and E. Shamir, "Query by committee, linear separation and random walks," Theor. Comput. Sci., vol. 284, no. 1, pp. 25-51, Jul. 2002.
39. Y. Freund, H. S. Seung, E. Shamir, and N. Tishby, "Selective sampling using the query by committee algorithm," Mach. Learn., vol. 28, no. 2/3, pp. 133-168, 1997.
40. T. Graepel and R. Herbrich, "The kernel Gibbs sampler," in Proc. Advances Neural Inf. Process. Syst., 2000, vol. 13, pp. 514-520.
41. C. Campbell, N. Cristianini, and A. J. Smola, "Query learning with large margin classifiers," in Proc. Int. Conf. Mach. Learn., 2000, pp. 111-118.
42. G. Schohn and D. Cohn, "Less is more: Active learning with support vector machines," in Proc. Int. Conf. Mach. Learn., Stanford, CA, 2000, pp. 839-846.
43. S. Tong and D. Koller, "Support vectormachine active learning with applications to text classification," in Proc. Int. Conf. Mach. Learn., Stanford, CA, 2000, pp. 999-1006.
44. D. Lewis and W. Gale, "A sequential algorithm for training text classifiers," in Proc. ACM-SIGIR Int. Conf. Res. Develop. Inf. Retrieval, 1994, pp. 3-12.
45. N. Roy and A. McCallum, "Toward optimal active learning through sampling estimation of error reduction," in Proc. Int. Conf. Mach. Learn., 2001, pp. 441-448.
46. D. Lewis and W. Gale, "Training text classifiers by uncertainty sampling," in Proc. ACM Int. Conf. Res. Develop. Inf. Retrieval, 1994, pp. 3-12.
47. S. C. H. Hoi, R. Jin, J. K. Zhu, andM. R. Lyu, "Batch mode active learning and its application to medical image classification," in Proc. Int. Conf. Mach. Learn., 2006, pp. 417-424.
48. K.-S. Goh, E. Y. Chang, and W.-C. Lai, "Multimodal concept-dependent active learning for image retrieval," in Proc. ACM Int. Conf. Multimedia, New York, Oct. 2004, pp. 564-571.
49. Y. Guo and D. Schuurmans, "Discriminative batch mode active learning," in Proc. Advances Neural Inf. Process. Syst., 2007, pp. 1-8.
50. W. Hu and W. Hu, "HIGCALS: A hierarchical graph-theoretic clustering active learning system," in Proc. IEEE Int. Conf. Syst., Man, Cybern., Oct. 2006, vol. 5, pp. 3895-3900.