Designing relevant features for continuous data sets using ICA

International Journal of Computational Intelligence and Applications

Volumn 7, Issue 4, 2008, Pages 447-468

  Prasad, Mithun ^a   Sowmya, Arcot ^a   Koch, Inge ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Classification; Feature subset selection; HRCT; Independent component analysis

Indexed keywords

AREAS OF INTERESTS; CLASSIFICATION; CLASSIFICATION ACCURACIES; COMPUTER TOMOGRAPHY IMAGES; CONSTRUCTION TECHNIQUES; CONTINUOUS DATUM; DATA SETS; FEATURE EXTRACTION TECHNIQUES; FEATURE SELECTIONS; FEATURE SPACES; FEATURE SUBSET SELECTION; HIGH RESOLUTIONS; HRCT; LARGE DATA SETS; MACHINE-LEARNING; MEDICAL IMAGE SEGMENTATIONS;

DIAGNOSTIC RADIOGRAPHY; FEATURE EXTRACTION; HEMODYNAMICS; IMAGE PROCESSING; LEARNING SYSTEMS; TOMOGRAPHY;

INDEPENDENT COMPONENT ANALYSIS;

EID: 64349122717     PISSN: 14690268     EISSN: None     Source Type: Journal    
DOI: 10.1142/S1469026808002387     Document Type: Article

References (46)

1. F. R. Bach and M. I. Jordan, Kernel independent component analysis, J. Mach. Learn. Res. 3 (2002) 1-48.
2. T. Hastie and R. Tibshirani, Independent component analysis through product density estimation, Proc. Neural Inform. Process. Syst. (2002), pp. 649-656.
3. D. Koller and M. Sahami, Toward optimal feature selection, in Proc. Thirteenth Int. Conf. Machine Learning (ICML'96), Bari, Italy (1996), pp. 284-292.
4. A. E. Guyon, An introduction to variable and feature selection, J. Mach. Learn. Res. 3 (2003) 1157-1182.
5. R. Kohavi and G. H. John, Wrappers for feature subset selection, Artif. Intell. 97 (1997) 273-324.
6. P. M. Narendra and K. Fukunaga, A branch and bound algorithm for feature subset selection, IEEE Trans. Comput. C-26(9) (1977) 917-922.
7. N. Wyse, R. Dubes and A. K. Jain, A critical evaluation of intrinsic dimensionality algorithms, Pattern Recognition in Practice, eds. E. S. Gelsema and L. N. Kanal (North-Holland, 1980), pp. 415-425.
8. I. Kononenko, Estimating attributes: Analysis and extensions of relief, Eur. Conf. Mach. Learn. (1994), pp. 171-182.
9. T. Cormen, C. Leiserson and R. Rivest, Introduction to Algorithms, Chap. 17 (The MIT Press, Cambridge, MA, 1990).
10. S. Russell and P. Norvig, Artificial Intelligence: A Modern Approach (Prentice Hall, Englewood Cliffs, NJ, 1995).
11. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach (Prentice Hall, Englewood Cliffs, NJ, 1982).
12. I. Foroutan and J. Sklansky, Feature selection for automatic classification of non-Gaussian data, IEEE Trans. Syst. Man Cybernet. 17 (1987) 187-198.
13. K. Fukunaga, Introduction to Statistical Pattern Recognition (Academic Press, San Diego, CA, 1990).
14. H. Almuallim and T. G. Dietterich, Learning with many irrelevant features, in Proc. Ninth National Conf. Artificial Intelligence (AAAI Press, 1991), pp. 547-552.
15. M. Hall, Correlation-based feature selection for discrete and numeric class machine learning, Proc. Seventeenth Int. Conf. Mach. Learn. (1999), pp. 359-366.
16. T. Jolliffe, Principal Component Analysis (Springer-Verlag, New-York, 1986).
17. M. S. Bartlett, H. M. Lades and T. J. Sejnowski, Independent component representations for face recognition, Proc. SPIE 3299 (1998) 528-539.
18. X. Zhou and B. Moghaddam, ICA-based probabilistic local appearance models, in Proc. Int. Conf. Image Processing, Greece (2001).
19. N. Vasconcelos and G. Carneiro, What is the role of independence for visual recognition, in Proc. Eur. Conf. Computer Vision, Denmark (2002).
20. H. K. Ekenel and B. Sankur, Feature selection in the independent component subspace for face recognition, Pattern Recogn. Lett. 25 (2004) 1377-1388.
21. Y. Huang and S. Luo, Genetic algorithm applied to ICA feature selection, Proc. Int. Conf. Neural Networks (2003), pp. 704-707.
22. M. Bressan and J. Vitriá, Feature subset selection in an ICA space, Topics in Artificial Intelligence, Springer Verlag Series, eds. M. T. E. Monferrer, F. Toledo and E. Golobardes, Lecture Notes in Computer Science, Vol. 2504 (2002), pp. 196-206.
23. Y. Sakaguchi, S. Ozawa and M. Kotani, Feature extraction using supervised independent component analysis by maximizing class distance, IEEJ Trans. Electron. Inform. Syst. 124-C (2004).
24. H. Liu and R. Setiono, A probabilistic approach to feature selection - A filter solution, in 13th Int. Conf. Machine Learning (ICML'96), Bari, Italy (1996), pp. 319-327.
25. S. Perkins, K. Lacker and J. Theiler, Grafting: Fast, incremental feature selection by gradient descent in function space, J. Mach. Learn., Special Issue on Variable and Feature Selection (2003) 1333-1356.
26. J. R. Bunch, C. P. Nielsen and D. C. Sorenson, Rank-one modification of the symmetric eigenproblem, Numerische Mathematik 31 (1978) 31-48.
27. S. Chandrasekaran, B. S. Manjunath, Y. F. Wang, J. Winkler and H. Zhang, An eigenspace update algorithm for image analysis, Graph. Models Image Proc. 59(5) (1997) 321-332.
28. R. D. DeGroat and R. Roberts, Efficient, numerically stablized rank-one eigenstructure updating, IEEE Trans. Acoustics, Speech Signal Process. 38(2) (1990) 301-316.
29. H. Murakami and B. V. K. V. Kumar, Efficient calculation of primary images from a set of images, IEEE Trans. Pattern Anal. Mach. Intell. 4(5) (1982) 511-515.
30. E. Oja, Subspace Mehods of Pattern Recognition (Research Studies Press, Letchworth, UK, 1983).
31. E. Oja and J. Karhunen, On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix, J. Math. Anal. Appl. 106 (1985) 69-84.
32. T. D. Sanger, Optimal unsupervised learning in a single-layer linear feedforward neural network, IEEE Trans. Neural Networks 2 (1989) 459-473.
33. J. Weng, Y. Zhang and W. S. Hwang, Candid covariance-free incremental principal component analysis, IEEE Trans. Pattern Anal. Mach. Intell. 25(8) (2003).
34. A. Hyvaerinen, J. Karhunen and E. Oja, Independent Component Analysis (John Wiley, New York, 2001).
35. S. Amari, A. Cichocki and H. H. Yang, A new learning algorithm for blind signal seperation, in Advances in Neural Information Processing Systems, eds. D. D. Touretzky, M. C. Mozer and M. E. Hasselmo, Vol. 8 (MIT Press, Cambridge, MA, 1996).
36. A. Hyvarinen and E. Oja, A fixed point algorithm for independent component analysis, Neural Comput. 9(7) (1997) 1483-1492.
37. P. Hall, D. Marshall and R. Martin, Merging and splitting eigenspace models, IEEE Trans. Pattern Anal. Mach. Intell. 22(9) (2000) 1042-1048.
38. T. Mitchell, Machine Learn. (McGraw Hill, 1997).
39. J. R. Quinlan, Induction of decision trees, Mach. Learn. 1 (1986) 81-106.
40. D. W. Aha, D. Kibler and K. Albert, Instance-based learning algorithms, Mach. Learn. 6 (1991) 37-66.
41. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations (Morgan Laufmann, San Fransisco, 1999).
42. K. Kira and L. Randell, A practical approach to feature selection, Proc. Ninth Int. Conf. Mach. Learn. (1992), pp. 249-256.
43. I. Koch and K. Naito, Dimension selection for feature selection and dimension reduction with principal and independent component analysis, Neural Comput. 19 (2007) 513-545.
44. C. Blake and C. Merz, UCI repository of machine learning databases, http://www.ics. uci.edu/~mlearn/MLRepository.html, http:// www.kernel-machines.com/ (1998).
45. M. Prasad and A. Sowmya, Multi-level classification of emphysema in HRCT lung images using delegated classifiers, in Proc. 11th Int. Cont. Medical Image Computing and Computer-Assisted Intervention 2008, New York, USA (2008), pp. 59-66.
46. M. Prasad, A. Sowmya and I. Koch, Feature subset selection using ICA for classifying emphysema in HRCT images, in Proc. Int. Conf. Pattern Recognition 2004, Cambridge, UK (2004), pp. 515-519.