Discriminant independent component analysis

IEEE Transactions on Neural Networks

Volumn 22, Issue 6, 2011, Pages 845-857

  Dhir, Chandra Shekhar ^a,b   Lee, Soo Young ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^b LG Electronics Inc   (South Korea)

Author keywords

Discriminant independent component analysis; feature extraction; Fishers's linear discriminant; negentropy

Indexed keywords

CLASSIFICATION PERFORMANCE; DISCRIMINANT INDEPENDENT COMPONENT ANALYSIS; DISCRIMINANT MODELS; FEATURE EXTRACTION TECHNIQUES; FISHER LINEAR DISCRIMINANTS; FISHERS'S LINEAR DISCRIMINANT; INFORMATION THEORETIC LEARNING; LATENT VARIABLE; LINEAR DISCRIMINANT ANALYSIS; LINEAR MODEL; LINEAR SUMMATION; MINIMAL REDUNDANCY; MULTIVARIATE DATA; NEGENTROPY; NEGENTROPY MAXIMIZATION; OPTIMIZATION PROBLEMS; REDUCED DATA; SEMI-SUPERVISED; SINGLE STAGE;

DISCRIMINANT ANALYSIS; FEATURE EXTRACTION; INFORMATION THEORY; OPTIMIZATION; PRINCIPAL COMPONENT ANALYSIS;

INDEPENDENT COMPONENT ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; METHODOLOGY; PRINCIPAL COMPONENT ANALYSIS; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; DISCRIMINANT ANALYSIS; LINEAR MODELS; PATTERN RECOGNITION, AUTOMATED; PRINCIPAL COMPONENT ANALYSIS;

EID: 79958003251     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2122266     Document Type: Review

References (49)

1. G. E. Hinton and T. J. Sejnowski, Unsupervised Learning: Foundations of Neural Computation. Cambridge, MA: MIT Press, 1999.
2. A. K. Jain, R. P. W. Duin, and J. Mao, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 1, pp. 4-37, Jan. 2000. (Pubitemid 32132953)
3. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification, 2nd ed. New York: Wiley, 2001.
4. S. Haykins, Unsupervised Adaptive Filtering. New York: Wiley, 2000.
5. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cognit. Neurosci., vol. 3. no. 1, pp. 71-86, 1991.
6. M. Kirby and L. Sirovich, "Application of the Karhunen-Loève procedure for the characterization of human faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 103-108, Jan. 1990. (Pubitemid 20653605)
7. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
8. A. J. Bell and T. J. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural Comput., vol. 7, no. 6, pp. 1129-1159, Nov. 1995.
9. T. W. Lee, Independent Component Analysis: Theory and Applications. Boston, MA: Kluwer, 1998.
10. P. Comon, "Independent component analysis, a new concept?" Signal Process., vol. 36, no. 3, pp. 287-314, Apr. 1994.
11. S. Roberts and R. Everson, Independent Component Analysis: Principles and Practice. Cambridge, U.K.: Cambridge Univ. Press, 2001.
12. R. Kohavi and G. H. John, "Wrappers for feature subset selection," Artif. Intell., vol. 97, nos. 1-2, pp. 273-324, Dec. 1997. (Pubitemid 127401107)
13. M. S. Bartlett, J. R. Movellan, and T. J. Sejnowski, "Face recognition by independent component analysis," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1450-1464, Nov. 2002. (Pubitemid 35428531)
14. R. Battiti, "Using mutual information for selecting features in supervised neural net learning," IEEE Trans. Neural Netw., vol. 5, no. 4, pp. 537-550, Jul. 1994.
15. N. Kwak and C.-H. Choi, "Input feature selection by mutual information based on Parzen window," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 12, pp. 1667-1671, Dec. 2002.
16. H. Peng, F. Long, and C. Ding, "Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 8, pp. 1226-1238, Aug. 2005. (Pubitemid 41245053)
17. L. Yu and H. Liu, "Efficient feature selection via analysis of relevance and redundancy," J. Mach. Learn. Res., vol. 5, pp. 1205-1224, Oct. 2004.
18. D.-S. Huang and C.-H. Zheng, "Independent component analysis-based penalized discriminant method for tumor classification using gene expression data," Bioinformatics, vol. 22, no. 15, pp. 1855-1862, May 2006. (Pubitemid 44283030)
19. C. S. Dhir and S. Y. Lee, "Hybrid feature selection: Combining fisher criterion and mutual information for efficient feature selection," in Proc. Adv. Neural Inf. Process., vol. 5506. 2009, pp. 613-620.
20. A. M. Martinez and A. C. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001. (Pubitemid 32254716)
21. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using LDA-based algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 195-200, Jan. 2003.
22. K. Fukunaga, Introduction of Statistical Pattern Recognition, 2nd ed. New York: Academic, 1990.
23. K.-C. Li, "Sliced inverse regression for dimension reduction," J. Amer. Stat. Assoc., vol. 86, no. 414, pp. 316-327, Jun. 1991.
24. D. R. Hardoon, S. Szedmak, and J. R. Shawe-Taylor, "Canonical correlation analysis: An overview with application to learning methods," Neural Comput., vol. 16, no. 12, pp. 2639-2664, Dec. 2004. (Pubitemid 39604012)
25. J. D. R. Farquhar, D. R. Hardoon, H. Meng, J. Shawe-Taylor, and S. Szedmak, "Two view learning: SVM-2K, theory and practice," in Proc. Adv. Neural Inf. Process. Syst. 18, 2006, pp. 355-362.
26. P. N. Belhumeur, J. P. Hespanda, and D. J. Kriegeman, "Eigenfaces versus fisherfaces: Recognition using class specific linear projection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 711-720, Jul. 1997. (Pubitemid 127762263)
27. F. Long, J. He, X. Ye, Z. Zhuang, and B. Li, "Discriminant independent component analysis as a subspace representation," J. Electron. (China), vol. 23, no. 1, pp. 103-106, 2006.
28. A. Renyi, Probability Theory. Amsterdam, The Netherlands: North Holland, 1970.
29. K. Torkkola, "Feature extraction by non parametric mutual information maximization," J. Mach. Learn. Res., vol. 3, pp. 1415-1438, Mar. 2003.
30. J. Principe, D. Xu, and J. Fisher, "Information theoretic learning," in Unsupervised Adaptive Filtering, vol. 1. New York: Wiley, 2000.
31. K. E. Hild, D. Erdogmus, K. Torkkola, and J. C. Principe, "Feature extraction using information-theoretic learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 9, pp. 1385-1392, Sep. 2006. (Pubitemid 44132646)
32. J. M. Leiva-Murillo and A. Artes-Rodriguez, "Maximization of mutual information for supervised linear feature extraction," IEEE Trans. Neural Netw., vol. 18, no. 5, pp. 1433-1441, Sep. 2007. (Pubitemid 47408542)
33. S. Akaho, "Conditionally independent component analysis for supervised feature extraction," Neurocomputing, vol. 49, nos. 1-4, pp. 139-155, Dec. 2002.
34. N. Slonim and N. Tishby, "Agglomerative information bottleneck," in Proc. Adv. Neural Process. Syst. 12, 2000, pp. 617-623.
35. U. Amato, A. Antoniadis, and G. Gregoire, "Independent component discriminant analysis," Int. J. Math., vol. 3, no. 7, pp. 735-753, 2003.
36. M. Dyrholm, C. Christoforou, and L. C. Parra, "Bilinear discriminant component analysis," J. Mach. Learn. Res., vol. 8, pp. 1097-1111, May 2007. (Pubitemid 46798408)
37. E. K. P. Chong and S. H. Zak, An Introduction to Optimization, 2nd ed. New York: Wiley, 2001.
38. A. Asuncion and D. J. Newman. (2007). UCI Machine Learning Repository. School Inf. Comput. Sci., Univ. California, Irvine [Online]. Available: http://www.ics.uci.edu/?mlearn/MLRepository.html
39. S. Aeberhard, D. Coomans, and O. De Vel, "Comparison of classifiers in high dimensional settings," Dept. Comput. Sci. & Math. Stat., James Cook Univ. North Queensland, Townsville, Australia, 1992.
40. E. Alpaydin and C. Kaynak, "Cascaded classifiers," Kybernetika, vol. 34, no. 4, pp. 369-374, 1998.
41. F. Burkhardt, A. Paeschke, M. Rolfes, W. Sendlmeier, and B. Weiss, "A database of german emotional speech," in Proc. Interspeech, Sep. 2005, pp. 1517-1520. (Pubitemid 43908362)
42. O. Pierre-Yves, "The production and recognition of emotions in speech: Features and algorithms," Int. J. Human-Comput. Stud., vol. 59, nos. 1-2, pp. 157-183, Jul. 2003.
43. H.-S. Lee, S. Park, B.-N. Kang, J. Shin, J.-Y. Lee, H. Je, B. Jun, and D. Kim, "The POSTECH face database (PF07) and performance evaluation," in Proc. IEEE Int. Conf. Autom. Face & Gesture Recognit., Sep. 2008, pp. 1-6.
44. P. W. Frey and D. J. Slate, "Letter recognition using Holland-style adaptive classifiers," Mach. Learn., vol. 6, no. 2, pp. 161-182, Mar. 1991.
45. M. P. W. Breukelen, D. M. J. Tax, and J. E. Hartog, "Handwritten digit recognition by combined classifiers," Kybernetika, vol. 34, no. 4, pp. 381-386, 1998.
46. M. A. Fanty and R. Cole, "Spoken letter recognition," in Proc. Adv. Neural Inf. Process. Syst., 1990, pp. 220-226.
47. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
48. T. Joachims, "Making large-scale SVM learning practical," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. Burges, and A. Smola, Eds. Cambridge, MA: MIT Press, 1999.
49. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov, "Neighbourhood components analysis," in Advances in Neural Information Processing Systems 17, L. K. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: MIT Press, 2005, pp. 513-520.