Graph embedded extreme learning machine

IEEE Transactions on Cybernetics

Volumn 46, Issue 1, 2016, Pages 311-324

  Iosifidis, Alexandros ^a   Tefas, Anastasios ^a   Pitas, Ioannis ^a  

^a ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

Extreme learning machine (ELM); Facial image classification; Graph embedding; Human action recognition

Indexed keywords

ALGORITHMS; BEHAVIORAL RESEARCH; CLASSIFICATION (OF INFORMATION); FACE RECOGNITION; FEEDFORWARD NEURAL NETWORKS; KNOWLEDGE ACQUISITION; NETWORK LAYERS; NEURAL NETWORKS; RADIAL BASIS FUNCTION NETWORKS;

CLASSIFICATION SCHEME; EXTREME LEARNING MACHINE; FACIAL EXPRESSIONS; GRAPH EMBEDDINGS; HUMAN BEHAVIOR ANALYSIS; HUMAN FACES; SINGLE-HIDDEN LAYER FEEDFORWARD NEURAL NETWORKS; SUBSPACE LEARNING;

LEARNING SYSTEMS;

ANATOMY AND HISTOLOGY; AUTOMATED PATTERN RECOGNITION; CLASSIFICATION; FACE; FEMALE; HUMAN; HUMAN ACTIVITIES; IMAGE PROCESSING; MACHINE LEARNING; MALE; PROCEDURES; VIDEORECORDING;

FACE; FEMALE; HUMAN ACTIVITIES; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MACHINE LEARNING; MALE; PATTERN RECOGNITION, AUTOMATED; VIDEO RECORDING;

EID: 84960389591     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2015.2401973     Document Type: Article

References (58)

1. G. Huang, Q. Zhu, and C. Siew, "Extreme learning machine: A new learning scheme of feedforward neural networks," in Proc. IEEE Int. Joint Conf. Neural Netw., vol. 2. Budapest, Hungary, 2004, pp. 985-990.
2. D. Rumelhart, G. Hinton, and R. Williams, "Learning representations by back-propagating errors," Nature, vol. 323, pp. 533-536, Oct. 1986.
3. M. Hagan and M. Menhaj, "Training feedforward networks with the Marquardt algorithm," IEEE Trans. Neural Netw., vol. 5, no. 6, pp. 989-993, Nov. 1994.
4. P. Bartlett, "The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network," IEEE Trans. Inf. Theory, vol. 44, no. 2, pp. 525-536, Mar. 1998.
5. R. Zhang, Y. Lan, G. Huang, and Z. Zu, "Universal approximation of extreme learning machine with adaptive growth of hidden nodes," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 365-371, Feb. 2012.
6. G. Huang, L. Chen, and C. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 879-892, Jul. 2006.
7. G. Huang, D. Wang, and Y. Lan, "Extreme learning machine: A survey," Int. J. Mach. Learn. Cybern., vol. 2, no. 2, pp. 107-122, 2011.
8. G. Huang, Extreme Learning Machine. Berlin, Germany: Springer, 2013.
9. G. Huang, "An insight to extreme learning machines: Random neurons, random features and kernels," Cogn. Comput., vol. 6, no. 3, pp. 379-390, 2014.
10. J. Cao, T. Chen, and J. Fan, "Fast online learning algorithm for landmark recognition based on BoW framework," in Proc. IEEE Conf. Ind. Electron. Appl., Hangzhou, China, 2014, pp. 1163-1168.
11. A. Iosifidis, A. Tefas, and I. Pitas, "Minimum class variance extreme learning machine for human action recognition," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 11, pp. 1968-1979, Nov. 2013.
12. S. Yan, D. Xu, B. Zhang, and H. Zhang, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
13. G. Arvanitidis and A. Tefas, "Exploiting graph embedding in support vector machines," in Proc. IEEE Int. Workshop Mach. Learn. Signal Process., Santander, Spain, 2012, pp. 1-6.
14. Y. Peng, S. Wang, X. Long, and B. L. Lu, "Discriminative graph regularized extreme learning machine for face recognition," Neurocomputing, vol. 149, pp. 340-353, Feb. 2015.
15. A. Iosifidis, A. Tefas, and I. Pitas, "Minimum variance extreme learning machine for human action recognition," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Florence, Italy, 2014, pp. 5427-5431.
16. A. Iosifidis, A. Tefas, and I. Pitas, "Regularized extreme learning machine for multi-view semi-supervised action recognition," Neurocomputing, vol. 145, pp. 250-262, Dec. 2014.
17. M. Belkin and P. Niyogi, "Laplacian eigenmaps for dimensionality reduction and data representation," Neural Comput., vol. 15, no. 6, pp. 1373-1396, 2003.
18. L. Saul and S. Roweis, "Think globally, fit locally: Unsupervised learning of low dimensional manifolds," J. Mach. Learn. Res., vol. 4, pp. 119-155, Jun. 2003.
19. R. Duda, P. Hart, and D. Stork, Pattern Classification, 2nd ed. New York, NY, USA: Wiley, 2000.
20. M. Sugiyama, "Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis," J. Mach. Learn. Res., vol. 8, pp. 1027-1061, May 2007.
21. G. Huang, H. Zhou, X. Ding, and R. Zhang, "Extreme learning machine for regression and multiclass classification," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 513-529, Apr. 2012.
22. D. Cai, X. He, and J. Han, "Spectral regression: A unified approach for sparse subspace learning," in Proc. Int. Conf. Data Min., Omaha, NE, USA, 2007, pp. 73-82.
23. D. Cai, X. He, and J. Han, "Spectral regression for efficient regularized subspace learning," in Proc. Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, 2007, pp. 1-8.
24. R. Fletcher, Practical Methods of Optimization: Volume 2, Constrained Optimization. Chichester, U.K.: Wiley, 1980.
25. B. Frenay and M. Verleysen, "Using SVMs with randomised feature spaces: An extreme learning approach," in Proc. Eur. Symp. Artif. Neural Netw., Bruges, Belgium, 2010, pp. 315-320.
26. B. Scholkpf and A. Smola, Learning With Kernels. Cambridge, MA, USA: MIT Press, 2001.
27. K. Muller, S. Mika, G. Ratsch, K. Tsuda, and B. Scholkopf, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, Mar. 2001.
28. A. Argyriou, C. Micchelli, and M. Pontil, "When is there a representer theorem? Vector versus matrix regularizers," J. Mach. Learn. Res., vol. 10, pp. 2507-2529, Nov. 2009.
29. H. Wang and C. Schmid, "Action recognition with improved trajectories," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Sydney, NSW, USA, 2013, pp. 3551-3558.
30. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning realistic human actions from movies," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, 2008, pp. 1-8.
31. K. Bache and M. Lichman, "UCI machine learning repository," School Inf. Comput. Sci., Univ. California, Irvine, CA, USA, 2013. [Online]. Available: http://archive.ics.uci.edu/ml
32. F. Samaria and A. Harter, "Parameterisation of a stochastic model for human face identification," in Proc. IEEE Workshop Appl. Comput. Vis., Sarasota, FL, USA, 1994, pp. 138-142.
33. A. Martinez and A. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001.
34. K. Lee, J. Ho, and D. Kriegman, "Acquiring linear subspaces for face recognition under variable lighting," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 5, pp. 684-698, May 2005.
35. T. Kanade, Y. Tian, and J. Cohn, "Comprehensive database for facial expression analysis," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Grenoble, France, 2000, pp. 46-53.
36. L. Yin, X. Wei, Y. Sun, J. Wang, and M. Rosato, "A 3D facial expression database for facial behavior research," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Southampton, U.K., 2006, pp. 211-216.
37. M. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba, "Coding facial expressions with Gabor wavelets," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Nara, Japan, 1998, pp. 200-205.
38. M. Marszalek, I. Laptev, and C. Schmid, "Actions in context," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, USA, 2009, pp. 2929-2936.
39. M. Zhu, "Recall, precision and average precision," Dept. Stat. Actuarial Sci., Univ. Waterloo, Waterloo, ON, Canada, Tech. Rep., 2004.
40. J. Niebles, C. Chend, and L. Fei-Fei, "Modeling temporal structure of decomposable motion segemnts for activity classification," in Proc. Eur. Conf. Comput. Vis., Crete, Greece, 2010, pp. 392-405.
41. S. Hadfield and R. Bowden, "Hollywood 3D: Recognizing actions in 3D natural scenes," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Portland, OR, USA, 2013, pp. 3398-3405.
42. P. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach. Englewood Cliffs, NJ, USA: Prentice-Hall, 1982.
43. J. Wright, A. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 1-18, Feb. 2009.
44. X. Liu, S. Yan, and H. Jin, "Projective nonnegative graph embedding," IEEE Trans. Image Process., vol. 19, no. 5, pp. 1126-1137, May 2010.
45. A. James, "One-sample face recognition with local similarity decisions," Int. J. Appl. Pattern Recognit., vol. 1, no. 1, pp. 61-80, 2013.
46. Z. Sun et al., "Face recognition with multi-resolution spectral feature images," PLoS ONE, vol. 8, no. 2, Feb. 2013, Art. ID e55700.
47. X. Tang, G. Feng, and J. Cai, "Weighted group sparse representation for undersampled face recognition," Neurocomputing, vol. 145, pp. 402-415, Dec. 2014.
48. S. Nikitidis, A. Tefas, and I. Pitas, "Maximum margin projection subspace learning for visual data analysis," IEEE Trans. Image Process., vol. 23, no. 10, pp. 4413-4425, Oct. 2014.
49. S. Nikitidis, A. Tefas, and I. Pitas, "Subclass discriminant nonnegative matrix factorization for facial image analysis," Pattern Recognit., vol. 45, no. 12, pp. 4080-4091, 2012.
50. S. Nikitidis, A. Tefas, and I. Pitas, "Projected gradients for subclass discriminant nonnegative subspace learning," IEEE Trans. Cybern., vol. 44, no. 12, pp. 2168-2267, Dec. 2014.
51. K. Konda and R. Memisevic, "Unsupervised learning of depth and motion," arXiv:1312.3429v2, 2013.
52. S. Hadfield, K. Lebeda, and R. Bowden, "Natural action recognition using invariant 3D motion encoding," in Proc. Eur. Conf. Comput. Vis., Zurich, Switzerland, 2014, pp. 758-771.
53. W. Brendel and S. Todorovic, "Learning spatiotemporal graphs of human activities," in Proc. Int. Conf. Comput. Vis., Barcelona, Spain, 2011, pp. 778-785.
54. E. Vig, M. Dorr, and D. Cox, "Space-variant descriptor sampling for action recognition based on saliency and eye movements," in Proc. Eur. Conf. Comput. Vis., Florence, Italy, 2012, pp. 84-97.
55. A. Gaidon, Z. Harchaoui, and C. Schmid, "Recognizing activities with cluster-tries of tracklets," in Proc. Brit. Mach. Vis. Conf., Bristol, U.K., 2012, pp. 1-14.
56. S. Mathe and C. Sminchisescu, "Dynamic eye movement datasets and learnt saliency models for visual action recognition," in Proc. Eur. Conf. Comput. Vis., Florence, Italy, 2012, pp. 842-856.
57. Y. Jiang, Q. Dai, X. Xue, W. Liu, and C. Ngo, "Trajectory-based modeling of human actions with motion reference points," in Proc. Eur. Conf. Comput. Vis., Florence, Italy, 2012, pp. 425-438.
58. M. Jain, H. Jegou, and P. Bouthemy, "Better exploiting motion for better action recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, 2013, pp. 2555-2562.