Integration of affective computing techniques and soft computing for developing a human affective recognition system for U-learning systems

International Journal of Mobile Learning and Organisation

Volumn 8, Issue 1, 2014, Pages 50-66

  Wu, Chih Hung ^a   Tzeng, Yi Lin ^a   Kuo, Bor Chen ^a   Tzeng, Gwo Hshiung ^b  

^a NATIONAL TAICHUNG UNIVERSITY OF EDUCATION   (Taiwan)

^b NATIONAL TAIPEI UNIVERSITY   (Taiwan)

Author keywords

Affective computing; ECG; EEG; Electrocardiogram; Electroencephalography; Emotion recognition system; Support vector machine; SVM; Ubiquitous learning

Indexed keywords

EID: 84896915968     PISSN: 1746725X     EISSN: 17467268     Source Type: Journal    
DOI: 10.1504/IJMLO.2014.059997     Document Type: Article

References (66)

1. Abdulhamit, S. (2005) 'Automatic recognition of alertness level from EEG by using neural network and wavelet coefficients', Expert Systems with Applications, Vol. 28, pp.701-711.
2. Acevedo, F.J., Maldonado, S., Domínguez, E., Narváez, A. and López, F. (2007) 'Probabilistic support vector machines for multi-class alcohol identification', Sensors and Actuators B: Chemical, Vol. 122, pp.227-235.
3. Ben Ammar, M., Neji, M., Alimi, A.M. and Gouard Res, G. (2010) 'The affective tutoring system', Expert Systems with Applications, Vol. 37, pp.3013-3023.
4. Boostani, R., Sadatnezhad, K. and Sabeti, M. (2009) 'An efficient classifier to diagnose of schizophrenia based on the EEG signals', Expert Systems with Applications, Vol. 36, pp.6492-6499.
5. Bradley, M.M. and Lang, P.J. (1994) 'Measuring emotion: the self-assessment manikin and the semantic differential', Journal of Behavior Therapy and Experimental Psychiatry, Vol. 25, pp.49-59.
6. Branka?k, J., KukushkA, V.I., Vyssotski, A.L. and Draguhn, A. (2010) 'EEG gamma frequency and sleep-wake scoring in mice: comparing two types of supervised classifiers', Brain Research, Vol. 1322, pp.59-71.
7. Ceylan, R. and Özbay, Y. (2007) 'Comparison of FCM, PCA and WT techniques for classification ECG arrhythmias using artificial neural network', Expert Systems with Applications, Vol. 33, pp.286-295.
8. Chaudhuri, A. and De, K. (2011) 'Fuzzy support vector machine for bankruptcy prediction', Applied Soft Computing, Vol. 11, pp.2472-2486.
9. Chawla, M.P.S., Verma, H.K. and Kumar, V. (2008) 'A new statistical PCA-ICA algorithm for location of R-peaks in ECG', International Journal of Cardiology, Vol. 129, pp.146-148.
10. Cheng, M-Y., Roy, A.F.V. and Chen, K-L. (2012) 'Evolutionary risk preference inference model using fuzzy support vector machine for road slope collapse prediction', Expert Systems with Applications, Vol. 39, pp.1737-1746.
11. Cvetkovic, D., Übeyli, E.D. and Cosic, I. (2008) 'Wavelet transform feature extraction from human PPG, ECG, and EEG signal responses to ELF PEMF exposures: a pilot study', Digital Signal Processing, Vol. 18, pp.861-874.
12. Diery, A., Rowlands, D., Cutmore, T.R.H. and James, D. (2011) 'Automated ECG diagnostic P-wave analysis using wavelets', Computer Methods and Programs in Biomedicine, Vol. 101, pp.33-43.
13. Flake, J., Moon, T.K., Mckee, M. and Gunther, J.H. (2010) 'Application of the relevance vector machine to canal flow prediction in the Sevier River Basin', Agricultural Water Management, Vol. 97, pp.208-214.
14. Flombaum, J.I., Scholl, B.J. and Pylyshyn, Z.W. (2008) 'Attentional resources in visual tracking through occlusion: the high-beams effect', Cognition, Vol. 107, pp.904-931.
15. Froese, T., Hadjiloucas, S., Galvão, R.K.H., Becerra, V.M. and Coelho, C.J. (2006) 'Comparison of extrasystolic ECG signal classifiers using discrete wavelet transforms', Pattern Recognition Letters, Vol. 27, pp.393-407.
16. Greenwald, M.K., Cook, E.W. and Lang, P.J. (1989) 'Affective judgement and psychophysiological response: dimensional covariation in the evaluation of pictorial stimuli', Journal of Psychophysiology, Vol. 3, pp.51-64.
17. Hasan, O. (2009) 'Automatic detection of epileptic seizures in EEG using discrete wavelet transform and approximate entropy', Expert Systems with Applications, Vol. 36, pp.2027-2036.
18. Horng, M-H. (2009) 'Multi-class support vector machine for classification of the ultrasonic images of supraspinatus', Expert Systems with Applications, Vol. 36, pp.8124-8133.
19. Hsu, C.K., Hwang, G.J., Chang, Y.T. and Chang, C.K. (2013) 'Effects of video caption modes on English listening comprehension and vocabulary acquisition using handheld devices', Educational Technology & Society, Vol. 16, pp.403-414.
20. Hsu, W-Y., Lin, C-H., Hsu, H-J., Chen, P-H. and Chen, I.R. (2012) 'Wavelet-based envelope features with automatic EOG artifact removal: application to single-trial EEG data', Expert Systems with Applications, Vol. 39, pp.2743-2749.
21. Hung, I.C., Yang, X.J., Fang, W.C., Hwang, G.J. and Chen, N.S. (2014) 'A context-aware video prompt approach to improving in-field reflection levels of students', Computers & Education, Vol. 70, pp.80-91.
22. Hung, P.H., Hwang, G.J., Lin, Y.F., Wu, T.H. and Su, I.H. (2013) 'Seamless connection between learning and assessment-applying progressive learning tasks in mmobile ecology inquiry', Educational Technology & Society, Vol. 16, pp.194-205.
23. Hwang, G.J., Tsai, C.C., Chu, H.C. and Kinshuk, C.C.Y. (2012) 'A context-aware ubiquitous learning approach to conducting scientific inquiry activities in a science park', Australasian Journal of Educational Technology, Vol. 28, pp.931-947.
24. Hwang, G.J., Tsai, C.C. and Yang, S.J.H. (2008) 'Criteria, strategies and research issues of context-aware ubiquitous learning', Educational Technology & Society, Vol. 11, pp.81-91.
25. Hwang, G.J., Wu, P.H., Zhuang, Y.Y. and Huang, Y.M. (2013) 'Effects of the inquiry-based mobile learning model on the cognitive load and learning achievement of students', Interactive Learning Environments, Vol. 21, pp.338-354.
26. Kim, K-J. and Ahn, H. (2012) 'A corporate credit rating model using multi-class support vector machines with an ordinal pairwise partitioning approach', Computers & Operations Research, Vol. 39, pp.1800-1811.
27. Korürek, M. and Nizam, A. (2010) 'Clustering MIT-BIH arrhythmias with ant colony optimization using time domain and PCA compressed wavelet coefficients', Digital Signal Processing, Vol. 20, pp.1050-1060.
28. Lang, P.J. (1980) Technology in Mental Health Care Delivery Systems, Ablex Publication Corp., Norwood, NJ.
29. Lang, P.J., Bradley, M.M. and Cuthbert, B.N. (2005) International Affective Picture System (IAPS): Technical Manual and Affective Ratings, Technical Report A-6, University of Florida, Gainesville, FL.
30. Li, D., Yang, W. and Wang, S. (2010) 'Classification of foreign fibers in cotton lint using machine vision and multi-class support vector machine', Computers and Electronics in Agriculture, Vol. 74, pp.274-279.
31. Li, S., Tsang, I.W. and Chaudhari, N.S. (2012a) 'Relevance vector machine based infinite decision agent ensemble learning for credit risk analysis', Expert Systems with Applications, Vol. 39, No. 5, pp.4947-4953.
32. Li, W., He, Q-C., Fan, X-M. and Fei, Z-M. (2012b) 'Evaluation of driver fatigue on two channels of EEG data', Neuroscience Letters, Vol. 506, pp.235-239.
33. Li, X., Nie, P., Qiu, Z-J. and He, Y. (2011) 'Using wavelet transform and multi-class least square support vector machine in multi-spectral imaging classification of Chinese famous tea', Expert Systems with Applications, Vol. 38, pp.11149-11159.
34. Lima, C.A.M., Coelho, A.L.V. and Chagas, S. (2009) 'Automatic EEG signal classification for epilepsy diagnosis with relevance vector machines', Expert Systems with Applications, Vol. 36, pp.10054-10059.
35. Liu, J., Zhang, C. and Zheng, C. (2010) 'EEG-based estimation of mental fatigue by using KPCA-HMM and complexity parameters', Biomedical Signal Processing and Control, Vol. 5, pp.124-130.
36. Looi, C-K., Wong, L-H., So, H-J., Seow, P., Toh, Y., Chen, W., Zhang, B., Norris, C. and Soloway, E. (2009) 'Anatomy of a mobilized lesson: learning my way', Computers & Education, Vol. 53, pp.1120-1132.
37. Lu, J. and Zhang, E. (2007) 'Gait recognition for human identification based on ICA and fuzzy SVM through multiple views fusion', Pattern Recognition Letters, Vol. 28, pp.2401-2411.
38. Marchand, G.C. and Gutierrez, A.P. (2012) 'The role of emotion in the learning process: Comparisons between online and face-to-face learning settings', The Internet and Higher Education, Vol. 15, pp.150-160.
39. Martis, R.J., Chakraborty, C. and Ray, A.K. (2009) 'A two-stage mechanism for registration and classification of ECG using Gaussian mixture model', Pattern Recognition, Vol. 42, pp.2979-2988.
40. Merzagora, A.C., Bunce, S., Izzetoglu, M. and Onaral, B. (2006) 'Wavelet analysis for EEG feature extraction in deceptive detection', IEEE Proceedings on EBMS, Vol. 6, pp.2434-2437.
41. Muller, K.R., Mika, S., Ratsch, G., Tsuda, K. and Scholkopf, B. (2001) 'An introduction to kernelbased learning algorithms', IEEE Transactions on Neural Networks, Vol. 12, pp.181-201.
42. Murugappan, M., Ramachandran, N. and Sazali, Y. (2010) 'Classification of human emotion from EEG using discrete wavelet transform', Journal of Biomedical Science and Engineering, Vol. 3, pp.390-396.
43. Ogata, H., Li, M., Hou, B., Uosaki, N., El-Bishouty, M. and Yano, Y. (2011) 'Scroll: supporting to share and reuse ubiquitous learning log in the context of language learning', Research and Practice in Technology Enhanced Learning, Vol. 6, pp.69-82.
44. Picard, R. (1997) Affective Computing, MIT Press, Cambridge, MA.
45. Polat, K. and Güne?, S. (2007) 'Detection of ECG arrhythmia using a differential expert system approach based on principal component analysis and least square support vector machine', Applied Mathematics and Computation, Vol. 186, pp.898-906.
46. Pylyshyn, Z.W. and Storm, R.W. (1988) 'Tracking multiple independent targets: evidence for a parallel tracking mechanism', Spatial Vision, Vol. 3, pp.179-197.
47. Ribeiro, R.L., Teixeira-Silva, F., Pompéia, S. and Bueno, O.F.A. (2007) 'IAPS includes photographs that elicit low-arousal physiological responses in healthy volunteers', Physiology & Behavior, Vol. 91, pp.671-675.
48. Samjin, C. (2008) 'Detection of valvular heart disorders using wavelet packet decomposition and support vector machine', Expert Systems with Applications, Vol. 35, pp.1679-1687.
49. Shen, K-Q., Li, X-P., Ong, C-J., Shao, S-Y. and Wilder-Smith, E.P.V. (2008) 'EEG-based mental fatigue measurement using multi-class support vector machines with confidence estimate', Clinical Neurophysiology, Vol. 119, pp.1524-1533.
50. Shieh, M-D. and Yang, C-C. (2008) 'Classification model for product form design using fuzzy support vector machines', Computers & Industrial Engineering, Vol. 55, pp.150-164.
51. Shih, J.L., Hwang, G.J., Chu, Y.C. and Chuang, C.W. (2011) 'An investigation-based learning model for using digital libraries to support mobile learning activities', The Electronic Library, Vol. 29, pp.488-505.
52. Shih, S-C., Kuo, B-C. and Liu, Y-L. (2012) 'Adaptively ubiquitous learning in Campus Math Path', Educational Technology & Society, Vol. 15, No. 2, pp.298-308.
53. Subasi, A. and Ismail Gursoy, M. (2010) 'EEG signal classification using PCA, ICA, LDA and support vector machines', Expert Systems with Applications, Vol. 37, pp.8659-8666.
54. Sun, S., Zhang, C. and Lu, Y. (2008) 'The random electrode selection ensemble for EEG signal classification', Pattern Recognition, Vol. 41, pp.1663-1675.
55. Tipping, M.E. (2000) 'The relevance vector machine', in Solla, S.A., Leen, T.K. and Müller, K-R. (Eds): Advances in Neural Information Processing Systems 12, MIT Press, pp.652-658.
56. Tok, S., Koyuncu, M., Dural, S. and Catikkas, F. (2010) 'Evaluation of International Affective Picture System (IAPS) ratings in an athlete population and its relations to personality', Personality and Individual Differences, Vol. 49, pp.461-466.
57. Übeyli, E.D., Ilbay, G., ?ahin, D. and Ate?, N. (2009) 'Analysis of spike-wave discharges in rats using discrete wavelet transform', Computers in Biology and Medicine, Vol. 39, pp.294-300.
58. Wong, L-H. and Looi, C-K. (2011) 'What seams do we remove in mobile-assisted seamless learning? A critical review of the literature', Computers & Education, Vol. 57, pp.2364-2381.
59. Wu, P.H., Hwang, G.J., Su, L.H. and Huang, Y.M. (2012) 'A context-aware mobile learning system for supporting cognitive apprenticeships in nursing skills training', Educational Technology & Society, Vol. 15, pp.223-236.
60. Wu, T., Yan, G.-Z., Yang, B.-H. and Sun, H. (2008) 'EEG feature extraction based on wavelet packet decomposition for brain computer interface', Measurement, Vol. 41, pp.618-625.
61. Yang, B-H., Yan, G-Z., Yan, R-G. and Wu, T. (2007) 'Adaptive subject-based feature extraction in brain-computer interfaces using wavelet packet best basis decomposition', Medical Engineering & Physics, Vol. 29, pp.48-53.
62. Yeh, Y-C., Wang, W-J. and Chiou, C.W. (2009) 'Cardiac arrhythmia diagnosis method using linear discriminant analysis on ECG signals', Measurement, Vol. 42, pp.778-789.
63. Yin, C.J., Song, Y.J., Tabata, Y., Ogata, H. and Hwang, G.J. (2013) 'Developing and implementing a framework of participatory simulation for mobile learning using scaffolding', Educational Technology & Society, Vol. 16, pp.137-150.
64. Yusuff, A.A., Fei, C., Jimoh, A.A. and Munda, J.L. (2011) 'Fault location in a series compensated transmission line based on wavelet packet decomposition and support vector regression', Electric Power Systems Research, Vol. 81, pp.1258-1265.
65. Zhang, C., Zheng, C-X. and Yu, X-L. (2009) 'Automatic recognition of cognitive fatigue from physiological indices by using wavelet packet transform and kernel learning algorithms', Expert Systems with Applications, Vol. 36, pp.4664-4671.
66. Zhao, C., Zheng, C., Zhao, M., Tu, Y. and Liu, J. (2011) 'Multivariate autoregressive models and kernel learning algorithms for classifying driving mental fatigue based on electroencephalographic', Expert Systems with Applications, Vol. 38, pp.1859-1865.