Prediction of advertisement preference by fusing EEG response and sentiment analysis

Neural Networks

Volumn 92, Issue , 2017, Pages 77-88

  Gauba, Himaanshu ^a   Kumar, Pradeep ^a   Roy, Partha Pratim ^a   Singh, Priyanka ^a   Dogra, Debi Prosad ^b   Raman, Balasubramanian ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY ROORKEE   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY BHUBANESWAR   (India)

Author keywords

EEG signal analysis; Multimedia indexing and retrieval; Multimodal rating; Predictive modeling; Sentiment analysis

Indexed keywords

DECISION TREES; ELECTROENCEPHALOGRAPHY; FORECASTING; PREDICTIVE ANALYTICS; SENTIMENT ANALYSIS;

EEG SIGNALS; ELECTRO-ENCEPHALOGRAM (EEG); MULTI-MODAL; MULTIMEDIA INDEXING AND RETRIEVAL; MULTIMODAL FRAMEWORKS; NATURAL LANGUAGE PROCESSING; PREDICTIVE MODELING; REGRESSION TECHNIQUES;

MODAL ANALYSIS;

ARTICLE; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; DECISION TREE; ELECTROENCEPHALOGRAPHY; HUMAN; HUMAN EXPERIMENT; INFORMATION PROCESSING; LINEAR REGRESSION ANALYSIS; NATURAL LANGUAGE PROCESSING; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; RANDOM FOREST; REGRESSION ANALYSIS; SENTIMENT ANALYSIS; SIGNAL PROCESSING; ADVERTISING; BIOLOGICAL MODEL; BRAIN; CONSUMER ATTITUDE; INTERNET; PHYSIOLOGY; PROCEDURES;

ADVERTISING AS TOPIC; BRAIN; CONSUMER BEHAVIOR; ELECTROENCEPHALOGRAPHY; HUMANS; INTERNET; MODELS, NEUROLOGICAL; NATURAL LANGUAGE PROCESSING;

EID: 85013777747     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2017.01.013     Document Type: Article

References (50)

1. Ansari-Asl, K., Chanel, G., & Pun, T. (2007). A channel selection method for eeg classification in emotion assessment based on synchronization likelihood. In 15th European signal processing conference (pp. 1241–1245).
2. Atrey, P.K., Hossain, M.A., El Saddik, A., Kankanhalli, M.S., Multimodal fusion for multimedia analysis: a survey. Multimedia Systems 16:6 (2010), 345–379.
3. Azami, H., Mohammadi, K., & Bozorgtabar, B. (2012). An improved signal segmentation using moving average and savitzky-golay filter.
4. Breiman, L., Random forests. Machine Learning 45:1 (2001), 5–32.
5. Cambria, E., White, B., Jumping nlp curves: a review of natural language processing research [review article]. IEEE Computational Intelligence Magazine 9:2 (2014), 48–57.
6. Chanel, G., Ansari-Asl, K., & Pun, T. (2007). Valence-arousal evaluation using physiological signals in an emotion recall paradigm. In International conference on systems, man and cybernetics (pp. 2662–2667).
7. Chanel, G., Kronegg, J., Grandjean, D., & Pun, T. (2006). Emotion assessment: Arousal evaluation using eegs and peripheral physiological signals. In International workshop on multimedia content representation, classification and security (pp. 530–537).
8. Chatzopoulou, G., Sheng, C., & Faloutsos, M. (2010). A first step towards understanding popularity in youtube. In Conference on computer communications workshops (pp. 1–6).
9. Chikkerur, S., Sundaram, V., Reisslein, M., Karam, L.J., Objective video quality assessment methods: A classification, review, and performance comparison. IEEE Transactions on Broadcasting 57:2 (2011), 165–182.
10. Chowdhury, M.E., Mullinger, K.J., Glover, P., Bowtell, R., Reference layer artefact subtraction (rlas): a novel method of minimizing eeg artefacts during simultaneous fmri. Neuroimage 84 (2014), 307–319.
11. Daimi, S.N., Saha, G., Classification of emotions induced by music videos and correlation with participants rating. Expert Systems with Applications 41:13 (2014), 6057–6065.
12. Dixit, R., Popescu, A., Bagić, A., Ghearing, G., Hendrickson, R., Medical comorbidities in patients with psychogenic nonepileptic spells (pnes) referred for video-eeg monitoring. Epilepsy & Behavior 28:2 (2013), 137–140.
13. Filippova, K., & Hall, K.B. (2011). Improved video categorization from text metadata and user comments. In 34th International conference on research and development in information retrieval (pp. 835–842).
14. Flexer, A., Bauer, H., Pripfl, J., Dorffner, G., Using ica for removal of ocular artifacts in eeg recorded from blind subjects. Neural Networks 18:7 (2005), 998–1005.
15. Gallege, L.S., & Raje, R.R. (2016). Towards selecting and recommending online software services by evaluating external attributes. In 11th Annual cyber and information security research conference (pp. 23:1–23:4).
16. Hadjidimitriou, S.K., Hadjileontiadis, L.J., Toward an eeg-based recognition of music liking using time-frequency analysis. IEEE Transactions on Biomedical Engineering 59:12 (2012), 3498–3510.
17. Hawkins, J.B., Brownstein, J.S., Tuli, G., Runels, T., Broecker, K., Nsoesie, E.O., et al. Measuring patient-perceived quality of care in us hospitals using twitter. BMJ Quality & Safety 25:6 (2016), 404–413.
18. Hsu, C.-F., Khabiri, E., & Caverlee, J. (2009). Ranking comments on the social web. In International conference on computational science and engineering, Vol. 4, (pp. 90–97).
19. Hyvärinen, A., Oja, E., Independent component analysis: algorithms and applications. Neural Networks 13:4 (2000), 411–430.
20. Kaur, B., Singh, D., & Roy, P.P. (0000). A novel framework of eeg-based user identification by analyzing music-listening behavior, Multimedia Tools and Applications, (pp. 1–22).
21. Khushaba, R.N., Wise, C., Kodagoda, S., Louviere, J., Kahn, B.E., Townsend, C., Consumer neuroscience: Assessing the brain response to marketing stimuli using electroencephalogram (eeg) and eye tracking. Expert Systems with Applications 40:9 (2013), 3803–3812.
22. Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., Patras, I., Deap: A database for emotion analysis; using physiological signals. IEEE Transactions on Affective Computing 3:1 (2012), 18–31.
23. Koelstra, S., Patras, I., Fusion of facial expressions and eeg for implicit affective tagging. Image and Vision Computing 31:2 (2013), 164–174.
24. Kostílek, M., & Št'astnỳ, J. (2012). Eeg biometric identification: repeatability and influence of movement-related eeg. In International conference on applied electronics (pp. 147–150).
25. Kuhn, S., Egert, B., Neumann, S., Steinbeck, C., Building blocks for automated elucidation of metabolites: Machine learning methods for nmr prediction. BMC Bioinformatics, 9(1), 2008, 400.
26. Kumar, P., Gauba, H., Roy, P.P., Dogra, D.P., Coupled hmm-based multi-sensor data fusion for sign language recognition. Pattern Recognition Letters, 2016.
27. Lang, A., Involuntary attention and physiological arousal evoked by structural features and emotional content in tv commercials. Communication Research 17:3 (1990), 275–299.
28. Liaw, A., Wiener, M., Classification and regression by randomforest. R News 2:3 (2002), 18–22.
29. Loria, S., Textblob: simplified text processing. Secondary TextBlob: Simplified Text Processing, 2014.
30. Murakami, N., & Ito, E. (2011). Emotional video ranking based on user comments. In 13th International conference on information integration and web-based applications and services (pp. 499–502).
31. Mustafa, M., Guthe, S., Magnor, M., Single-trial eeg classification of artifacts in videos. ACM Transactions on Applied Perception, 9(3), 2012, 12.
32. Onton, J., Westerfield, M., Townsend, J., Makeig, S., Imaging human eeg dynamics using independent component analysis. Neuroscience & Biobehavioral Reviews 30:6 (2006), 808–822.
33. ® in Information Retrieval 2:1–2 (2008), 1–135.
34. Pang, B., Lee, L., & Vaithyanathan, S. (2002). Thumbs up?: sentiment classification using machine learning techniques. In Conference on empirical methods in natural language processing (pp. 79–86).
35. Polikar, R., Tilley, C., Hillis, B., & Clark, C.M. (2010). Multimodal eeg, mri and pet data fusion for alzheimer's disease diagnosis. In International conference of engineering in medicine and biology (pp. 6058–6061).
36. Scholler, S., Bosse, S., Treder, M.S., Blankertz, B., Curio, G., Muller, K.-R., Wiegand, T., Toward a direct measure of video quality perception using eeg. IEEE Transactions on Image Processing 21:5 (2012), 2619–2629.
37. Shamma, D.A., Yew, J., Kennedy, L., & Churchill, E.F. (2011). Viral actions: Predicting video view counts using synchronous sharing behaviors. In ICWSM.
38. Shieh, E., & Zamoshchin, A. (0000). Modeling hotel quality belief in natural language reviews.
39. Siersdorfer, S., Chelaru, S., Nejdl, W., & San Pedro, J. (2010). How useful are your comments?: analyzing and predicting youtube comments and comment ratings. In 19th international conference on world wide web (pp. 891–900).
40. Soleymani, M., Pantic, M., Pun, T., Multimodal emotion recognition in response to videos. IEEE Transactions on Affective Computing 3:2 (2012), 211–223.
41. Stytsenko, K., Jablonskis, E., & Prahm, C. (2011). Evaluation of consumer eeg device emotiv epoc. In MEi: CogSci Conference.
42. Subasi, A., Automatic recognition of alertness level from eeg by using neural network and wavelet coefficients. Expert Systems with Applications 28:4 (2005), 701–711.
43. Thelwall, M., Buckley, K., Paltoglou, G., Cai, D., Kappas, A., Sentiment strength detection in short informal text. Journal of the American Society for Information Science and Technology 61:12 (2010), 2544–2558.
44. Tso, G.K., Yau, K.K., Predicting electricity energy consumption: A comparison of regression analysis, decision tree and neural networks. Energy 32:9 (2007), 1761–1768.
45. Übeyli, E.D., Combined neural network model employing wavelet coefficients for eeg signals classification. Digital Signal Processing 19:2 (2009), 297–308.
46. Wang, Q., Sourina, O., & Nguyen, M.K. (2010). Eeg-based” serious” games design for medical applications. In International conference on cyberworlds (pp. 270–276).
47. Wang, S., Zhu, Y., Wu, G., Ji, Q., Hybrid video emotional tagging using users eeg and video content. Multimedia tools and applications 72:2 (2014), 1257–1283.
48. Yang, T., Lee, D.-Y., Kwak, Y., Choi, J., Kim, C., Kim, S.-P., Evaluation of tv commercials using neurophysiological responses. Journal of physiological anthropology, 34(1), 2015, 19.
49. Yazdani, A., Lee, J.-S., Vesin, J.-M., Ebrahimi, T., Affect recognition based on physiological changes during the watching of music videos. ACM Transactions on Interactive Intelligent Systems, 2(1), 2012, 7.
50. Yessenov, K., Misailovic, S., Sentiment analysis of movie review comments. Methodology, 2009, 1–17.