An evaluation of mouse and keyboard interaction indicators towards non-intrusive and low cost affective modeling in an educational context

Procedia Computer Science

Volumn 35, Issue C, 2014, Pages 691-700

  Salmeron Majadas, Sergio ^a   Santos, Olga C ^a   Boticario, Jesus G ^a  

^a UNIVERSIDAD NACIONAL DE EDUCACIÓN A DISTANCIA   (Spain)

Author keywords

Affective computing; Affective states; Human computer interaction; Keyboard; Mouse; User modeling

Indexed keywords

CHEMICAL ACTIVATION; E-LEARNING; KNOWLEDGE BASED SYSTEMS; MAMMALS; PROBLEM SOLVING;

AFFECTIVE COMPUTING; AFFECTIVE STATE; KEYBOARD; MOUSE; USER MODELING;

HUMAN COMPUTER INTERACTION;

EID: 84924143936     PISSN: None     EISSN: 18770509     Source Type: Conference Proceeding    
DOI: 10.1016/j.procs.2014.08.151     Document Type: Conference Paper

References (42)

1. Tao, J., Tan, T.: Affective Computing: A Review. In: Tao, J., Tan, T., and Picard, R.W. (eds.) Affective Computing and Intelligent Interaction. pp. 981-995. Springer Berlin Heidelberg (2005).
2. Picard, R.W.: Affective computing. (1995).
3. Ainley, M.: Connecting with Learning: Motivation, Affect and Cognition in Interest Processes. Educ. Psychol. Rev. 18, 391-405 (2006).
4. Lynch, D.J.: Motivational Factors, Learning Strategies and Resource Management as Predictors of Course Grades. Coll. Stud. J. 40, 423-428 (2006).
5. Hussain, M.S., AlZoubi, O., Calvo, R.A., D'Mello, S.K.: Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor. In: Biswas, G., Bull, S., Kay, J., and Mitrovic, A. (eds.) Artificial Intelligence in Education. pp. 131-138. Springer Berlin Heidelberg (2011).
6. Barreto, A., Zhai, J., Adjouadi, M.: Non-intrusive Physiological Monitoring for Automated Stress Detection in Human-Computer Interaction. In: Lew, M., Sebe, N., Huang, T., and Bakker, E. (eds.) Human-Computer Interaction. pp. 29-38. Springer Berlin/Heidelberg (2007).
7. D'Mello, S., Graesser, A.: Mining Bodily Patterns of affective experience during learning. Proceedings of the 3rd International Conference on Educational Data Mining. pp. 31-40 (2010).
8. Kaklauskas, A., Zavadskas, E.K., Seniut, M., Krutinis, M., Dzemyda, G., Ivanikovas, S., Stankevic, V., Simkevicius, C., Jarusevicius, A.: Web-based biometric mouse decision support system for user's emotional and labour productivity analysis. June 11 (2008).
9. Harley, J.M., Bouchet, F., Azevedo, R.: Aligning and Comparing Data on Emotions Experienced during Learning with MetaTutor. In: Lane, H.C., Yacef, K., Mostow, J., and Pavlik, P. (eds.) Artificial Intelligence in Education. pp. 61-70. Springer Berlin Heidelberg (2013).
10. Babiker, A., Faye, I., Malik, A.: Pupillary behavior in positive and negative emotions. 2013 IEEE International Conference on Signal and Image Processing Applications (ICSIPA). pp. 379-383 (2013).
11. Kardan, S., Conati, C.: Exploring Gaze Data for Determining User Learning with an Interactive Simulation. In: Masthoff, J., Mobasher, B., Desmarais, M.C., and Nkambou, R. (eds.) User Modeling, Adaptation, and Personalization. pp. 126-138. Springer Berlin Heidelberg (2012).
12. Sengupta, T., Jeng, O.-J.: Eye and mouse movements for user interface design. Proceedings of Bioengineering Conference, 2003 IEEE 29th Annual. pp. 1-2 (2003).
13. Tullis, T., Albert, W.: Measuring the user experience: Collecting, analyzing, and presenting usability metrics. Morgan Kaufmann (2010).
14. Tsai, C.-J., Chang, T.-Y., Yang, Y.-J., Wu, M.-S., Li, Y.-C.: An Approach for User Authentication on Non-Keyboard Devices Using Mouse Click Characteristics and Statistical-Based Classification. Int. J. Innov. Comput. Inf. Control. 8, 7875-7886 (2012).
15. Lin, C.-C., Chang, C.-C., Liang, D.: A New Non-intrusive Authentication Approach for Data Protection Based on Mouse Dynamics. 2012 International Symposium on Biometrics and Security Technologies (ISBAST). pp. 9-14 (2012).
16. Bakelman, N., Monaco, J.V., Cha, S.-H., Tappert, C.C.: Keystroke Biometric Studies on Password and Numeric Keypad Input. Intelligence and Security Informatics Conference (EISIC), 2013 European. pp. 204-207 (2013).
17. Karnan, M., Akila, M., Krishnaraj, N.: Biometric personal authentication using keystroke dynamics: A review. Appl. Soft Comput. 11, 1565-1573 (2011).
18. Monaco, J.V., Bakelman, N., Cha, S.-H., Tappert, C.C.: Developing a Keystroke Biometric System for Continual Authentication of Computer Users. Intelligence and Security Informatics Conference (EISIC), 2012 European. pp. 210-216 (2012).
19. Villani, M., Curtin, M., Ngo, G., Simone, J., Fort, H.S., Cha, S.: Keystroke biometric recognition studies on long-text input under ideal and applicationoriented conditions. In Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW06. pp. 39-47 (2006).
20. Sottilare, R.A., Proctor, M.: Passively Classifying Student Mood and Performance within Intelligent Tutors. Educ. Technol. Soc. 15, 101-114 (2012).
21. Tsoulouhas G, Georgiou D, Karakos A: Detection of Learner's Affective State Based on Mouse Movements. J. Comput. 3, 9-18 (2011).
22. Kaklauskas, A., Krutinis, M., Seniut, M.: Biometric mouse intelligent system for student's emotional and examination process analysis. Advanced Learning Technologies, 2009. ICALT 2009. Ninth IEEE International Conference on. pp. 189-193 (2009).
23. Bixler, R., D'Mello, S.: Detecting Boredom and Engagement During Writing with Keystroke Analysis, Task Appraisals, and Stable Traits. Proceedings of the 2013 International Conference on Intelligent User Interfaces. pp. 225-234. ACM, New York, NY, USA (2013).
24. Khanna, P., Sasikumar, M.: Recognising Emotions from Keyboard Stroke Pattern. Int. J. Comput. Appl. 11, 1-5 (2010).
25. Felipe, D.A.M., Gutierrez, K.I.N., Quiros, E.C.M., Vea, L.A.: Towards the Development of Intelligent Agent for Novice C/C++ Programmers through Affective Analysis of Event Logs. Proc. Int. MultiConference Eng. Comput. Sci. 1, (2012).
26. Epp, C., Lippold, M., Mandryk, R.L.: Identifying emotional states using keystroke dynamics. Proceedings of the 2011 annual conference on Human factors in computing systems. pp. 715-724 (2011).
27. Khan, I.A., Brinkman, W.-P., Hierons, R.: Towards estimating computer users' mood from interaction behaviour with keyboard and mouse. Front. Comput. Sci. 1-12 (2013).
28. Zimmermann P, Gomez P, Danuser B, Schär S. Extending usability: Putting affect into the user-experience. Proc. Nord. 27-32; 2006
29. Lee, P.-M., Tsui, W.-H., Hsiao, T.-C.: A Low-Cost Scalable Solution for Monitoring Affective State of Students in E-learning Environment Using Mouse and Keystroke Data. In: Cerri, S.A., Clancey, W.J., Papadourakis, G., and Panourgia, K. (eds.) Intelligent Tutoring Systems. pp. 679-680. Springer Berlin Heidelberg (2012).
30. Gao, Y., Bianchi-Berthouze, N., Meng, H.: What does touch tell us about emotions in touchscreen-based gameplay? ACM Trans. Comput.-Hum. Interact. TOCHI. 19, 31 (2012).
31. Lee, H., Choi, Y.S., Lee, S., Park, I.P.: Towards unobtrusive emotion recognition for affective social communication. Consumer Communications and Networking Conference (CCNC), 2012 IEEE. pp. 260-264. IEEE (2012).
32. Salmeron-Majadas, S., Santos, O.C., Boticario, J.G.: Affective State Detection in Educational Systems through Mining Multimodal Data Sources. In: D'Mello, S.K., Calvo, R.A., and Olney, A. (eds.) 6th International Conference on Educational Data Mining. pp. 348-349. International Educational Data Mining Society, Memphis (2013).
33. Bradley, M.M., Lang, P.J.: Measuring emotion: The self-Assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry. 25, 49-59 (1994).
34. Santos, O.C., Rodriguez-Ascaso, A., Boticario, J.G., Salmeron-Majadas, S., Quirós, P., Cabestrero, R.: Challenges for Inclusive Affective Detection in Educational Scenarios. In: Stephanidis, C. and Antona, M. (eds.) Universal Access in Human-Computer Interaction. Design Methods, Tools, and Interaction Techniques for eInclusion. pp. 566-575. Springer Berlin Heidelberg (2013).
35. Lang, P.J., Bradley, M.M., Cuthbert, B.N.: International affective picture system (IAPS): Instruction manual and affective ratings. Cent. Res. Psychophysiol. Univ. Fla. (1999).
36. Saneiro M, Santos OC, Salmeron-Majadas S, Boticario JG, Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches. The Scientific World Journal, vol. 2014, article ID 484873, 2014.
37. Salmeron-Majadas, S., Santos, O.C., Boticario, J.G.: Exploring indicators from keyboard and mouse interactions to predict the user affective state. In: D'Mello, S.K., Calvo, R.A., and Olney, A. (eds.)7th International Conference on Educational Data Mining.(in press)
38. Scherer, K.R.: What are emotions? And how can they be measured? Soc. Sci. Inf. 44, 695-729 (2005).
39. Plutchik, R.: The circumplex as a general model of the structure of emotions and personality. In: Plutchik, R. and Conte, H.R. (eds.) Circumplex models of personality and emotions. pp. 17-45. American Psychological Association, Washington, DC, US (1997).
40. Santos, O.C., Boticario, J.G., Manjarres-Riesco, A.: An approach for an Affective Educational Recommendation Model. Recommender Systems for Technology Enhanced Learning Research Trends Applications. Springer. (2014).
41. Arevalillo-Herráez, M., Moreno-Picot, S., Arnau, D., Moreno-Clari, P., Boticario, J.G., Santos, O.C., Cabestrero, R., Quirós, P., Salmeron-Majadas, S., Manjarrés-Riesco, A.: Towards Enriching an ITS with Affective Support. Proc. 3rd International Workshop on Personalization Approaches in Learning Environments (PALE), CEUR Workshop Proceedings, 2013, pp. 5-13
42. Santos, O.C., Saneiro, M., Salmeron-Majadas, S., Boticario, J.G. (2014) Some progress in a methodological approach to eliciting emotional recommendations for educational scenarios. In proceedings of the 14th IEEE International Conference on Advanced Learning Technologies (ICALT 2014), in press.