Using touchscreen interaction data to predict cognitive workload

ICMI 2016 - Proceedings of the 18th ACM International Conference on Multimodal Interaction

Volumn , Issue , 2016, Pages 349-356

  Mock, Philipp ^a   Gerjets, Peter ^a   Tibus, Maike ^b   Trautwein, Ulrich ^b   Möller, Korbinian ^a   Rosenstiel, Wolfgang ^b  

^a UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^b UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Adaptive learning systems; Machine learning; Multi Touch

Indexed keywords

ARTIFICIAL INTELLIGENCE; FORECASTING; INTERACTIVE COMPUTER SYSTEMS;

ADAPTIVE LEARNING SYSTEMS; AUTOMATIC PREDICTION; CLASSIFICATION ACCURACY; COGNITIVE WORKLOADS; INTERACTION PATTERN; MACHINE LEARNING METHODS; MULTI-TOUCH; TOUCH-SCREEN INTERACTION;

LEARNING SYSTEMS;

EID: 85016580983     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2993148.2993202     Document Type: Conference Paper

References (23)

1. M. H. Ashcraft and J. Battaglia. Cognitive arithmetic: Evidence for retrieval and decision processes in mental addition. Journal of Experimental Psychology: Human Learning and Memory, 4(5):527, 1978.
2. V. M. G. Barrios, C. Gutl, A. M. Preis, K. Andrews, M. Pivec, F. Modritscher, and C. Trummer. Adele: A framework for adaptive e-learning through eye tracking. Proc. I-KNOW, pages 609{616, 2004.
3. Y.-W. Chen and C.-J. Lin. Combining svms with various feature selection strategies. In Feature extraction, pages 315{324. Springer, 2006.
4. S. K. D'Mello and A. Graesser. Multimodal semi-Automated affect detection from conversational cues, gross body language, and facial features. User Modeling and User-Adapted Interaction, 20(2):147{187, 2010.
5. J. Edelmann, P. Mock, A. Schilling, P. Gerjets, W. Rosenstiel, and W. Straßer. Towards the Keyboard of Oz: Learning soft-keyboard models from raw optical sensor data. In Proc. ITS, pages 163{172. ACM, 2012.
6. Y. Gao, N. Bianchi-Berthouze, and H. Meng. What does touch tell us about emotions in touchscreen-based gameplay? TOCHI, 19(4):31, 2012.
7. P. Gerjets, C. Walter, W. Rosenstiel, M. Bogdan, and T. O. Zander. Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach. Using Neurophysiological Signals that Reect Cognitive or Affective State, page 20, 2015.
8. I. Imbo, A. Vandierendonck, and S. De Rammelaere. The role of working memory in the carry operation of mental arithmetic: Number and value of the carry. The quarterly journal of experimental psychology, 60(5):708{731, 2007.
9. D. A. Kalaman and J.-A. Lefevre. Working memory demands of exact and approximate addition. European Journal of Cognitive Psychology, 19(2):187{212, 2007.
10. E. Klein, K. Moeller, K. Dressel, F. Domahs, G. Wood, K. Willmes, and H.-C. Nuerk. To carry or not to carry - is this the question? disentangling the carry effect in multi-digit addition. Acta psychologica, 135(1):67{76, 2010.
11. J. Kong, C. Wang, K. Kwong, M. Vangel, E. Chua, and R. Gollub. The neural substrate of arithmetic operations and procedure complexity. Cognitive Brain Research, 22(3):397{405, 2005.
12. H. Meng and N. Bianchi-Berthouze. Affective state level recognition in naturalistic facial and vocal expressions. IEEE Transactions on Cybernetics, 44(3):315{328, 2014.
13. P. Mock, J. Edelmann, A. Schilling, and W. Rosenstiel. User identification using raw sensor data from typing on interactive displays. In Proc. IUI, pages 67{72. ACM, 2014.
14. P. Mock, J. Jaszkowic, J. Edelmann, Y. Kammerer, A. Schilling, and W. Rosenstiel. KeyValuate: A framework for rapid evaluation of adaptive keyboards on touchscreens. In Proc. OzCHI, pages 361{369. ACM, 2015.
15. K. Moeller, E. Klein, and H.-C. Nuerk. Three processes underlying the carry effect in addition{evidence from eye tracking. British Journal of Psychology, 102(3):623{645, 2011.
16. T. Murray and I. Arroyo. Toward measuring and maintaining the zone of proximal development in adaptive instructional systems. In Intelligent Tutoring Systems, pages 749{758. Springer, 2002.
17. S. Salmeron-Majadas, O. C. Santos, and J. G. Boticario. An evaluation of mouse and keyboard interaction indicators towards non-intrusive and low cost affective modeling in an educational context. Procedia Computer Science, 35:691{700, 2014.
18. Samsung. SUR40. http://www.samsung.com/uk/b/p/LH40SFWTGC/EN, 2012. Accessed: 2016-09-08.
19. M. Saneiro, O. C. Santos, S. Salmeron-Majadas, and J. G. Boticario. Towards emotion detection in educational scenarios from facial expressions and body movements through multimodal approaches. The Scientific World Journal, 2014, 2014.
20. M. Specht. Sensor technology for learning support. Bulletin of the IEEE Technical Committee on Learning Technology, 16(2/3):1, 2014.
21. L. Vgotsky. Mind in society: The development of higher mental processes, 1978.
22. B. P. Woolf. Building intelligent interactive tutors: Student-centered strategies for revolutionizing e-learning. Morgan Kaufmann, 2010.
23. B. Yin and F. Chen. Towards automatic cognitive load measurement from speech analysis. In Human-Computer Interaction. Interaction Design and Usability, pages 1011{1020. Springer, 2007.