Using psycho-physiological measures to assess task difficulty in software development

Proceedings - International Conference on Software Engineering

Volumn , Issue 1, 2014, Pages 402-413

  Fritz, Thomas ^a   Begel, Andrew ^b   Müller, Sebastian C ^a   Yigit Elliott, Serap ^c   Züger, Manuela ^a  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b MICROSOFT RESEARCH   (United States)

^c EXPONENT INC   (United States)

Author keywords

psycho physiological; study; task difficulty

Indexed keywords

CLASSIFICATION (OF INFORMATION); CLASSIFIERS; CODES (SYMBOLS); ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; PHYSIOLOGY; PROGRAM DEBUGGING; SOFTWARE ENGINEERING;

CODE COMPREHENSION; ELECTRODERMAL ACTIVITY; NAIVE BAYES CLASSIFIERS; PROFESSIONAL PROGRAMMERS; PROGRAMMING SUPPORT; PSYCHO-PHYSIOLOGICAL; STUDY; TASK DIFFICULTY;

SOFTWARE DESIGN;

EID: 84993661798     PISSN: 02705257     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2568225.2568266     Document Type: Conference Paper

References (74)

1. N. Ali, Z. Sharafl, Y. Gueheneuc, and G. Antoniol. An empirical study on requirements traceability using eye-tracking. In Proc. of the 28th Int'l. Conf. on Software Maintenance (ICSM), pages 191-200, 2012.
2. J. L. Andreassi. Psychophysiology: Human Behavior & Physiological Response. Lawrence Erlbaum Associates, 2007.
3. A. F. Ax. The physiological differentiation between fear and anger in humans. Psychosomatic Medicine, pages 433-442, 1953.
4. B. P. Bailey and S. T. Iqbal. Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. ACM Trans. on Computer-Human Interaction, 14 (4): 21, 2008.
5. L. O. Bauer, B. D. Strock, R. Goldstein, J. A. Stern, and L. C. Walrath. Auditory discrimination and the eyeblink. Psychophysiology, 22 (6): 636-641, 1985.
6. J. Beatty. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91 (2): 276, 1982.
7. J. Beatty. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91 (2): 276-292, March 1982.
8. R. Bednarik and M. Tukiainen. An eye-tracking methodology for characterizing program comprehension processes. In Proc. of the 2006 Symposium on Eye Tracking Research & Applications, pages 125-132. ACM, 2006.
9. R. Bednarik and M. Tukiainen. Temporal eye-tracking data: evolution of debugging strategies with multiple representations. In Proc. of the 2008 Symposium on Eye Tracking Research & Applications, pages 99-102. ACM, 2008.
10. R. Bednarik, H. Vrzakova, and M. Hradis. What do you want to do next: a novel approach for intent prediction in gaze-based interaction. In Proc. of the Symposium on Eye Tracking Research & Applications, pages 83-90. ACM, 2012.
11. H. Berger. Über das Elektrenkephalogramm des Menschen. In European Archives of Psychiatry and Clinical Neuroscience, volume 87, pages 527-570, 1929.
12. C. Berka, D. J. Levendowski, M. N. Lumicao, A. Yau, G. Davis, V. T. Zivkovic, R. E. Olmstead, P. D. Tremoulet, and P. L. Craven. EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviation, space, and environmental medicine, pages B231-B244, 2007.
13. W. Boucsein. Electrodermal Activity. Springer-Verlag, New York, 2012.
14. K. A. Brookhuis and D. De Waard. The use of psychophysiology to assess driver status. In Ergonomics, 1993.
15. J. B. Brookings, G. F. Wilson, and C. R. Swain. Psychophysiological responses to changes in workload during simulated air traffic control. Biological psychology, 42 (3): 361-377, 1996.
16. M. Crosby and J. Stelovsky. How do we read algorithms? A case study. Computer, 23 (1): 25-35, 1990.
17. M. E. Dawson, A. M. Schell, and D. L. Filion. The electrodermal system. Handbook of Psychophysiology, page 159, 2007.
18. P. J. De Jong and H. Merckelbach. Eyeblink frequency, rehearsal activity, and sympathetic arousal. Int'l. Journal of Neuroscience, 51 (1-2): 89-94, 1990.
19. F. Détienne. Software Design-Cognitive Aspects. Springer-Verlag New York, Inc., New York, NY, USA, 2002.
20. D. G. Doehring. The relation between manifest anxiety and rate of eyeblink in a stress situation. Technical report, Central Institute for the Deaf, St Louis, MO, 1957.
21. S. Eivazi and R. Bednarik. Predicting problem-solving behavior and performance levels from visual attention data. In Proc. of the 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction, pages 9-16, 2011.
22. D. C. Fowles, M. J. Christie, R. Edelberg, W. W. Grings, D. T. Lykken, and P. H. Venables. Publication recommendations for electrodermal measurements. Psychophysiology, 18 (3): 232-239, 1981.
23. A. Gevins, M. E. Smith, H. Leong, L. McEvoy, S. Whitfield, R. Du, and G. Rush. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors: The Journal of the Human Factors and Ergonomics Society, 40 (1): 79-91, 1998.
24. J. H. Goldberg and X. P. Kotval. Computer interface evaluation using eye movements: methods and constructs. Int'l. Journal of Industrial Ergonomics, 24 (6): 631-645, 1999.
25. A. Greco, A. Lanata, G. Valenza, G. Rota, N. Vanello, and E. Scilingo. On the deconvolution analysis of electrodermal activity in bipolar patients. In Proc. of the Annual Int'l. Conf. of the IEEE on Engineering in Medicine and Biology Society (EMBC), pages 6691-6694, 2012.
26. D. Grimes, D. S. Tan, S. E. Hudson, P. Shenoy, and R. P. Rao. Feasibility and pragmatics of classifying working memory load with an electroencephalograph. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pages 835-844. ACM, 2008.
27. E. Haapalainen, S. Kim, J. F. Forlizzi, and A. K. Dey. Psycho-physiological measures for assessing cognitive load. In Proc. of the 12th ACM Int'l. Conf. on Ubiquitous Computing, pages 301-310. ACM, 2010.
28. E. Haapalainen, S. Kim, J. F. Forlizzi, and A. K. Dey. Psycho-physiological measures for assessing cognitive load. In Proc. of the 12th ACM Int'l. Conf. on Ubiquitous Computing, Ubicomp'10, pages 301-310, New York, NY, USA, 2010. ACM.
29. A. Haarmann, W. Boucsein, and F. Schaefer. Combining electrodermal responses and cardiovascular measures for probing adaptive automation during simulated flight. Applied Ergonomics, 40 (6): 1026-1040, 2009.
30. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten. The WEKA data mining software: an update. ACM SIGKDD Explorations Newsletter, 11 (1): 10-18, Nov. 2009.
31. T. C. Handy. Event-related potentials: a methods handbook. MIT Press, 2005.
32. S. G. Hart and L. E. Staveland. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload, 1 (3): 139-183, 1988.
33. M. K. Holland and G. Tarlow. Blinking and mental load. Psychological Reports, 31 (1): 119-127, 1972.
34. M. K. Holland and G. Tarlow. Blinking and thinking. Perceptual and Motor Skills, 41 (2): 403-406, 1975.
35. C. S. Ikehara and M. E. Crosby. Assessing cognitive load with physiological sensors. In Proc. of the 38th Annual Hawaii Int'l. Conf. on System Sciences, HICSS'05, pages 295. 1-, Washington, DC, USA, 2005. IEEE Computer Society.
36. S. T. Iqbal, X. S. Zheng, and B. P. Bailey. Task-evoked pupillary response to mental workload in human-computer interaction. In CHI'04 Extended Abstracts on Human Factors in Computing Systems, CHI EA'04, pages 1477-1480, New York, NY, USA, 2004. ACM.
37. R. J. Jacob and K. S. Karn. Commentary on section 4-eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In The Mind's Eye, pages 573-605. North-Holland, Amsterdam, 2003.
38. I. A. Khan, W.-P. Brinkman, and R. M. Hierons. Do moods affect programmers' debug performance? Cognition, Technology & Work, 13 (4): 245-258, 2011.
39. I. A. Khan, R. M. Hierons, and W. P. Brinkman. Mood independent programming. In Proc. of the 14th European Conf. on Cognitive ergonomics: Invent! Explore!, pages 269-272. ACM, 2007.
40. J. Klingner. Fixation-aligned pupillary response averaging. In Proc. of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA'10, pages 275-282, New York, NY, USA, 2010. ACM.
41. A. F. Kramer. Physiological metrics of mental workload: A review of recent progress. Technical Report NPRDC-TN-90-23, Navy Personnel Research and Development Center, June 1990.
42. A. F. Kramer. Physiological metrics of mental workload: A review of recent progress. Multiple-task Performance, pages 279-328, 1991.
43. I. Lawrence J. Prinzel, P. Alan T., F. Frederick G., S. Mark W., and M. Peter J. Empirical analysis of EEG and ERPs for pyschophysiological adaptive task allocation. Technical report, NASA Langley, 2001.
44. J. C. Lee and D. S. Tan. Using a low-cost electroencephalograph for task classification in HCI research. In Proc. of the 19th Annual ACM Symposium on User Interface Software and Technology, pages 81-90. ACM, 2006.
45. C. Maaoui and A. Pruski. Emotion recognition through physiological signals for human-machine communication. Cutting Edge Robotics, 2010.
46. S. Makeig and T.-P. Jung. Tonic, phasic, and transient EEG correlates of auditory awareness in drowsiness. Cognitive Brain Research, 4 (1): 15-25, 1996.
47. P. Manoilov. Eye-blinking artefacts analysis. In Proc. of the 2007 Int'l. Conf. on Computer Systems and Technologies, page 52, 2007.
48. D. McDuff, A. Karlson, A. Kapoor, A. Roseway, and M. Czerwinski. Affectaura: an intelligent system for emotional memory. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pages 849-858. ACM, 2012.
49. A. Nakasone, H. Prendinger, and M. Ishizuka. Emotion recognition from electromyography and skin conductance. In Proc. of the 5th Int'l. Workshop on Biosignal Interpretation, pages 219-222, 2005.
50. NASA-Ames Research Center, Aerospace Human Factors Research Division. NASA TLX Load Index (TLX): Paper-and-pencil version.
51. Neurosky. Neurosky's eSense™ meters and detection of mental state, 2009.
52. S. Nevalainen and J. Sajaniemi. Short-term effects of graphical versus textual visualisation of variables on program perception. In Proc. of the 17th Annual Psychology of Prgramming Interest Group Workshop, pages 77-91, 2005.
53. N. Nourbakhsh, Y. Wang, F. Chen, and R. A. Calvo. Using galvanic skin response for cognitive load measurement in arithmetic and reading tasks. In Proc. of the 24th Australian Computer-Human Interaction Conf., OzCHI'12, pages 420-423, New York, NY, USA, 2012. ACM.
54. C. Parnin. Subvocalization-toward hearing the inner thoughts of developers. In Proc. of the 19th Int'l. Conf. on Program Comprehension (ICPC), pages 197-200. IEEE, 2011.
55. R. W. Picard, E. Vyzas, and J. Healey. Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Trans. on Pattern Analysis and Machine Intelligence, 23 (10): 1175-1191, 2001.
56. M.-Z. Poh, N. Swenson, and R. Picard. A wearable sensor for unobtrusive, long-term assessment of electrodermal activity. IEEE Trans. on Biomedical Engineering, 57 (5): 1243-1252, 2010.
57. G. C. Porras and Y.-G. Guéhéneuc. An empirical study on the efficiency of different design pattern representations in UML class diagrams. Empirical Software Engineering, 15 (5): 493-522, 2010.
58. R. Quinlan. C4. 5: Programs for Machine Learning. Morgan Kaufmann Publishers, San Mateo, CA, 1993.
59. D. W. Rowe, J. Sibert, and D. Irwin. Heart rate variability: Indicator of user state as an aid to human-computer interaction. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pages 480-487. ACM Press/Addison-Wesley Publishing Co., 1998.
60. K. Ryu and R. Myung. Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic. Int'l. Journal of Industrial Ergonomics, 35 (11): 991-1009, 2005.
61. S. Schmidt and H. Walach. Electrodermal activity (EDA)-state-of-the-art measurements and techniques for parapsychological purposes. Journal of Parapsychology, 64 (2): 139, June 2000.
62. C. Setz, B. Arnrich, J. Schumm, R. La Marca, G. Troster, and U. Ehlert. Discriminating stress from cognitive load using a wearable EDA device. IEEE Trans. on Information Technology in Biomedicine, 14 (2): 410-417, 2010.
63. Z. Sharafi, Z. Soh, Y.-G. Guéhéneuc, and G. Antoniol. Women and men-different but equal: On the impact of identifier style on source code reading. In Proc. of the 20th Internationl Conf. on Program Comprehension, pages 27-36. IEEE, 2012.
64. Z. Sharafl, A. Marchetto, A. Susi, and G. Antoniol. An empirical study on the efficiency of graphical vs. textual representations in requirements comprehension. In Proc. of the Int'l. Conf. on Program Comprehension. IEEE, 2013.
65. B. Sharif, M. Falcone, and J. I. Maletic. An eye-tracking study on the role of scan time in finding source code defects. In Proc. of the Symposium on Eye Tracking Research & Applications, pages 381-384. ACM, 2012.
66. B. Sharif and J. I. Maletic. An eye tracking study on camelcase and underscore identifier styles. In Proc. of the 18th Int'l. Conf. on Program Comprehension (ICPC), pages 196-205. IEEE, 2010.
67. B. Sharif and J. I. Maletic. An eye tracking study on the effects of layout in understanding the role of design patterns. In Proc. of the Int'l. Conf. on Software Maintenance, pages 1-10. IEEE, 2010.
68. Y. Shi, N. Ruiz, R. Taib, E. Choi, and F. Chen. Galvanic skin response (GSR) as an index of cognitive load. In CHI'07 Extended Abstracts on Human Factors in Computing Systems, pages 2651-2656. ACM, 2007.
69. J. Simola, J. Salojärvi, and I. Kojo. Using hidden markov model to uncover processing states from eye movements in information search tasks. Cognitive Systems Research, 9 (4): 237-251, 2008.
70. M. E. Smith and A. Gevins. Neurophysiologic monitoring of mental workload and fatigue during operation of a flight simulator. In Defense and Security, pages 116-126. Int'l. Society for Optics and Photonics, 2005.
71. M. Sterman, C. Mann, and D. Kaiser. Quantitative EEG patterns of differential in-flight workload. In Proc. of the 6th Annual Workshop on Space Operations Applications and Research (SOAR), volume 2, NASA, Johnson Space Center, 1993.
72. C. Telford and N. Thompson. Some factors influencing voluntary and reflex eyelid responses. Journal of Experimental Psychology, 16 (4): 524, 1933.
73. H. Uwano, M. Nakamura, A. Monden, and K.-I. Matsumoto. Analyzing individual performance of source code review using reviewers' eye movement. In Proc. of the 2006 Symposium on Eye Tracking Research & Applications, ETRA'06, pages 133-140, New York, NY, USA, 2006. ACM.
74. G. F. Wilson. An analysis of mental workload in pilots during flight using multiple psychophysiological measures. The Int'l. Journal of Aviation Psychology, 12 (1): 3-18, 2002.