A systematic literature review on the usage of eye-tracking in software engineering

Information and Software Technology

Volumn 67, Issue , 2015, Pages 79-107

  Sharafi, Zohreh ^a   Soh, Zéphyrin ^a   Guéhéneuc, Yann Gaël ^a  

^a ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

Experiment; Eye tracking; Software engineering

Indexed keywords

BEHAVIORAL RESEARCH; COGNITIVE SYSTEMS; DATA REDUCTION; EXPERIMENTS; EYE MOVEMENTS; SOFTWARE ENGINEERING;

COLLABORATIVE INTERACTION; ENGINEERING COMMUNITY; EVIDENCE BASED SOFTWARE ENGINEERINGS (EBSE); EYE TRACKING TECHNOLOGIES; EYE-TRACKING STUDIES; QUANTITATIVE MEASURES; SYSTEMATIC LITERATURE REVIEW; SYSTEMATIC LITERATURE REVIEW (SLR);

EYE TRACKING;

EID: 84942013015     PISSN: 09505849     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.infsof.2015.06.008     Document Type: Conference Paper

References (54)

1. S.G. Hart, and L.E. Staveland Development of NASA-TLX (task load index): results of empirical and theoretical research Adv. Psychol. 52 1988 139 183
2. B. Kitchenham Empirical paradigm - the role of experiments Proceedings of the 2006 International Conference on Empirical Software Engineering Issues: Critical Assessment and Future Directions 2007 Springer-Verlag Berlin, Heidelberg 25 32
3. A. Jedlitschka, D. Pfahl, Reporting guidelines for controlled experiments in software engineering, in: Proceedings of the 2005 International Symposium on Empirical Software Engineering, 2005, pp. 10 pp.-, http://dx.doi.org/10.1109/ISESE.2005.1541818.
4. H. Zhang, M.A. Babar, and P. Tell Identifying relevant studies in software engineering Inf. Softw. Technol. 53 6 2011 625 637
5. M. Turner, B. Kitchenham, D. Budgen, P. Brereton, Lessons learnt undertaking a large-scale systematic literature review, in: Proceedings of the 12th International Conference on Evaluation and Assessment in Software Engineering, EASE '08, British Computer Society, Swinton, UK, UK, 2008, pp. 110-118.
6. M. Lavallée, P.N. Robillard, and R. Mirsalari Performing systematic literature reviews with novices: an iterative approach IEEE Trans. Educ. 57 3 2014 175 181 10.1109/TE.2013.2292570
7. R.J. Erich Gamma, Richard Helm, and J. Vlissides Design Patterns Elements of Reusable Object-Oriented Software 1995 Addison-Wesley Pub Co.
8. R. Schauer, and R.K. Keller Pattern visualization for software comprehension Proceeding of 6th International Workshop on Program Comprehension, IWPC '98 1998 IEEE 4 12
9. E. Gamma, Applying design patterns in Java, in: D. Deugo (Ed.), Java Gems: Jewels from Java Report, SIGS Reference Library, 1996, pp. 47-53.
10. D. Jing, Y. Sheng, and Z. Kang Visualizing design patterns in their applications and compositions IEEE Trans. Softw. Eng. 33 7 2007 433 453 10.1109/TSE.2007.1012
11. D.I. Sjøberg, J.E. Hannay, O. Hansen, V.B. Kampenes, A. Karahasanovic, N.-K. Liborg, and A.C. Rekdal A survey of controlled experiments in software engineering IEEE Trans. Softw. Eng. 31 9 2005 733 753
12. B.A. Kitchenham, S.L. Pfleeger, L.M. Pickard, P.W. Jones, D.C. Hoaglin, K.E. Emam, and J. Rosenberg Preliminary guidelines for empirical research in software engineering IEEE Trans. Softw. Eng. 28 8 2002 721 734 10.1109/TSE.2002.1027796
13. B.A. Kitchenham, T. Dyba, and M. Jorgensen Evidence-based software engineering Proceedings of the 26th International Conference on Software Engineering, ICSE '04 2004 IEEE Computer Society Washington, DC, USA 273 281
14. B. Kitchenham, O. Pearl Brereton, D. Budgen, M. Turner, J. Bailey, and S. Linkman Systematic literature reviews in software engineering - a systematic literature review Inf. Softw. Technol. 51 1 2009 7 15 10.1016/j.infsof.2008.09.009
15. D.L. Sackett, S.E. Straus, W.S. Richardson, W. Rosenberg, and R.B. Haynes Evidence-Based Medicine: How to Practice and Teach EBM second ed. 2000 Churchill Livingstone
16. B. Kitchenham, Procedures for Undertaking Systematic Reviews, Tech. rep., Joint Technical Report, Computer Science Department, Keele University (TR/SE- 0401) and National ICT Australia Ltd., 2004.
17. P. Brereton, B.A. Kitchenham, D. Budgen, M. Turner, and M. Khalil Lessons from applying the systematic literature review process within the software engineering domain J. Syst. Softw. 80 4 2007 571 583
18. D. Budgen, A.J. Burn, O.P. Brereton, B.A. Kitchenham, and R. Pretorius Empirical evidence about the UML: a systematic literature review Softw.: Pract. Exper. 41 4 2011 363 392 10.1002/spe.1009
19. H. Do, S. Elbaum, and G. Rothermel Supporting controlled experimentation with testing techniques: an infrastructure and its potential impact Emp. Softw. Eng. 10 4 2005 405 435 10.1007/s10664-005-3861-2
20. B. Sharif, and H. Kagdi On the use of eye tracking in software traceability Proceedings of the 6th International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE '11 2011 ACM New York, NY, USA 67 70
21. M.A. Just, and P.A. Carpenter A theory of reading: from eye fixations to comprehension Psychol. Rev. 87 4 1980 329
22. V. Ponsoda, D. Scott, and J.M. Findlay A probability vector and transition matrix analysis of eye movements during visual search Acta Psychol. 88 2 1995 167 185
23. J.H. Goldberg, and J.I. Helfman Comparing information graphics: a critical look at eye tracking Proceedings of the 3rd Workshop: BEyond Time and Errors: Novel evaLuation Methods for Information Visualization, BELIV '10 2010 ACM New York, NY, USA 71 78
24. C. Lankford Gazetracker: software designed to facilitate eye movement analysis Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, ETRA '00 2000 ACM New York, NY, USA 51 55
25. J.L. Sibert, M. Gokturk, and R.A. Lavine The reading assistant: eye gaze triggered auditory prompting for reading remediation Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, UIST '00 2000 ACM New York, NY, USA 101 107
26. R.J. Jacob, and K.S. Karn Eye tracking in human-computer interaction and usability research: Ready to deliver the promises Mind's Eye: Cognit. Appl. Aspects Eye Move. Res. 2 3 2003 4
27. B. Sharif Empirical assessment of UML class diagram layouts based on architectural importance Proceedings of the 27th IEEE International Conference on Software Maintenance, ICSM '11 2011 IEEE Computer Society Washington, DC, USA 544 549
28. J. Sajaniemi, Comparison of three eye tracking devices in psychology of programming research, in: Proceedings of the 16th Annual Psychology of Programming Interest Group Workshop, PPIG '04, 2004, pp. 151-158.
29. B. Sharif, and J.I. Maletic An eye tracking study on camelcase and under-score identifier styles Proceeding of 18th IEEE International Conference on Program Comprehension, ICPC '10 2010 IEEE Computer Society 196 205
30. Y. Gueheneuc, H. Kagdi, J. Maletic, Working session: Using eye-tracking to understand program comprehension, in: Proceedings of IEEE 17th International Conference on Program Comprehension, ICPC '09, 2009, pp. 278-279, http://dx.doi.org/10.1109/ICPC.2009.5090057.
31. R. Bednarik, and M. Tukiainen Effects of display blurring on the behavior of novices and experts during program debugging Proceeding of Conference on Extended Abstracts on Human Factors in Computing Systems, CHI '05 2005 ACM New York, NY, USA 1204 1207
32. R. Bednarik, and M. Tukiainen Visual attention tracking during program debugging Proceedings of the Third Nordic Conference on Human-computer Interaction, NordiCHI '04 2004 ACM New York, NY, USA 331 334
33. J.M. Henderson, and G.L. Pierce Eye movements during scene viewing: evidence for mixed control of fixation durations Psychon. Bullet. Rev. 15 3 2008 566 573
34. V. Levenshtein Binary codes capable of correcting deletions, insertions and reversals Soviet Phys. Doklady 10 1966 707
35. M.A. Just, and P.A. Carpenter Eye fixations and cognitive processes Cognit. Psychol. 8 4 1976 441 480
36. A. Duchowski Eye Tracking Methodology: Theory and Practice 2007 Springer-Verlag New York Inc
37. K. Rayner Eye movements in reading and information processing: 20 years of research Psychol. Bullet. 124 3 1998 372
38. C.M. Privitera, and L.W. Stark Algorithms for defining visual regions-of-interest: comparison with eye fixations IEEE Trans. Pattern Anal. Mach. Intell. 22 2000 970 982
39. A.F. Blackwell, A.R. Jansen, and K. Marriott Restricted focus viewer: a tool for tracking visual attention M. Anderson, P.C.-H. Cheng, V. Haarslev, Behavior Research Methods, Instruments, & Computers Lecture Notes in Computer Science vol. 1889 2000 Springer 162 177
40. P. Romero, R. Lutz, R. Cox, and B. du Boulay Co-ordination of multiple external representations during java program debugging Proceedings of IEEE 2002 Symposia on Human Centric Computing Languages and Environments 2002 IEEE 207 214
41. J.H. Goldberg, A.M. Wichansky, Eye tracking in usability evaluation: a practitioners guide, in: Hyönä R. Radach, H. Deubel (Eds.), The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research, 2002.
42. J.H. Goldberg, M.J. Stimson, M. Lewenstein, N. Scott, and A.M. Wichansky Eye tracking in web search tasks: design implications Proceedings of the 20 02 Symposium on Eye Tracking Research & Applications, ETRA '02 2002 ACM New York, NY, USA 51 58 http://dx.doi.org/10.1145/507072.507082
43. J.H. Goldberg, and X.P. Kotval Computer interface evaluation using eye movements: methods and constructs Int. J. Indust. Ergon. 24 6 1999 631 645
44. A. Poole, L.J. Ball, Eye tracking in human-computer interaction and usability research: Current status and future, in: Prospects, Chapter in C. Ghaoui (Ed.): Encyclopedia of Human-Computer Interaction, Idea Group, Inc., Pennsylvania, 2005, pp. 211-219.
45. J. Ayres, J. Flannick, J. Gehrke, and T. Yiu Sequential pattern mining using a bitmap representation Proceedings of the 8th ACM International Conference on Knowledge Discovery and Data Mining, KDD '02 2002 ACM New York, NY, USA 429 435
46. F. Cristino, S. Mathot, J. Theeuwes, and I.D. Gilchrist Scanmatch: a novel method for comparing fixation sequences Behav. Res. Meth. 42 2010 692 700
47. P. Bresciani, A. Perini, P. Giorgini, F. Giunchiglia, and J. Mylopoulos Tropos: an agent-oriented software development methodology Auton. Agents Multi-Agent Syst. 8 3 2004 203 236
48. A.R. Jansen, A.F. Blackwell, and K. Marriott A tool for tracking visual attention: the restricted focus viewer Behav. Res. Meth., Instrum., Comp. 35 1 2003 57 69
49. SR Research Ltd, EyeLink II User Manual version (07/02/2006), SR Research Ltd., February 2006.
50. Seeing Machine, Seeing Machine's website - FaceLAB, 2010 < www.seeingmachines.com/product/facelab/ > (accessed 16.04.14).
51. A.T. Duchowski, J. Driver, S. Jolaoso, W. Tan, B.N. Ramey, and A. Robbins Scanpath comparison revisited Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA '10 2010 ACM New York, NY, USA 219 226
52. R. Dewhurst, M. Nyström, H. Jarodzka, T. Foulsham, R. Johansson, and K. Holmqvist It depends on how you look at it: scanpath comparison in multiple dimensions with multimatch, a vector-based approach Behav. Res. Meth. 44 4 2012 1079 1100
53. B. Walters, M. Falcone, A. Shibble, B. Sharif, Towards an eye-tracking enabled IDE for software traceability tasks, in: Proceeding of International Workshop on Traceability in Emerging Forms of Software Engineering, TEFSE '13, 2013, pp. 51-54, http://dx.doi.org/10.1109/TEFSE.2013.6620154.
54. B.C.O.F. Fehringer Eye tracking gaze visualiser: eye tracker and experimental software independent visualisation of gaze data Proceedings of the Symposium on Eye Tracking Research & Applications, ETRA '14 2014 ACM New York, NY, USA 259 262