Expertise Differences in the Comprehension of Visualizations: A Meta-Analysis of Eye-Tracking Research in Professional Domains

Educational Psychology Review

Volumn 23, Issue 4, 2011, Pages 523-552

  Gegenfurtner, Andreas ^a   Lehtinen, Erno ^a   Säljö, Roger ^a,b  

^a UNIVERSITY OF TURKU   (Finland)

^b UNIVERSITY OF GOTHENBURG   (Sweden)

Author keywords

Expertise; Eye tracking; Graphics comprehension; Information reduction; Long term working memory; Meta analysis; Parafoveal processing

Indexed keywords

EID: 81155131097     PISSN: 1040726X     EISSN: 1573336X     Source Type: Journal    
DOI: 10.1007/s10648-011-9174-7     Document Type: Review

References (117)

1. *Abernethy, B. (1990). Expertise, visual search, and information pick-up in squash. Perception, 19, 63-77.
2. *Abernethy, B., & Russel, D. G. (1987). The relationship between expertise and visual search strategy in a racquet sport. Human Movement Science, 6, 283-319.
3. *Amadieu, F., van Gog, T., Paas, F., Tricot, A., & Mariné, C. (2009). Effects of prior knowledge and concept-map structure on disorientation, cognitive load, and learning. Learning and Instruction, 19, 376-386.
4. *Augustyniak, P., & Tadeusiewicz, R. (2006). Assessment of electrocardiogram visual interpretation strategy based on scanpath analysis. Physiological Measurement, 27, 597-608.
5. *Bard, C., & Fleury, M. (1976). Analysis of visual search activity during sport problem situations. Journal of Human Movement Studies, 3, 214-222.
6. *Bard, C., Fleury, M., Carrière, L., & Hallé, M. (1980). Analysis of gymnastics judges' visual search. Research Quarterly for Exercise and Sport, 51, 267-273.
7. Barrouillet, P., & Camos, V. (2007). The time-based resource-sharing model of working memory. In N. Osaka, R. H. Logie, & D. E. Mark (Eds.), The cognitive neuroscience of working memory (pp. 57-80). Oxford: Oxford University Press.
8. Beal, D. J., Corey, D. M., & Dunlap, W. P. (2002). On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in meta-analysis of correlations. Journal of Applied Psychology, 87, 583-589.
9. *Bednarik, R., & Tukiainen, M. (2007). Validating the restricted focus viewer: A study using eye-movement tracking. Behavior Research Methods, 39, 274-282.
10. Bellenkes, A. H., Wickens, C. D., & Kramer, A. F. (1997). Visual scanning and pilot expertise: The role of attentional flexibility and mental model development. Aviation, Space and Environmental Medicine, 48, 569-579.
11. *Bertrand, C., & Thullier, F. (2009). Effects of player position task complexity in visual exploration behavior in soccer. International Journal of Sport Psychology, 40, 306-323.
12. Billett, S. (2009). Personal epistemologies, work, and learning. Educational Research Review, 4, 210-219.
13. Butcher, K. R. (2006). Learning from text with diagrams: Promoting mental model development and inference generation. Journal of Educational Psychology, 98, 182-197.
14. Campbell, D. J. (1986). Task complexity: A review and analysis. Academy of Management Review, 13, 40-52.
15. *Cauraugh, J. H., Singer, R. N., & Chen, D. (1993). Visual scanning and anticipation of expert and beginning tennis players. In S. Serpa (Ed.), Proceedings of the World Congress of Sport Psychology (pp. 336-340). Lisbon: International Society of Sport Psychology.
16. *Chapman, P. R., & Underwood, G. (1998). Visual search of driving situations: Danger and experience. Perception, 27, 951-964.
17. *Chapman, P. R., & Underwood, G. (1999). Visual search of dynamic scenes: Event types and the role of experience in viewing driving situations. In G. Underwood (Ed.), Eye guidance in reading and scene perception (pp. 369-393). Amsterdam: Elsevier.
18. *Charness, N., Reingold, E. M., Pomplun, M., & Stampe, D. M. (2001). The perceptual aspect of skilled performance in chess: Evidence from eye movements. Memory & Cognition, 29, 1146-1152.
19. Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4, 55-81.
20. Chi, M. T. H. (2006). Two approaches to the study of experts' characteristics. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 21-30). Cambridge: Cambridge University Press.
21. *Cooper, L., Gale, A., Darker, I., Toms, A., & Saada, J. (2009). Radiology image perception and observer performance: How does expertise and clinical information alter interpretation? Stroke detection explored through eye-tracking. In B. Sahiner & D. J. Manning (Eds.), Medical Imaging 2009: Image perception, observer performance, and technology assessment Vol. 7263 (pp. 72630K-72630K-12). Bellingham: SPIE.
22. *Cooper, L., Gale, A., Saada, J., Gedela, S., Scott, H., & Toms, A. (2010). The assessment of stroke multidimensional CT and MR imaging using eye movement analysis: Does modality preference enhance observer performance? In D. J. Manning & C. K. Abbey (Eds.), Medical Imaging 2010: Image perception, observer performance, and technology assessment Vol. 7627 (pp. 76270B-76270B-12). Bellingham: SPIE.
23. Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87-185.
24. *Crundall, D., Underwood, G., & Chapman, P. (1999). Driving experience and the functional field of view. Perception, 28, 1075-1087.
25. *Crundall, D., Chapman, P., Phelps, N., & Underwood, G. (2003). Eye movements and hazard perception in police pursuit and emergency response driving. Journal of Experimental Psychology: Applied, 9, 163-174.
26. *Crundall, D., Chapman, P., France, E., Underwood, G., & Phelps, N. (2005). What attracts attention during police pursuit driving? Applied Cognitive Psychology, 19, 409-420.
27. *de Groot, A. D., & Gobet, F. (1996). Perception and memory in chess. Heuristics of the professional eye. Assen: van Gorcum.
28. Dwyer, F. M., & Joseph, J. (1984). The effects of prior knowledge, presentation mode, and visual realism on student achievement. Journal of Experimental Education, 52, 110-121.
29. *Dyer, A. G., Found, B., & Rogers, D. (2006). Visual attention and expertise for forensic signature analysis. Journal of Forensic Sciences, 51, 1397-1404.
30. Eilam, B., & Poyas, Y. (2008). Learning with multiple representations: Extending multimedia learning beyond the lab. Learning and Instruction, 18, 368-378.
31. Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211-245.
32. Ericsson, K. A., & Lehmann, A. C. (1996). Expert and exceptional performance: Evidence of maximal adaptations to task constraints. Annual Review of Psychology, 47, 273-305.
33. Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.). (2006). Cambridge handbook of expertise and expert performance. Cambridge: Cambridge University Press.
34. Feltovich, P. J., Prietula, M. J., & Ericsson, K. A. (2006). Studies of expertise from psychological perspectives. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), Cambridge handbook of expertise and expert performance (pp. 41-67). Cambridge: Cambridge University Press.
35. Gibson, J. J. (1986). The ecological approach to visual perception. New York: Psychology.
36. Ginns, P. (2005). Meta-analysis of the modality effect. Learning and Instruction, 15, 313-331.
37. Gnaur, D. (2010). Seizing workplace learning affordances in high-pressure work environments. Vocations and Learning, 3, 223-238.
38. Goldstone, R. L. (1998). Perceptual learning. Annual Review of Psychology, 49, 585-612.
39. *Goulet, C., Bard, C., & Fleury, M. (1989). Expertise differences in preparing to return a tennis serve: A visual information processing approach. Journal of Sport & Exercise Psychology, 11, 382-398.
40. Grant, E. R., & Spivey, M. J. (2003). Eye movements and problem solving: Guiding attention guides thought. Psychological Science, 14, 462-466.
41. Haider, H., & Frensch, P. A. (1999). Eye movement during skill acquisition: More evidence for the information reduction hypothesis. Journal of Experimental Psychology: Learning, Memory, & Cognition, 25, 172-190.
42. Hall, S. M., & Brannick, M. T. (2002). Comparison of two random effects methods of meta-analysis. Journal of Applied Psychology, 87, 377-389.
43. *Helsen, W., & Pauwels, J. M. (1990). Analysis of visual search activity in solving tactical game problems. In D. Brogan (Ed.), Visual search (pp. 177-184). London: Taylor & Francis.
44. *Helsen, W., & Pauwels, J. M. (1992). A cognitive approach to visual search in sport. In D. Brogan (Ed.), Visual search 2 (pp. 379-388). London: Taylor & Francis.
45. *Helsen, W., & Starkes, J. L. (1999). A multidimensional approach to skilled perception and performance in sport. Applied Cognitive Psychology, 13, 1-27.
46. Henderson, A. J., Alexander, H., Haywood, A., Stapleton, P., Cooke, M., Patterson, E., et al. (2010). Promoting and providing expert guidance in work-intensive clinical settings. Vocations and Learning, 3, 141-156.
47. *Hermans, O. & Laarni, J. (2003). Searching information from screen maps. Paper presented at the 9th Scandinavian Research Conference on Geographical Information Science, Espoo.
48. Hidi, S. (2006). Interest: A unique motivational variable. Educational Research Review, 1, 69-82.
49. *Huestegge, L., Skottke, E.-M., Anders, S., Müsseler, J., & Debus, G. (2010). The development of hazard perception: Dissociation of visual orientation and hazard processing. Transportation Research Part F: Traffic Psychology and Behaviour, 13, 1-8.
50. Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Thousand Oaks: Sage.
51. Hyönä, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20, 172-176.
52. *Jarodzka, H., Scheiter, K., Gerjets, P., & van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20, 146-154.
53. Just, M. A., & Carpenter, P. A. (1984). Using eye fixations to study reading comprehension. In D. E. Kieras & M. A. Just (Eds.), New methods in reading comprehension research (pp. 151-182). Hillsdale: Erlbaum.
54. Kalyuga, S. (2007). Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review, 19, 509-539.
55. Kalyuga, S. (2008). Relative effectiveness of animated and static diagrams: An effect of learner prior knowledge. Computers in Human Behavior, 24, 852-861.
56. Kalyuga, S., Chandler, P., & Sweller, J. (2000). Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology, 92, 1-11.
57. *Kasarskis, P., Stehwien, J., Hickox, J., & Aretz, A. (2001). Comparison of expert and novice scan behaviors during FR flight. Paper presented at the 11th International Symposium on Aviation Psychology, Columbus, OH.
58. *Kato, T., & Fukuda, T. (2002). Visual search strategies of baseball batters: Eye movements during the preparatory phase of batting. Perceptual and Motor Skills, 94, 380-386.
59. *Konstantopoulos, P. (2009). Investigating drivers' visual search strategies: Towards an efficient training intervention. Unpublished doctoral thesis, University of Nottingham, Nottingham, England.
60. *Kristjanson, A. F., & Antes, J. R. (1989). Eye movement analysis of artists and nonartists viewing paintings. Visual Arts Research, 15, 21-30.
61. *Krupinski, E. A. (2005). Visual search of mammographic images: Influence of lesion subtlety. Academic Radiology, 12, 965-969.
62. Krupinski, E. A. (2010). Current perspectives in medical image perception. Attention, Perception, & Psychophysics, 72, 1205-1217.
63. *Krupinski, E. A., Tillack, A. A., Richter, L., Henderson, J. T., Bhattacharyya, A. K., Scott, K. M., et al. (2006). Eye-movement study and human performance using telepathology virtual slides. Implications for medical education and differences with experience. Human Pathology, 37, 1543-1556.
64. Kuhn, D. (2009). Do students need to be taught how to reason? Educational Research Review, 4, 1-6.
65. *Kundel, H. L., Nodine, C. F., Conant, E. F., & Weinstein, S. P. (2007). Holistic component of image perception in mammogram interpretation: Gaze-tracking study. Radiology, 242, 396-402.
66. *Laurent, E., Ward, P., Williams, A. M., & Ripoll, H. (2006). Expertise in basketball modifies perceptual discrimination abilities, underlying cognitive processes, and visual behaviours. Visual Cognition, 13, 247-271.
67. Lesgold, A., Rubinson, H., Feltovich, P., Glaser, R., Klopfer, D., & Wang, Y. (1988). Expertise in a complex domain: Diagnosing X-ray pictures. In M. T. H. Chi, R. Glaser, & M. J. Farr (Eds.), The nature of expertise (pp. 311-342). Hillsdale: Erlbaum.
68. *Litchfield, D., Ball, L. J., Donovan, T., Manning, D. J., & Crawford, T. (2008). Learning from others: Effects of viewing another person's eye movements while searching for chest nodules. In B. Sahiner & D. J. Manning (Eds.), Medical Imaging 2008: Image perception, observer performance, and technology assessment Vol. 6917 (pp. 691715-691715-9). Bellingham: SPIE.
69. *Liu X., Gale A. G., & Song, T. (2007). Detection of terrorist threats in air passenger luggage: Expertise development. Paper presented at the 41st Annual IEEE International Carnahan Conference, Ottawa.
70. Mann, D. T. Y., Williams, A. M., Ward, P., & Janelle, C. M. (2007). Perceptual-cognitive expertise in sport: A meta-analysis. Journal of Sport & Exercise Psychology, 29, 457-478.
71. *Manning, D., Ethell, S., Donovan, T., & Crawford, T. (2006). How do radiologists do it? The influence of experience and training on searching for chest nodules. Radiography, 12, 134-142.
72. Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York: Cambridge University Press.
73. Mayer, R. E., & Gallini, J. K. (1990). When is an illustration worth ten thousand words? Journal of Educational Psychology, 82, 715-726.
74. Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43-52.
75. *McRobert, A. P., Williams, A. M., Ward, P., & Eccles, D. W. (2009). Tracing the process of expertise in a simulated anticipation task. Ergonomics, 52, 474-483.
76. Meltzoff, A. N., Brooks, R., Shon, A. P., & Rao, R. P. N. (2010). "Social" robots are psychological agents for infants: A test of gaze following. Neural Networks, 23, 966-972.
77. Miller, G. (1956). The magical number seven, plus or minus two: Some limits on our capacity for information processing. Psychological Review, 63, 81-97.
78. *Moran, A., Byrne, A., & McGlade, N. (2002). The effects of anxiety and strategic planning on visual search behaviour. Journal of Sports Sciences, 20, 225-236.
79. Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91, 358-368.
80. *Moreno, F. J., Reina, R., Luis, V., & Sabido, R. (2002). Visual search strategies in experienced and inexperienced gymnastic coaches. Perceptual and Motor Skills, 95, 901-902.
81. *Moreno, F. J., Saavedra, J. M., Sabido, R., Luis, V., & Reina, R. (2006). Visual search strategies of experienced and nonexperienced swimming coaches. Perceptual and Motor Skills, 103, 861-872.
82. Nalanagula, D., Greenstein, J. S., & Gramopadhye, A. K. (2006). Evaluation of the effect of feedforward training displays of search strategy on visual search performance. International Journal of Industrial Ergonomics, 36, 289-300.
83. National Research Council (1992). Combining information: Statistical issues and opportunities for research. Washington, DC: National Academy of Sciences.
84. *Nodine, C. F., Kundel, H. L., Lauver, S. C., & Toto, L. C. (1996). Nature of expertise in searching mammograms for breast masses. Academic Radiology, 3, 1000-1006.
85. *Nodine, C. F., Mello-Thoms, C., Kundel, H. R., & Weinstein, S. P. (2002). Time course of perception and decision making during mammographic interpretation. American Journal of Roentgenology, 179, 917-923.
86. *North, J. S., Williams, A. M., Hodges, N., Ward, P., & Ericsson, K. A. (2009). Perceiving patterns in dynamic action sequences: Investigating the processes underpinning stimulus recognition and anticipation skill. Applied Cognitive Psychology, 23, 878-894.
87. Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38, 1-4.
88. Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (2003). Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities. Computers in Human Behavior, 19, 221-243.
89. Powers, W. T. (2005). Behavior: The control of perception. New Canaan: Benchmark.
90. *Raab, M., & Johnson, J. G. (2007). Expertise-based differences in search and option-generation strategies. Journal of Experimental Psychology: Applied, 13, 158-170.
91. *Reingold, E. M., Charness, N., Pomplun, M., & Stampe, D. M. (2001). Visual span in expert chess players. Psychological Science, 12, 48-55.
92. *Ripoll, H., Kerlirzin, Y., Stein, J.-F., & Reine, B. (1993). Decision making and visual strategies of boxers in a simulated problem-solving situation. In G. d'Ydewalle & J. van Rensbergen (Eds.), Perception and cognition: Advances in eye-movement research (pp. 141-147). Amsterdam: North-Holland.
93. *Ripoll, H., Kerlirzin, Y., Stein, J.-F., & Reine, B. (1995). Analysis of information processing, decision making, and visual strategies in complex problem solving sport situations. Human Movement Science, 14, 325-349.
94. Rosenthal, R., & DiMatteo, M. R. (2001). Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59-82.
95. *Savelsbergh, G. J. P., Williams, A. M., van der Kamp, J., & Ward, P. (2002). Visual search, anticipation and expertise in soccer goalkeepers. Journal of Sports Sciences, 20, 279-287.
96. *Savelsbergh, G. J. P., van der Kamp, J., Williams, A. M., & Ward, P. (2005). Anticipation and visual search behaviour in expert soccer goalkeepers. Ergonomics, 48, 1686-1697.
97. Scheiter, K., Gerjets, P., Huk, T., Imhof, B., & Kammerer, Y. (2009). The effects of realism in learning with dynamic visualizations. Learning and Instruction, 19, 481-494.
98. Schmidt, F. L., Oh, I.-S., & Hayes, T. L. (2009). Fixed- versus random-effects models in meta-analysis: Model properties and an empirical comparison of differences in results. British Journal of Mathematical and Statistical Psychology, 62, 97-128.
99. *Schriver, A. T., Morrow, D. G., Wickens, C. D., & Talleur, D. A. (2008). Expertise differences in attentional strategies related to pilot decision making. Human Factors, 50, 864-878.
100. *Singer, R. N., Cauraugh, J. H., Chen, D., Steinberg, G. M., & Frehlich, S. G. (1996). Visual search, anticipation, and reactive comparisons between highly-skilled and beginning tennis players. Journal of Applied Sport Psychology, 8, 9-26.
101. Spanjers, I. A. E., van Gog, T., & van Merriënboer, J. J. G. (2010). A theoretical analysis of how segmentation of dynamic visualizations optimizes students' learning. Educational Psychology Review, 22, 411-423.
102. Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4, 295-312.
103. Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. Berlin: Springer.
104. *Underwood, G., Crundall, D., & Chapman, P. (2002). Selective searching while driving: The role of experience in hazard detection and general surveillance. Ergonomics, 45, 1-12.
105. *Vaeyens, R., Lenoir, M., Williams, A. M., & Philippaerts, R. M. (2007). Mechanisms underpinning successful decision making in skilled youth players: An analysis of visual search behaviors. Journal of Motor Behavior, 39, 395-408.
106. *van Gog, T., Paas, F., & van Merriënboer, J. J. G. (2005). Uncovering expertise-related differences in troubleshooting performance: Combining eye movement and concurrent verbal protocol data. Applied Cognitive Psychology, 19, 205-221.
107. *Vickers, J. N. (1988). Knowledge structures of expert-novice gymnasts. Human Movement Science, 7, 47-72.
108. Vickers, J. N. (2007). Perception, cognition, and decision training. The quiet eye in action. Champaign: Human Kinetics.
109. *Vogt, S., & Magnussen, S. (2007). Expertise in pictorial perception: Eye-movement patterns and visual memory in artists and laymen. Perception, 36, 91-100.
110. *Ward, P., Williams, A. M., & Bennett, S. J. (2002). Visual search and biological motion perception in tennis. Research Quarterly for Exercise and Sport, 73, 107-112.
111. *Williams, A. M., & Davids, K. (1997). Assessing cue usage in performance contexts: A comparison between eye-movement and concurrent verbal report methods. Behavior Research Methods, Instruments, & Computers, 29, 364-375.
112. *Williams, A. M., & Davids, K. (1998). Visual search strategy, selective attention, and expertise in soccer. Research Quarterly for Exercise and Sport, 69, 111-128.
113. *Williams, A. M., & Elliott, D. (1999). Anxiety, expertise, and visual search strategy in karate. Journal of Sport & Exercise Psychology, 21, 362-375.
114. *Williams, A. M., Davids, K., Burwitz, L., & Williams, J. G. (1994). Visual search strategies in experienced and inexperienced soccer players. Research Quarterly for Exercise and Sport, 65, 127-135.
115. *Williams, A. M., Ward, P., Knowles, J. M., & Smeeton, N. J. (2002). Anticipation skill in a real-world task: Measurement, training, and transfer in tennis. Journal of Experimental Psychology: Applied, 8, 259-270.
116. *Wilson, M., McGrath, J., Vine, S., Brewer, J., Defriend, D., & Masters, R. (2010). Psychomotor control in a virtual laparoscopic surgery training environment: Gaze control parameters differentiate novices from experts. Surgical Endoscopy, 24, 2458-2464.
117. Wood, R. E. (1986). Task complexity: Definition of the construct. Organizational Behavior and Human Decision Processes, 37, 60-82.