The cognitive effectiveness of subtitle processing

Media Psychology

Volumn 13, Issue 3, 2010, Pages 243-272

  Perego, Elisa ^a   del Missier, Fabio ^a   Porta, Marco ^b   Mosconi, Mauro ^b  

^a UNIVERSITY OF TRIESTE   (Italy)

^b UNIVERSITY OF PAVIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77956621020     PISSN: 15213269     EISSN: None     Source Type: Journal    
DOI: 10.1080/15213269.2010.502873     Document Type: Article

References (81)

1. Banbury, S., & Berry, D. C. (1998). The disruption of speech and office-related tasks by speech and office noise. British Journal of Psychology, 89, 499-517.
2. Bergen, L., Grimes, T., & Potter, D. (2005). How attention partitions itself during simultaneous message presentations. Human Communication Research, 31, 311-336.
3. Beymer, D., Russell, D. M., & Orton, P. Z. (2007, September). An eye tracking study of how font size, font type, and pictures influence online reading. Paper presented at the International Conference Interact 2007, Socially Responsible Interaction, Rio De Janeiro, Brazil.
4. Broadbent, D. E. (1958). Perception and communication. Oxford, UK: Pergamon Press.
5. Brondeel, H. (1994). Teaching subtitling routines. Meta, 39, 26-33.
6. Brown, V., Huey, D., & Findlay, J. M. (1997). Face detection in peripheral vision: Do faces pop out? Perception, 26, 1555-1570.
7. Chaparro, B. S., Shaikh, A. D., & Baker, J. R. (2005). Reading online text with a poor layout: Is performance worse? [Electronic version]. Usability News, 7. Retrieved July 30, 2010, from http://psychology.wichita.edu/surl/usabilitynews/71/page_setting.html
8. Chiaro, D., Heiss, C., & Bucaria, C. (Eds.). (2008). Between text and image. Updating research in screen translation. Amsterdam, the Netherlands: John Benjamins.
9. Coltheart, M. (Ed.). (1987). Attention and performance II: The psychology of reading. London: Lawrence Erlbaum.
10. de Linde, Z., & Kay, N. (1999a). Processing subtitles and film images. Hearing vs. deaf viewers. The Translator, 5, 45-60.
11. de Linde, Z., & Kay, N. (1999b). The semiotics of subtitling. Manchester, UK: St. Jerome Publishing.
12. Del Missier, F., Mäntylä, T., & Bruine de Bruin, W. (2010). Executive functions in decision making: An individual differences approach. Thinking & Reasoning, 16, 69-97.
13. Díaz Cintas, J. (2001) La traducción audiovisual: El subtitulado [Audiovisual translation: Subtitling]. Salamanca, Spain: Ediciones Almar.
14. Díaz Cintas, J. (2003) Teoría y prática de la subtitulación. Inglés-Español [Theory and practice of subtitling: English-Spanish]. Barcelona, Spain: Ariel Cine.
15. Díaz Cintas, J., & Remael, A. (2007). Audiovisual translation: Subtitling. Manchester, UK: St. Jerome.
16. Drew, D. G., & Grimes, T. (1987). Audio-visual redundancy and TV news recall. Communication Research, 14, 452-461.
17. Duchowski, A. (2007). Eye tracking methodology. Theory and practice. London: Springer-Verlag.
18. d'Ydewalle, G., & De Bruycker, W. (2007). Eye movements of children and adults while reading television subtitles. European Psychologist, 12, 196-205.
19. d'Ydewalle, G., & Gielen, I. (1992). Attention allocation with overlapping sound, image, and text. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 415-427). New York: Springer-Verlag.
20. d'Ydewalle, G., Muylle, P., & Van Rensbergen, J. (1985). Attention shifts in partially redundant information situations. In R. Groner, G. W. McConkie, & C. Menz (Eds.), Eye movements and human information processing (pp. 375-384). Amsterdam, the Netherlands: Elsevier Science.
21. d'Ydewalle, G., & Pavakanun, U. (1995). Acquisition of a second/foreign language by viewing a television program. In P. Winterhoff-Spurk (Ed.), Psychology of media in Europe: The state of the art, perspectives for the future (pp. 51-64). Opladen, Germany: Westdeutscher Verlag.
22. d'Ydewalle, G., & Pavakanun, U. (1997). Could enjoying a movie lead to language acquisition? In P. Winterhoff-Spurk, & T. Van der Voort (Eds.), New horizons in media psychology (pp. 145-155). Opladen, Germany: Westdeutscher Verlag.
23. d'Ydewalle, G., Praet, C., Verfaillie, K., & Van Rensbergen, J. (1991). Watching subtitled television. Automatic reading behaviour. Communication Research, 18, 650-666.
24. d'Ydewalle, G., & Van de Poel, M. (1999). Incidental foreign language acquisition by children watching subtitled television programs. Journal of Psycholinguistic Research, 28, 227-244.
25. d'Ydewalle, G., & Van Rensbergen, J. (1989). Developmental studies of text-picture interactions in the perception of animated cartoons with text. In H. Mandl & J. R. Levin (Eds.), Knowledge acquisition from text and pictures, (pp. 233-248). Amsterdam, the Netherlands: Elsevier Science.
26. d'Ydewalle, G., Van Rensbergen, J., & Pollet, J. (1987). Reading a message when the same message is available auditorily in another language: The case of subtitling. In J. K. O'Regan, & A. Lévy-Schoen (Eds.), Eye movements: From psychology to cognition (pp. 313-321). Amsterdam, the Netherlands: Elsevier Science.
27. Ferreira, F., & Henderson J. M. (1995). Reading processes during syntactic analysis and reanalysis. In J. M. Henderson, M. Singer, & F. Ferreira (Eds.), Reading and language processing (pp. 119-147). Mahwah, NJ: Lawrence Erlbaum.
28. Fisher, D. F., Karsh, R., Breitenbach, F., & Barnette, B. D. (1983). Eye movements and picture recognition: Contribution or embellishment? In R. Groner, C. Menz, D. E. Fisher, & R. A. Monty (Eds.), Eye movements and psychological functions: International views (pp. 193-210). Mahwah, NJ: Lawrence Erlbaum.
29. Fox, J. R., Park, B., & Lang, A. (2007). When available resources become negative resources. The effects of cognitive overload on memory sensitivity and criterion bias. Communication Research, 34, 277-296.
30. Friedman, N. P., Haberstick, B. C., Willcutt, E. G., Miyake, A. Young, S. E., Corley, R. P., & Hewitt, J. K. (2007). Greater attention problems during childhood predict poorer executive functioning in late adolescence. Psychological Science, 18, 893-900.
31. Gielen, M. (1988). Perceptie en ondertitles: de parafoveale en perifere informatieverwerking van ondertitles [Perception and subtitles: The parafoveal and peripheral information processing of subtitles]. Leuven, the Netherlands: University of Leuven.
32. Gottlieb, H. (1992). Subtitling. A new university discipline. In C. Dollerup, & A. Loddegaard (Eds.), Teaching translation and interpreting 1. Training, talent and experience. Papers from the first language international conference (pp. 161-170). Amsterdam, the Netherlands: John Benjamins.
33. Gottlieb, H. (1994). Subtitling. Diagonal translation. Perspectives: Studies in Translatology, 2, 101-121.
34. Gottlieb, H. (1998). Subtitling. In Baker, M. (Ed.) Routledege encyclopaedia of translation studies (pp. 244-248). London: Routledge.
35. Grillo, V., & Kawin, B. (1981). Reading at the moviemovies: Subtitles, silence and the structure of the brain. Post Script: Essays in Film and the Humanities, 1, 25-32.
36. Grimes, T. (1991). Mild auditory-visual dissonance in television news may exceed viewer attentional capacity. Human Communication Research, 18, 268-298.
37. Ivarsson, J., & Carroll, M. (1998). Subtitling. Smrishamn, Sweden: Trans Edit HB.
38. Kano, F., & Tomonaga, M. (2009). How chimpanzees look at pictures: A comparative eye-tracking study. Proceedings of the Royal Society B, 276. doi:1098/rspb.2008. 1811
39. Kano, F., & Tomonaga, M. (2010). Face scanning in chimpanzees and humans: Continuity and discontinuity. Animal Behaviour, 79, 227-235.
40. Karamitroglou, F. (1998). A proposed set of subtitling standards in Europe. [Electronic version]. Translation Journal, 2. Retrieved July 30, 2010, from http://www.accurapid.com/journal/04stndrd.htm
41. Koolstra, C. M., & Beentjes, J. W. (1999). Children's vocabulary acquisition in a foreign language through watching subtitled TV programs at home. Educational Technology Research and Development, 47, 51-60.
42. Koolstra, C. M., Peeters, A. L., & Spinhof, H. (2002). The pros and cons of dubbing and subtitling. European Journal of Communication, 17, 325-354.
43. Koolstra, C. M., Van der Voort, T. H. A., & d'Ydewalle, G. (1999). Lengthening the presentation time of subtitles on television: Effects on children's reading time and recognition. Communications, 24, 407-422.
44. Kothari, B. (1998). Film songs as continuing education: Same language subtitling for literacy. Economic and Political Weekly, 33, 2507-2510.
45. Kothari, B. (2000). Same language subtitling on Indian television: Harnessing the power of popular culture for literacy. In K. Wilkins (Ed.), Redeveloping communication for social change: Theory, practice and power (pp. 135-146). New York: Rowman & Littlefield.
46. Kothari, B., & Takeda, J. (2000). Same language subtitling for literacy: Small change for colossal gains. In S. C. Bhatnagar, & R. Schware (Eds.), Information and communication technology in development (pp. 176-186). New Delhi: Sage.
47. Krause, W. (1982). Eye fixations and three-term series problems, or: Is there evidence for task independent information units? In R. Groner, & P. Fraisse (Eds.), Cognition and eye movements (pp. 122-138). Berlin: Deutscher Verlag der Wissenschaften.
48. Kruger, J.-L. (2008). Subtitler training as part of a general training programme in the language professions. In J. Díaz Cintas (Ed.) The didactics of audiovisual translation (pp. 71-87). Amsterdam, the Netherlands: John Benjamins.
49. LaBerge, D., & Samuels, S. J. (1974). Toward a theory of automatic information processing in reading. Cognitive Psychology, 6, 293-323.
50. Lang, A. (1995) Defining audio/video redundancy from a limited capacity information processing perspective. Communication Research, 22, 86-115.
51. Lang, A. (2000). The limited capacity model of mediated message processing. Journal of Communication, 50, 46-70.
52. Lang, A. (2001). Defining audio/video redundancy from a limited-capacity information processing perspective. Communication Research, 22, 86-115.
53. Lang, A., Potter, R, & Bolls, P. (1999). Something for nothing: Is visual encoding automatic? Media Psychology, 1, 145-164.
54. Lautenbacher, O. P. (2009, April). From still pictures to moving pictures. When eye-tracking meets subtitling. Paper presented at the International Conference Eye-to-IT Conference, Copenhagen, Denmark.
55. Liversedge, S. P., & Findlay, J. M. (2000). Saccadic eye movements and cognition. Trends in Cognitive Science, 4, 6-14.
56. Logan, G. (1997). Automaticity and reading: Perspectives from the instance theory of automatization. Reading & Writing Quarterly, 13, 123-146.
57. Ludwig, T. (2002). Psych Inquiry [computer software]. New York: Worth.
58. Luyken, G.-M., Herbst, T., Langham-Brown, J., Reid, H., & Spinhof, H. (1991). Overcoming language barriers in television. Dubbing and subtitling for the European audience. Manchester, UK: The European Institute for the Media.
59. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex ''frontal lobe'' tasks: A latent variable analysis. Cognitive Psychology, 41, 49-100.
60. Paivio, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart, and Winston.
61. Paivio, A. (1986). Mental representations: A dual coding approach. Oxford, UK: Oxford University Press.
62. Perego, E. (2008a). What would we read best? Hypotheses and suggestions for the location of line breaks in film subtitles. The Sign Language Translator and Interpreter, 2, 35-63.
63. Perego, E. (2008b). Subtitles and line-breaks: Towards improved readability. In D. Chiaro, C. Heiss, & C. Bucaria (Eds.), Between text and image. Updating research in screen translation (pp. 211-223). Amsterdam, the Netherlands: John Benjamins.
64. Perfetti, C. A. (1985). Reading ability. New York: Oxford Press.
65. Perfetti, C. A., & Marron, M. A. (1998). Learning to read: Literacy acquisition by children and adults. In D. A. Wagner (Ed.), Advances in adult literacy research and development (pp. 89-138). Philadelphia: Hampton Press.
66. Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32, 3-25.
67. Praet, C., Verfaillie, K., De Graef, P., Van Rensbergen, J., & d'Ydewalle, G. (1990). A one line text is not half a two line text. In R. Groner, G. d'Ydewalle, & R. Parham (Eds.), From eye to mind: Information acquisition in perception, search, and reading (pp. 205-213). Amsterdam, the Netherlands: Elsevier Science.
68. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372-422.
69. Rayner, K., & Morris, R. (1990). Do eye movements reflect higher order processes in reading? In R. Groner, G. d'Ydewalle, & R. Parham (Eds.), From eye to mind: Information acquisition in perception, search and reading (pp. 179-190). Amsterdam, the Netherlands: Elsevier Science.
70. Rayner, K., & Pollatsek, A. (1987). Eye movements in reading: A tutorial review. In M. Coltheart (Ed.), Attention and performance II: The psychology of reading (pp. 327-362). London: Lawrence Erlbaum.
71. Rayner, K., & Pollatsek, A. (1989). The psychology of reading. Englewood Cliffs, NJ: Prentice Hall.
72. Rayner, K., & Sereno, S. C. (1994). Eye movements in reading. Psycholinguistic studies. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 57-81). San Diego, CA: Academic Press.
73. Rundle, C. (2000). Using subtitles to teach translation. In R. M. Bollettieri Bosinelli, C. Heiss, M. Soffritti, & S. Bernardini (Eds.), La traduzione multimediale: Quale traduzione per quale testo? [Multimedia translation: What translation for what text?] (pp. 167-181). Bologna, Italy: CLUEB.
74. Schneider, W., Eschmann, A., & Zuccolotto, A. (2002). E-Prime reference guide. Pittsburgh, PA: Psychology Software Tools.
75. Schyns, P. G., & Oliva, A. (1994). From blobs to boundary edges: Evidence for time and spatial scale dependent scene recognition. Psychological Science, 5, 195-200.
76. Stanovich, K. E. (1990). Concepts in developmental theories of reading skill: Cognitive resources, automaticity, and modularity. Developmental Review, 10, 72-100.
77. Theeuwes, J., & Van der Stigchel, S. (2006). Faces capture attention: Evidence from inhibition of return. Visual Cognition, 13, 657-665.
78. Tomonaga, M., & Imura, T. (2009). Faces capture the visuospatial attention of chimpanzees (Pan troglodytes): Evidence from a cueing experiment [Electronic version]. Frontiers in Zoology, 6. Retrieved July 30, 2010, from http://www.frontiersinzoology.com/content/6/1/14 (doi:10.1186/1742-9994-6-14)
79. Treisman, A. (1968). Strategies and models of visual attention. Psychological Review, 84, 127-190.
80. Wickens, C. D., & McCarley, J. S. (2008). Applied attention theory. Boca Raton, FL: CRC Press.
81. Zhou, S. (2004). Effects of visual intensity and audiovisual redundancy in bad news. Media Psychology, 6, 237-256.