EmoPlayer: A media player for video clips with affective annotations

Interacting with Computers

Volumn 20, Issue 1, 2008, Pages 17-28

  Chen, Ling ^a,b   Chen, Gen Cai ^a   Xu, Cheng Zhe ^a   March, Jack ^b   Benford, Steve ^b  

^a ZHEJIANG UNIVERSITY   (China)

^b UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Affective computing; Media player; Multimedia annotation; User interface

Indexed keywords

SOFTWARE DESIGN; USER INTERFACES; VIDEO SIGNAL PROCESSING;

AFFECTIVE COMPUTING; MULTIMEDIA ANNOTATION; VIDEO CLIPS;

MULTIMEDIA SYSTEMS;

EID: 37249009151     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2007.06.003     Document Type: Article

References (33)

1. Abowd, G.D., Gauger, M., Lachenmann, A., 2003. The family video archive: an annotation and browsing environment for home movies. In: Proceedings of the 5th ACM SIGMM International Workshop on Multimedia Information Retrieval, pp. 1-8.
2. Barbieri, M., Mekenkamp, G., Ceccarelli, M., Nesvadba, J., 2001. The color browser: a content driven linear video browsing tool. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 627-630.
3. Bottoni, P., Civica, R., Levialdi, S., Orso, L., Panizzi, E., Trinchese, R., 2004. MADCOW: a multimedia digital annotation system. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 55-62.
4. Bulterman, D.C.A., 2003. Using SMIL to encode interactive, peer-level multimedia annotations. In: Proceedings of the 2003 ACM Symposium on Document Engineering, pp. 32-41.
5. Carter, S., Churchill, E., Denoue, L., Helfman, J., Nelson, L., 2004. Digital graffiti: public annotation of multimedia content. In: Proceedings of CHI'04 Extended Abstracts on Human Factors in Computing Systems, pp. 1207-1210.
6. Chan, C.H., Jones, G.J.F., 2005. Affect-based indexing and retrieval of films. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, pp. 427-430.
7. Christel, M.G., Warmack, A.S., 2001. The effect of text in storyboards for video navigation. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 1409-1412.
8. Cockton G. From doing to being: bringing emotion into interaction. Interacting with Computers 14 2 (2002) 89-92
9. Costa, M., Correia, N., Guimarães, N., 2002. Annotations as multiple perspectives of video content. In: Proceedings of the Tenth ACM International Conference on Multimedia, pp. 283-286.
10. Cowie R., Douglas-Cowie E., Tsapatsoulis N., Votsis G., Kollias S., Fellenz W., and Taylor J.G. Emotion recognition in human-computer interaction. IEEE Signal Processing Magazine 18 1 (2001) 32-80
11. Craggs, R., Wood, M.M., 2004. A categorical annotation scheme for emotion in the linguistic content of dialogue. In: Proceedings of the Affective Dialogue Systems, Tutorial and Research Workshop, pp. 89-100.
12. Crockford C., and Agius H. An empirical investigation into user navigation of digital video using the VCR-like control set. International Journal of Human-Computer Studies 64 4 (2006) 340-355
13. Davidoff L.L. Introduction to Psychology. 2nd ed. (1980), McGraw-Hill, New York
14. Ekman P. Emotion in the Human Face (1982), Cambridge University Press, Cambridge
15. Fogli, D., Fresta, G., Mussio, P., 2004. On electronic annotation and its implementation. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 98-102.
16. Költringer, T., Tomitsch, M., Kappel, K., Kalbeck, D., Grechenig, T., 2005. In: Implications for designing the user experience of DVD menus, Proceedings of CHI'05 Extended Abstracts on Human Factors in Computing Systems, pp. 1565-1568.
17. Kwon, O.W., Chan, K., Hao, J., Lee, T.W., 2003. Emotion recognition by speech signals. In: Proceedings of the 8th European Conference on Speech Communication and Technology, pp. 125-128.
18. Liu, H., Lieberman, H., Selker, T., 2003a. A model of textual affect sensing using real-world knowledge. In: Proceedings of the 8th International Conference on Intelligent User Interfaces, pp. 125-132.
19. Liu, H., Selker, T., Lieberman, H., 2003b. Visualizing the affective structure of a text document. In: Proceedings of CHI'03 Extended Abstracts on Human Factors in Computing Systems, pp. 740-741.
20. Murray I.R., and Arnott J.L. Toward the simulation of emotion in synthetic speech: a review of the literature on human vocal emotion. Journal of the Acoustical Society of America 93 2 (1993) 1097-1108
21. Norman, D.A., 2001. DVD menu design: the failures of web design recreated yet again. Available at: http://www.useit.com/alertbox/20011209.html (last retrieved 16 October 2006).
22. Partala T., and Surakka V. The effects of affective interventions in human-computer interaction. Interacting with Computers 16 2 (2004) 295-309
23. Peter C., and Herbon A. Emotion representation and physiology assignments in digital systems. Interacting with Computers 18 2 (2006) 139-170
24. Picard R.W., and Klein J. Computers that recognise and respond to user emotion: theoretical and practical implications. Interacting with Computers 14 2 (2002) 141-169
25. Qian, Y., Feijs, L.M.G., 2004. Exploring the potentials of combining photo annotating tasks with instant messaging fun. In: Proceedings of the 3rd International Conference on Mobile and Ubiquitous Multimedia, pp. 11-17.
26. Ramos, G., Balakrishnan, R., 2003. Fluid interaction techniques for the control and annotation of digital video. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, pp. 105-114.
27. Russell J.A. Culture and the categorization of emotions. Psychological Bulletin 110 3 (1991) 426-450
28. Thompson W.F., Schellenberg E.G., and Husain G. Decoding speech prosody: do music lessons help?. Emotion 4 1 (2004) 46-64
29. Tokitomo, A., Kazuhiro, N., Hiroshi, Y., 2004. Effect of facial colors on humanoids in emotion recognition using speech. In: Proceedings of the 13th IEEE International Workshop on Robot and Human Interactive Communication, pp. 59-64.
30. Valdez P., and Mehrabian A. Effects of color on emotions. Journal of Experimental Psychology: General 123 4 (1994) 394-409
31. Wang, H.C., Ahuja, N., 2003. Facial expression decomposition. In: Proceedings of the 9th IEEE International Conference on Computer Vision, pp. 958-965.
32. Williams M.A., Moss S.A., Bradshaw J.L., and Mattingley J.B. Look at me, I'm smiling: visual search for threatening and nonthreatening facial expressions. Visual Cognition 12 1 (2005) 29-50
33. Xia, F., Wang, H., Fu, X.L., Zhao, J.Y., 2005. An XML-based implementation of multimodal affective annotation. In: Proceedings of the 1st International Conference on Affective Computing and Intelligent Interaction, 535-541.