Fight or unite: Investigating game genres for image tagging

Journal of the American Society for Information Science and Technology

Volumn 62, Issue 7, 2011, Pages 1311-1324

  Goh, Dion Hoe Lian ^a   Ang, Rebecca P ^b   Lee, Chei Sian ^a   Chua, Alton Y K ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL PERFORMANCE; COMPUTATIONAL TASK; CONTROL APPLICATIONS; HUMAN COMPUTATION; HUMAN INTELLIGENCE; QUALITY OF COMPUTATION; USERS' PERCEPTION;

QUALITY CONTROL;

USER INTERFACES;

EID: 79959374400     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.21478     Document Type: Article

References (57)

1. Barrington, L., Turnbull, D., O'Malley, D., &, Lanckriet, G., (2009). User-centered design of a social game to tag music. In Proceedings of the 2009 ACM Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD) (pp. 7-10). New York: ACM Press.
2. Bell, M., Reeves, S., Brown, B., Sherwood, S., McMillan, D., Ferguson, J., &, Chalmers, M., (2009). Eyespy: Supporting navigation through play. In Proceedings of the 2009 Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 123-132). New York: ACM Press.
3. Brockmyer, J.H., Fox, C.M., Curtiss, K.A., McBroom, E., Burkhart, K.M., &, Pidruzny, J.N., (2009). The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology, 45 (4), 624-634.
4. Casey, S., Kirman, B., &, Rowland, D., (2007). The gopher game: A social, mobile, locative game with user generated content and peer review. In Proceedings of the 2007 International Conference on Advances in Computer Entertainment Technology (pp. 9-16). New York: ACM Press. (Pubitemid 47274962)
5. Champion, E., (2003). Applying game design theory to virtual heritage environments. In Proceedings of the First International Conference on Computer Graphics and Interactive Techniques (pp. 273-274). New York: ACM Press.
6. Chung, E.K., &, Yoon, J.W., (2009). Categorical and specificity differences between user-supplied tags and search query terms for images. An analysis of Flickr tags and Web image search queries. Information Research, 14 (3), paper 408. Retrieved from
7. Csikszentmihalyi, M., (1990). Flow: The psychology of optimal experience. New York: Harper Perennial.
8. Datta, R., Joshi, D., Li, J., &, Wang, J.Z., (2008). Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys, 40 (2), article 5. Retrieved from
9. Davis, F.D., (1989). Perceived usefulness, PEOU and user acceptance of information technology. MIS Quarterly, 13 (4), 319-340.
10. Desurvire, H., &, Wiberg, C., (2008). Master of the game: Assessing approachability in future game design. In Proceedings of the Twenty-Sixth Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 3177-3182). New York: ACM Press.
11. Ding, Y., Jacob, E.K., Zhang, Z., Foo, S, Yan, E., George, N.L., &, Guo, L., (2009). Perspectives on social tagging. Journal of the American Society for Information Science and Technology, 60 (12), 2388-2401.
12. Ducheneaut, N., Yee, N., Nickell, E., &, Moore, R.J., (2006). "Alone Together?" Exploring the social dynamics of massively multiplayer online games. In Proceedings of the 2006 Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 407-416). New York: ACM Press. (Pubitemid 44032125)
13. Eakins, J.P., &, Graham, M.E., (1999). Content-based Image Retrieval - A report to the JISC Technology Applications Programme. Institute for Image Data Research, University of Northumbria at Newcastle. Retrieved from
14. Goh, D.H., Ang, R.P., &, Tan, H.C., (2008). Strategies for designing effective psychotherapeutic gaming interventions for children and adolescents. Computers in Human Behavior, 24 (5), 2217-2235.
15. Goh, D.H., Chua, A., Lee, C.S., &, Razikin, K., (2009). Resource discovery through social tagging: A classification and content analytic approach. Online Information Review, 33 (3), 568-583.
16. Goh, D.H., Lee, C.S., &, Chua, A.Y.K., (2010). Do games motivate mobile content sharing? In Proceedings of the 12th International Conference on Asia-Pacific Digital Libraries. Lecture Notes in Computer Science, 6102, 61-70.
17. Golder, S.A., &, Huberman, B.A., (2006). Usage patterns of collaborative tagging systems. Journal of Information Science, 32 (2), 198-208. (Pubitemid 43384497)
18. Ho, C.J., Chang, T.H., Lee, J.C., Hsu, J.Y.J., &, Chen, K.T., (2009). KissKissBan: A competitive human computation game for image annotation. In Proceedings of the 2009 ACM Special Interest Group on Knowledge Discovery and Data Mining (SIGKDD) (pp. 11-14). New York: ACM Press.
19. Hsu, C.L., &, Lu, H.P., (2007). Consumer behavior in online game communities: A motivational factor perspective. Computers in Human Behavior, 23 (3), 1642-1659.
20. Jaschke, R., Eisterlehner, F., Hotho, A., &, Stumme, G., (2009). Testing and evaluating tag recommenders in a live system. In Proceedings of the Third ACM Conference on Recommender Systems (pp. 369-372). New York: ACM Press.
21. Jennett, C., Cox, A.L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., &, Walton, A., (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66 (9), 641-661.
22. Johnson, D., &, Wiles, J., (2003). Effective affective user interface design in games. Ergonomics, 46 (13/14), 1332-1345. (Pubitemid 37474027)
23. Kankaanranta, M.H., &, Neittaanmäki, P., (2009). Design and use of serious games. Dordrecht, Netherlands: Springer.
24. Law, E., &, von Ahn, L., (2009). Input-agreement: A new mechanism for collecting data using human computation games. In Proceedings of the 2009 Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 1197-1206). New York: ACM Press.
25. Lazzaro, N., &, Keeker, K., (2004). What's my method? A game show on games. In Proceedings of the 2004 Conference on Human Factors in Computing Systems Extended Abstracts (pp. 1093-1094). New York: ACM Press.
26. Lee, C.S., Goh, D.H., Chua, A.Y.K., &, Ang, R.P., (2010). Indagator: Investigating perceived gratifications of an application that blends mobile content sharing with gameplay. Journal of the American Society for Information Science and Technology, 61 (6), 1244-1257.
27. Lee, C.S., Goh, D.H., Razikin, K., &, Chua, A., (2009). Tagging, sharing and the influence of personal experience. Journal of Digital Information, 10 (1). Retrieved from
28. Li, J., &, Wang, J.Z., (2003). Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25 (9), 1075-1088.
29. Li, J., &, Wang, J.Z., (2008). Real-time computerized annotations of pictures. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30 (6), 985-1002.
30. Lin, H.F., (2007). Effects of extrinsic and intrinsic motivation on employee knowledge sharing intentions. Journal of Information Science, 33 (2), 135-149.
31. Malone, T.W., (1981). Toward a theory of intrinsically motivating instruction. Cognitive Science, 4 (5), 333-369.
32. Melenhorst, M., Grootveld, M., van Setten, M., &, Veenstra, M., (2008). Tag-based information retrieval of video content. In Proceedings of the First International Conference on Designing Interactive User Experiences for TV and Video (pp. 31-40). New York: ACM Press.
33. O'Brien, H.L., &, Toms, E.G., (2008). What is user engagement? A conceptual framework for defining user engagement with technology. Journal of the American Society of Information Science and Technology, 59 (6), 938-955. (Pubitemid 351548473)
34. Pagulayan, R.J., Keeker, K., Wixon, D., Romero, R., &, Fuller, T., (2002). User-centered design in games. In, J. Jacko, &, A. Sears, (Eds.), Handbook for human-computer interaction in interactive systems. Mahwah, NJ: Lawrence Erlbaum Associates.
35. Pavlidis, T., (2009). Why meaningful automatic tagging of images is very hard. In Proceedings of the 2009 IEEE International Conference on Multimedia and Expo (pp. 1432-1435). Washington, DC: IEEE Press.
36. Pinelle D., Wong N., &, Stach T., (2008). Heuristic evaluation for games: Usability principles for video game design. In Proceedings of the 26th Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 1453-1462). New York: ACM Press.
37. Qin, H., Rau, P.P., &, Salvendy, G., (2010). Effects of different scenarios of game difficulty on player immersion. Interacting with Computers, 22 (3), 230-239.
38. Ravaja, N., Salminen, M., Saari, T., Laarni, J., Holopainen, J., &, Jarvinen, A., (2004). Emotional response patterns and sense of presence during video games: Potential criterion variables for game design. In Proceedings of the Third Nordic Conference on Human-Computer Interaction (pp. 339-347). New York: ACM Press.
39. Rieber, L.P., (1996). Seriously considering play: Designing interactive learning environments based on the blending of microworlds, simulations, and games. Educational Technology Research and Development, 44 (2), 45-58.
40. Robertson, S., Vojnovic, M., &, Weber, I., (2009). Rethinking the ESP Game. In Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (pp. 3937-3942). New York: ACM Press.
41. Saeed, K., &, Abdinnour-Helm, S., (2008). Examining the effects of information system characteristics and perceived usefulness on post adoption usage of information systems. Information & Management, 45 (6), 376-386.
42. Seloff, G.A., (1990). Automated access to NASA-JSC image archives. Library Trends, 38 (4), 682-696.
43. Siorpaes, K., &, Hepp, M., (2008). Games with a purpose for the Semantic Web. IEEE Intelligent Systems, 23 (3), 50-60. (Pubitemid 351751946)
44. Stephenson, W., (1967). The play theory of mass communication. Chicago: University of Chicago Press.
45. Stvilia, B., &, Jörgensen, C., (2008). User-generated collection-level metadata in an online photo-sharing system. Library & Information Science Research, 31 (1), 54-65.
46. Sun, H., &, Zhang, P., (2008). An exploration of affect factors and their role in user technology acceptance: Mediation and causality. Journal of the American Society for Information Science and Technology, 59 (8), 1252-1263.
47. Sweetser, P., &, Wyeth, P., (2005). GameFlow: A model for evaluating player enjoyment in games. Computers in Entertainment, 3 (3). Retrieved from
48. Tuite, K., Snavely, N., Hsiao, D.Y., Smith, A.M., &, Popovic, Z., (2010). Reconstructing the world in 3D: Bringing games with a purpose outdoors. In Proceedings of the Fifth International Conference on the Foundations of Digital Games (pp. 232-239). New York: ACM Press.
49. von Ahn, L., &, Dabbish, L., (2004). Labeling images with a computer game. In Proceedings of the 2004 Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 319-326). New York: ACM Press.
50. von Ahn, L., &, Dabbish, L., (2008). Designing games with a purpose. Communications of the ACM, 51 (8), 58-67.
51. von Ahn, L., Liu, R., &, Blum, M., (2006). Peekaboom: A game for locating objects in images. In Proceedings of the 2006 Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 55-64). New York: ACM Press. (Pubitemid 44032086)
52. Vorderer, P., Hartmann, T., &, Klimmt, C., (2003). Explaining the enjoyment of playing video games: The role of competition. In Proceedings of the Second International Conference on Computer Games. New York: ACM Press.
53. Walsh, G., &, Golbeck, J., (2010). Curator: A game with a purpose for collection recommendation. In Proceedings of the 2010 Annual Special Interest Group on Computer-Human Interaction at the Conference on Human Factors in Computing Systems (SIGCHI) (pp. 2079-2082). New York: ACM Press.
54. Westman, S., (2009). Image users' information needs and search behaviour. In, A. Goker, and, J. Davies, (Eds.), Information Retrieval: Searching in the 21st Century (pp. 63-83), Chippenham, Wiltshire, UK: John Wiley & Sons.
55. Woszczynski, A.B., Roth, P.L., &, Segars, A.H., (2002). Exploring the theoretical foundations of playfulness in computer interactions. Computers in Human Behavior, 18 (4), 369-388. (Pubitemid 34295568)
56. Yoon, J.W., (2009). Towards a user-oriented thesaurus for non-domain-specific image collections. Information Processing & Management, 45 (4), 452-468.
57. Zyda, M., (2005). From visual simulation to virtual reality to games. IEEE Computer, 38 (9), 25-32. (Pubitemid 41387800)