Member activities and quality of tags in a collection of historical photographs in Flickr

Journal of the American Society for Information Science and Technology

Volumn 61, Issue 12, 2010, Pages 2477-2489

  Stvilia, Besiki ^a   Jörgensen, Corinne ^a  

^a FLORIDA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPLEX TERM; CONTROLLED VOCABULARY; KNOWLEDGE ORGANIZATION SYSTEMS; LIBRARY OF CONGRESS; NAMED ENTITIES; NOUN PHRASE; SUBJECT HEADINGS;

PHOTOGRAPHY;

METADATA;

EID: 78449275501     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.21432     Document Type: Article

References (75)

1. Agirre, E., Ansa, O., Hovy, E., &, Martinez, D., (2000, August). Enriching very large ontologies using the WWW. Paper presented at the ECAI Ontology Learning Workshop, Berlin, Germany. Retrieved April 26, 2010, from
2. Ames, M., &, Naaman, M., (2007) Why we tag: Motivations for annotation in mobile and onlinemedia. In, B. Begole, &, S. Payne, (Eds.), Proceedings of the Special Interest Group on Computer"Human Interaction (SIGCHI) (pp. 971 - 980). New York: ACM Press.
3. Bailey, K., (1994) Methods of social research (4th ed.). New York: The Free Press.
4. Bar-Iian, J., Zhitomirsky-Geffet, M., Miller, Y., &, Shoham, S., (2010) The effects of background information and social interaction on image tagging. Journal of American Society for Information Science and Technology, 61 (5), 940 - 951.
5. Blair, D.C., (1996) STAIRS redux: Thoughts on the STAIRS evaluation. Journal of the American Society for Information Science, 47 (1), 4 - 22.
6. Brooks, T.A., (1993) All the right descriptors: A test of the strategy of unlimited aliasing. Journal of the American Society for Information Science, 44 (3), 137 - 147.
7. Buckland, M., (1999) Vocabulary as a central concept in library and information science. In, T. Arpanac, et al. (Eds.), Proceedings of the Third International Conference on Conceptions of Library and Information Science (pp. 3 - 12). Zagreb, Croatia: Lokve. Retrieved June 28, 2009, from
8. Chen, H., Yim, T., Fye, D., &, Schatz, B., (1995) Automatic thesaurus generation for an electronic community system. Journal the American Society for Information Science, 46 (3), 175 - 193.
9. Choi, Y., (2008) Analyzing image searching on the Web: How do undergraduates search and use visual information? In Final Report, 2008 OCLC/ALISE Library and Information Science Research Grant Project. Retrieved August 17, 2009, from
10. Chung, E., &, Yoon, J., (2008) Categorical and specificity differences between user-supplied tags and search query terms for images. An analysis of Flickr tags and Web image search queries. Information Research, 14 (3). Retrieved March 17, 2010, from
11. Cosley, D., Akey, K., Alson, B., Baxter, J., Broomfield, M., &, Lee, S., et al. (2009). Using technologies to support reminiscence. Proceedings of the 2009 British Computer Society Conference on Human-Computer Interaction (pp. 480 - 484). Swinton, United Kingdom: British Computer Society.
12. Cosley, D., Frankowski, D., Terveen, L., &, Riedl, J., (2007). Suggestbot: Using intelligent task routing to help people find work in Wikipedia. In, A. Puerta, &, T. Lau, (Eds.), Proceedings of the 12th International Conference on Intelligent User Interfaces (pp. 28 - 31). New York: ACM Press.
13. Croft, W., &, Cruse, D., (2004) Cognitive linguistics (pp. 82 - 86). Cambridge, MA: Cambridge University Press.
14. Crowston, K., &, Scozzi, B., (2004, April). Coordination practices for bug fixing within FLOSS development teams. Paper presented at the First International Workshop on Computer Supported Activity Coordination (CSAC 2004), Porto, Portugal. Retrieved April 26, 2010, from
15. Cunningham, S., &, Masoodian, M., (2006) Looking for a picture: An analysis of everyday image information searching. In, G. Marchionini, &, M. Nelson, (Eds.), Proceedings of the Sixth ACM/IEEE-CS Joint Conference on Digital Libraries (pp. 198 - 199). New York: ACM Press.
16. Dervin, B., (1992). From the mind's eye of the user: The sense-making qualitative-quantitative methodology. In, J.D. Glazier, &, R. Powell, (Ed.), Qualitative research in information management (pp. 61 - 84). Englewood, CO: Libraries Unlimited.
17. Efthimiadis, E.N., (2000) Interactive query expansion: A user-based evaluation in a relevance feedback environment. Journal of the American Society for Information Science, 51 (11), 989 - 1003.
18. Engestrom, Y., (2000) Activity theory as a framework for analyzing and redesigning work. Ergonomics, 43 (7), 960 - 974.
19. Flickr Blog. (2009). Retrieved June 28, 2009, from
20. Furnas, G., Landauer, T.K., Gomez, L.M., &, Dumais, S., (1987) The vocabulary problem in human"system communication. Communications of the ACM, 30 (11), 964 - 971.
21. Garfinkel, H., (1967) Studies in ethnomethodology. Englewood Cliffs, NJ: Prentice-Hall.
22. Gasser, L., (1986) The integration of computing and routine work. ACM Transactions on Office Information Systems, 4 (3), 225 - 250.
23. Gemmell, J., Bell, G., &, Lueder, R., (2006) MyLifeBits: A personal database for everything. Communications of the ACM Archive, 49 (1), 88 - 95.
24. Golder, S., &, Huberman, B., (2006) Usage patterns of collaborative tagging systems. Journal of Information Science, 32 (2), 198 - 208.
25. Greenberg, J., (2001a) Optimal query expansion (QE) processing methods with semantically encoded structures thesauri terminology. Journal of the American Society for Information Science and Technology, 52 (6), 487 - 498.
26. Greenberg, J., (2001b) Quantitative categorical analysis of metadata elements in image applicable metadata schemas. Journal of the American Society for Information Science and Technology, 52, 917 - 914.
27. Greenberg, J., (2002). Semantic web construction: An inquiry of authors' views on collaborative metadata generation. In Proceeding of the International Conference on Dublin Core and Metadata for e-Communities (pp. 45 - 52). Florence, Italy: Firenze University Press. Retrieved April 26, 2010, from
28. Hersh, W., Pentecost, J., &, Hickam, D., (1996) A task-oriented approach to information retrieval evaluation. Journal of the American Society for Information Science, 47 (1), 50 - 56. (Pubitemid 126582655)
29. Hjrland, B., (2008) What is knowledge organization (KO) ? Knowledge Organization, 35 (2/3), 86 - 101.
30. Jörgensen, C., (1995a). Classifying images: Criteria for grouping as revealed in a sorting task. In, R. Schwartz, (Ed.), Proceedings of the 6th ASIS SIG/CR Classification Research Workshop: Vol. 6. Advances in classification research (pp. 45 - 64). ASIS Monograph Series. Medford, NJ: Information Today.
31. Jörgensen, C., (1995b). Image attributes: An investigation. Unpublished doctoral thesis, Syracuse University, NY.
32. Jörgensen, C., (1996, October). Indexing images: Testing an image description template. Paper presented at the 59th Annual Meeting of the American Society for Information Science, Baltimore, MD.
33. Jörgensen, C., (1997). Challenges in image classification. In, E. Efthimiadis, (Ed.), Proceedings of the 8th ASIS SIG/CR Classification Research Workshop: Vol. 8. Advances in classification research (pp. 92 - 98). ASIS Monograph Series. Medford, NJ: Information Today.
34. Jörgensen, C., (1998) Image attributes in describing tasks: An investigation. Information Processing & Management, 34 (2/3), 161 - 174.
35. Jörgensen, C., &, Jörgensen, P., (2002, January 22). Testing a vocabulary for image indexing and ground truthing. In, G.B. Beretta, &, R. Schettini, (Eds.), Internet Imaging III: Vol. 4672. Proceedings of SPIE (pp. 212 - 215). Bellingham, WA: SPIE.
36. Jörgensen, C., Stvilia, B., &, Jörgensen, P., (2008, October). Is there a role for controlled vocabulary in taming tags? Paper presented at the 19th Workshop of the American Society for Information Science and Technology Special Interest Group in Classification Research, Columbus, OH.
37. Klavans, J.L., Sheffield, C., Abels, E., Lin, J., Passonneau, R., &, Sidhu, T., et al. (2009) Computational linguistics for metadata building (CLiMB): Using text mining for the automatic identification, categorization, and disambiguation of subject terms for image metadata. Multimedia Tools and Applications, 42 (1), 115 - 138.
38. Kuutti, K., (1991). Activity theory and its applications to information systems research and development. In, H.-E. Nissen, (Ed.), Information systems research (pp. 529 - 549). Amsterdam, the Netherlands: Elsevier Science.
39. Lakoff, G., (1988). Cognitive semantics. In, U. Eco, M. Santambrogio, &, P. Violi, (Eds.), Meaning and mental representations (pp. 119 - 154). Bloomington, IN: Indiana University Press.
40. Lancaster, F., (2000) Indexing and abstracting in theory and practice. Champaign: University of Illinois, Graduate School of Library and Information Science.
41. Leontiev, A., (1978) Activity, consciousness, personality. Englewood Cliffs, NJ: Prentice-Hall.
42. Lin, X., Beaudoin, J.E., Bui, Y., &, Desai, K., (2006) Exploring characteristics of social classification. In, J. Furner, &, J.T. Tennis, (Eds.), Proceedings of the 17th ASIS&T Classification Research Workshop: Vol. 17. Advances in classification research. Medford, NJ: Information Today. Retrieved August 17, 2009, from
43. Mathes, A., (2004) Folksonomies: Cooperative classification and communication through shared metadata. Retrieved August 17, 2009, from
44. Medelyan, O., &, Milne, D., (2008, April). Augmenting domain-specific thesauri with knowledge from Wikipedia. Paper presented at the NZ Computer Science Research Student Conference (NZCSRSC 2008), Christchurch, New Zealand. Retrieved April 26, 2010, from.
45. Nov, O., Naaman, M., &, Ye, C., (2010) Analysis of participation in an online photo-sharing community: A multidimensional perspective. Journal of American Society for Information Science and Technology, 61 (3), 555 - 566.
46. Perez, J., (2009) Google rolls out semantic search capabilities. PCWorld. Retrieved August 17, 2009, from
47. Porter, M., (1980) An algorithm for suffix stripping. Program, 14, 130 - 137.
48. Rorissa, A., &, Iyer, H., (2008) Theories of cognition and image categorization: What category labels reveal about basic level theory. Journal of the American Society for Information Science and Technology, 59 (9), 1383 - 1392.
49. Rosch, E., (1973) Natural categories. Cognitive Psychology, 4, 328 - 350.
50. Rosch, E., (1978). Principles of categorization. In, E. Rosch, &, B. Lloyd, (Eds.), Cognition and categorization (pp. 27 - 48). Hillsdale, NJ: Erlbaum.
51. Rosch, E., Mervis, C., Gray, W., Johnson, D., &, Boyes-Braem, P., (1976) Basic objects in natural categories. Cognitive Psychology, 8 (3), 382 - 439.
52. Scacchi, W., (2005) Socio-technical interaction networks in free/open source software development processes. In, S.T. Acua, &, N. Juristo, (Ed.), Software process modeling. New York: Springer.
53. Schmidt, K., &, Bannon, L., (1993) Taking CSCW seriously: Supporting articulation work. Computer Supported Cooperative Work, 1 (1"2), 7 - 40.
54. Schmitz, P., (2006, May). Inducing ontology from Flickr tags. Paper presented at the World Wide Web 2006 (WWW2006): Collaborative Web Tagging Workshop. Retrieved April 26, 2010, from
55. Shatford, S., (1986) Analyzing the subject of a picture: A theoretical approach. Cataloging and Classification Quarterly, 6 (3), 39 - 62.
56. Soergel, D., (1974) Indexing languages and thesauri: Construction and maintenance. New York: Wiley.
57. Springer, M., Dulabahn, B., Michel, P., Natanson, B., Reser, D., &, Woodward, D., et al. (2008) For the common good: The Library of Congress Flickr pilot project. Retrieved August 19, 2009, from
58. Strong, D., Lee, Y., &, Wang, R., (1997) Data quality in context. Communications of the ACM, 40 (5), 103 - 110.
59. Stvilia, B., &, Gasser, L., (2008) Value based metadata quality assessment. Library and Information Science Research, 30 (1), 67 - 74.
60. Stvilia, B., Gasser, L., Twidale, M., Shreeves, S., &, Cole, T., (2004). Metadata quality for federated collections. In, S. Chengulur-Smith, L. Raschid, J. Long, &, C. Seko, (Eds.), Proceedings of the International Conference on Information Quality (pp. 111 - 125). Cambridge, MA: MITIQ.
61. Stvilia, B., Gasser, L., Twidale, M.B., &, Smith, L.C., (2007) A framework for information quality assessment. Journal of the American Society for Information Science and Technology, 58 (12), 1720 - 1733.
62. Stvilia, B., &, Jörgensen, C., (2009) User-generated collection level metadata in an online photo-sharing system. Library & Information Science Research, 31 (1), 54 - 65.
63. Stvilia, B., Twidale, M., Smith, L.C., &, Gasser, L., (2008) Information quality work organization in Wikipedia. Journal of the American Society for Information Science, 59 (6), 983 - 1001.
64. Svenonius, E., (1986) Unanswered questions in the design of controlled vocabularies. Journal of the American Society for Information Science, 37 (5), 331 - 340.
65. Tan, Y., Kan, M., &, Lee, D., (2006). Search engine driven author disambiguation. Proceedings of ACM/IEEE Joint Conference on Digital Libraries (pp. 314 - 315). New York. ACM Press.
66. Tanaka, J., &, Taylor, M., (1991) Object categories and expertise: Is the basic level in the eye of the beholder ? Cognitive Psychology, 23 (3), 457 - 482.
67. Taylor, R., (1986) Value-added processes in information systems. Norwood, NJ: Ablex Publishing.
68. Trant, J., (2008, September). Keynote address. Paper presented at the Dublin Core Annual Meeting, Humboldt-University, Berlin, Germany. Slides retrieved August 17, 2009, from
69. Trant, J., (2009) Studying social tagging and folksonomies: A review and framework. The Journal of Digital Information, 10 (1). Retrieved August 17, 2009, from
70. von Ahn, L., &, Dabbish, L., (2004) Labeling images with a computer game. Proceedings of the International Conference on Human Factors in Computing Systems (CHI 2004) (pp. 319 - 326). New York: ACM Press.
71. Wacholder, N., &, Liu, L., (2006) User preference: A measure of query-term quality. Journal of the American Society for Information Science and Technology, 57 (12), 1566 - 1580.
72. Wacholder, N., &, Liu, L., (2008) Assessing term effectiveness in the interactive information access process. Information Processing & Management, 44 (3), 1022 - 1031.
73. Weick, K., (1995) Sensemaking in organizations. Thousand Oaks, CA: Sage.
74. Weick, K., Sutcliffe, K., &, Obstfeld, D., (2005) Organizing and the process of sensemaking. Organizational Science, 16 (4), 409 - 421.
75. Yi, K., &, Chan, L.M., (2009) Linking folksonomy to Library of Congress Subject Headings: An exploratory study. Journal of Documentation, 65 (6), 872 - 900.