User evaluation of automatically generated keywords and toponyms for geo-referenced images

Journal of the American Society for Information Science and Technology

Volumn 64, Issue 3, 2013, Pages 480-499

  Ostermann, Frank O ^a   Tomko, Martin ^b   Purves, Ross ^c  

^a JOINT RESEARCH CENTRE   (Italy)

^b UNIVERSITY OF MELBOURNE   (Australia)

^c UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

automatic classification; evaluation; image retrieval

Indexed keywords

ANNOTATION METHODS; AUTOMATIC CLASSIFICATION; AUTOMATIC GENERATION; AUTOMATICALLY GENERATED; EVALUATION; FOCUS GROUPS; GEO-REFERENCED IMAGES; HETEROGENEOUS DATA SOURCES; ONLINE QUESTIONNAIRE; QUALITATIVE APPROACH; QUALITATIVE INFORMATION; RETRIEVAL PROCEDURES; SPATIAL DATABASE; USER EVALUATIONS; USER EXPERIMENTS; WEB RESOURCES;

EXPERIMENTS; QUALITY CONTROL; SURVEYS;

IMAGE RETRIEVAL;

EID: 84874244175     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.22738     Document Type: Article

References (39)

1. Abdelmoty, A.I., Smart, P.D., &, Jones, C.B., (2007). Building place ontologies for the semantic web: Issues and approaches. In, R.S. Purves, &, C.B. Jones, (Eds.), Proceeding of the Fourth ACM Workshop on Geographical information retrieval (pp. 7-12). New York, NY: ACM.
2. Abebe, R., (2008). User-generated descriptions of individual images versus labels of groups of images: A comparison using basic level theory. Information Processing & Management, 44 (5), 1741-1753.
3. Armitage, L.H., &, Enser, P.G.B., (1997). Analysis of user need in image archives. Journal of Information Science, 23 (4), 287.
4. Brabyn, L., &, Mark, D.M., (2011). Using viewsheds, GIS, and a landscape classification to tag landscape photographs. Applied Geography, 31 (3), 1115-1122.
5. Datta, R., Joshi, D., Li, J., &, Wang, J.Z., (2008). Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys, 40 (2), 1-60.
6. De Boer, A., Dias, E., &, Verbree, E., (2008). Processing 3D Geo-Information for augmenting georeferenced and oriented photographs with text labels. In, A. Ruas, &, C. Gold, (Eds.), Headway in spatial data handling. Lecture Notes in Geoinformation and Cartography (pp. 351-365). Berlin, Heidelberg: Springer-Verlag.
7. Edwardes, A.J., &, Purves, R.S., (2007). A theoretical grounding for semantic descriptions of place. In, M. Ware, &, G. Taylor, (Eds.), Proceedings of the Seventh International Symposium on Web and Wireless Geographical Information Systems (W2GIS). LNCS, 4857, 106-121.
8. Fan, X., Aker, A., Tomko, M., Smart, P.D., Sanderson, M., &, Gaizauskas, R., (2010). Automatic image captioning from the web for GPS photographs. In Proceedings of the Annual ACM SIGMM International Conference on Multimedia Information Retrieval. New York, NY: ACM.
9. Florea, F., Buzuloiu, V., Rogozan, A., Bensrhair, A., &, Darmoni, S., (2007). Automatic image annotation combining the content and the context of medical images (pp. 1-4). Proceedings of the IEEE. doi: 10.1109/ISSCS.2007. 4292712
10. Geertz, C., (1983). Local knowledge: Further essays in interpretive anthropology. New York, NY: Basic Books.
11. Hollenstein, L., &, Purves, R.S., (2010). Exploring place through user-generated content: Using Flickr tags to describe city cores. Journal of Spatial Information Science, (1), 21.
12. Hollink, L., Schreiber, A.T., Wielinga, B.J., &, Worring, M., (2004). Classification of user image descriptions. International Journal of Human-Computer Studies, 61 (5), 601-626.
13. Jones, C.B., Purves, R.S., Clough, P.D., &, Joho, H., (2008). Modelling vague places with knowledge from the web. International Journal of Geographical Information Science, 22 (10), 1045-1065.
14. Li, J., &, Wang, J. Z., (2008). Real-time computerized annotation of pictures. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30, 985-1002.
15. Lindlof, T.R., &, Taylor, B.C., (2002). Qualitative communication research methods (2nd ed.). Thousand Oaks, CA: Sage Publications.
16. Manning, C.D., Raghavan, P., &, Schuetze, H., (2009). An introduction to information retrieval. Cambridge, UK: Cambridge University Press.
17. Mark, D.M., Freksa, C., Hirtle, S.C., Lloyd, R., &, Tversky, B., (1999). Cognitive models of geographic space. International Journal of Geographic Information Science, 13 (8), 747-774.
18. Miles, A., &, Bechhofer, S., (2009). SKOS simple knowledge organization system reference. World Wide Web Consortium. Retrieved from http://www.w3.org/TR/2009/REC-skos-reference-20090818/
19. Minelli, S., &, Harding, J., (2009). Images collected by the consortium (Deliverable No. 2.3.2). Project Tripod. Retrieved from http://tripod.shef.ac.uk/outcomes/public-deliverables/Tripod-D2.3.2.pdf
20. Müller, H., Müller, W., Squire, D.M., Marchand-Maillet, S., &, Pun, T., (2001). Performance evaluation in content-based image retrieval: Overview and proposals. Pattern Recognition Letters, 22 (5), 593-601.
21. Naaman, M., Song, Y.J., Paepcke, A., &, Garcia-Molina, H., (2006). Assigning textual names to sets of geographic coordinates. Computers, Environment and Urban Systems, 30 (4), 418-435.
22. O'Hare, N., Gurrin, C., Jones, G.J.F., &, Smeaton, A.F., (2005). Combination of content analysis and context features for digital photograph retrieval. Retrieved from http://doras.dcu.ie/391/
23. Popescu, A., &, Moëllic, P.-A., (2009). MonuAnno: Automatic annotation of georeferenced landmarks images. Proceeding of the ACM International Conference on Image and Video Retrieval (CIVR '09) (pp. 1-8). New York, NY: ACM.
24. Purves, R.S., Edwardes, A.J., Fan, X., Hall, M.M., &, Tomko, M., (2010). Automatically generating keywords for georeferenced images. In, M. Hakley, J. Morley, &, A. Rahemtulla, (Eds.), Proceedings of the GIS Research UK 18th Annual Conference (GISRUK 2010) (pp. 359-362). London, UK.
25. Purves, R.S., Edwardes, A.J., &, Sanderson, M., (2008). Describing the where-improving image annotation and search through geography. In, G. Csurka, (Ed.), Proceedings of the First International Workshop on Metadata Mining for Image Understanding (MMIU '08) (pp. 105-113). Funchal, Portugal.
26. Sanderson, M., Paramita, M.L., Clough, P.D., &, Kanoulas, E., (2010). Do user preferences and evaluation measures line up? In Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 555-562).
27. Sandhaus, P., &, Boll, S., (2011). Semantic analysis and retrieval in personal and social photo collections. Multimedia Tools and Applications, 51 (1), 5-33.
28. Schnell, R., Hill, P., &, Esser, E., (2008). Methoden der empirischen Sozialforschung [Methods of empirical social sciences]. München: Oldenbourg.
29. Shatford, S., (1986). Analyzing the subject of a picture: A theoretical approach. Cataloging and Classification Quarterly, 6 (3), 39-62.
30. Sigurbjörnsson, B., &, Van Zwol, R., (2008). Flickr tag recommendation based on collective knowledge. In Proceedings of the 17th International Conference on World Wide Web (pp. 327-336). New York, NY: ACM Press.
31. Smart, P.D., Jones, C.B., &, Twaroch, F., (2010). Multi-source Toponym data integration and mediation for a meta-gazetteer service. Geographic Information Science, 234-248.
32. Smeulders, A.W., Worring, M., Santini, S., Gupta, A., &, Jain, R., (2002). Content-based image retrieval at the end of the early years. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 22 (12), 1349-1380.
33. Smith, B., &, Mark, D.M., (2001). Geographical categories: An ontological investigation. International Journal of Geographic Information Science, 15 (7), 591-612.
34. Tomko, M., &, Purves, R.S., (2009). Venice, City of Canals: Characterizing regions through content classification. Transactions in GIS, 13 (3), 295-314.
35. Tomko, M., Trautwein, F., &, Purves, R.S., (2009). Identification of practically visible spatial objects in natural environments. In, M. Sester, L. Bernard, &, V. Paelke, (Eds.), Advances in GIScience. Lecture Notes in Geoinformation and Cartography (pp. 1-23). Berlin, Heidelberg: Springer-Verlag.
36. Tuffield, Mischa M., Harris, S., Brewster, C., Gibbins, N., Ciravegna, F., Sleeman, D., (.), Wilks, Y., (2006). Image annotation with photocopain. CiteSeerX. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=?doi= 10.1.1.109.7324
37. Tversky, B., &, Hemenway, K., (1983). Categories of environmental scenes. Cognitive Psychology, 15 (1), 121-149.
38. Winget, M., (2006). User-defined classification on the online photo sharing site Flickrłdots or, how I Learned to stop worrying and love the million typing monkeys. In, J. Furner, &, J.T. Tennis, (Eds.), Advances in classification research, Proceedings of the 17th Annual American Society for Information Science and Technology Special Interest Group on Classification Research Workshop. Philadelphia, PA.
39. Zhang, D., Islam, M.M., &, Lu, G., (2012). A review on automatic image annotation techniques. Pattern Recognition, 45 (1), 346-362.