Remote Sensing image retrieval by scene semantic matching

IEEE Transactions on Geoscience and Remote Sensing

Volumn 51, Issue 5, 2013, Pages 2874-2886

  Wang, Min ^a   Song, Tengyi ^a  

^a Nanjing Normal University   (China)

Author keywords

Attributed relational graph (ARG); Image retrieval; Object based image analysis; Remote sensing (RS) image; Scene matching; Semantic; Semantic gap

Indexed keywords

ATTRIBUTED RELATIONAL GRAPH; OBJECT BASED IMAGE ANALYSIS; REMOTE SENSING IMAGES; SCENE MATCHING; SEMANTIC GAP;

REMOTE SENSING; SEMANTICS; TOPOLOGY;

IMAGE RETRIEVAL;

ACCURACY ASSESSMENT; EXPERIMENTAL STUDY; IMAGE ANALYSIS; NUMERICAL MODEL; REMOTE SENSING; TOPOLOGY;

EID: 84885022985     PISSN: 01962892     EISSN: None     Source Type: Journal    
DOI: 10.1109/TGRS.2012.2217397     Document Type: Article

References (48)

1. R. Datta, D. Joshi, J. Li, and J. Z. Wang, "Image retrieval: Ideas, influences, and trends of the new age," ACM Comput. Surv., vol. 40, no. 2, pp. 1-60, Apr. 2008.
2. C. Faloutsos, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovic, and W. Equitz, "Efficient and effective querying by image content," J. Intell. Inf. Syst., vol. 3, no. 3/4, pp. 231-262, Jul. 1994.
3. A. Pentland, R. W. Picard, and S. Sclaroff, "Photobook: Content-based manipulation of image databases," Int. J. Comput. Vis., vol. 18, no. 3, pp. 233-254, Jun. 1996. (Pubitemid 126713877)
4. J. R. Smith and S. F. Chang, "VisualSEEK: A fully automated content-based image query system," Proc. 4th ACM Int. Multimedia Conf., pp. 87-98, 1996.
5. J. Z. Wang, J. Li, and G. Wiederhold, "SIMPLIcity: Semantics-sensitive integrated matching for picture libraries," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 9, pp. 947-963, Sep. 2001. (Pubitemid 32981615)
6. GazoPa, Feb. 2012. [Online]. Available: http://en.Wikipedia.org/wiki/ GazoPa
7. R. L. Gregory, Eye and Brain: The Psychology of Seeing. Princeton, NJ: Princeton Univ. Press, 1997.
8. Y. Liu, D. S. Zhang, and G. J. Lu, "Region-based image retrieval with high-level semantics using decision tree learning," Pattern Recognit., vol. 41, no. 8, pp. 2554-2570, Aug. 2008.
9. Z. Shi, H. Qing, and Z. Z. Shi, "An index and retrieval framework integrating perceptive features and semantics for multimedia databases," Multimedia Tools Appl., vol. 42, no. 2, pp. 207-231, Apr. 2009.
10. W. Huang, Y. Gao, and K. L. Chan, "A review of region-based image retrieval," J. Signal Process. Syst., vol. 59, no. 2, pp. 143-161, May 2010.
11. Y. Liu, D. S. Zhang, G. J. Lu, and W. Y. Ma, "A survey of content-based image retrieval with high-level semantics," Pattern Recognit., vol. 40, no. 1, pp. 262-282, Jan. 2007. (Pubitemid 44486285)
12. H. F. Wang and Z. X. Sun, "The methods of semantics processing in content-based image retrieval," J. Image Graph., vol. 6, no. 10, pp. 945-952, 2001.
13. N. Wu and F. M. Song, "An image retrieval method based on high-level image semantic information," J. Image Graph., vol. 11, no. 12, pp. 1774-1780, 2006.
14. C. Colombo, A. D. Bimbo, and P. Pala, "Semantics in visual information retrieval," IEEE Multimedia, vol. 6, no. 3, pp. 38-53, Jul.-Sep. 1999.
15. V. Mezaris, I. Kompatsiaris, and M. G. Strintzis, "An ontology approach to object-based image retrieval," in Proc. Int. Conf. Image Process., Barcelona, Spain, 2003, pp. 511-514.
16. M. Obeid, B. Jedynak, and M. Daoudi, "Image indexing & retrieval using intermediate features," in Proc. 9th ACM Int. Conf. Multimedia, Ottawa, ON, Canada, 2001, pp. 531-533.
17. X. S. Zhou and T. S. Huang, "Relevance feedback in image retrieval: A comprehensive review," Multimedia Syst., vol. 8, no. 6, pp. 536-544, Apr. 2003.
18. S. F. Cheng, W. Chen, and H. Sundaram, "Semantic visual templates: Linking visual features to semantics," in Proc. Int. Conf. Image Process., Chicago, IL, 1998, pp. 531-535.
19. C. R. Shyu, M. Klaric, G. J. Scott, A. S. Barb, C. H. Davis, and K. Palaniappan, "GeoIRIS: Geospatial information retrieval and indexing system - Content mining, semantics modeling, and complex queries," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 4, pp. 839-852, Apr. 2007. (Pubitemid 46495619)
20. G. J. Scott, M. N. Klaric, C. H. Davis, and C. R. Shyu, "Entropy-Balanced bitmap tree for shape-based object retrieval from large-scale satellite imagery databases," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 5, pp. 1603-1616, May 2011.
21. S. S. Durbha and R. L. King, "Knowledge mining in earth observation data archives: A domain ontology perspective," in Proc. IEEE Int. Geosci. Remote Sens. Symp.: Sci. Soc.: Exploring Manag. Changing Planet, Anchorage, AK, 2004, pp. 172-173.
22. J. Li and R. M. Narayanan, "Integrated spectral and spatial information mining in remote sensing imagery," IEEE Trans. Geosci. Remote Sens., vol. 42, no. 3, pp. 673-685, Mar. 2004.
23. S. S. Durbha and R. L. King, "Semantics-enabled framework for knowledge discovery from earth observation data archives," IEEE Trans. Geosci. Remote Sens., vol. 43, no. 11, pp. 2563-2572, Nov. 2005.
24. H. Sun, S. X. Li, W. J. Li, Z. Ming, and S. B. Cai, "Semantic-based retrieval of remote sensing images in a grid environment," IEEE Geosci. Remote Sens. Lett., vol. 2, no. 4, pp. 440-444, Oct. 2005. (Pubitemid 41633539)
25. K. W. Tobin, B. L. Bhaduri, E. A. Bright, A. Cheriyadat, T. P. Karnowski, P. J. Palathingal, T. E. Potok, and J. R. Price, "Automated feature generation in large-scale geospatial libraries for content-based indexing," Photogramm. Eng. Remote Sens., vol. 72, no. 5, pp. 531-540, May 2006. (Pubitemid 43848072)
26. Y. Li and T. R. Bretschneider, "Semantic-Sensitive Satellite Image Retrieval," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 4, pp. 853-860, Apr. 2007.
27. P. Blanchart and M. Datcu, "A semi-supervised algorithm for auto-annotation and unknown structures discovery in satellite image databases," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens., vol. 3, no. 4, pp. 698-717, Dec. 2010.
28. D. Bratasanu, I. Nedelcu, and M. Datcu, "Bridging the semantic gap for satellite image annotation and automatic mapping applications," IEEE J. Sel. Topics Appl. Earth Observ. Remote Sens, vol. 4, no. 1, pp. 193-204, Mar. 2011.
29. M. Ferecatu and N. Boujemaa, "Interactive remote-sensing image retrieval using active relevance feedback," IEEE Trans. Geosci. Remote Sens., vol. 45, no. 4, pp. 818-826, Apr. 2007. (Pubitemid 46495617)
30. E. A. El-Kwae and M. R. Kabuka, "A robust framework for content-based retrieval by spatial similarity in image databases," ACM Trans. Inf. Syst., vol. 17, no. 2, pp. 174-198, Apr. 1999.
31. B. Li and F. Fonseca, "TDD: A comprehensive model for qualitative spatial similarity assessment," Spatial Cognit. Comput., vol. 6, no. 1, pp. 31-62, Jan. 2006.
32. S. Aksoy, "Modeling of remote sensing image content using attributed relational graphs," in Proc. Lecture Notes Comput. Sci., 2006, vol. 4109, pp. 475-483. (Pubitemid 44543138)
33. F. Kalaycilar, A. Kale, D. Zamalieva, and S. Aksoy, "Mining of remote sensing image archives using spatial relationship histograms," in Proc. IEEE Int. Geosci. Remote Sens. Symp., Boston, MA, 2008, pp. III-589-III-592.
34. E. Remias, G. Sheikholeslami, and A. D. Zhang, "Block-oriented image decomposition and retrieval in image database systems," in Proc. Int. Workshop Multi-Media Database Manage. Syst., Blue Mountain Lake, NY, 1996, pp. 85-92.
35. D. Li and X. Ning, "A new image decomposition method for content-based remote sensing image retrieval," Geomatics Inf. Sci. Wuhan Univ., vol. 31, no. 8, pp. 659-662, 2006.
36. U. Benz, M. Baatz, and G. Schreier, "OSCAR-object oriented segmentation and classification of advanced radar allow automated information extraction," in Proc. IEEE Int. Geosci. Remote Sens. Symp., Sydney, Australia, 2001, pp. 1913-1915.
37. T. Blaschke and G. J. Hay, "Object-oriented image analysis and scale-space: Theory and methods for modeling and evaluating multiscale landscape structure," in Proc. Int. Archives Photogramm. Remote Sens., 2001, vol. 34, pp. 22-29.
38. H. G. Akçay and S. Aksoy, "Automatic detection of geospatial objects using multiple hierarchical segmentations," IEEE Trans. Geosci. Remote Sens., vol. 46, no. 7, pp. 2097-2111, Jul. 2008.
39. P. Aplin, P. M. Atkinson, and P. Curran, "Per-field classification of land use using the forthcoming very fine spatial resolution satellite sensors: Problems and potential solutions," in Advances in Remote Sensing and GIS Analysis, P. M. Atkinson and N. J. Tate, Eds. Chichester, U.K.: Wiley, 1999, pp. 219-239.
40. J. Im, J. R. Jensen, and J. A. Tullis, "Object-based change detection using correlation image analysis and image segmentation," Int. J. Remote Sens., vol. 29, no. 2, pp. 399-423, Jan. 2008. (Pubitemid 350269296)
41. W. Zhou and A. Troy, "An object oriented approach for analysing and characterizing urban landscape at the parcel level," Int. J. Remote Sens., vol. 29, no. 11, pp. 3119-3135, Jun. 2008. (Pubitemid 351911284)
42. I. A. Rizvi and B. K. Mohan, "Object-Based image analysis of high-resolution satellite images using modified cloud basis function neural network and probabilistic relaxation labeling process," IEEE Trans. Geosci. Remote Sens., vol. 49, no. 12, pp. 4815-4820, Dec. 2011.
43. M. Wang, "A multiresolution remotely sensed image segmentation method combining rainfalling watershed algorithm and fast region merging," in Proc. Int. Archives Photogramm., Remote Sens. Spatial Inf. Sci., 2008, vol. 38, Part 4, pp. 1213-1218.
44. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 2000.
45. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
46. C. C. Chang and S. Y. Lee, "Retrieval of similar pictures on pictorial databases," Pattern Recognit., vol. 24, no. 7, pp. 675-680, Jul. 1991.
47. T. Bruns and M. Egenhofer, "Similarity of spatial scenes," in Proc. 7th Int. Symp. Spatial Data Handling, Delft, The Netherlands, 1996, pp. 173-184.
48. J. S. Payne, L. Heppelwhhite, and T. J. Stonham, "Perceptually based metrics for the evaluation of textural image retrieval methods," in Proc. IEEE Int. Conf. Multimedia Comput. Syst. Conf., 1999, vol. 2, pp. 793-797.