Distributed frameworks and parallel algorithms for processing large-scale geographic data

Parallel Computing

Volumn 29, Issue 10, 2003, Pages 1297-1333

  Hawick, Kenneth A ^a   Coddington, P D ^b   James, H A ^a  

^a BANGOR UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

Distributed computing; Geographic information systems; Grid computing; Metacomputing; Parallel computing

Indexed keywords

ALGORITHMS; DATA PROCESSING; DECISION SUPPORT SYSTEMS; GEOGRAPHIC INFORMATION SYSTEMS; METADATA;

METACOMPUTING;

PARALLEL PROCESSING SYSTEMS;

EID: 0141749111     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2003.04.001     Document Type: Conference Paper

References (68)

1. Allcock W.et al. The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications. 23:2001;187-200.
2. S.R.M. Barres, T. Kauranne, Spectral and multigrid spherical Helmholtz equation solvers on distributed memory parallel computers, in: Proc. Fourth Workshop on Use of Parallel Processors in Meteorology, ECMWF, 1990.
3. R.S. Bell, A. Dickinson, The Meteorological Office Unified Model for data assimilation, climate modelling and NWP and its implementation on a CRAY Y-MP, in: Proc. Fourth Workshop on Use of Parallel Processors in Meteorology, ECMWF, 1990.
4. S. Border, The use of indicator Kriging as a biased estimator to discriminate between ore and waste, Applications of Computers in the Mineral Industry, University of Wollongong, N.S.W., October 1993.
5. K. Bryceson, M. Bryant, The GIS/rainfall connection, in GIS User, No. 4, August 1993, pp. 32-35.
6. K.P. Bryceson, P. Wilson, M. Bryant, Daily rainfall estimation from satellite data using rules-based classification techniques and a GIS, unpublished, November 1995.
7. H. Casanova, J. Dongarra, NetSolve: a network server for solving computational science problems, in: Proc. Supercomputing '96.
8. Choi J., Dongarra J.J., Pozo R., Walker D.W. ScaLAPACK: a scalable linear algebra library for distributed memory concurrent computers. Proc. of the Fourth Symposium on the Frontiers of Massively Parallel Computation. 1992;120-127 IEEE Computer Society Press.
9. P.D. Coddington, G. Hamlyn, K.A. Hawick, H.A. James, J. Hercus, D. Uksi, D. Weber, A software infrastructure for federated geospatial image exploitation services, DHPC Technical Report DHPC-092, Department of Computer Science, University of Adelaide, 2000.
10. Coddington P.D., Hawick K.A., Kerry K.E., Mathew J.A., Silis A.J., Webb D.L., Whitbread P.J., Irving C.G., Grigg M.W., Jana R., Tang K. Implementation of a geospatial imagery digital library using Java and CORBA. Proc. Technologies of Object-Oriented Languages and Systems Asia (TOOLS 27). September 1998;IEEE.
11. P.D. Coddington et al., Interfacing to on-line geospatial imagery archives, in: Proc. of Australasian Urban and Regional Information Systems Assoc. Conf. (AURISA'99), Leura, NSW, 1999.
12. Deelman E.et al. A virtual data grid for LIGO. Lecture Notes in Computer Science. 2110:2001;3-12.
13. D. Dent, The ECMWF model on the CRAY Y-MP8, in: Proc. Fourth Workshop on Use of Parallel Processors in Meteorology, ECMWF, 1990.
14. Distributed and High-Performance Computing Group, On-Line Data Archives (OLDA) Project. Available from 〈http://www.dhpc.adelaide.edu.au/olda/〉.
15. Earth System Grid. Available from 〈http://www.earthsystemgrid.org/〉.
16. European Data Grid, Earth Observation Science Applications. Available from 〈http://styx.esrin.esa.it/grid/〉.
17. European Space Agency, SpaceGrid. Available from 〈http://www.spacegrid.org/〉.
18. I. Foster, D. Gannon (Eds.), The Open Grid Services Architecture Platform. Available from 〈http://www.ggf.org/ogsa-wg〉.
19. Foster I., Kesselman C. The Grid: Blueprint for a New Computing Infrastructure. 1999;Morgan Kaufmann Publishers, Inc. ISBN 1-55860-475-8.
20. Fox G.C., Williams R.D., Messina P.C. Parallel Computing Works! 1994;Morgan Kaufmann Publishers, Inc. ISBN 1-55860-253-4.
21. The Globus Project. Available from 〈http://www.globus.org/〉.
22. The Globus Project, Commodity Grid Kits. Available from 〈http://www.globus.org/cog/〉.
23. The GMS User's Guide, Meteorological Satellite Center, 3-235 Nakakiyoto, Kiyose, Tokyo 204, Japan, second ed., 1989.
24. M. Grigg, P. Whitbread, C. Irving, A. Lui, R. Jana, Component based architecture for a distributed library system, in: Proc. Distributed Multimedia Systems Conference, Aizu, Japan, 1999.
25. K.A. Hawick, R. Stuart Bell, A. Dickinson, P.D. Surry, B.J.N. Wylie, Parallelisation of the unified weather and climate model data assimilation scheme, in: Proc. Workshop of Fifth ECMWF Workshop on Use of Parallel Processors in Meteorology, European Centre for Medium Range Weather Forecasting, Reading November 1992 (invited paper).
26. Hawick K.A., Coddington P.D. Interfacing to distributed active data archives. Future Generation Computer Systems. 16:1999;73-89.
27. K.A. Hawick, P.D. Coddington, H.A. James, C.J. Patten, On-line data archives, in: Proc. Hawai'i Int. Conf. on System Sciences (HICSS-34), Maui, 2001.
28. K.A. Hawick, H.A. James, K.J. Maciunas, F.A. Vaughan, A.L. Wendelborn, M. Buchhorn, M. Rezny, S.R. Taylor, M.D. Wilson, Geographic information systems applications on an ATM-based distributed high performance computing system, in: Proc. High-Performance Computing and Networks (HPCN) Europe '97, Vienna, 1997.
29. Hawick K.A., James H.A., Silis A.J., Grove D.A., Kerry K.E., Mathew J.A., Coddington P.D., Patten C.J., Hercus J.F., Vaughan F.A. DISCWorld: an environment for service-based metacomputing. Future Generation Computing Systems (FGCS). 15:1999;623-635.
30. K.A. Hawick, H.A. James, A distributed job placement language, DHPC Technical Report DHPC-070, Department of Computer Science, University of Adelaide, May 1999.
31. K.A. Hawick, H.A. James, Distributed high-performance computation for remote sensing, in: Proc. Supercomputing '97, San Jose, November 1997.
32. High Performance Fortran Forum (HPFF), High Performance Fortran Language Specification, Scientific Programming, vol. 2, no. 1, July 1993.
33. J. Hildebrandt, M. Grigg, S. Bytheway, R. Hollemby, S. James, Dynamic C2 application of imagery and GIS information using backend repositories, in: Proc. Command & Control Research & Technology Symposium, Rhode Island, June 1999.
34. H.A. James, Scheduling in metacomputing systems, PhD Thesis, Department of Computer Science, University of Adelaide, 1999.
35. H.A. James, K.A. Hawick, Data futures in DISCWorld, in: Proc. High Performance Computing and Networking (HPCN Europe 2000), Amsterdam, May 2000, LNCS 1823, pp. 41-50.
36. H.A. James, K.A. Hawick, Eric: a user and applications interface to a distributed satellite data repository, DHPC Technical Report DHPC-008, Department of Computer Science, University of Adelaide, 1997.
37. H.A. James, K.A. Hawick, A Web-based interface for on-demand processing of satellite imagery archives, in: Proc. of the Australian Computer Science Conference (ACSC'98), Perth, February 1998.
38. H.A. James, K.A. Hawick, Remote application scheduling on metacomputing systems, in: Proc. HPDC'99, Redondo Beach, California, August 1999.
39. H.A. James, C.J. Patten, K.A. Hawick, Stencil methods on distributed high performance computers, DHPC Technical Report DHPC-010, Department of Computer Science, University of Adelaide, 1997.
40. K.E. Kerry, K.A. Hawick, Spatial interpolation on distributed, high-performance computers, in: Proc. of High-Performance Computing and Networks (HPCN) Europe '98, Amsterdam, April 1998.
41. Lorenc A.C., Bell R.S., Macpherson B. The Meteorological Office analysis correction data assimilation scheme. Quarterly Journal of the Royal Meteorological Society. 117:1991;59-89.
42. Mason D.C., O'Conaill M., McKendrick I. Variable resolution block Kriging using a hierarchical spatial data structure. International Journal of Geographical Information Systems. 8(5):1994;429-449.
43. J.A. Mathew, P.D. Coddington, K.A. Hawick, Analysis and development of Java Grande benchmarks, in: Proc. of the ACM 1999 Java Grande Conference, San Francisco, June 1999.
44. J.A. Mathew, H.A. James, K.A. Hawick, Development routes for message passing parallelism in Java, in: Proc. ACM 2000 Java Grande Conference, San Francisco, June 2000, pp. 54-61.
45. J.A. Mathew, A.J. Silis, K.A. Hawick, Inter server transport of Java byte code in a metacomputing environment, in: Proc. of Technology of Object-Oriented Languages and Systems Pacific (TOOLS 28), Melbourne, November 1998.
46. Message Passing Interface Forum, MPI: a message passing interface standard. Available from 〈http://www.mpi-forum.org/〉.
47. NASA Goddard Space Flight Center. Available from 〈http://www.gsfc.nasa.gov/〉.
48. U.S. National Imagery and Mapping Agency (NIMA). Available from 〈http://www.nima.mil/〉.
49. U.S. National Imagery and Mapping Agency (NIMA), Geospatial and Imagery eXploitation Services (GIXS) specification, S1010420-B, version 1.2, June 2000. Available from 〈http://www.nima.mil/sandi/arch/addinfo.html〉.
50. U.S. National Imagery and Mapping Association, USIGS Geospatial and Imagery Access Services (GIAS) specification, version 3.1, N0101-B, February 1998.
51. Oliver M.A., Webster R. Kriging: a method of interpolation for geographical information systems. International Journal of Geographical Information Systems. 4(3):1990;313-332.
52. OpenGIS Consortium. Available from 〈http://www.opengis.org〉.
53. Open GIS Consortium, Catalog Interface Implementation Specification (version 1.0). Available from 〈http://www.opengis.org/techno/implementation.htm〉.
54. C.J. Patten, K.A. Hawick, Flexible high-performance access to distributed storage resources, in: Proc. 9th IEEE Int. Sym. on High Performance Distributed Computing (HPDC'00), Pittsburgh, 2000.
55. C.J. Patten, F.A. Vaughan, K.A. Hawick, A.L. Brown, DWorFS: file system support for legacy applications in DISCWorld, in: Proc. 5th IDEA Workshop, Fremantle, February 1998.
56. M. Rezny, Aspects of high performance computing, Ph.D. Thesis, Department of Mathematics, University of Queensland, 1995.
57. A.J. Silis, K.A. Hawick, World Wide Web server technology and interfaces for distributed, high-performance computing systems, DHPC Technical Report DHPC-017, Department of Computer Science, University of Adelaide, 1997.
58. D. Skillicorn, The case for datacentric grids, in: Proc. Workshop on Massively Parallel Processing, Int. Parallel and Distributed Processing Symposium (IPDPS), Fort Lauderdale, April 2002.
59. Smarr L., Catlett C.E., Metacomputing Communications of the ACM. 35(6):1992;44-52.
60. Suarez M.J. Atmospheric modelling on a SIMD computer. Hoffmann G.-R., Snelling D.F. Multiprocessing in Meteorological Models. 1988;Springer-Verlag.
61. Sun Microsystems, Java advanced imaging API. Available from 〈http://java.sun.com/products/java-media/jai/〉.
62. S.F.B. Tett, A massively parallel algorithm for the spectral method, in: Proc. Fourth Workshop on Use of parallel processors in meteorology, ECMWF, 1990.
63. S.F.B. Tett, Ph.D. Thesis, University of Edinburgh, 1992.
64. J.A. Toon, Intelligent systems: practical data mining in a world saturated with data, DHPC Technical Report DHPC-017, School of Informatics, University of Wales, Bangor, July 2002.
65. U.K. Meteorological Office, Unified Model Documentation paper 50, 1991.
66. D.L. Webb, A.L. Wendelborn, K.A. Maciunas, Process networks as a high-level notation for metacomputing, in: Proc. Int. Parallel Programming Symposium (IPPS'99), Puerto Rico, 1999.
67. D.C. Weber, Reconnaissance use case with GIXS, DSTO note, unpublished, 2000.
68. D. Weber, H. James, A federated GIXS model, in: Proc 5th Int. Conf. Command and Control, Research and Technology Symposium, Canberra, Australia, October 2000.