The design and implementation of OGSA-DQP: A service-based distributed query processor

Future Generation Computer Systems

Volumn 25, Issue 3, 2009, Pages 224-236

  Lynden, Steven ^a   Mukherjee, Arijit ^b   Hume, Alastair C ^c   Fernandes, Alvaro A A ^a   Paton, Norman W ^a   Sakellariou, Rizos ^a   Watson, Paul ^b  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Data grid; Data integration; Web service

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; ARCHITECTURE; BENCHMARKING; BIOINFORMATICS; DATA STORAGE EQUIPMENT; DATABASE SYSTEMS; ELECTRONIC COMMERCE; INFORMATION RETRIEVAL SYSTEMS; INTEGRATION; MANAGEMENT INFORMATION SYSTEMS; QUERY PROCESSING;

BIOINFORMATICS APPLICATIONS; DATA GRID; DATA INTEGRATION; DATA MANAGEMENTS; DATA STORAGES; DATABASE MANAGEMENT SYSTEMS; DISTRIBUTED APPLICATION DEVELOPMENTS; DISTRIBUTED QUERIES; E BUSINESSES; E SCIENCES; GRID ENVIRONMENTS; HARDWARE AND SOFTWARES; INTERNAL ARCHITECTURES; PAPER ADDRESSES; PERFORMANCE RESULTS; PROCESSING TECHNOLOGIES; QUERY PROCESSORS; RESULTING SYSTEMS; SERVICE ORCHESTRATIONS; USAGE SCENARIOS;

COMPUTER ARCHITECTURE;

EID: 55949126590     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2008.08.003     Document Type: Article

References (56)

1. J. Ainsworth, R. Harper, I. Juma, I. Buchan, Psygrid: Applying e-science to epidemiology, in: 19th IEEE Symposium on Computer-Based Medical Systems, 2006, pp. 727-732
2. Aloisio G., Cafaro M., and Fiore S. The grid-dbms: Towards dynamic data management in grid environments. Proc. Intl. Conf. on Information Technology: Coding and Computation (2005), IEEE Press 199-204
3. Alpdemir M.N., Mukherjee A., Paton N.W., Watson P., Fernandes A.A.A., Gounaris A., and Smith J. Service-based distributed querying on the grid. Proc. 1st Int. Conf. Service-Oriented Computing (2003), Springer 467-482
4. Antonioletti M., Atkinson M., Baxter R., Borley A., Chue Hong N.P., Collins B., Hardman N., Hulme A.C., Knox A., Jackson M., Krause A., Laws S., Magowan J., Paton N.W., Pearson D., Sugden T., Watson P., and Westhead M. The design and implementation of Grid database services in OGSA-DAI. Concurrency Comput. Practice Experience 17 (2005) 357-376
5. Antonioletti M., Krause A., Paton N.W., Eisenberg A., Laws S., Malaika S., Melton J., and Pearson D. The ws-dai family of specifications for web service data access and integration. SIGMOD Rec. 35 1 (2006) 48-55
6. Atkinson M., Chervenak A.L., Kunszt P., Narang I., Paton N.W., Pearson D., Shoshani A., and Watson P. Data access, integration and management. The Grid 2: Blueprint for a New Computing Infrastructure (2004), Morgan-Kaufmann 391-429
7. W.H. Bell, D. Bosio, W. Hoschek, P. Kunszt, G. McCance, M. Silander, Project Spitfire - Towards Grid Web Service Databases, in: Global Grid Forum, vol. 5, 2002
8. Braumandl R., Keidl M., Kemper A., Kossmann D., Kreutz A., Seltzsam S., and Stocker K. ObjectGlobe: Ubiquitous query processing on the internet. VLDB J. 10 1 (2001) 48-71
9. F. Cabrera, et al. Web services transaction (WS-Transaction), Technical Report, IBM developerWorks Report. http://www-106.ibm.com/developerworks/library/ws-transpec/, 2002
10. M. Cherniack, H. Balakrishnan, M. Balazinska, Scalable distributed stream processing, in: Proceedings of the First Biennial Conference on Innovative Data Systems Research (CIDR), Asilomar, CA, January 2003
11. Chervenak A., et al. Giggle: A framework for constructing scaleable replica location services. Proc. Supercomputing (2002), IEEE Press
12. F. Curbera, et al. Business process execution language for web services, Technical Report, IBM developerWorks Report. http://www-106.ibm.com/developerworks/library/ws-bpel/, 2002
13. Davidson S.B., Crabtree J., Brunk B.P., Schug J., Tannen V., Overton G.C., and Stoeckert C.J. K2/Kleisli and GUS: Experiments in integrated access to genomic data sources. IBM Syst. J. 40 2 (2001) 512-531
14. Mendes Sampaio S.d.F., Paton N.W., Smith J., and Watson P. Measuring and modelling the performance of a parallel odmg compliant object database server. Concurrency Comput. Practice Experience 18 1 (2006) 63-109
15. Deelman E., Singh G., Su M.-H., Blythe J., Gil Y., Kesselman C., Mehta G., Vahi K., Berriman G.B., Good J., Laity A.C., Jacob J.C., and Katz D.S. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Sci. Programm. 13 3 (2005) 219-237
16. P. Dinda, B. Plale, A unified relational approach to grid information services, Technical Report GWD-GIS-012-1, Global Grid Forum, 2001
17. Fiore S., Negro A., Vadacca S., Cafaro M., Mirto M., and Aloisio G. Advanced grid database management with the GRelC data access service. Parallel and Distributed Processing and Applications (2007), Springer 683-694
18. Fomkin R., and Risch T. Framework for querying distributed objects managed by a grid infrastructure. Data Management in Grids. DMG (2005), Springer 58-70
19. Foster I., and Karonis N. A grid-enabled MPI: Message passing in heterogeneous distributed computing systems. Proc. Supercomputing (1998), IEEE Press
20. Foster I., Kesselman C., Nick J.M., and Tuecke S. Grid services for distributed system integration. IEEE Comput. 35 6 (2002) 37-46
21. Foster I., Kesselman C., and Tuecke S. The anatomy of the grid: Enabling scalable virtual organizations. Int. J. Supercomput. Appl. 15 3 (2001)
22. I. Foster, J. Voeckler, M. Wilde, Y. Zhao, The virtual data grid: A new model and architecture for data-intensive collaboration, in: Proc. CIDR, 2003
23. Garcia-Milina H., Ullman J.D., and Widom J. Database System Implementation (2000), Morgan Kaufmann
24. Gottschalk K., Graham S., Kreger H., and Snell J. Introduction to web services architecture. IBM Syst. J. 41 2 (2002) 170-177
25. Gounaris A., Comito C., Sakellariou R., and Talia D. A service-oriented system to support data integration on data grids. CCGRID (2007) 627-635
26. Gounaris A., Sakellariou R., Paton N.W., and Fernandes A.A. A novel approach to resource scheduling for parallel query processing on computational grids. Distrib. Parallel Databases 19 2-3 (2006) 87-106
27. Gounaris A., Smith J., Paton N.W., Sakellariou R., Fernandes A.A.A., and Watson P. Adapting to changing resource performance in grid query processing. Data Management in Grids. DMG (2005), Springer 30-44
28. G. Graefe, Encapsulation of parallelism in the volcano query processing system, in: Proc. SIGMOD, 1990, pp. 102-111
29. S. Graham, J. Treadwell, (Eds.). Web service resource properties 1.2, Technical Report. http://docs.oasis-open.org/wsrf/wsrf-ws_resource_properties-1.2-spec-os.pdf, 2006
30. Harris M.A., et al. The Gene Ontology (GO) database and informatics resource. Nucleic Acids Res. 32 1 (2004) D258-261
31. Huebsch R., Hellerstein J.M., Lanham N., Thau Loo B., Shenker S., and Stoica I. Querying the internet with PIER. VLDB (2003) 321-332
32. M. Jackson, et al. Performance analysis of the OGSA-DAI software, in: Proc. e-Science All Hands Conference, 2004
33. V. Josifovski, P. Schwarz, L. Haas, E. Lin, Garlic: A new flavor of federated query processing for DB2, in: Proc. SIGMOD, 2002, pp. 524-532
34. Kim W., Choi I., Gala S.K., and Scheevel M. On resolving schematic heterogeneity in multidatabase systems. Distrib. Parallel Databases 1 3 (1993) 251-279
35. Kossmann D. The state of the art in distributed query processing. ACM Comput. Surveys 32 4 (2000) 422-469
36. Litzkow M.J., Livny M., and Mutka M.W. Condor - A Hunter of Idle Workstations. Proc. 8th International Conference on Distributed Computing Systems (1988), IEEE Press 104-111
37. Liu D.T., and Franklin M.J. GridDB: A data-centric overlay for scientific grids. Proc. VLDB (2004), Morgan-Kaufmann 600-611
38. Malaika S., Nelin C.J., Qu R., Reinwald B., and Wolfson D.C. DB2 and web services. IBM Syst. J. 41 4 (2002) 666-685
39. T. Malik, A.S. Szalay, T. Budavari, A.R. Thakar, SkyQuery: A web service approach to federate databases, in: Proc. CIDR, 2003
40. Moore R.W., Baru C., Marciano R., Rajasekar A., and Wan M. Data-Intensive Computing. In: Foster I., and Kesselman C. (Eds). The Grid: Blueprint for a New Computing Infrastructure (1999), Morgan Kaufmann 105-129 (Chapter 5)
41. R. Motwani, J. Widom, A. Arasu, B. Babcock, S. Babu, M. Datar, G. Manku, C. Olston, J. Rosenstein, R. Varma, Query processing, resource management, and approximation in a data stream management system, in: Proceedings of the First Biennial Conference on Innovative Data Systems Research, CIDR, Asilomar, CA, 2003, pp. 245-256
42. A. Mukherjee, P. Watson, Adding dynamism to ogsa-dqp: Incorporating the dynasoar framework in distributed query processing, in: Euro-Par Workshops, 2006, pp. 22-33
43. Narayanan S., Kurc T.M., and Saltz J. Database support for data-driven scientific applications in the grid. Parallel Process. Lett. 13 2 (2003) 245-271
44. V. Papadimos, D. Maier, K. Tufte, Distributed query processing and catalogs for peer-to-peer systems, in: Proceedings of CIDR 2003, First Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, 2003
45. In: Riordan R.M. (Ed). Microsoft ADO.NET Step by Step (2002), Microsoft Press
46. Sánchez A., Pérez M.S., Karasavvas K., Herrero P., and Pérez A. Mapfs-dai, an extension of ogsa-dai based on a parallel file system. Future Generation Comput. Syst. 23 1 (2007) 138-145
47. Scholl T., Bauer B., Gufler B., Kuntschke R., Reiser A., and Kemper A. Scalable community-driven data sharing in e-science grids. Future Generation Computer System 25 3 (2008) 290-300
48. B. Seshasayee, K. Schwan, P. Widener, Soap-binq: High-Performance SOAP with continuous quality management, in: Proc. ICDCS, 2004, pp. 158-165
49. Smith J., Gounaris A., Watson P., Paton N.W., Fernandes A.A.A., and Sakellariou R. Distributed query processing on the grid. Proc. Grid Computing 2002. LNCS vol. 2536 (2002), Springer 279-290
50. Smith J., Gounaris A., Watson P., Paton N.W., Fernandes A.A.A., and Sakellariou R. Distributed query processing on the grid. Int. J. High Perform. Comput. Appl. 17 4 (2003) 353-368
51. Smith J., and Watson P. Fault-tolerance in distributed query processing. IDEAS (2005), IEEE Press 329-338
52. U. Srivastava, K. Munagala, J. Widom, R. Motwani, Query optimization over web services, in: VLDB'2006: Proceedings of the 32nd International Conference on Very Large Data Bases, VLDB Endowment, 2006, pp. 355-366
53. Pahlevi S.M., Lynden S., and Kojima I. Service-based data integration using ogsa-dqp and ogsa-webdb. Proc. 9th IEEE/ACM International Conference on Grid Computing. Grid 2008 (2008), IEEE Press
54. von Laszewski G., Foster I., Gawor J., and Lane P. A java commodity grid kit. Concurrency Comput. Practice Experience 13 8-9 (2001) 643-662
55. Zamboulis L., Fan H., Belhajjame K., Siepen J.A., Jones A.C., Martin N.J., Poulovassilis A., Hubbard S.J., Embury S.M., and Paton N.W. Data access and integration in the ispider proteomics grid. Data Integration in the Life Sciences (2006), Springer, DILS 3-18
56. L. Zamboulis, N. Martin, A. Poulovassilis, Query processing and optimization in integrated heterogeneous grid resources, Technical Report BBKCS-08-05, Birkbeck College, University of London, 2008