Large scale data management in grid systems: A survey

2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications, ICTTA

Volumn , Issue , 2008, Pages

  Hameurlain, Abdelkader ^a   Morvan, Franck ^a   El Samad, Mahmoud ^a  

^a UNIVERSITÉ PAUL SABATIER   (France)

Author keywords

Data management; Grid computing; Mobile agents

Indexed keywords

AGENTS; BENCHMARKING; COMMUNICATION; FINANCIAL DATA PROCESSING; GRID COMPUTING; INFORMATION SERVICES; MANAGEMENT; MANAGEMENT INFORMATION SYSTEMS; MOBILE AGENTS; MULTI AGENT SYSTEMS; TECHNOLOGY; TOTAL QUALITY MANAGEMENT;

AGENT-BASED APPROACHES; AUTONOMIC MANAGEMENT; COST MODELLING; DATA MANAGEMENT; DISTRIBUTED DATA; DYNAMIC QUERY OPTIMIZATION; DYNAMICITY; FUNDAMENTAL PROBLEMS; GRID DATA MANAGEMENT; GRID SYSTEMS; INFORMATION AND COMMUNICATION TECHNOLOGIES; INTENSIVE COMPUTING; INTERNATIONAL CONFERENCES; LARGE-SCALE DATA MANAGEMENT; P2P TECHNIQUES; RESOURCE DISCOVERY; WEB SERVICES;

SECURITY OF DATA;

EID: 49149116930     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICTTA.2008.4530359     Document Type: Conference Paper

References (76)

1. S. Adali et al., "Query Caching and Optimization in Distributed Mediator Systems", Proc. of ACM SIGMOD Intl. Conf. on Management of Data, ACM Press, 1996, pp. 137-148.
2. M. N. Alpdemir et al., "Using OGSA-DQP to Support Scientific Applications for the Grid", Proc. of SAG 2004, LNCS 3458, 2005, pp. 13-24.
3. M. Antonioletti, et al., "The design and implementation of Grid database services in OGSA-DAI", Concurrency and Computation: Practice & Experience , Vol. 17, 2005, pp. 357-376.
4. J.-P. Arcangeli, et al., "Mobile Agent Based Self-Adaptive Join for Wide-Area Distributed Query Processing", Journal of Database Management, Idea Group, Vol. 15, N. 4, 2004, pp. 25-44.
5. R. Avnur, J.-M. Hellerstein, "Eddies: Continuously Adaptive Query Processing", Proc. of the ACM SIGMOD Intl. Conf. on Management of Data, Vol. 29, ACM Press, 2000, pp. 261-272.
6. S. Babu, et al., "Proactive Re-optimization", in: Proc. of the ACM SIGMOD, ACM Press, 2005, pp. 107-118.
7. th Intl. Conf. on Grid and Cooperative Computing, Vol. 00, 2007, pp. 210-220.
8. th Intl. Workshop on Grid Computing, 2003, pp. 184 - 191.
9. nd EEE/ACM International Symposium on Cluster Computing and the Grid, Berlin, 2002, pp.350-351.
10. S. Cheema, et al., "Peer-to-peer Discovery of Computational Resources for Grid Applications", Proc. of Grid Computing Workshop, IEEE CS, 2005, pp. 179-185.
11. C. Chekuri and W. Hasan, "Scheduling Problem in Parallel Query Optimization", Symposium on Principles of Database Systems PODS'95, ACM Press, 1995, pp. 255-265.
12. th Intl. Conf. on Cooperative Information Systems, 2003, pp. 462481.
13. th IEEE Symp. on HPDC, IEEE CS, 2001, pp. 181-194.
14. V. F. V. Da Silva, et al., "An adaptive parallel query processing middleware for the Grid", Concurrence and Computation: Pratique and Experience, Wiley InterScience, Vol. 18, 2006, pp. 621-634.
15. D. J. DeWitt, J. Gray, "Parallel Database Systems, the Future of High Performance Database Systems", ACM , Vol. 35, N. 6, 1992, pp. 85-98.
16. S. Ding et al. "A Heuristic Algorithm for Agent-Based Grid Resource Discovery", Intl. Conf. on e-Technology, e-Commerce and e-Service, IEEE, 2005, pp. 222-225.
17. B. Ergenc, et al.,"Robust Placement of Mobile Relational Operators for Large Scale Distributed Query Optimization", Proc. of the 8th Intl. Conf. on Parallel and Distributed Computing, Applications and Technologies, IEEE CS, 2007, pp. 227-235.
18. I. Foster, "The Grid: A New Infrastructure for 21st Century Science", Physics Today, Vol. 55, N. 2, 2002, p. 42-56.
19. rd Intl. Conf. on AAMAS, 2004, pp. 815.
20. I. Foster, "Globus Toolkit Version 4: Software for Service-Oriented Systems", IFIP Intl. Conf. on Network and Parallel Computing, LNCS 3779, 2005, pp. 2-13.
21. A. Fuggetta, et al., "Understanding Code Mobility", IEEE Transactions on Software Engineering, IEEE CS, Vol. 24, N. 5, 1998, pp. 342-361.
22. M.N. Garofalakis, Y.E. Ioannidis, "Multi-dimensional Resource Scheduling for Parallel Queries", Proc. of the 1996 ACM SIGMOD, Vol. 25, pp. 365-376.
23. A. Gounaris, et al., "Adaptive Query Processing: A Survey", British National Conference on Databases, BNCOD, LNCS, Vol. 2405, 2002, pp. 11-25.
24. th Intl. Dexa Workhop, IEEE CS , 2004, pp. 506-510.
25. A. Gounaris, et al., "Resource Scheduling for Parallel Query Processing on Computational Grids", Proc. of the 5th IEEE/ACM Intl. Workshop on Grid Computing, 2004, pp. 396401.
26. A. Gounaris, et al., "Adapting to Changing Resource Performance in Grid Query", Proc. Of the Intl. VLDB Workshop (Data Management in Grids), LNCS 3836, 2005, pp. 30-44.
27. A. Hameurlain, F. Morvan, "CPU and Incremental Memory Allocation in Dynamic Parallelization of SQL Queries", Journal of Parallel Computing, Vol. 28, N. 4, 2002, pp. 525-556.
28. A. Hameurlain, F. Morvan, "Parallel Query Optimization Methods and Approaches: a Survey", Journal of Computers Systems Science & Engineering, Vol. 19, N. 5, 2004, pp. 95-114.
29. th Intl Dexa Workshop, IEEE CS, 2006, pp. 617-621.
30. th intl. Conf. on VLDB, 1994, pp. 36-47.
31. J.-M. Hellerstien, M. J. Franklin, "Adaptive Query Processing: Technology in Evolution", Bulletin of TCDE, Vol. 23, N. 2, IEEE, 2000, pp. 7-18.
32. rd Intl Conf. on Natural Computation, Vol. 5, 2007, pp. 8-13.
33. C.Huang, et al., "Dart: A Framework for Grid-Based Database Resource Access and Discovery", LNCS, Book of Grid and Cooperative Computing , Vol. 3033, pp. 855-862.
34. th Intl. Symposium on Parallel and Distributed Computing, IEEE CS, 2005, pp. 199-206.
35. th Intl. Conf. on Parallel and Distributed Computing Systems, 2006, p. 273-279.
36. A. Iamnitchi, D. Talia, "P2P computing and interaction with Grids", Future Generation Computer Systems, Vol. 21, N. 3, 2005, pp. 331-332.
37. Z. G. Ives, et al., "An Adaptive Query Execution System for Data Integration", Proc. of the ACM SIGMOD, ACM Press, 1999, pp. 299-310.
38. Z. G. Ives, et al., "Adapting to Source Properties in Processing Data Integration Queries", Proc. of the ACM SIGMOD, ACM Press, 2004, pp. 395-406.
39. R. Jones, J. Brown, "Distributed query processing via mobile agents", 1997, http://www.cs.umd.edu/~rjones/paper.html.
40. N. Kabra, D-J. DeWitt, "Efficient Mid-Query Re-Optimization of Sub-Optimal Query Execution Plans", Proc. of the ACM SIGMOD, Vol. 27, 1998, pp. 106-117.
41. th IEEE Intl. Workshops on Enabling Technologies, 2006, pp. 195-200.
42. D. Kossmann, "The State of the Art in Distributed Query Processing", ACM Computing Surveys, Vol.24, N. 24, ACM Press, 2000, pp. 422-429.
43. S. Liu, H.A. Karimi, "Grid query optimizer to improve query processing in grids", Future Generation Computer Systems, 2008, in Press.
44. H.Lu et al., "Query Processing in Parallel Relational Database Systems", IEEE CS Press, ISBN 0-816-5452-X, 1994.
45. M. Marzolla et al., "Peer-to-Peer for Discovering resources in a Dynamic Grid ", Journal of Parallel Computing, Vol. 33, N. 4-5, 2007, pp. 339-358.
46. D.S. Milojicic, et al., "Peer-to-Peer Computing", Technical Report HPL-2002, http://www.hpl.hp.com/techreports/2002/HPL-2002-57.html
47. th Intl. Conf. on Data Engineering, 1998, pp. 351-360.
48. B. Ozakar, F. Morvan, A. Hameurlain, "Query Optimization: Mobile Agents versus Accuracy of the Cost Estimation", Intl. Journal of Computer Systems Science & Engineering, Vol. 20, N. 3, 2005, pp. 161-168.
49. B. Ozakar, F. Morvan, A. Hameurlain, "Mobile Join Operators for Restricted Sources", Mobile Information Systems, Press Nieuwe Hemweg.Vol. 1, N. 3, 2005, pp. 167-184.
50. M. T. Özsu, P. Valduriez, "Principles of Distributed Database Systems", Second Edition Prentice-Hall, 1999.
51. E. Pacitti, et al., "Grid Data Management: Open Problems and News Issues"; Intl. Journal of Grid Computing; Springer, 2007, Vol. 5, N. 3, pp. 273-281.
52. J.-M. Pierson, et al., "GGM Efficient Navigation and Mining in Distributed Geno-Medical Data", IEEE Transactions on Nanobioscience, IEEE, Vol. 6, N. 2, June 2007, pp. 110-116.
53. F. Porto, et al., "An Adaptive Distributed Query Processing Grid Service", Proc. Of the Intl. VLDB Workshop (Data Management in Grids), LNCS 3836, 2005, pp. 45-57.
54. T. G. Ramos, et al., "An Extensible Resource Discovery Mechanism for Grid Computing Environments", Proc. Of the 6 IEEE Intl. Symposium on Cluster Computing and the Grid, 2006, pp. 115-122.
55. th IFIP/ACM Intl. Conf. on Distributed Systems Platforms, Vol. 2218, 2001, pp. 329-350.
56. A. Sahuguet et al., "Distributed Query Optimization: Can Mobile Agents Help? http://db.cis.upenn.edu/DL/mobile_optimization.pdf, 2000.
57. M. El Samad, et al., "A monitoring service for large scale dynamic query optimization in a Grid environment". Intl. Journal of Web and Grid Services, 2008, in Press.
58. J. M. Schopf, "Grid resource management: state of the art and future trends". Norwell, MA, Kluwer, Academic Publishers, 2004.
59. Y. Slimani, et al., "An Adaptable Cost Model for Distributed Query Optimization on the Grid", Proc. of the intl. Workshop on Grid Computing and Its Application to Data Analysis GADA, LNCS 3292, 2004, pp. 79-87.
60. J. Smith, et al., "Distributed Query Processing on the Grid", Proc. of the Third Workshop on Grid Computing, GRID 2002, LNCS 2536, 2002, pp. 279-290.
61. K. M. Soe, et al.,"Efficient Scheduling of Resources for Parallel Query Processing on Grid-based Architecture", Proc. of the 6th Asia-Pacific Symposium, IEEE, 2005, pp. 276-281.
62. I. Stoica, et al.,"Chord: A Scalable Peer-to-Peer Lookup Service for Internet Applications", Proc. of the 2001 ACM SIGCOMM Conf., pp. 17-32.
63. D. Talia, P. Trunfio, "Toward a synergy between P2P and Grids", IEEE Internet Computing, Vol. 7, N. 4, 2003, pp. 94-96.
64. D. Talia, P. Trunfio, "Peer-to-Peer protocols and Grid services for resource discovery on Grids", Advances in Parallel Computing, Vol. 14, Elsevier Science, 2005, pp. 83-103.
65. P. Trunfio, et al., "Peer-to-Peer resource discovery in Grids: Models and systems", Future Generation Computer Systems, Elsevier, 2007, Vol. 23, N. 7, pp. 864-878.
66. J. D. Ullman: Principles of Database and Knowledge-Base Systems, Computer Science Press 1989.
67. G. Wiederhold, "Mediators in the Architecture of Future Information Systems", Journal of IEEE Computer, Vol. 25, N.3, 1992, pp. 3849.
68. A. Wohrer et al., "Novel mediator architectures for Grid information systems", Future Generation Computer Systems, Elsevier, 2005, pp. 107-114.
69. A. Wohrer, P. Brezany, "A monitoring Service for Relational Database to Support Advanced Data Integration on the Grid", 1st Intl. Conf. on Complex, Intelligent and Software Intensive Systems, 2007, pp. 27-34.
70. R. Wolski et al., "The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing", Journal of Future Generation Computing Systems, Elsevier , Vol. 15, N. 5-6, 1999, pp. 757-768.
71. B. Yang, H. Garcia-Molina, "Designing a super-peer network:, Proc. of the 19th Intl. Conf. on Data Engineering, 2003, pp. 49-60.
72. rd Intl. Conf. on Semantics, Knowledge and Grid, 2007, pp. 570-571.
73. J. Yu et al., "Grid Resource Management Based on Mobile Agent", Proc. of the Intl. Conf. on Computational Intelligence for Modeling Control and Automation and Intl. Conf. on Intelligent Agents Web Technologies and Intl Commerce, 2006, pp. 255-256.
74. S. Zanikolas and R. Sakellariou, "A taxonomy of grid monitoring systems", Future Generation Computer Systems, Elsevier, Vol. 21, 2005, pp. 163-188.
75. Q. Zhu, S. Motheramgari, Y. Sun, "Cost Estimation for Queries Experiencing Multiple Contention States in Dynamic Multidatabase Environments", Journal of Knowledge and Information Systems, Vol. 5, No1, 2003, pp. 2649.
76. Y. Zhou, et al., "An adaptable distributed query processing architecture", Data & Knowledge Engineering, Vol. 53, N. 3, 2005, pp. 283-309.