A high performance suite of data services for grids

Future Generation Computer Systems

Volumn 26, Issue 4, 2010, Pages 622-632

  Sánchez, Alberto ^a   Pérez, María S ^b   Montes, Jesús ^c   Cortes, Toni ^d  

^a UNIVERSIDAD REY JUAN CARLOS   (Spain)

^b UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^c UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^d BARCELONA SUPERCOMPUTING CENTER   (Spain)

Author keywords

Data access services; Data exchange; Data grids; Data storage; Data intensive applications

Indexed keywords

DATA ACCESS; DATA EXCHANGE; DATA GRID; DATA STORAGE; DATA-INTENSIVE APPLICATION;

DATA STORAGE EQUIPMENT;

GRID COMPUTING;

EID: 74849103917     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2009.11.006     Document Type: Article

References (51)

1. K. Holtman, Object level physics data replication in the grid, in: Proceedings of the VII International Workshop on Advanced Computing and Analysis Techniques in Physics Research, ACAT 2000, October 2000, pp. 244-246
2. Lyster P.M., Ding C.H.Q., Ekers K., Ferraro R., Guo J., Harber M., Lamich D., Larson J.W., Lucchesi R., Rood R., Schubert S., Sawyer W., Sienkiewicz M., da Silva A., Stobie J., Takacs L.L., Todling R., and Zero J. Parallel computing at the nasa data assimilation office (dao). Proceedings of the 1997 ACM/IEEE Conference on Supercomputing. Supercomputing'97 (1997), ACM, New York, NY, USA 1-18
3. Young S.J., Fan G.Y., Hessler D., Lamont S., Elvins T.T., Hadida M., Hanyzewski G., Durkin J.W., Hubbard P., Kindlmann G., Wong E., Greenberg D., Karin S., and Ellisman M.H. Implementing a collaboratory for microscopic digital anatomy. Supercomputer Applications and High Performance Computing 10 2-3 (1996) 170-181
4. Freitag L.A., and Loy R.M. Adaptive, multiresolution visualization of large data sets using a distributed memory octree. Proceedings of the 1999 ACM/IEEE Conference on Supercomputing. Supercomputing'99 (1999), ACM Press and IEEE Computer Society Press, Portland, OR 60
5. Chervenak A., Foster I., Kesselman C., Salisbury C., and Tuecke S. The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Computer Applications 23 3 (2000) 187-200
6. Avery P. Data grids: A new computational infrastructure for data-intensive science. Philosophical Transactions of the Royal Society of London Series A-Mathematical Physical and Engineering Sciences 360 1795 (2002) 1191-1209
7. W. Hoschek, F.J. Jaen-Martinez, A. Samar, H. Stockinger, K. Stockinger, Data management in an international data grid project, in: Proceedings of the First IEEE/ACM International Workshop on Grid Computing, GRID 2000, December 2000
8. Kielmann T., Bal H.E., Maassen J., Nieuwpoort R.v., Eyraud L., Hofman R., and Verstoep K. Programming environments for high-performance grid computing: The Albatross project. Future Generation Computer Systems 18 8 (2002) 1113-1125
9. Becker D., Frings W., and Wolf F. Performance evaluation and optimization of parallel grid computing applications. Proceedings of the 16th Euromicro Conference on Parallel, Distributed and Network-based Processing. PDP 2008 (2008), IEEE Computer Society, Washington, DC, USA 193-199
10. Pérez M.S., Carretero J., García F., Peña Sánchez J.M., and Robles V. MAPFS-Grid: A flexible architecture for data-intensive grid applications. In: Rivera F.F., Bubak M., Tato A.G., and Doallo R. (Eds). European Across Grids Conference. Lecture Notes in Computer Science vol. 2970 (2003), Springer 111-118
11. I. Foster, C. Kesselman, J.M. Nick, S. Tuecke, The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, January 2002. Online at: http://www.globus.org/research/papers/ogsa.pdf
12. W. Allcock, J. Bester, J. Bresnahan, A. Chervenak, L. Liming, S. Meder, S. Tuecke, GridFTP Protocol Specification, September 2002
13. Karasavvas K., Antonioletti M., Atkinson M.P., Chue Hong N.P., Sugden T., Hume A.C., Jackson 0003 M., Krause A., and Palansuriya C. Introduction to OGSA-DAI services. In: Herrero P., Pérez M.S., and Robles V. (Eds). SAG. Lecture Notes in Computer Science vol. 3458 (2004), Springer 1-12
14. S. Graham, A. Karmarkar, J. Mischkinsky, I. Robinson, I. Sedukhin, Web service resource framework, Technical Report Version 1.2, OASIS, 2006
15. Chiu K., Govindaraju M., and Bramley R. Investigating the limits of SOAP performance for scientific computing. Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing. HPDC '02 (2002), IEEE Computer Society, Washington, DC, USA 246
16. W3C. SOAP Message Transmission Optimization Mechanism, January 2005. Available: http://www.w3.org/TR/soap12-mtom (accessed Nov. 2009)
17. Sundaresan N., and Moussa R. Algorithms and programming models for efficient representation of XML for internet applications. Computer Networks 39 5 (2002) 681-697
18. Liefke H., and Suciu D. XMILL: An efficient compressor for XML data. In: Chen W., Naughton J.F., and Bernstein P.A. (Eds). SIGMOD Conference (2000), ACM 153-164
19. Allcock W., Bresnahan J., Kettimuthu R., and Link M. The globus striped GridFTP framework and server. Proceedings of the 2005 ACM/IEEE Conference on Supercomputing. Supercomputing'05 (2005), IEEE Computer Society, Washington, DC, USA 54
20. Pérez M.S., Carretero J., Peña J.M., García F., and Robles V. MAPFS: A flexible multiagent parallel file system for clusters. Future Generation Computer Systems 22 5 (2006) 620-632
21. Data Access and Integration Services Working Group. Available: https://forge.gridforum.org/projects/dais-wg (accessed Nov. 2009)
22. Pérez M.S., García F., and Carretero J. A new multiagent based architecture for high performance I/O in clusters. International Conference on Parallel Processing (ICPP) Workshops (2001), IEEE Computer Society 201-206
23. I. Foster, et al. The Open Grid Services Architecture, version 1.0. 2005
24. M. Atkinson, K. Karasavvas, M. Antonioletti, R. Baxter, A. Borley, N. Chue Hong, A. Hume, M. Jackson, A. Krause, S. Laws, N. Paton, J. Schopf, T. Sugden, K. Tourlas, P. Watson, A new architecture for OGSA-DAI, in: Proceeedings of UK e-Science All Hands Meeting, 2005
25. SOAP Version 1.2: Messaging Framework, April 2007. Available: http://www.w3.org/TR/soap12-part1/ (accessed Nov. 2009)
26. Gmez-Martnez E., and Merseguer J. Frontiers of high performance computing and networking. In: Min G., Di Martino B., Tianruo Yang L., Guo M., and Rnger G. (Eds). ISPA 2006 International Workshops. Lecture Notes in Computer Science vol. 4331 (2006), Springer 884-896
27. Vilett C. Moore's Law vs. Storage Improvements vs. Optical Improvements (2001), Scientific American
28. Venugopal S., Buyya R., and Ramamohanarao K. A taxonomy of Data Grids for distributed data sharing, management, and processing. ACM Computing Surveys 38 1 (2006) 3
29. GT 4.0: Security. Available: http://www.globus.org/toolkit/docs/4.0/security (accessed Nov. 2009)
30. Allcock B., Bester J., Bresnahan J., Chervenak A.L., Foster I., Kesselman C., Meder S., Nefedova V., Quesnal D., and Tuecke S. Data management and transfer in high performance computational grid environments. Parallel Computing Journal 28 5 (2002) 749-771
31. J.S. Plank, M. Beck, W. Elwasif, T. Moore, M. Swany, R. Wolski, The Internet Backplane Protocol: Storage in the network. NetStore'99: Network Storage Symposium. Internet2, October 1999. http://dsi.internet2.edu/netstore99
32. Bassi A., Beck M., Moore T., Plank J.S., Swany M., Wolski R., and Fagg G. The internet backplane protocol: A study in resource sharing. Future Generation Computer Systems 19 4 (2003) 551-562
33. Thain D., Basney J., Son S.-C., and Livny M. The Kangaroo approach to data movement on the grid. Proceedings of the Tenth IEEE Symposium on High Performance Distributed Computing. HPDC10 (2001), IEEE Computer Society, Los Alamitos, CA, USA 0325
34. Baru C.K., Moore R.W., Rajasekar A., and Wan M. The SDSC storage resource broker. In: MacKay S.A., and Johnson J.H. (Eds). Proceedings of the 1998 Conference of the Centre for Advanced Studies on Collaborative Research. CASCON (1998), IBM Press, Toronto, Ontario, Canada 5
35. Chervenak A., Deelman E., Foster I., Guy L., Hoschek W., Iamnitchi A., Kesselman C., Kunszt P., Ripeanu M., Schwartzkopf B., Stockinger H., Stockinger K., and Tierney B. Giggle: A framework for constructing scalable replica location services. Proceedings of the 2002 ACM/IEEE Conference on Supercomputing. Supercomputing'02 (2002), IEEE Computer Society Press, Los Alamitos, CA, USA 1-17
36. Stockinger H., Samar A., Muzaffar S., and Donno F. Grid data mirroring package (GDMP). Scientific Programming 10 2 (2002) 121-133
37. Tatebe O., Morita Y., Matsuoka S., Soda N., and Sekiguchi S. Grid datafarm architecture for petascale data intensive computing. Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid. CCGRID'02 (2002), IEEE Computer Society, Washington, DC, USA 102
38. T. Perelmutov, D. Petravick, E. Corso, L. Magnoni, O. Barring, J. Baud, F. Donno, M. Litmaath, S. De Witt, J. Jensen, M. Haddox-Schatz, B. Hess, A. Kowalski, C. Watson, The storage resource manager interface specification, version 2.2. Lawrence Berkeley National Laboratory, January 2007
39. CASTOR-CERN Advanced Storage Manager. Available: http://castor.web.cern.ch/castor (accessed Nov. 2009)
40. R.W. Watson, R.A. Cyne, The parallel I/O architecture of the high-performance storage system (HPSS), in: Proceedings of the IEEE Symposium on Mass Storage Systems, 1995, pp. 27-44
41. HPSS-High Performance Storage System. Available: http://www.hpss-collaboration.org/hpss/ (accessed Nov. 2009)
42. Fermilab MASS STORAGE SYSTEM-Enstore. Available: http://www-ccf.fnal.gov/enstore/ (accessed Nov. 2009)
43. Hess B.K., Haddox-Schatz M., and Kowalski M.A. The design and evolution of Jefferson lab's Jasmine mass storage system. Proceedings of the 22nd IEEE/13th NASA Goddard Conference on Mass Storage Systems and Technologies. MSST'05 (2005), IEEE Computer Society 94-105
44. M. Ernst, P. Fuhrmann, M. Gasthuber, T. Mkrtchyan, C. Waldman, dCache, a distributed storage data caching system, in: Proceedings of the International Conference on Computing on High-Energy and Nuclear Physics, CHEP'01, Beijing, China, September 2001, p. 244
45. dCache. Available: http://www.dcache.org/ (accessed Nov. 2009)
46. Magowan J. A view on relational data on the grid. Proceedings of the 17th International Symposium on Parallel and Distributed Processing. IPDPS'03 (2003), IEEE Computer Society, Washington, DC, USA 90
47. Malaika S., Eisenberg A., and Melton J. Standards for databases on the grid. SIGMOD Record 32 3 (2003) 92-100
48. Bester J., Foster I., Kesselman C., Tedesco J., and Tuecke S. Gass: A data movement and access service for wide area computing systems. IOPADS '99: Proceedings of the Sixth Workshop on I/O in Parallel and Distributed Systems (1999), ACM Press, New York, NY, USA 78-88
49. Brian S. White, Andrew S. Grimshaw, Anh Nguyen-Tuong, Grid-based file access: The legion I/O model, in: Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing, HPDC'00, 2000, pp. 165-174
50. Bhardwaj D., and Sinha M. Gridfs: Ensuring high-speed data transfer using massively parallel I/O. In: Bhalla S. (Ed). DNIS. Lecture Notes in Computer Science vol. 3433 (2005), Springer 280-287
51. F. Hupfeld, T. Cortes, B. Kolbeck, E. Focht, M. Hess, J. Malo, J. Marti, J. Stender, E. Cesario, Xtreemfs: A case for object-based storage in grid data management, in: Proceedings of 33th International Conference on Very Large Data Bases (VLDB) Workshops, 2007