Enabling high data throughput in desktop grids through decentralized data and metadata management: The BlobSeer approach

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5704 LNCS, Issue , 2009, Pages 404-416

  Nicolae, Bogdan ^a   Antoniu, Gabriel ^b   Bougé, Luc ^c  

^a UNIVERSITÉ DE RENNES 1   (France)

^b CAMPUS DE BEAULIEU   (France)

^c UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS PATTERNS; CENTRALIZED SERVER; CONTENT DISTRIBUTION NETWORKS; DATA AND METADATA; DATA MANAGEMENT; DATA STORAGE; DATA THROUGHPUT; DESKTOP GRID; DISTRIBUTED HASH TABLES; HIGH OUTPUT; INPUT DATAS; MANAGEMENT SERVICE; PEER-TO-PEER PROTOCOLS; RECENT PROGRESS; SEGMENT TREE;

ARTIFICIAL INTELLIGENCE; BIOINFORMATICS; DISTRIBUTED PARAMETER NETWORKS; METADATA; NETWORK PROTOCOLS;

RANDOM ACCESS STORAGE;

EID: 70350635638     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-03869-3_40     Document Type: Conference Paper

References (17)

1. Anderson, D.P.: Boinc: A system for public-resource computing and storage. In: GRID 2004: Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing,, Washington, DC, USA, pp. 4-10. IEEE Computer Society, Los Alamitos (2004)
2. Fedak, G., Germain, C., Neri, V.: Xtremweb: A generic global computing system. In: CC-GRID 2001: Proceedings of the IEEE International Symposium on Cluster Computing and the Grid. pp. 582-587. Press (2001)
3. Chien, A., Calder, B., Elbert, S., Bhatia, K.: Entropia: Architecture and performance of an enterprise desktop grid system. Journal of Parallel and Distributed Computing 63, 597-610 (2003)
4. Costa, F., Silva, L., Fedak, G., Kelley, I.: Optimizing data distribution in desktop grid platforms. Parallel Processing Letters (PPL) 18, 391-410 (2008)
5. Al-Kiswany, S., Ripeanu, M., Vazhkudai, S.S., Gharaibeh, A.: Stdchk: A checkpoint storage system for desktop grid computing. In: ICDCS 2008: Proceedings of the the 28th International Conference on Distributed Computing Systems, Washington, DC, USA, pp. 613-624. IEEE Computer Society, Los Alamitos (2008)
6. Lustre file system: High-performance storage architecture and scalable cluster file system. White Paper (2007), http://wiki.lustre.org/index.php/Lustre Publications
7. Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: Pvfs: A parallel file system for linux clusters. In: ALS 2000: Proceedings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, USA, pp. 317-327. USENIX Association (2000)
8. Ghemawat, S., Gobioff, H., Leung, S.T.: The google file system. SIGOPS Oper. Syst. Rev. 37(5), 29-43 (2003)
9. You, L.L., Pollack, K.T., Long, D.D.E.: Deep store: An archival storage system architecture. In: ICDE 2005: Proceedings of the 21st International Conference on Data Engineering, Washington, DC, USA, pp. 804-8015. IEEE Computer Society, Los Alamitos (2005)
10. Respower render farm (2003), http://www.respower.com
11. Patoli, Z., Gkion, M., Al-Barakati, A., Zhang, W., Newbury, P.F., White, M.: How to build an open source render farm based on desktop grid computing. In: Hussain, D.M.A., Rajput, A.Q.K., Chowdhry, B.S., Gee, Q. (eds.) IMTIC. Communications in Computer and Information Science, vol. 20, pp. 268-278. Springer, Heidelberg (2008)
12. Nicolae, B., Antoniu, G., Bougé, L.: How to enable efficient versioning for large object storage under heavy access concurrency. In: EDBT 2009: 2nd International Workshop on Data Management in P2P Systems (DaMaP 2009), St Petersburg, Russia (2009)
13. Nicolae, B., Antoniu, G., Bougé, L.: Enabling lock-free concurrent fine-grain access to massive distributed data: Application to supernovae detection. In: CLUSTER 2008: Proceedings of the 2008 IEEE International Conference on Cluster Computing, Tsukuba, Japan, pp. 310-315 (2008)
14. Nicolae, B., Antoniu, G., Bougé, L.: Distributed management of massive data: An efficient fine-grain data access scheme. In: Palma, J.M.L.M., Amestoy, P.R., Daydé, M., Mattoso, M., Lopes, J.C. (eds.) VECPAR 2008. LNCS, vol. 5336, pp. 532-543. Springer, Heidelberg (2008)
15. Zheng, C., Shen, G., Li, S., Shenker, S.: Distributed segment tree: Support of range query and cover query over dht. In: IPTPS 2006: The Fifth International Workshop on Peer-to-Peer Systems, Santa Barbara, USA (2006)
16. Boost c++ libraries (2008), http://www.boost.org
17. Bolze, R., Cappello, F., Caron, E., Daydé, M., Desprez, F., Jeannot, E., Jégou, Y., Lanteri, S., Leduc, J.,Melab, N.,Mornet, G., Namyst, R., Primet, P.,Quetier, B., Richard, O., Talbi, E.G., Touche, I.: Grid'5000: A large scale and highly reconfigurable experimental grid testbed. Int. J. High Perform. Comput. Appl. 20(4), 481-494 (2006)