Filecules in high-energy physics: Characteristics and impact on resource management

Proceedings of the IEEE International Symposium on High Performance Distributed Computing

Volumn 2006, Issue , 2006, Pages 69-79

  Iamnitchi, Adriana ^a   Doraimani, Shyamala ^a   Garzoglio, Gabriele ^b  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b FERMI NATIONAL ACCELERATOR LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FILECULES; MATURE GRID DEPLOYMENTS; RESOURCE MANAGEMENT; WORKLOAD MODELS;

ABSTRACTING; COMPUTER SUPPORTED COOPERATIVE WORK; DATA ACQUISITION; DATA REDUCTION; HIGH ENERGY PHYSICS; RESOURCE ALLOCATION;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 33845895313     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. Bittorrent, http://www.bittorrent.com.
2. L. Adamic, B. Huberman, R. Lukose, and A. Puniyani. Search in power law networks. Physical Review. E, 64:46135-46143, 2001.
3. E. Adar and B. A. Huberman. Free riding on Gnutella. First Monday, 5(10), 2000.
4. M. Allen and R. Wolski. The Livny and Plank-Beck problems: Studies in data movement on the computational grid. In Supercomputing, 2003.
5. A. Amer, D. D. E. Long, and R. C. Burns. Group-based management of distributed file caches. In ICDCS, pages 525-, 2002.
6. M. Arlitt, R. Friedrich, and T. Jin. Workload characterization of a web proxy in a cable modem environment. Technical Report HPL-1999-48, Hwelett-Packard Laroratories, 1999.
7. P. Avery and I. Foster. The griphyn project: Towards petascale virtual data Grids. Technical Report GriPhyN-2001-15, 2001.
8. L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web caching and Zipf-like distributions: Evidence and implications. In InfoCom, New York, NY, 1999. IEEE Press.
9. R. Brun and F. Rademakers. ROOT: An object oriented data analysis framework, 1996.
10. The collider detector at fermilab, http://www-cdf.fnal.gov/physics/ public/public.html.
11. E. Cohen, A. Fiat, and H. Kaplan. Associative search in peer to peer networks: Harnessing latent semantics. In Infocom, San Fancisco, CA, 2003.
12. The DZero Experiment., http://www-d0.fnal.gov.
13. Deutches Elektronen-Synchrotron, http://www.desy.de.
14. J. R. Douceur and W. J. Bolosky. A large-scale study of file-system contents. In Proceedings of the ACM SIGMETRICS international conference on Measurement and modeling of computer systems, pages 59-70, Atlanta, Georgia, USA, 1999. ACM Press New York, NY, USA.
15. M. Faloutsos, P. Faloutsos, and C. Faloutsos. On power-law relationships of the internet topology. In SIGCOMM, pages 251-262, 1999.
16. I. Foster and A. Iamnitchi. On death, taxes, and the convergence of peer-to-peer and Grid computing. In 2nd International Workshop on Peer-to-Peer Systems (IPTPS '03), Berkeley, CA, 2003.
17. I. Foster, C. Kesselman, and S. Tuecke. The anatomy of the Grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Applications, 15(3):200-222, 2001.
18. P. Fuhrmann. dCache: the commodity cache. In Twelfth NASA Goddard and Twenty First IEEE Conference on Mass Storage Systems and Technologies, Washington DC, Spring 2004.
19. G. R. Ganger and M. F. Kaashoek. Embedded inodes and explicit grouping: Exploiting disk bandwidth for small files. In USENIX Annual Technical Conference, pages 1-17, 1997.
20. J. Griffioen and R. Appleton. Reducing file system latency using a predictive approach. In USENIX Summer, pages 197-207, 1994.
21. A. Iamnitchi and I. Foster. Interest-aware information dissemination in small-world communities. 2005.
22. A. Iamnitchi, M. Ripeanu, and I. Foster. Small-world file-sharing communities. In Infocom, Hong Kong, China, 2004.
23. N. Leibowitz, M. Ripeanu, and A. Wierzbicki. Deconstructing the Kazaa network. In Workshop on Internet Applications, San Francisco, CA, 2003.
24. L. Loebel-Carpenter, L. Lueking, C. Moore, R. Pordes, J. Trumbo, S. Veseli, I. Terekhov, M. Vranicar, S. White, and V. White. SAM and the particle physics data Grid. In Computing in High-Energy and Nuclear Physics, Beijing, China, 2001.
25. E. Otoo, D. Rotem, and A. Romosan. Optimal file-bundle caching algorithms for data-grids. In SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing, page 6, Washington, DC, USA, 2004. IEEE Computer Society.
26. E. J. Otoo, D. Rotem, A. Romosan, and S. Seshadri. File caching in data intensive scientific applications on data-grids. In Data Management in Grids, 2005.
27. E. J. Otoo, D. Rotem, and S. Seshadri. Efficient algorithms for multi-file caching. In 15th International Conference Database and Expert Systems Applications, pages 707-719, 2004.
28. Particle physics data grid project, http://www.ppdg.net.
29. M. Ripeanu, A. Iamnitchi, and I. Foster. Mapping the Gnutella network: Properties of large-scale peer-to-peer systems and implications for system design. Internet Computing, 6(1):50-57, 2002.
30. S. Saroiu, P. K. Gummadi, R. Dunn, S. D. Gribble, and H. Levy. An analysis of internet content delivery systems. In Proc. of the Fifth Symposium on Operating Systems Design and Implementation (OSDI 2002), Boston, MA, USA, 2002.
31. S. Saroiu, P. K. Gummadi, and S. D. Gribble. A measurement study of peer-to-peer file sharing systems. In Multimedia Computing and Networking (MMCN), San Jose, CA, USA, 2002.
32. C. D. Tait and D. Duchamp. Detection and exploitation of file working sets. In Proceedings of the 11th International Conference on Distributed Computing Systems (ICDCS), pages 2-9, Washington, DC, 1991. IEEE Computer Society.
33. I. Terekhov. Meta-computing at D0. In Nuclear Instruments and Methods in Physics Research, Section A, NIMA14225, volume 502/2-3, pages 402-406, 2002.
34. D. Thain, J. Bent, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and M. Livny. Pipeline and batch sharing in grid workloads. In Proceedings of the Twelfth IEEE Symposum on High Performance Distributed Computing, pages 152-161, Seattle, WA, June 2003.
35. B. Wei, G. Fedak, and F. Cappello. Collaborative data distribution with BitTorrent for computational desktop grids, 2005.
36. B. Wei, G. Fedak, and F. Cappello. Scheduling independent tasks sharing large data distributed with BitTorrent, 2005.
37. N. E. Young. On-line file caching. In SODA '98: Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms, pages 82-86, Philadelphia, PA, USA, 1998. Society for Industrial and Applied Mathematics.