메뉴 건너뛰기




Volumn , Issue , 2010, Pages

Reconciling scratch space consumption, exposure, and volatility to achieve timely staging of job input data

Author keywords

Data staging; End user data delivery; High performance data management; HPC center serviceability

Indexed keywords

CURRENT PRACTICES; DATA DELIVERY; DATA SOURCE; DIRECT TRANSFER; END USERS; HIGH-END COMPUTING; HIGH-SPEED; INPUT DATAS; INTERMEDIATE NODE; JOB THROUGHPUT; PERFORMANCE DATA; PLANETLAB; SCIENTIFIC APPLICATIONS; SPACE CONSUMPTION; START-UPS; STARTUP TIME;

EID: 77953972798     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2010.5470367     Document Type: Conference Paper
Times cited : (3)

References (49)
  • 1
    • 77954009024 scopus 로고    scopus 로고
    • LHC-the large hadron collider
    • LHC-the large hadron collider. http://lhc.web.cern.ch/lhc/, 2009
    • (2009)
  • 2
    • 77953978088 scopus 로고    scopus 로고
    • Spallation Neutron Source
    • Spallation Neutron Source. http://www.sns.gov/, 2008.
    • (2008)
  • 3
    • 77953968541 scopus 로고    scopus 로고
    • Sloan digital sky survey
    • Sloan digital sky survey. http://www.sdss.org, 2005.
    • (2005)
  • 4
    • 77953974248 scopus 로고    scopus 로고
    • Laser Interferometer Gravitational-Wave Observatory
    • Laser Interferometer Gravitational-Wave Observatory. http://www.ligo. caltech.edu/, 2008.
    • (2008)
  • 5
    • 0029482941 scopus 로고
    • The parallel i/o architecture of the high-performance storage system (hpss)
    • R.A. Coyne and R.W. Watson. The parallel i/o architecture of the high-performance storage system (hpss). In Proc. IEEE MSS Symposium, 1995.
    • (1995) Proc. IEEE MSS Symposium
    • Coyne, R.A.1    Watson, R.W.2
  • 6
    • 77954022118 scopus 로고    scopus 로고
    • National center for biotechnology information
    • National center for biotechnology information. http://www.ncbi.nlm.nih. gov/, 2009.
    • (2009)
  • 7
    • 77953998338 scopus 로고    scopus 로고
    • National Center for Computational Sciences
    • National Center for Computational Sciences. http://www.nccs.gov/, 2008.
    • (2008)
  • 8
    • 85084160707 scopus 로고    scopus 로고
    • Disk failures in the real world: What does an mttf of 1,000,000 hours mean to you?
    • Bianca Schroeder and Garth A. Gibson. Disk failures in the real world: what does an mttf of 1,000,000 hours mean to you? In Proc. USENIX FAST, 2007.
    • (2007) Proc. USENIX FAST
    • Schroeder, B.1    Gibson, G.A.2
  • 10
    • 27744473438 scopus 로고    scopus 로고
    • Reliability analysis of disk drive failure mechanisms
    • S. Shah and J.G. Elerath. Reliability analysis of disk drive failure mechanisms. In Proc. RAMS, 2005.
    • (2005) Proc. RAMS
    • Shah, S.1    Elerath, J.G.2
  • 11
    • 2942747872 scopus 로고    scopus 로고
    • Using run-time predictions to estimate queue wait times and improve scheduler performance
    • W. Smith, V.E. Taylor, and I.T. Foster. Using run-time predictions to estimate queue wait times and improve scheduler performance. In Proc. JSSPP, 1997.
    • (1997) Proc. JSSPP
    • Smith, W.1    Taylor, V.E.2    Foster, I.T.3
  • 12
    • 0002516307 scopus 로고    scopus 로고
    • Using queue time predictions for processor allocation
    • A. Downey. Using queue time predictions for processor allocation. In Proc. JSSPP, 1997.
    • (1997) Proc. JSSPP
    • Downey, A.1
  • 14
    • 77954006268 scopus 로고    scopus 로고
    • Cluster resources. http://www.clusterresources.com/, 2008.
    • (2008) Cluster Resources
  • 16
    • 0032592464 scopus 로고    scopus 로고
    • The network weather service: A distributed resource performance forecasting service for metacomputing
    • Rich Wolski, Neil Spring, and Jim Hayes. The Network Weather Service: A distributed resource performance forecasting service for metacomputing. Future Generation Computing Systems, 15(5):757-768, 1999.
    • (1999) Future Generation Computing Systems , vol.15 , Issue.5 , pp. 757-768
    • Wolski, R.1    Spring, N.2    Hayes, J.3
  • 20
    • 2442502680 scopus 로고    scopus 로고
    • Stork: Making data placement a first class citizen in the grid
    • T. Kosar and M. Livny. Stork: Making data placement a first class citizen in the grid. In Proc. ICDCS, 2004.
    • (2004) Proc. ICDCS
    • Kosar, T.1    Livny., M.2
  • 21
    • 51849134699 scopus 로고    scopus 로고
    • Scale and performance in the CoBlitz large-file distribution service
    • KyoungSoo Park and Vivek S. Pai. Scale and performance in the CoBlitz large-file distribution service. In Proc. 3rd USENIX NSDI, 2006.
    • (2006) Proc. 3rd USENIX NSDI
    • Park, K.1    Pai, V.S.2
  • 24
    • 12144291755 scopus 로고    scopus 로고
    • A blueprint for introducing disruptive technology into the internet
    • Larry Peterson, Tom Anderson, David Culler, and Timothy Roscoe. A Blueprint for Introducing Disruptive Technology into the Internet. In Proc. ACM HotNets, 2002.
    • (2002) Proc. ACM HotNets
    • Peterson, L.1    Anderson, T.2    Culler, D.3    Roscoe, T.4
  • 25
    • 34548012303 scopus 로고    scopus 로고
    • A power-aware run-time system for high-performance computing
    • C. Hsu and W. Feng. A power-aware run-time system for high-performance computing. In Proc. SC, 2005.
    • (2005) Proc. SC
    • Hsu, C.1    Feng., W.2
  • 27
    • 77953969533 scopus 로고    scopus 로고
    • TeraGrid
    • TeraGrid. http://www.teragrid.org/, 2009.
    • (2009)
  • 28
    • 77953985151 scopus 로고    scopus 로고
    • Internet2
    • Internet2. http://www.internet2.edu/, 2008.
    • (2008)
  • 29
    • 77953997659 scopus 로고    scopus 로고
    • Reddnet
    • Reddnet. http://www.reddnet.org/, 2009.
    • (2009)
  • 30
    • 77954023124 scopus 로고    scopus 로고
    • National Lambda Rail
    • National Lambda Rail. http://www.nlr.net/, 2008.
    • (2008)
  • 31
    • 77954012813 scopus 로고    scopus 로고
    • Batch Queue Prediction
    • Batch Queue Prediction. http://nws.cs.ucsb.edu/ewiki/nws.php?id= Batch+Queue+Prediction, 2008.
    • (2008)
  • 32
    • 70149104141 scopus 로고    scopus 로고
    • Optimizing center performance through coordinated data staging, scheduling and recovery
    • Z. Zhang, C. Wang, S. S. Vazhkudai, X. Ma, G. Pike, J. Cobb, and F. Mueller. Optimizing center performance through coordinated data staging, scheduling and recovery. In Proc. SC, 2007.
    • (2007) Proc. SC
    • Zhang, Z.1    Wang, C.2    Vazhkudai, S.S.3    Ma, X.4    Pike, G.5    Cobb, J.6    Mueller, F.7
  • 33
    • 70449707775 scopus 로고    scopus 로고
    • Scratch as a cache: Rethinking hpc center scratch storage
    • H. Monti, A.R. Butt, and S.S. Vazhkudai. /scratch as a cache: Rethinking hpc center scratch storage. In Proc. ICS, 2009.
    • (2009) Proc. ICS
    • Monti, H.1    Butt, A.R.2    Vazhkudai, S.S.3
  • 35
    • 57349105585 scopus 로고    scopus 로고
    • Disk scrubbing versus intra-disk redundancy for high-reliability raid storage systems
    • Ilias Iliadis, Robert Haas, Xiao-Yu Hu, and Evangelos Eleftheriou. Disk scrubbing versus intra-disk redundancy for high-reliability raid storage systems. In Proc. SIGMETRICS, 2008.
    • (2008) Proc. SIGMETRICS
    • Iliadis, I.1    Haas, R.2    Hu, X.-Y.3    Eleftheriou, E.4
  • 38
    • 77953984281 scopus 로고    scopus 로고
    • Druschel et. al. Freepastry
    • Druschel et. al. Freepastry. http://freepastry.rice.edu/, 2004.
    • (2004)
  • 40
    • 0031223146 scopus 로고    scopus 로고
    • A tutorial on reed-solomon coding for fault- tolerance in RAID-like systems
    • J. S. Plank. A tutorial on Reed-Solomon coding for fault- tolerance in RAID-like systems. Software - Practice & Experience, 27(9):995-1012, 1997.
    • (1997) Software - Practice & Experience , vol.27 , Issue.9 , pp. 995-1012
    • Plank, J.S.1
  • 44
    • 27544508607 scopus 로고    scopus 로고
    • The kangaroo approach to data movement on the grid
    • D. Thain, S. Son J. Basney, and M. Livny. The kangaroo approach to data movement on the grid. In Proc. HPDC, 2001.
    • (2001) Proc. HPDC
    • Thain, D.1    Son J Basney, S.2    Livny, M.3
  • 46
    • 85091097467 scopus 로고    scopus 로고
    • Reliability and security in the CoDeeN content distribution network
    • L. Wang, K. Park, R. Pang, V. Pai, and L. Peterson. Reliability and security in the CoDeeN content distribution network. In Proc. USENIX ATC, 2004.
    • (2004) Proc. USENIX ATC
    • Wang, L.1    Park, K.2    Pang, R.3    Pai, V.4    Peterson, L.5
  • 48
    • 0141459059 scopus 로고    scopus 로고
    • Algorithms for high performance, wide-area distributed file downloads
    • James S. Plank, Scott Atchley, Ying Ding, and Micah Beck. Algorithms for high performance, wide-area distributed file downloads. Parallel Processing Letters, 13(2):207-224, 2003.
    • (2003) Parallel Processing Letters , vol.13 , Issue.2 , pp. 207-224
    • Plank, J.S.1    Atchley, S.2    Ding, Y.3    Beck, M.4
  • 49
    • 18844361883 scopus 로고    scopus 로고
    • Downloading replicated, wide-area files - A framework and empirical evaluation
    • Rebecca L. Collins and James S. Plank. Downloading replicated, wide-area files - a framework and empirical evaluation. In Proc. Symposium on Network Computing, 2004.
    • (2004) Proc. Symposium on Network Computing
    • Collins, R.L.1    Plank, J.S.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.