Experiments with in-transit processing for data intensive grid workflows

Proceedings - IEEE/ACM International Workshop on Grid Computing

Volumn , Issue , 2007, Pages 193-200

  Bhat, Viraj ^a   Parashar, Manish ^a   Klasky, Scott ^b  

^a RUTGERS UNIVERSITY   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATIONS; DATA REDUCTION; DATA STORAGE EQUIPMENT; GRID COMPUTING;

DATA INTENSIVE GRID; DATA MANIPULATIONS; DATA-INTENSIVE; DATASTREAM (CO); DISTRIBUTED APPLICATIONS; END TO END (ETE); ENGINEERING APPLICATIONS; ENGINEERING WORKFLOWS; INTERNATIONAL CONFERENCES; MANAGEMENT STRATEGIES; WIDE AREA; WORK-FLOWS;

DATA PROCESSING;

EID: 47249120810     PISSN: 15505510     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/GRID.2007.4354133     Document Type: Conference Paper

References (20)

1. V. Bhat, M. Parashar, M. Khandekar, N. Kandasamy, and S. Klasky, "A Self-Managing Wide-Area Data Streaming Service using Model-based Online Control," in 7th IEEE International Conference on Grid Computing (Grid 2006). Barcelona, Spain: IEEE Computer Society, 2006, pp. 176-183.
2. S. Klasky, B. Ludäscher, and M. Parashar, "The Center for Plasma Edge Simulation Workflow Requirements," in 22nd International Conference on Data Engineering Workshops (ICDEW'06). Atlanta, GA, USA: IEEE Computer Society, 2006, p. 73.
3. H. Liu, "Accord: A Programming System for Autonomic Self-Managing Applications," Ph.D. dissertation, Rutgers University, 2005.
4. Lawrence-Berkeley-National-Laboratory, "Energy Sciences Network (ESNET-4)," 2006. [Online], Available: http://www.es.net/
5. J. Plank and M. Beck, "The Logistical Computing Stack - A Design For Wide-Area, Scalable, Uninterruptible Computing," in Dependable Systems and Networks, Workshop on Scalable, Uninterruptible Computing (DNS 2002), Bethesda, Maryland, USA, 2002.
6. M. Eriksen, "Trickle: A Userland Bandwidth Shaper for Unix-like Systems," in USENIXAnnual Technical Conference (USENIX'05). Anaheim, CA, USA: SAGE, 2005, pp. 61-70.
7. A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, and S. Tuecke, 'The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets," in Network Storage Symposium (NetStore '99), vol. 23. Seattle, WA, USA: Journal of Network and Computer Applications, 1999, pp. 187-200.
8. A. Shoshani, A. Sim, and J. Gu, "Storage Resource Managers: Middleware Components for Grid Storage," in 10th Goddard Conference on Mass Storage Systems and Technologies, 19th IEEE Symposium on Mass Storage Systems, College Park, MD, USA, 2002, p. 14.
9. W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, and I. Foster, "The Globus Striped Gridftp Framework and Server," in Super Computing (SC'05). Seattle, WA, USA: IEEE Computer Society, 2005, pp. 54-64.
10. J. S. Plank, M. Beck, W. R. Elwasif, T. Moore, M. Swany, and R. Wolski, 'The Internet Backplane Protocol: Storage in the Network," in NetStore99, Seattle, WA, USA, 1999.
11. A. Hanushevsky, "bbcp peer to peer cp program," 2002. [Online]. Available: http://www.slac.stanford.edu/~abh/bbcp/
12. Y. Gu and R. Grossman, "SABUL: A Transport Protocol for Grid Computing," Journal of Grid Computing, vol. 1, no. 4, pp. 377-386, 2003.
13. M. Beynon, C. Chang, U. Catalyurek, T. Kurc, A. Sussman, R. Andrade, H.and Ferreira, and J. Saltz, "Processing Large-Scale Multi-Dimensional Data in Parallel and Distributed Environments," Parallel data-intensive algorithms and applications, vol. 28, no. 5, pp. 827-859, 2002.
14. G. Singh, C. Kesselman, and E. Deelman, "Optimizing Grid-based Workflow Execution," Journal of Grid Computing, vol. 3, no. 3-4, pp. 201-219, September 2005.
15. J. In, P. Avery, R. Cavanaugh, L. Chitnis, M. Kulkarni, and S. Ranka, "SPHINX: A Fault-Tolerant System for Scheduling in Dynamic Grid Environments," in 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05). Denver, Colorado, USA: IEEE Computer Society, 2005, p. 12.2.
16. S. Venugopal, R. Buyya, and L. Winton, "A Grid Service Broker for Scheduling e-Science Applications on Global Data Grids," Concurrency and Computation: Practice & Experience, vol. 18, no. 6, pp. 685-699, May 2006.
17. G. v. Laszewski, K. Amin, and et. al, "GridAnt: A Client-Controllable Grid Workflow System," in 37th Hawaii International Conference on System Science (HICSS'04), Waikoloa, Big Island, Hawaii, 2004, p. 10.
18. R. D. Stevens, A. J. Robinson, and C. A. Goble, "myGrid: Personalised Bioinformatics on the Information Grid," in 11th International Conference on Intelligent Systems in Molecular Biology, vol. 19. Brisbane, Australia: Bioinformatics, Oxford University Press, 2003, pp. i302-i304.
19. X. Ma, J. Lee, and M. Winslett, "High-Level Buffering for Hiding Periodic Output Cost in Scientific Simulations," IEEE Transactions Parallel Distributed Systems, vol. 17, no. 3, pp. 193-204, March 2006.
20. Z. Cai, V. Kumar, and K. Schwan, "IQ-Paths: Predictably High Performance Data Streams Across Dynamic Network Overlays," Journal of Grid Computing, vol. 5, no. 2, pp. 129-150, June 2007.