Accelerating distributed workflows with edge resources

Proceedings - IEEE 27th International Parallel and Distributed Processing Symposium Workshops and PhD Forum, IPDPSW 2013

Volumn , Issue , 2013, Pages 2129-2138

  Ramakrishnan, Siddharth ^a   Reutiman, Robert ^a   Chandra, Abhishek ^a   Weissman, Jon ^a  

^a University of Minnesota   (United States)

Author keywords

data intensive computing; Distributed computing; network systems; workflows

Indexed keywords

NETWORK ROUTING;

COMPUTATIONAL PLATFORMS; DATA-INTENSIVE COMPUTING; IN-NETWORK COMPUTATIONS; NETWORK BOTTLENECKS; NETWORK SYSTEMS; PERFORMANCE METRICS; WORK-FLOWS; WORKFLOW APPLICATIONS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84899766654     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2013.240     Document Type: Conference Paper

References (33)

1. D. Sulakhe, A. Rodriguez, M. Wilde, I. Foster, and N. Maltsev, "Interoperability of GADU in Using Heterogeneous Grid Resources for Bioinformatics Applications," IEEE Transactions on Information Technology in Biomedicine, vol. 12, no. 2, pp. 241-246, Mar. 2008.
2. J. C. Jacob, D. S. Katz, T. Prince, B. G. Berriman, J. C. Good, A. C. Laity, E. Deelman, G. Singh, and M.-H. Su, "The Montage Architecture for Grid-Enabled Science Processing of Large, Distributed Datasets," in Proceedings of the Earth Science Technology Conference, Jun. 2004.
3. E. Deelman, S. Callaghan, E. Field, H. Francoeur, R. Graves, N. Gupta, V. Gupta, T. H. Jordan, C. Kesselman, P. Maechling, J. Mehringer, G. Mehta, D. Okaya, K. Vahi, and L. Zhao, "Managing Large-Scale Workflow Execution from Resource Provisioning to Provenance tracking: The CyberShake Example," in Proceedings of the Second IEEE International Conference on e-Science and Grid Computing (e-Science'06), 2006.
4. I. J. Taylor, E. Deelman, D. B. Gannon, and M. Shields, Eds., Workflows for e-Science: Scientific Workflows for Grids. Springer-Verlag, Dec. 2006.
5. D. Turi, P. Missier, C. A. Goble, D. D. Roure, and T. Oinn, "Taverna workflows: Syntax and semantics," in Science, 2007, pp. 441-448.
6. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz, "Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems," Scientific Programming Journal, vol. 13, no. 3, pp. 219-237, Jul. 2005.
7. "Squid proxy cache," http://www.squid-cache.org.
8. D. Andersen, H. Balakrishnan, F. Kaashoek, and R. Morris, "Resilient overlay networks," in ACM SOSP, 2001.
9. B. Cohen, "Incentives build robustness in BitTorrent," in Proceedings of the First Workshop on the Economics of Peer-to-Peer Systems, Jun. 2003.
10. D. P. Anderson, "BOINC: A System for Public-Resource Compting and Storage," in Proceedings of the 5th ACM/IEEE International Workshop on Grid Computing, 2004.
11. J. Weissman and S. Ramakrishnan, "Using proxies to accelerate cloud applications," in HotCloud'09: Proceedings of the 2009 conference on Hot topics in cloud computing. Berkeley, CA, USA: USENIX Association, 2009.
12. "The Basic Local Alignment Search Tool (BLAST)," http://www.ncbi.nlm.nih.gov/blast.
13. C. Lumezanu, Y. Baden, N. Spring, and B. Bhattacharjee, "Triangle inequality and routing policy violations in the internet," in Proceedings of the 10th International Conference on Passive and Active Network Measurement, 2009.
14. H. Zheng, E. K. Lua, M. Pias, and T. G. Griffin, "Internet routing policies and round-trip-times," in PAM, 2005.
15. S. Ramakrishnan, R. Reutiman, A. Chandra, and J. Weissman, "Standing on the Shoulders of Others: Using Proxies to Opportunistically Boost Distributed Applications," Dept. of CSE, Univ. of Minnesota, Tech. Rep. 10-012, Aug. 2010.
16. A. Barker, J. B. Weissman, and J. van Hemert, "Orchestrating Data-centric Workflows," in IEEE/ACM CCGrid International Symposium on Cluster Computing and the Grid, 2008.
17. "Condor project," http://www.cs.wisc.edu/condor/.
18. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. H. Rolf Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," in Proceedings of the Nineteenth ACM Symposium on Operating systems Principles, October 2003.
19. B. Yee, D. Sehr, G. Dardyk, J. B. Chen, R. Muth, T. Ormandy, S. Okasaka, N. Narula, and N. Fullaga, "Native client: a sandbox for portable, untrusted, x86 native code," in Proceedings of IEEE Security and Privacy, 2009.
20. Y. Chawathe, S. Ratnasamy, L. Breslau, N. Lanham, and S. Shenker, "Making Gnutella-like P2P Systems Scalable," in Proceedings of ACM SIGCOMM, Aug. 2003.
21. V. Lo, D. Zappala, D. Zhou, Y. Liu, and S. Zhao, "Cluster Computing on the Fly: P2P Scheduling of Idle Cycles in the Internet," in Proceedings of the IEEE Fourth International Conference on Peer-to-Peer Systems, 2004.
22. "Sloan digital sky survey," http://www.sdss.org/.
23. "A Brief Introduction to the Flexible Image Transport System (FITS)," http://fits.gsfc.nasa.gov/fits-intro.html.
24. F. Ableson, C. Collins, and R. Sen, Unlocking Android: A Developer's Guide. Manning, CT, USA, 2009.
25. D. L. Tennenhouse, J. M. Smith, W. D. Sincoskie, D. J. Wetherall, and G. J. Minden, "A survey of active network research," IEEE Communications Magazine, vol. 35, pp. 80-86, 1997.
26. H. Andrade, T. M. Kurç, A. Sussman, and J. H. Saltz, "Exploiting functional decomposition for efficient parallel processing of multiple data analysis queries," in IPDPS, 2003, p. 81.
27. M. Swany, "Improving throughput for grid applications with network logistics," in SC '04: Proceedings of the 2004 ACM/IEEE conference on Supercomputing. IEEE Computer Society, 2004, p. 23.
28. R. Wolski, N. T. Spring, and J. Hayes, "The network weather service: A distributed resource performance forecasting service for metacomputing," Journal of Future Generation Computing Systems, vol. 15, pp. 757-768, 1999.
29. A. Pasztor and D. Veitch, "Active probing using packet quartets," in ACM SIGCOMM Internet Measurement Workshop, 2002, pp. 293-305.
30. A. Downey, "Using pathchar to estimate internet link characteristics," in Proceedings of ACM SIGCOMM, 1999, pp. 241-250.
31. K. Lai and M. Baker, "Measuring link bandwidths using a deterministic model of packet delay," in Proceedings of ACM SIGCOMM, 2000, pp. 283-294.
32. J. Kim, A. Chandra, and J. Weissman, "OPEN: Passive Network Performance Estimation for Data-intensive Applications," Dept. of CSE, Univ. of Minnesota, Tech. Rep. 08-041, 2008.
33. A. jan Su, D. R. Choffnes, A. Kuzmanovic, and F. E. Bustamante, "Drafting behind akamai (travelocity-based detouring)," in Proceedings of ACM SIGCOMM, 2006, pp. 435-446.