RhEA: Automatic filtering for unstructured cloud storage

Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2013

Volumn , Issue , 2013, Pages 343-355

  Gkantsidis, Christos ^a   Vytiniotis, Dimitrios ^a   Hodson, Orion ^a   Narayanan, Dushyanth ^a   Dinu, Florin ^a   Rowstron, Antony ^a  

^a MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

BANDWIDTH; DATA HANDLING; DATA TRANSFER; STATIC ANALYSIS; SYSTEMS ANALYSIS; WINDOWS OPERATING SYSTEM;

APPLICATION CODES; AUTOMATIC FILTERING; CLOUD PROVIDERS; CLOUD STORAGES; COMPUTE RESOURCES; SEMI STRUCTURED DATA; STORAGE LAYERS; WINDOWS AZURES;

DIGITAL STORAGE;

EID: 85076716331     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (42)

1. Amazon Simple Storage Service (Amazon S3). http://aws.amazon.com/s3/. Accessed: 08/09/2011.
2. G. Ananthanarayanan et al. “Reining in the Outliers in MapReduce Clusters using Mantri”. Operating Systems Design and Implementation (OSDI). USENIX, 2010.
3. Apache Cassandra. http://cassandra.apache.org/. Accessed: 03/10/2011.
4. B. Calder et al. “Windows Azure Storage: a highly available cloud storage service with strong consistency”. Proc. of 23rd Symp. on Operating Systems Principles (SOSP). ACM, 2011.
5. R. Chaiken et al. “SCOPE: Easy and Effcient Parallel Processing of Massive Datasets”. VLDB. 2008.
6. Y. Chen et al. “The Case for Evaluating MapReduce Performance Using Workload Suites”. MASCOTS. IEEE Computer Society, 2011.
7. A. Cheung et al. “Automatic partitioning of database applications”. Proc. VLDB Endow. 5.11 (2012).
8. B. Cook, A. Podelski, and A. Rybalchenko. “Termination proofs for systems code”. Proc. of the SIGPLAN conf. on Programming Language Design and Implementation (PLDI). ACM, 2006.
9. V. Crescenzi and G. Mecca. “Automatic Information Extraction from Large Websites”. J. ACM 51.5 (2004).
10. V. Crescenzi, G. Mecca, and P. Merialdo. “RoadRunner: Towards Automatic Data Extraction from Large Web Sites”. Proc. of 27th International Conference on Very Large Data Bases (VLDB). Morgan Kaufmann Publishers Inc., 2001.
11. T. von Eicken. Network performance within Amazon EC2 and to Amazon S3. http://blog.rightscale.com/2007/10/28/network-performance-within-amazon-ec2-andto-amazon-s3/. Accessed: 08/09/2011. 2007.
12. S. L. Garfinkel. An Evaluation of Amazon's Grid Computing Services: EC2, S3 and SQS. Tech. rep. Harvard University, 2007.
13. A. F. Gates et al. “Building a high-level dataflow system on top of Map-Reduce: the Pig experience”. Proc. VLDB Endow. 2.2 (2009).
14. A. G. Greenberg et al. “VL2: a scalable and flexible data center network”. SIGCOMM. Ed. by P. Rodriguez et al. ACM, 2009.
15. S. Gulwani, K. K. Mehra, and T. Chilimbi. “SPEED: precise and efficient static estimation of program computational complexity”. Proc. of 36th ACM SIGPLAN-SIGACT symposium on Principles of programming languages (POPL). ACM, 2009.
16. Z. Guo et al. “Nemo: Whole Program Optimization for Distributed Data-Parallel Computation.” Proc. of the 10th Symposium on Operating Systems Design and Implementation (OSDI). USENIX Association, 2012.
17. S. Horwitz, T. Reps, and D. Binkley. “Interprocedural slicing using dependence graphs”. SIGPLAN Not. 39 (4 2004).
18. L. Hubert et al. “Sawja: Static Analysis Workshop for Java”. Formal Verification of Object-Oriented Software. Ed. by B. Beckert and C. Marché. Springer Berlin / Heidelberg, 2011.
19. F. Hueske et al. “Opening the black boxes in data flow optimization”. Proc. VLDB Endow. 5.11 (2012).
20. L. Huston et al. “Diamond: A Storage Architecture for Early Discard in Interactive Search”. FAST. USENIX, 2004.
21. M. Isard et al. “Quincy: Fair Scheduling for Distributed Computing Clusters”. Proc. of 22nd ACM Symposium on Operating Systems Principles (SOSP). 2009.
22. M.-Y. Iu and W. Zwaenepoel. “HadoopToSQL: A MapReduce query optimizer”. EuroSys'10. 2010.
23. S. Iyer. Geo Location Data From DB-Pedia. http: / / downloads.dbpedia.org/3.3/en/geo_en.csv.bz2. Accessed: 22/09/2011.
24. S. Iyer. Map Reduce Program to group articles in Wikipedia by their GEO location. http://code.google.com/p/hadoopmap-reduce-examples/wiki/Wikipedia_GeoLocation. Accessed: 08/09/2011. 2009.
25. E. Jahani, M. J. Cafarella, and C. Ré. “Automatic Optimization for MapReduce Programs”. PVLDB 4.6 (2011).
26. R. Jhala and R. Majumdar. “Path slicing”. Proc. of the 2005 ACM SIGPLAN conf. on Programming Language Design and Implementation (PLDI). ACM, 2005.
27. N. Kushmerick, D. S. Weld, and R. B. Doorenbos. “Wrapper Induction for Information Extraction”. IJCAI (1). Morgan Kaufmann, 1997.
28. A. Miné. “The octagon abstract domain”. Higher Order Symbol. Comput. 19.1 (2006).
29. F. Nielson, H. R. Nielson, and C. Hankin. Principles of Program Analysis. Springer-Verlag New York, Inc., 1999.
30. A. Pavlo et al. “A comparison of approaches to large-scale data analysis”. Proc. of 35th SIGMOD intl conf on Management of data. ACM, 2009.
31. Public Data Sets on AWS. http: / / aws . amazon . com / publicdatasets/. Accessed: 03/05/2012.
32. E. Riedel et al. “Active Disks for Large-Scale Data Processing”. Computer 34 (6 2001).
33. snappy: A fast compressor/decompressor. http: / / code . google.com/p/snappy/. Accessed: 03/05/2012.
34. A. Thusoo et al. “Hive - a petabyte scale data warehouse using Hadoop”. Proceedings of the 26th International Conference on Data Engineering, ICDE 2010, March 1-6, 2010, Long Beach, California, USA. IEEE, 2010.
35. B. D. Vo and G. S. Manku. “RadixZip: linear time compression of token streams”. Proc of 33rd intl. conf. on Very Large Data Bases (VLDB). VLDB Endowment, 2007.
36. M. Weiser. “Program slicing”. Proc. of 5th intl. conf. on Software Engineering (ICSE). IEEE Press, 1981.
37. B. Wiedermann and W. R. Cook. “Extracting queries by static analysis of transparent persistence”. Proc. of 34th ACM SIGPLAN-SIGACT symposium on Principles of programming languages (POPL). ACM, 2007.
38. B. Wiedermann, A. Ibrahim, and W. R. Cook. “Interprocedural query extraction for transparent persistence”. Proc. of 23rd ACM SIGPLAN conference on Object-oriented programming systems languages and applications (OOPSLA). ACM, 2008.
39. Windows Azure Storage. http: / / www . microsoft . com / windowsazure / features / storage/. Accessed: 08/09/2011.
40. M. Zaharia et al. “Improving MapReduce Performance in Heterogeneous Environments”. Operating Systems Design and Implementation (OSDI). USENIX, 2008.
41. Zebra Reference Guide. http://pig.apache.org/docs/r0.7.0/zebra_reference.html. Accessed: 22/09/2011. 2011.
42. J. Zhang et al. “Optimizing data shuffling in data-parallel computation by understanding user-defined functions”. Proc. of 9th USENIX conference on Networked Systems Design and Implementation. USENIX Association, 2012.