SCAN-lite: Enterprise-wide analysis on the cheap

Proceedings of the 4th ACM European Conference on Computer Systems, EuroSys'09

Volumn , Issue , 2009, Pages 117-130

  Soules, Craig A N ^a   Keeton, Kimberly ^a   Morrey III, Charles B ^a  

^a HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Analysis; Content hashing; Distributed processing; Scheduling; Two phase scanning

Indexed keywords

ANALYSIS; CONTENT HASHING; DATA ANALYSIS; DESKTOP SEARCH; DISTRIBUTED PROCESSING; ENTERPRISE IS; IDLE TIME; MULTIPLE MACHINE; RESOURCE REQUIREMENTS; TOTAL WORK; TWO-PHASE SCANNING; VIRUS SCANNING;

DISTRIBUTED PARAMETER NETWORKS; INFORMATION MANAGEMENT; SCHEDULING;

SCANNING;

EID: 70349146132     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1519065.1519079     Document Type: Conference Paper

References (24)

1. N. Agrawal, W.J. Bolosky, J.R. Douceur, and J.R. Lorch. A five-year study of file-system metadata. In Proc. USENIX FAST, pages 31-45, 2007.
2. Autonomy. http://www.autonomy.com/.2009.
3. W.J. Bolosky, J.R. Douceur, D. Ely, and M. Theimer. Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs. In Proc. ACM SIGMETRICS, pages 34-43, 2000.
4. H. Bryhni, E. Klovning, and O. Kure. A comparison of load balancing techniques for scalable web servers. Network, IEEE, 14(4):58-64, July/August 2000.
5. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. In Proc. USENIX OSDI, pages 137-150, 2004.
6. J. Dilley, B. Maggs, J. Parikh, H. Prokop, R. Sitaraman, and B. Weihl. Globally distributed content delivery. Internet Computing, IEEE, 6(5):50-58, 2002.
7. K. Eshghi, M. Lillibridge, L. Wilcock, G. Belrose, and R. Hawkes. Jumbo store: Providing efficient incremental upload and versioning for a utility rendering service. In Proc. USENIX FAST, pages 123-138, 2007.
8. I. Foster and C. Kesselman. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1999. ISBN 1558604758.
9. GDS. Google desktop search, http://desktop.google.com/. 2009.
10. R. Golding, P. Bosch, C. Staelin, T. Sullivan, and J. Wilkes. Idleness is not sloth. In Proc. USENIX Technical Conf, pages 201-222, 1995.
11. Hadoop. http://hadoop.apache.org/. 2009.
12. K. Keeton, C. Santos, D. Beyer, J. Chase, and J. Wilkes. Designing for disasters. In Proc. USENIX FAST, pages 59-72, 2004.
13. A.W. Leung, M. Shao, T. Bisson, S. Pasupathy, and E.L. Miller. Spyglass: Fast, scalable metatdata search for large-cale storage systems. In Proc. USENIX FAST, 2009.
14. LSF. Load sharing facility, http://www.platform.com. 2009.
15. McAfee. Artemis technology, http://www.mcafee. com/us/enterprise/ products/artemis-technology/index.html. 2009.
16. M. Mesnier, M. Wachs, R. Sambasivan, A. Zheng, and G. Ganger. Modeling the relative fitness of storage. In Proc. ACM SIGMETRICS, pages 37-48, 2007.
17. A. Muthitacharoen, B. Chen, and D. Mazieres. A low-bandwidth network file system. In Proc. ACM SOSP, pages 174-187, 2001.
18. S. Quinlan and S. Dorward. Venti: a new approach to archival storage. In Proc. USENIX FAST, Monterey, CA, 2002.
19. T. Sterling, D.J. Becker, D. Savarese, J.E. Dorband, U.A. Ranawake, and C.V. Packer. Beowulf: A parallel workstation for scientific computation. In Proc. Intl. Conf. on Parallel Processing, pages 11-14, 1995.
20. D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the condor experience. Concurrency-Practice and Experience, 17(2-4):323-356, 2005.
21. A. Tridgell and P. Mackerras. The rsync algorithm. Technical report, Australian National University, 1998.
22. Y.T. Wang and R.J.T. Morris. Quickly finding near-optimal storage system designs. ACM Transactions on Computer Systems, 24(4):337-374, November 2005.
23. S. Zhou, X. Zheng, J. Wang, and P. Delisle. Utopia: a load sharing facility for large, heterogeneous distributed computer systems. Technical report, University of Toronto, 1993.
24. B. Zhu, K. Li, and H. Patterson. Avoiding the disk bottleneck in the data domain deduplication file system. In Przoc. USENIX FAST, pages 269-282, 2008.