Long-term availability prediction for groups of volunteer resources

Journal of Parallel and Distributed Computing

Volumn 72, Issue 2, 2012, Pages 281-296

  Lázaro, Daniel ^a   Kondo, Derrick ^b   Marqus, Joan Manuel ^a,c  

^a UNIVERSITAT OBERTA DE CATALUNYA   (Spain)

^b INRIA RHÔNE ALPES   (France)

^c UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Availability prediction; Reliability; Service deployment; Trace analysis; Volunteer computing

Indexed keywords

COMPUTING POWER; PARALLEL APPLICATION; PETAFLOPS; PREDICTION METHODS; PREDICTIVE METHODS; SERVICE DEPLOYMENT; TIME-PERIODS; VOLUNTEER COMPUTING; WORK-FLOWS;

RELIABILITY; TRACE ANALYSIS;

FORECASTING;

EID: 84855348685     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2011.10.007     Document Type: Article

References (34)

1. D. Anderson, Boinc: a system for public-resource computing and storage, in: Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, Pittsburgh, USA, 2004.
2. D. Anderson, G. Fedak, The computational and storage potential of volunteer computing, in: Proceedings of the IEEE International Symposium on Cluster Computing and the Grid, CCGRID'06, 2006.
3. A. Andrzejak, D. Kondo, D.P. Anderson, Ensuring collective availability in volatile resource pools via forecasting, in: DSOM, 2008, pp. 149161.
4. R. Arpaci, A. Dusseau, A. Vahdat, L. Liu, T. Anderson, D. Patterson, The interaction of parallel and sequential workloads on a network of workstations, in: Proceedings of SIGMETRICS'95, 1995, pp. 267278.
5. M. Bakkaloglu, J.J. Wylie, C. Wang, G.R. Ganger, On correlated failures in survivable storage systems, Technical Report MU-CS-02-129, Carnegie Mellon University, May 2002.
6. R. Bhagwan, S. Savage, G. Voelker, Understanding availability, in: Proceedings of IPTPS'03, 2003.
7. R. Bhagwan, K. Tati, Y.-C. Cheng, S. Savage, G.M. Voelker, Total recall: system support for automated availability management, in: NSDI, 2004, pp. 337350.
8. W. Bolosky, J. Douceur, D. Ely, M. Theimer, Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs, in: Proceedings of SIGMETRICS, 2000.
9. J. Chu, K. Labonte, B. Levine, Availability and locality measurements of peer-to-peer file systems, in: Proceedings of ITCom: Scalability and Traffic Control in IP Networks, 2003.
10. F.L. Daniel Ford, F. Popovici, M. Stokely, V.-A. Truong, L. Barroso, C. Grimes, S. Quinlan, Availability in globally distributed storage systems, in: Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation, 2010.
11. A. Dimakis, P. Godfrey, Y. Wu, M. Wainwright, and K. Ramchandran Network coding for distributed storage systems IEEE Transactions on Information Theory 56 9 2010 4539 4551 10.1109/TIT.2010.2054295
12. P. Dinda Online prediction of the running time of tasks Cluster Computing 5 3 2002 225 236
13. P. Domingues, P. Marques, L. Silva, Resource usage of windows computer laboratories, in: Parallel Processing, 2005, ICPP 2005 Workshops, International Conference Workshops on, 2005, pp. 469476. doi:10.1109/ICPPW.2005.77. (Pubitemid 43904193)
14. J.R. Douceur Is remote host availability governed by a universal law? SIGMETRICS Performance Evaluation Review 31 3 2003 25 29
15. C. Elkan, Using the triangle inequality to accelerate k-means, in: ICML, 2003, pp. 147153.
16. T. Estrada, M. Taufer, K. Reed, Modeling job lifespan delays in volunteer computing projects, in: Cluster Computing and the Grid, 2009, CCGRID'09, 9th IEEE/ACM International Symposium on, 2009, pp. 331338. doi:10.1109/CCGRID.2009. 69.
17. B. Javadi, D. Kondo, J. Vincent, D. Anderson, Mining for statistical availability models in large-scale distributed systems: an empirical study of seti@home, in: 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS, 2009. URL: http://mescal.imag.fr/membres/derrick.kondo/pubs/javadimascots09.pdf.
18. B. Javadi, D. Kondo, J. Vincent, and D. Anderson Discovering statistical models of availability in large distributed systems: An empirical study of SETI@home IEEE Transactions on Parallel and Distributed Systems 22 11 2011 1896 1903 10.1109/TPDS.2011.50
19. P. Kneevi, A. Wombacher, and T. Risse DHT-based self-adapting replication protocol for achieving high data availability Advanced Internet Based Systems and Applications 2009 Springer-Verlag Berlin, Heidelberg 201 210 doi:http://dx.doi.org/10.1007/978-3-642-01350-819 (Chapter). URL: http://dx.doi.org/10.1007/978-3-642-01350-819
20. D. Kondo, A. Andrzejak, D.P. Anderson, On correlated availability in Internet distributed systems, in: IEEE/ACM International Conference on Grid Computing, Grid, Tsukuba, Japan, 2008.
21. D. Kondo, G. Fedak, F. Cappello, A.A. Chien, and H. Casanova Characterizing resource availability in enterprise desktop grids Journal of Future Generation Computer Systems 23 7 2007 888 903 (Pubitemid 46755399)
22. D. Kondo, B. Javadi, A. Iosup, D. Epema, The failure trace archive: enabling comparative analysis of failures in diverse distributed systems, in: Cluster, Cloud and Grid Computing, CCGrid, 2010 10th IEEE/ACM International Conference on, 2010, pp. 398407. doi:10.1109/CCGRID.2010.71.
23. D. Kondo, M. Taufer, C. Brooks, H. Casanova, A. Chien, Characterizing and evaluating desktop grids: an empirical study, in: Proceedings of the International Parallel and Distributed Processing Symposium, IPDPS'04, 2004.
24. D. Long, A. Muir, R. Golding, A longitudinal survey of Internet host reliability, in: 14th Symposium on Reliable Distributed Systems, 1995, pp. 29.
25. J.W. Mickens, B.D. Noble, Exploiting availability prediction in distributed systems, in: Proceedings of the 3rd Conference on Networked Systems Design & Implementation, 2006. URL: http://www.eecs.umich.edu/~jmickens/ predictors.pdf.
26. Publications by BOINC projects. http://boinc.berkeley.edu/wiki/ PublicationsbyBOINCprojects.
27. K. Ramachandran, H. Lutfiyya, M. Perry, Decentralized resource availability prediction for a desktop grid, in: Cluster, Cloud and Grid Computing, CCGrid, 2010 10th IEEE/ACM International Conference on, 2010, pp. 643648. doi:10.1109/CCGRID.2010.54.
28. F. Salfner, M. Lenk, and M. Malek A survey of online failure prediction methods ACM Computing Surveys 42 2010 10:1 10:42 doi:http://doi.acm.org/10.1145/ 1670679.1670680 URL: http://doi.acm.org/10.1145/1670679.1670680
29. S. Saroiu, P. Gummadi, S. Gribble, A measurement study of peer-to-peer file sharing systems, in: Proceedings of MMCN, 2002.
30. L.M. Schnorr, A. Legrand, J.-M. Vincent, Visualization and detection of resource usage anomalies in large scale distributed systems, Tech. Rep. INRIA-00529569, INRIA, October 2010.
31. W.T. Sullivan, D. Werthimer, S. Bowyer, J. Cobb, G. Gedye, D. Anderson, A new major SETI project based on project serendip data and 100,000 personal computers, in: Proc. of the Fifth Intl. Conf. on Bioastronomy, 1997.
32. R. Vilalta, C.V. Apte, J.L. Hellerstein, S. Ma, and S.M. Weiss Predictive algorithms in the management of computer systems IBM Systems Journal 41 2002 461 474 doi:http://dx.doi.org/10.1147/sj.413.0461 URL: http://dx.doi.org/10. 1147/sj.413.0461
33. D. Vyas, and J. Subhlok Volunteer computing on clusters Proceedings of the 12th International Conference on Job Scheduling Strategies for Parallel Processing JSSPP'06 2007 Springer-Verlag Berlin, Heidelberg 161 175 URL: http://dl.acm.org/citation.cfm?id=1757044.1757052
34. R. Wolski, N. Spring, and J. Hayes The network weather service: a distributed resource performance forecasting service for metacomputing Journal of Future Generation Computer Systems 15 56 1999 757 768