Projecting disk usage based on historical trends in a cloud environment

ScienceCloud '12 - 3rd Workshop on Scientific Cloud Computing

Volumn , Issue , 2012, Pages 63-70

  Stokely, Murray ^a   Mehrabian, Amaan ^a   Albrecht, Christoph ^a   Labelle, François ^a   Merchant, Arif ^a  

^a GOOGLE INC   (United States)

Author keywords

Capacity planning; Ensemble forecasting; Resource usage

Indexed keywords

ACCURATE PREDICTION; CAPACITY PLANNING; DISK SPACE; DISTRIBUTED COMPUTING ENVIRONMENT; DISTRIBUTED STORAGE SYSTEM; ENSEMBLE FORECASTING; GEOGRAPHIC REGIONS; HISTORICAL TRENDS; I/O BANDWIDTH; MEAN ABSOLUTE ERROR; NON-STABLE; PRIVATE CLOUDS; PRODUCT LAUNCH; RESOURCE USAGE; SCARCE RESOURCES; USER CLASSIFICATION;

CLOUD COMPUTING; COMPUTER SYSTEMS; FORECASTING; MULTIPROCESSING SYSTEMS;

HARD DISK STORAGE;

EID: 84863967013     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2287036.2287050     Document Type: Conference Paper

References (15)

1. N. Agrawal, W. J. Bolosky, J. R. Douceur, and J. R. Lorch. A five-year study of file-system metadata. ACM Trans. Storage, 3, October 2007.
2. J. Allspaw. The Art of Capacity Planning: Scaling Web Resources. O'Reilly Media, Inc., 2008.
3. J. S. Armstrong. Combining Forecasts, Principles of forecasting: A handbook for researchers and practitioners.
4. J. S. Armstrong. Combining forecasts: The end of the beginning or the beginning of the end? International Journal of Forecasting, 5:585-588.
5. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: a distributed storage system for structured data. In OSDI '06: Proceedings of the 7th Symposium on Operating Systems Design and Implementation, pages 205-218, Nov. 2006.
6. R. Clemen. Combining forecasts: A review and annotated bibliography. International Journal of Forecasting, 5:559-583, 1989.
7. J. Durbin and S. J. Koopman. Time Series Analysis by State Space Methods. Number 9780198523543 in OUP Catalogue. Oxford University Press, 2001.
8. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google file system. In SOSP '03: Proceedings of the 19th ACM Symposium on Operating Systems Principles, pages 29-43, Oct. 2003.
9. C. Z. Loboz. Cloud resource usage: extreme distributions invalidating traditional capacity planning models. In Proceedings of the 2nd international workshop on Scientific cloud computing, ScienceCloud '11, pages 7-14, New York, NY, USA, 2011. ACM.
10. D. A. Menascé and P. Ngo. Understanding cloud computing: Experimentation and capacity planning.
11. A. K. Mishra, J. L. Hellerstein, W. Cirne, and C. R. Das. Towards characterizing cloud backend workloads: insights from Google compute clusters. SIGMETRICS Performance Evaluation Review, 37(4):34-41, 2010.
12. R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 2012. ISBN 3-900051-07-0.
13. M. Stokely, F. Rohani, and E. Tassone. Large-scale parallel statistical forecasting computations in R. In JSM Proceedings, Section on Physical and Engineering Sciences, Alexandria, VA, 2011. American Statistical Association.
14. M. Stokely, J. Winget, E. Keyes, C. Grimes, and B. Yolken. Using a market economy to provision compute resources across planet-wide clusters. In Parallel & Distributed Processing, 2009. IPDPS 2009. IEEE International Symposium on, pages 1-8. IEEE, 2009.
15. A. Verma, L. Cherkasova, and R. H. Campbell. ARIA: automatic resource inference and allocation for MapReduce environments. In Proceedings of the 8th ACM international conference on Autonomic computing, ICAC '11, pages 235-244, New York, NY, USA, 2011. ACM.