A novel model for synthesizing parallel I/O workloads in scientific applications

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn Proceedings of the 2008 IEEE International Conference on Cluster Computing, ICCC 2008, Issue , 2008, Pages 252-261

  Feng, Dan ^a,b   Zou, Qiang ^a,b   Jiang, Hong ^c   Zhu, Yifeng ^d  

^a HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^c UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^d UNIVERSITY OF MAINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATIONS; PAPER; STABILITY CRITERIA;

ARRIVAL TIMES; BURSTINESS; CONVENTIONAL MODELS; DISTRIBUTED SYSTEMS; GENERIC MODELS; I/O TRACES; I/O WORKLOADS; MARKOV ARRIVAL PROCESSES; PARALLEL STORAGE SYSTEMS; PERFORMANCE EVALUATIONS; SCIENTIFIC APPLICATIONS; SIMULATION STUDIES; SOME APPLICATIONS; STABLE PROCESSES; STORAGE SYSTEMS; STRONG CORRELATIONS; TRACE-DRIVEN SIMULATIONS;

CORRELATION METHODS;

EID: 57949085237     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2008.4663778     Document Type: Conference Paper

References (30)

1. L. Tian, D. Feng, H. Jiang, and et al., "Pro: A popularity-based multi-threaded reconstruction optimization for raid-structured storage systems," in Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST), San Jose, CA, 2007.
2. B. Anderson, "Mass storage system performance prediction using a trace-driven simulator," in Proceedings of the 22nd IEEE Conference on Mass Storage Systems and Technologies (MSST), 2005.
3. Z. Kurmas, K. Keeton, and K. Mackenzie, "Synthesizing representative i/o workloads using iterative distillation," in Proceedings of the 11th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), 2003.
4. Y. Zhu, H. Jiang, J. Wang, and F. Xian, "A novel distributed metadata management system for large cluster-based storagev," IEEE Transaction on Distributed and Parallel Systems, vol. 19, no. 4, pp. 1-14, April 2008.
5. The Lustre website. [Online]. Available: www.lustre.org
6. Lawrence livermore national labs. [Online]. Available: www.llnl.gov
7. Los alamos national labs. [Online]. Available: http://institutes.lanl.gov
8. A. S. M. Priscilla and et al., "A traffic characterization procedure for multimedia applicatioins in converged networks," in Proceedings of the 13th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS'05).
9. M. W. Garrett and W. Willinger, "Analysis, modeling and generation of self-similar vbr video traffic," in Proceedings of SIGCOMM'94.
10. F. Wang, Q. Xin, B. Hong, and et al., "File system workload analysis for large scale scientic computing applications," in Proceedings of 21st IEEE Conference on Mass Storage Systems and Technologies (MSST'04).
11. J. Nunez and J. Bent, "Mpi-io test users guide (version 1.0)," Los Alamos National Labs, May 2007.
12. S. J. Baylor and C. E. Wu, "Parallel i/o workload characteristics using vesta," in Proceedings of the IPPS'95 Workshop on Input/Output in Parallel and Distributed Systems (IOPADS'95).
13. E. L. Miller and R. H. Katz, "Input/output behavior of supercomputing applications," in Proceedings of the 1991 International Conference on Supercomputing.
14. J. Oly and D. Reed, "Markov model prediction of i/o request for scientific application," in Proceedings of the 2002 International Conference on Supercomputing.
15. B. Hong and T. Madhyastha, "The relevance of long-range dependence in disk traffic and implications for trace synthesis," in Proceedings of the IEEE Conference on Mass Storage Systems and Technologies, 2005.
16. M. Gomez and V. Santonja, "Analysis of self-similarity in i/o workload using structural modeling," in Proceedings of the 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), College Park, Maryland, 1999.
17. S. Gribble, G. Manku, and E. Brewer, "Self-similarity in high-level file systems: Measurement and applications," in Proceedings of the ACM SIGMETRICS'98.
18. M. Wang, T. Madhyastha, and et al., "Data mining meets performance evaluation: Fast algorithms for modeling bursty traffic," in Proceedings of the 16th International Conference on Data Engineering (ICDE), 2002.
19. M. Wang, A. Ailamaki, and C. Faloutsos, "Capturing the spatio-temporal behavior of real traffic data," in IFIP International Symposium on Computer Performance Modeling, Measurement, and Evaluation, 2002.
20. S. R. Alam and J. S. Vetter, "An analysis of system balance requirements for scientific applications," in Proceedings of the 2006 International Conference on Parallel Processing (ICPP'06).
21. E. Smirni and D. A. Reed, "Workload characterization of input/output intensive parallel applications," in Proceedings of the Conference on Modelling Techniques and Tools for Computer Performance Evaluation, vol. 1245, pp. 169-180.
22. N. Tran, "Automatic arima time series modeling and forecasting for adaptive input/output prefetching," Ph.D. dissertation, University of Illinois at Urbana-Champaign.
23. J. Zhang, A. Sivasubramaniam, H. Franke, N. Gautam, Y. Zhang, and S. Nagar, "Synthesizing representative i/o workloads for tpc-h," in Proceedings of HPCA, 2004.
24. A. Dainotti, A. Pescape, and G. Ventre, "Worm traffic analysis and characterization," in Proceedings of the IEEE International Conference on Communications (ICC'07).
25. G. Samorodnitsky and M. Taqqu, Stable Non-Gaussian Random Processes: Stochastic Models with Infinite Variance. New York: Chapman and Hall, 1994.
26. J. Rosinski, "On the structure of stationary stable processes," The Annals of Probability, vol. 23, pp. 1163-1187, 1995.
27. D. Surgailis, J. Rosinski, and et al., "Stable generalized moving averages," Probability Theory and Related Fields, pp. 543-558, 1993.
28. W. Leland, M. Taqqu, W. Willinger, and D. Wilson, "On the self-similar nature of ethernet traffic (extended version," IEEE/ACM Transactions on Networking, vol. 2, pp. 1-15, Feb. 1994.
29. M. E. Crovella and A. Bestavros, "Self-similarity in world wide web traffic: evidence and possible causes," IEEE/ACM Transactions on Networking, vol. 5, pp. 835-846, 1997.
30. Z. J. Liu and et al., Computational Science Technique and Matlab. Beijing, P. R. China: Science Press, 2001.