An Improved Long-Term File-Usage Prediction Algorithm

25th International Computer Measurement Group Conference, CMG 1999

Volumn , Issue , 1999, Pages

  Gibson, Lieutenant Colonel Tim ^a   Miller, Ethan L ^b  

^a C4 Systems Directorate   (United States)

^b University of Marylandw Baltimore County   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIGITAL STORAGE;

'CURRENT; COMPUTING CENTER; DATA MART; LONG-TERM STORAGE; ORDERS OF MAGNITUDE; PERCEIVED PERFORMANCE; PREDICTION ALGORITHMS; STORAGE SPACES; TERTIARY STORAGES; USER FILES;

DATA MINING;

EID: 85153952789     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. C. J. Antonelli and P. Honeyman, “Integrating Mass Storage and File Systems, ” Twelfth IEEE Symposium on Mass Storage Systems, Monterey, CA, 1993, pages 133-138.
2. Edward R. Arnold and Marc E. Nelson, “Automatic Unix backup in a Mass-Storage Environment, ” USENIX-Winter 1988, February 1988, pages 131-136.
3. Mary G. Baker, John H. Hartmon, Michael Kupfer, Ken W. Shirriff, and John K. Ousterhout, “Measurement of a Distributed File System, ”Operating System Review 25(5), Proceedings of the 13th ACM Symposium on Operating Systems Principles, 1991, pages 198-212.
4. Ronald D. Christman, Danny P. Cook, and Christian W. Mercier, “Re-engineering the Los Alamos Common File system, ”Proceedings of the Tenth IEEE Symposium on Mass Storage Systems, May 1990, pages 122-125.
5. Michael D. Dahlin, Clifford J. Mather, Randolph Y. Wang, Thomas E. Anderson, and David A. Patterson, “A quantitative analysis of cache policies for scalable network file systems, ” Proceedings of the SIGMETRICS '94 Annual Conference on Measurement and Modeling of Computer Systems, Nashville, Tennessee, May 1994.
6. Bob Devine, Sunita Sarawagi, and Kannan Muthukkaruppan, “Caching for Tertiary Storage, ” Unpublished paper, University of California, Berkeley, CA, 9 December 1992.
7. The E-Mass Corporation maintains a full listing of their software, tape-robot, optical disk, and magnetic tape technical specifications at http://www.emass.com, 6 February 1999.
8. Timothy J. Gibson, Ethan L. Miller, and Darrell D. E. Long, “Long-term File Activity and Inter-Reference Patterns, ” CMG98 Proceedings, 24th International Conference on Technology Management and Performance Evaluation of Enterprise-Wide Information Systems, Computer Measurement Group, Anaheim, CA, December 1998, pages 976-987.
9. Timothy J. Gibson, Long-term File System Activity and the Efficacy of Automatic File Migration, Doctoral Dissertation, University of Maryland, Baltimore County, May 1998.
10. Timothy J. Gibson and Ethan L. Miller, “Long-Term File Activity Patterns in a UNIX Workstation Environment, ” Fifteenth IEEE Symposium on Mass Storage Systems, Greenbelt, MD, March 1998, pages 355-371.
11. John J. Gniewek, “Towards Improved Tape Storage and Retrieval Response time, ”Fifteenth IEEE Symposium on Mass Storage Systems, Greenbelt, MD, March 1998, pages 81-94.
12. Steven D. Gribble, Gurmeet Singh Manku, Eric A. Brewer, Timothy J. Gibson and Ethan L. Miller, “Self-Similarity in File-System Traffic, ” SIGMETRICS '98/PERFORMANCE '98, Joint International Conference on Measurement and Modeling of Computer Systems, Madison, WI, June 1998, pages 141-150.
13. Robert L. Henderson and Alan Poston, “MSS-II and RASH: a mainframe UNIX-based mass storage system with a rapid access storage hierarchy file management system, ” USENIX Winter 1989 Conference, San Diego, CA, January 1989, pages 65-84.
14. Bruce K. Hillyer and Avi Silberschatz, “Scheduling Non-Contiguous Tape Retrievals, ” Fifteenth IEEE Symposium on Mass Storage Systems, Greenbelt, MD, March 1998, pages 113-123.
15. Bruce K. Hillyer and Avi Silberschatz, “On the Modeling of the Characteristics of a Serpentine Tape Drive, ” Proceedings of the 1996 ACM SIGMETRICS Conference on Measurement and Modeling of Computing Systems, Philadelphia, PA, May 1996, pages 170-179.
16. Theodore Johnson and Ethan L. Miller, “Benchmarking Tape System Performance, ” Fifteenth IEEE Symposium on Mass Storage Systems, Greenbelt, MD, March 1998, pages 355-372.
17. David W. Jensen and Daniel A. Reed, “File Archive Activity in a Supercomputer Environment.” Technical Report UIUCDCS-R-91-1672, Department of Computer Science, University of Illinois, Urbana, IL, 1991.
18. D. H. Lawrie, J. M. Randal, and R. R. Barton, “Experiments with Automatic File Migration, ” IEEE Computer, July 1982, pages 45-55.
19. Daniel Menascé, Odysseas I. Pentakalos, and Yelena Yesha, “An Analytic Model of Hierarchical Mass Storage Systems with Network-Attached Storage Devices, ” Proceedings of the 1996 ACM SIGMETRICS Conference on Measurement and Modeling of Computing Systems, Philadelphia, PA, May 1996, pages 180-189.
20. Ethan L. Miller and Theodore Johnson, “Performance Measurements and Models of Tertiary Storage Devices, ” Proceedings of the 1998 Conference on Very Large Databases (VLDB'98), New York, NY, August 1998.
21. Ethan L. Miller and Randy H. Katz, “An Analysis of File Migration in a UNIX Supercomputing Environment, ”USENIX Winter 1993 Conference, San Diego, CA, January 1993, pages 421-434.
22. Ethan L. Miller and Randy H. Katz, “Analyzing the I/O Behavior of Supercomputer Applications, ”Eleventh IEEE Symposium on Mass Storage Systems, Monterey, CA, 1991, pages 51-55.
23. Ethan L. Miller and Randy H. Katz, “Input/Output Behavior of Supercomputing Applications, ” Proceedings of Supercomputing '91, Albuquerque, NM, 1991, pages 567-577.
24. L. Mummert and M. Satyanarayanan, “Long-term Distributed File Reference Tracing: Implementation and Experience, ”Software- Practice and Experience, Volume 26(6), June 1996, pages 705-736.
25. John K. Ousterhout, Herve Da Costa, David Harrison, John Kunze, Mike Kupfer, and James Thompson, “A Trace-Driven Analysis of the UNIX 4.2 BSD File System, ” Operating System Review 19(5), Proceedings of the 10th ACM Symposium on Operating Systems Principles, 1985, pages 15-24.
26. R. Hugo Patterson, Garth A. Gibson, Eka Ginting, Daniel Stodolsky, and Jim Zelenka, “Informed Prefetching and Caching, ” Operating System Review 29(5), Proceedings of the 15th ACM Symposium on Operating Systems Principles, 1995, pages 79-95.
27. M. Satyanarayanan, “A Study of File Sizes and Functional Lifetimes, ” Proceedings of the 8th Symposium on Operating systems Principles, Association of Computing Machinery, 1981, pages 96-108.
28. Ken W. Shirriff and John K. Ousterhout, “A Trace-Driven Analysis of Name and Attribute Caching in a Distributed System, ” USENIX Winter 1992 Conference, San Francisco, CA, January 1993, pages 315-332.
29. Alan Jay Smith, “Analysis of long term file reference patterns for application to file migration algorithms, ” IEEE Transactions on Software Engineering SE-7(4), 1981, pages 403-417.
30. Alan Jay Smith, “Long term file migration: development and evaluation of algorithms, ” Communications of the ACM 24(8), 1981, pages 521-532.
31. Keith A. Smith and Margo I. Seltzer, “File System Aging- Increasing Relevance of File System Benchmarks, ”Proceedings of the 1997 SIGMETRICS Conference, June 1997, Seattle, WA, pages 203-213.
32. Stephen Strange, “Analysis of Long-Term Unix File Access Patterns for Application to Automatic File Migration Strategies, ”Technical Report UCB/CSD-92-700, Computer Science Division (EECS), University of California, Berkeley, California, 1992.
33. Stephen Strange, A Survey of Storage System Design Employing Automatic File Migration, submission for CS266, University of California, Berkeley, CA, 11 May 1991.
34. The TeraStor Corporation provides a full listing of their new products at http://www.terastor.com, 16 January 1998.
35. David Tweten, “Hiding Mass Storage Under Unix: NASA's MSS-II Architecture, ”Tenth IEEE Symposium on Mass Storage Systems, Monterey, CA, May 1991, pages 140-145.