Exploiting the Non-Determinism and Asynchrony of Set Iterators to Reduce Aggregate File I/O Latency

Operating Systems Review (ACM)

Volumn 31, Issue 5, 1997, Pages 252-263

  Steere, David C ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL LINGUISTICS; COMPUTER SYSTEMS PROGRAMMING; DATA ACQUISITION; DATA STRUCTURES; DISTRIBUTED COMPUTER SYSTEMS; ITERATIVE METHODS; NETWORK PROTOCOLS; WIDE AREA NETWORKS;

DISTRIBUTED FILE SYSTEM (DFS); DYNAMIC SETS; INPUT/OUTPUT LATENCY; WORLD WIDE WEB (WWW);

INPUT OUTPUT PROGRAMS;

EID: 0031539253     PISSN: 01635980     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/269005.266705     Document Type: Article

References (42)

1. ARNOLD, K., AND GOSLING, J. The Java Programming Language. The Java Series. Addison-Wesley, 1996, pp. 221-223.
2. BACH, M. J. The De sign of the Unix Operating System. Prentice Hall, Inc. A division of Simon & Schuster, Englewood Cliffs, New Jersey 07632, 1986. Chapter 3: The Buffer Cache.
3. BAENTSCH, M., BAUM, L., MOLTER, G., ROTHKUGEL, S., AND STURM, P. Enhancing the web infrastructure - from caching to replication. IEEE Internet Computing 1,2 (Apr. 1997). Also available as http://www.computer.org/internet/9702/baentsch9702.htm.
4. BAKER, M. G., HARTMAN, J. H., KUPFER, M. D., SHIRRIFF, K., AND OUSTERHOUT, J. K. Measurements of a distributed file system. In Proceedings of the 13th ACM Symposium on Operating Systems Principles (October 1991).
5. BOWMAN, M., SPASOJEVIC, M., AND SPECTOR, A. File system support for search. Transarc white paper, 1994.
6. CAO, P., FELTEN, E. W., KARLIN, A., AND LI, K. A study of integrated prefetching and caching strategies. In Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems (May 1995).
7. CAO, P., FELTEN, E. W., AND Li, K. Implementation and performance of application-controlled file caching. In Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation (November 1994).
8. CUREWITZ, K. M., KRISHNAN, P., AND VITTER, J. S. Practical prefetching via data compression. In Proceedings of the 1993 ACM Conf. on Management of Data (SIGMOD) (May 1993).
9. DUSKA, B., AND MARWOOD, D. Squid proxy analysis. Appeared in the Second Web Caching Workshop, Boulder, Colorado, June 1997. http://ircache.nlanr.net/Cache/Workshop97/, 1997. Also available as http://www.cs.ubc.ca/spider/marwood/Projects/SPA/Report/ Report.html.
10. GIFFORD, D. K., JOUVELOT, P., SHELDON, M. A., AND O'TOOLE, JR., J. W. Semantic file systems. In Proceedings of the 13th ACM Symposium on Operating Systems Principles (October 1991).
11. GLASSMAN, S. A caching relay for the world wide web. Computer Networks and ISDN Systems 27, 2 (Nov. 1994). Special Issue: selected papers from the First International WWW Conference.
12. GRIFFIOEN, J., AND APPLETON, R. The design, implementation, and evaluation of a predictive caching file system. Tech. Rep. CS-264-96, Department of Computer Science, University of Kentucky, June 1996.
13. GRIMSHAW, A. S., AND LOYOT, E. C., J. ELFS: Object-oriented extensible file systems. Tech. Rep. TR-91-14, Computer Science Department, University of Virginia, July 1991.
14. HOWARD, J., KAZAR, M., MENEES, S., NICHOLS, D., SATYANARAYANAN, M., SIDEBOTHAM, R., AND WEST, M. Scale and performance in a distributed file system. ACM Trans. Comput. Syst. 6, 1 (Feb. 1988).
15. JACOBSON, V. Congestion avoidance control. In Proceedings of the SIGCOMM '88 Conference on Communications Architectures and Protocols (1988).
16. JOSEPH, A. D., DELESPINASSE, A. F., TAUBER, J. A., GIFFORD, D. K., AND KAASHOEK, M. F. Rover: A toolkit for mobile information access. In Proceedings of the 15th ACM Symposium on Operating Systems Principles (December 1995).
17. JOY, W. An introduction to the C shell. In Unix User's Manual, Supplementary Documents, M. J. Karels and S. J. Leffler, Eds. Computer Science Division, Department of Electrical Engineering and Computer Science, University of California, 1980.
18. KIMBREL, T., TOKMINS, A., PATTERSON, R. H., BERSHAD, B., CAO, P., FELTEN, E. W., GIBSON, G. A., KARLIN, A. R., AND LI, K. A trace-driven comparison of algorithms for parallel prefetching and caching. In Proceedings of the Second USENIX Symposium on Operating Systems Design and Implementation (Oct. 1996).
19. KLEIMAN, S. Vnodes: An architecture for multiple file system types in Sun UNIX. In Summer USENIX Conference Proceedings (Atlanta, 1986).
20. KOTZ, D. Disk-directed I/O for MIMD multiprocessors. In Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation (November 1994).
21. KOTZ, D., AND ELLIS, C. Practical prefetching techniques for parallel file systems. In Proceedings of the 1st International Conference on Parallel and Distributed Information Systems (Miami Beach, Florida, Dec. 1992).
22. KUENNING, G. H. The design of the SEER predictive caching system. In Proceedings of the Workshop on Mobile Computing Systems and Applications (Santa Cruz, CA, Dec. 1994).
23. LISKOV, B., AND GUTTAG, J. Abstraction and Specification in Program Development. The MIT EECS Series. MIT Press, Cambridge, MA ; McGraw-Hill, New York, 1986.
24. MANBER, U., AND Wu, S. Glimpse: A tool to search through entire file systems. In Winter USENIX Conference Proceedings (1994). Also available as The University of Arizona Department of Computer Science Technical Report TR 93-34.
25. MOWRY, T. C., DEMKE, A. K., AND KRIEGER, O. Automatic compiler-inserted I/O prefetching for out-of-core applications. In Proceedings of the Second USENIX Symposium on Operating Systems Design and Implementation (Oct. 1996).
26. NELSON, M., WELCH, B., AND OUSTERHOUT, J. Caching in the Sprite Network File System. ACM Trans. Comput. Syst. 6, 1 (Feb. 1988).
27. OUSTERHOUT, J. K., DA COSTA, H., HARRISON, D., KUNZE, J. A., KUPFER, M., AND THOMPSON, J. G. A trace-driven analysis of the UNIX 4.2 BSD file system. In Proceedings of the 10th ACM Symposium on Operating Systems Principles (December 1985).
28. PADMANABHAN, V. N., AND MOGUL, J. C. Using predictive prefetching to improve world wide web latency. ACM SIGCOMM Computer Communication Review 26, 3 (July 1996).
29. PATTERSON, R. H., GIBSON, G. A., GINTING, E., STODOLSKY, D., AND ZELENKA, J. Informed prefetching and caching. In Proceedings of the 15th ACM Symposium on Operating System Principles (Dec. 1995).
30. PU, C., BLACK, A., COWAN, C., WALPOLE, J., AND CONSEL, C. Microlanguages for operating system specialization. In Proceedings of the SIGPLAN Workshop on Domain Specific Languages (Paris, France, Jan. 1997).
31. SANDBERG, R., GOLDBERG, D., KLEIMAN, S., WALSH, D., AND LYON, B. Design and implementation of the Sun Network File System. In Summer USENIX Conference Proceedings, Portland (1985).
32. SATYANARAYANAN, M. A study of file sizes and functional lifetimes. In Proceedings of the 8th ACM Symposium on Operating Systems Principles (December 1981).
33. SHAW, M., WULF, W. A., AND LONDON, R. L. Abstraction and verification in Alphard: Defining and specifying iteration and generators. Commun. ACM 20, 8 (Mar. 1977). Reprinted in Tutorial: Programming Language Design, text for IEEE Tutorial by Anthony I. Wasserman, 1980, pp. 145-155.
34. SHAW, M., WULF, W. A., AND LONDON, R. L. Abstraction and verification in Alphard: Defining and specifying iteration and generators. Commun. ACM 20, 8 (Mar. 1977). Reprinted in Tutorial: Programming Language Design, text for IEEE Tutorial by Anthony I. Wasserman, 1980, pp. 145-155.
35. SMITH, A. J. Disk cache - miss ratio analysis and design considerations. ACM Trans. Comput. Syst. 3, 3 (Aug. 1985).
36. SPASOJEVIC, M., AND SATYANARAYANAN, M. A usage profile and evaluation of a wide-area distributed file system. In Winter Usenix Conference Proceedings (San Francisco, CA, 1994).
37. STAEHLI, R. Quality of Service Specification for Resource Management in Multimedia Systems. PhD thesis, Department of Computer Science and Engineering, Oregon Graduate Institute, 1996. Available as ftp://cse.ogi.edu/pub/tech-reports/1996/96-TH-001.ps.gz.
38. STEERE, D., KISTLER, J., AND SATYANARAYANAN, M. Efficient user-level file cache management on the Sun vnode interface. In Summer USENIX Conference Proceedings (Anaheim, CA, 1990).
39. STEERE, D. C. Using Dynamic Sets to Reduce the Aggregate Latency of Data Access. PhD thesis, School of Computer Science, Carnegie Mellon University, 1997. Available as technical report CMU-CS-94-215.
40. TAIT, C. D., AND DUCHAMP, D. Detection and exploitation of file working sets. In Proceedings of the 11th International Conference on Distributed Com puting Systems (Arlington, TX, 1991).
41. WEBCOMPASS 1.0. Quarterdeck, Corp. Marina del Ray, CA. (800) 683-6696. Additional information is available at http://www.quarterdeck.com.
42. WING, J., AND STEERE, D. Specifying weak sets. In Proceedings of the International Conference on Distributed Computer Systems (Vancouver, June 1995). Also available as Carnegie Mellon University School of Computer Science technical report CMU-CS-94-194.