Web servers under overload: How scheduling can help

ACM Transactions on Internet Technology

Volumn 6, Issue 1, 2006, Pages 20-52

  Schroeder, Bianca ^a,b   Harchol Balter, Mor ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b Carnegie Mellon University   (United States)

Author keywords

Overload; Scheduling; SRPT; Starvation; Unfairness; Web server

Indexed keywords

MATHEMATICAL MODELS; RESPONSE TIME (COMPUTER SYSTEMS); SCHEDULING; WIDE AREA NETWORKS; WORLD WIDE WEB;

OVERLOAD; SRPT; STARVATION; UNFAIRNESS; WEB SERVER;

SERVERS;

EID: 33745251650     PISSN: 15335399     EISSN: 15335399     Source Type: Journal    
DOI: 10.1145/1125274.1125276     Document Type: Article

References (65)

1. ABDELZAHER, T. F. AND BHATTI, N. T. 1999. Web content adaptation to improve server overload behavior. WWW8/Comput. Networks 31, 11-16, 1563-1577.
2. ALMESBERGER, W. Linux network traffic control - implementation overview. Available at http://lrcwww.epfl.ch/linux-diffserv/.
3. ANDRESEN, D. AND YANG, T. 1997. Multiprocessor scheduling with client resources to improve the response time of WWW applications. In the International Conference on Supercomputing. 92-99.
4. ARLITT, M. AND JIN, T. 2000. Workload characterization of the 1998 world cup Web site. IEEE Network 14, 3, 30-37.
5. ARON, M. AND DRUSCHEL, P. 1999. TCP implementation enhancements for improving webserver performance. Tech. Rep. TR99-335, Rice University.
6. BANGA, G. AND DRUSCHEL, P. 1999. Measuring the capacity of a web server under realistic loads. World Wide Web 2, 1-2, 69-83.
7. BANGA, G., DRUSCHEL, P., AND MOGUL, J. C. 1999. Resource containers: A new facility for resource management in server systems. In Proceedings of OSDI '99. 45-58.
8. BANSAL, N. AND HARCHOL-BALTER, M. 2001a. Analysis of SRPT scheduling: Investigating unfairness. In Proceedings of ACM SIGMETRICS '01.
9. BANSAL, N. AND HARCHOL-BALTER, M. 2001b. Scheduling solutions for coping with transient overload. Tech. rep. CMU-CS-01-134, Carnegie Mellon University.
10. BARFORD, P. AND CROVELLA, M. E. 1998. Generating representative Web workloads for network and server performance evaluation. In Proceedings of SIGMETRICS '98 (July) 151-160.
11. BARFORD, P. AND CROVELLA, M. E. 1999. A performance evaluation of hyper text transfer protocols. In Proceedings of ACM SIGMETRICS '99 (May) 188-179.
12. BENDER, M., CHAKRABARTI, S., AND MUTHUKRISHNAN, S. 1998. Flow and stretch metrics for scheduling continuous job streams. In Proceedings of the 9th Annual ACM-SIAM Symposium on Discrete Algorithms.
13. BERNSTEIN, D. J. 1997. Syn cookies. http://cr.yp.to/syncookies.html.
14. BESTAVROS, A., CARTER, R. L., CROVELLA, M. E., CUNHA, C. R., HEDDAYA, A., AND MIRDAD, S. A. 1995. Application-level document caching in the Internet. In Proceedings of the 2nd International Workshop on Services in Distributed and Networked Environments (SDNE'96) (June).
15. BRAKMO, L. AND PETERSON, L. 1995. Performance problems in 4.4 BSD TCP. ACM Comput. Comm. Rev. 25, 5.
16. BRAUN, H. AND CLAFFY, K. 1994. Web traffic characterization: An assessment of the impact of caching documents from NCSA's Web server. In Proceedings of the 2nd International WWW Conference,
17. CHEHKASOVA, L. AND PHAAL, P. 1998. Session-based admission control: A mechanism for improving the performance of an overloaded web server. Tech. Rep. HPL-98-119, Hewlett Packard Laboratories.
18. COCKCROFT, A. 1996. Watching your web server. The Unix Insider at http://www.unixinsider.com (April).
19. COLAJANNI, M., YU, P. S., AND DIAS, D. M. 1998. Analysis of task assignment policies in scalable distributed Web-server systems. IEEE Trans. Parall. Distrib. Syst. 9, 6, 585-699.
20. Cooperative Association for Internet Data Analysis (CAIDA). 1999. Packet length distributions. http://www.caida.org/analysis/AIX/plen_hist.
21. CROVELLA, M., FRANGIOSO, R., AND HARCHOL-BALTER, M. 1999. Connection scheduling in web servers. In USENIX Symposium on Internet Technologies and Systems (Oct).
22. DAY, M., CAIN, B., TOMLINSON, G., AND RZEWSKI, P. 2002. A model for content internetworking (cdi). Internet Draft (draft-ietf-cdi-model-02.txt) (May).
23. DIAS, D. M., KISH, W., MUKHERJEE, R., AND TEWARI, R. 1996. A scalable and highly available web server. In COMPCON. 85-92.
24. DRUSCHEL, P. AND BANGA, G. 1996. Lazy receiver processing (LRP): A network subsystem architecture for server systems. In Proceedings of OSDI '96 (Oct) 261-275.
25. ELNIKETY, S., NAHUM, E. M., TRACEY, J., AND ZWAENEPOEL, W. 2004. A method for transparent admission control and request scheduling in dynamic e-commerce Web sites. In International World-Wide Web Conference (WWW'04) (May) New York, NY.
26. FELDMANN, A. Web performance characteristics. IETF (Nov). http://www.research.att.com/anja/feldmann/papers.html.
27. FRIEDMAN, E. J. AND HENDERSON, S. G. 2003. Fairness and efficiency in web server protocols. In Proceedings of the ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems (May).
28. GONG, M. AND WILLIAMSON, C. 2008. Quantifying the properties of SRPT scheduling. In Proceedings of IEEE /ACM International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS).
29. GWERTZMAN, J. AND SELTZER, M. 1994. The case for geographical push-caching. In Proceedings of HotOS '94 (May).
30. HARCHOL-BALTER, M., SCHROEDER, B., AGRAWAL, M., AND BANSAL, N. 2003. Size-based scheduling to improve web performance. ACM Trans. Comput. Syst. 21, 2 (May).
31. Internet Town Hall. The Internet traffic archives. Available at http://town.hall.org/Archives/pub/ITA/.
32. Internet Traffic Report. 2004. http://www.internettrafficreport.com.
33. IRCache Home. 2004. The trace files. http://www.ircache.net/Traces/.
34. IYER, R., TEWARI, V., AND KANT, K. 2000. Overload control mechanisms for web servers. In Workshop on Performance and QoS of Next Generation Networks (Nov).
35. JOHNSON, K. L., CARR, J. F., DAY, M. S., AND KAASHOEK, M. F. 2000. The measured performance of content distribution networks. In Proceedings of the 5th International Web Caching and Content Delivery Workshop.
36. KAASHOEK, M., ENGLER, D., WALLACH, D., AND GANGER, G. 1996. Server operating systems. In SIGOPS European Workshop '96. 141-148.
37. KRISHNAMURTHY, B. AND REXFORD, J. 2001. Web Protocols and Practice: HTTP/1.1, Networking Protocols, Caching, and Traffic Measurement. Addison-Wesley.
38. KRISHNAMURTHY, B., WILLS, C., AND ZHANG, Y. 2001. The use and performance of content distribution networks. In Proceedings of the 1st ACM SIGCOMM Workshop on Internet Measurement.
39. KUROSE, J. AND ROSS, K. W. 2001. Computer Networking: A Top-Down Approach Featuring the Internet. Addison Wesley Longman, Inc.
40. LEFEBVRE, W. 2002 Cnn.com: Facing a world crisis. The USENIX Technical Conference, (June).
41. MAGGS, B. VICE PRESIDENT OF RESEARCH, 2001. Akamai Technologies. Personal communication.
42. MANLEY, S. AND SELTZER, M. 1997. Web facts and fantasy. In Proceedings of the 1997 USITS.
43. MCWHERTER, D., SCHROEDER, B., AILAMAKI, A., AND HARCHOL-BALTER, M. 2004. Priority mechanisms for OLTP and transactional web applications. In the 20th International Conference on Data Engineering (ICDE'04).
44. Microsoft TechNet Insights AND ANSWER FOR IT PROFESSIONAL 2001. The arts and science of web server tuning with internet information services 5.0. http://www.microsoft.com/technet/.
45. MOGUL, J. C. 1995. The case for persistent-connection HTTP. In Proceedings of ACM SIGCOMM '95 (Oct). 299-313.
46. MOGUL, J. C. 1995. Network behavior of a busy Web server and its clients. Tech. Rep. 95/5, Digital Western Research Laboratory (Oct).
47. MOGUL, J. C. AND RAMAKRISHNAN, K. K. 1996. Eliminating receive livelock in an interrupt-driven kernel. In Proceedings of USENIX Technical Conference. 99-111.
48. MURTA, C. D. AND CORLASSOLI, T. P. 2003. Fastest connection first: A new scheduling policy for web servers. In Proceedings of the 18th International Teletraffic Congress (ITC-18) (Sept).
49. NAHUM, E., ROSU, M., SESHAN, S., AND ALMEIDA, J. 2001. The effects of wide-area conditions on www server performance. In Proceedings of ACM SIGMETRICS'01. 257-267.
50. National Institute Standards and Technology. Nistnet. http://snad.ncsl.nist.gov/itg/nistnet/.
51. PADHYE, J., FIROIU, V., TOWSLEY, D. F., AND KUROSE, J. F. 2000. Modeling tcp reno performance: A simple model and its empirical validation. IEEE / ACM Trans. Netw. 8, 2, 133-145.
52. PAI, V. S., DRUSCHEL, P., AND ZWAENEPOEL, W. 1999. Flash: An efficient and portable web server. In Proceedings of USENIX 1999 (June).
53. PAXSON, V. AND ALLMAN, M. 2000. Computing TCP's retransmission timer. RFC 2988, http://www.faqs.org/rfcs/rfc2988.html.
54. RAI, I. A., URVOY-KELLER, G., AND BIERSACK, E. 2003. Analysis of LAS scheduling for job size distributions with high variance. In Proceedings of the ACM Sigmetrics Conference on Measurement and Modeling of Computer Systems (SIGMETRICS) (June).
55. RAWAT, M. AND KSHEMKAYANI, A. 2003. SWIFT: Scheduling in web servers for fast response time. In the 2nd IEEE International Symposium on Network Computing and Applications (April).
56. RIZZO, L. 1997. Dummynet: A simple approach to the evaluation of network protocols. ACM Comput. Commun. Rev. 27, 1.
57. SCHRAGE, L. E. AND MILLER, L. W. 1966. The queue M/G/1 with the shortest remaining processing time discipline. Operations Resear. 14, 670-684.
58. SESHAN, S., BALAKRISHNAN, H., PADMANABHAN, V. N., STEMM, M., AND KATZ, R. 1998. TCP behavior of a busy internet server: Analysis and improvements. In Proceedings of the Conference on Computer Communications (IEEE Infocom). 252-262.
59. SILBERSCHATZ, A., GALVIN, P., AND GAGNE, G. 2002. Operating System Concepts, 6th Ed. John Wiley & Sons.
60. STALLINGS, W. 2001. Operating Systems, 4th Ed. Prentice Hall.
61. The World Wide Web Consortium (W3C). Libwww - the W3C protocol library, http://www.w3.org.
62. VOIGT, T. AND GUNNIGBERG, P. 2001. Kernel-based control of persistent web server connections. ACM SIGMETRICS Performance Evaluation Review 29, 2, 20-25.
63. VOIGT, T., TEWARI, R., FREIMUTH, D., AND MEHRA, A. 2001. Kernel mechanisms for service differentiation in overloaded web servers. In Proceedings of the USENIX Annual Technical Conference (June) Boston, MA.
64. WELSH, M. AND CULLER, D. 2003. Adaptive overload control for busy internet servers. In Proceedings of the USENIX Symposium on Internet Technologies and Systems.
65. WIERMAN, A. AND HARCHOL-BALTER, M. 2003. Classifying scheduling policies with respect to unfairness in an M/GI/1. In ACM Sigmetrics International Conference on Measurement and Modeling of Computer Systems.