Predicting response times for the Spotify backend

Proceedings of the 2012 8th International Conference on Network and Service Management, CNSM 2012

Volumn , Issue , 2012, Pages 117-125

  Yanggratoke, Rerngvit ^a   Kreitz, Gunnar ^b   Goldmann, Mikael ^b   Stadler, Rolf ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b SPOTIFY   (United Kingdom)

Author keywords

distributed object store; Key value store; performance measurements; performance modeling; response times; streaming media services; system dimensioning

Indexed keywords

DISTRIBUTED OBJECTS; KEY-VALUE STORE; PERFORMANCE MEASUREMENTS; PERFORMANCE MODELING; STREAMING MEDIA SERVICES; SYSTEM DIMENSIONING;

ENGINEERING RESEARCH;

RESPONSE TIME (COMPUTER SYSTEMS);

EID: 84872061963     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. G. Kreitz and F. Niemelä, "Spotify - large scale, low latency, P2P music-on-demand streaming," in Peer-to-Peer Computing. IEEE, 2010, pp. 1-10.
2. I. Sysoev, "Nginx," http://nginx.org/.
3. D. R. Karger, E. Lehman, F. T. Leighton, R. Panigrahy, M. S. Levine, and D. Lewin, "Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the world wide web," in STOC, F. T. Leighton and P. W. Shor, Eds. ACM, 1997, pp. 654-663.
4. L. Kleinrock, Theory, Volume 1, Queueing Systems. Wiley-Interscience, 1975.
5. D. Mosberger and T. Jin, "httperf - a tool for measuring web server performance," SIGMETRICS Perform. Eval. Rev., vol. 26, no. 3, pp. 31-37, Dec. 1998.
6. W. Tarreau, "Haproxy," http://haproxy.1wt.eu/.
7. S. Godard, "iostat," http://linux.die.net/man/1/iostat.
8. M. Mitzenmacher and E. Upfal, Probability and Computing: Randomized Algorithms and Probabilistic Analysis. Cambridge University Press, Jan. 2005.
9. M. Raab and A. Steger, ""Balls into Bins" - A Simple and Tight Analysis," in Proceedings of the Second International Workshop on Randomization and Approximation Techniques in Computer Science, ser. RANDOM '98. London, UK: Springer-Verlag, 1998, pp. 159-170.
10. J. Garcia, L. Prada, J. Fernandez, A. Nunez, and J. Carretero, "Using black-box modeling techniques for modern disk drives service time simulation," in Simulation Symposium, 2008. ANSS 2008. 41st Annual, april 2008, pp. 139-145.
11. A. Lebrecht, N. Dingle, and W. Knottenbelt, "A performance model of zoned disk drives with i/o request reordering," in Quantitative Evaluation of Systems, 2009. QEST '09. Sixth International Conference on the, sept. 2009, pp. 97-106.
12. F. Cady, Y. Zhuang, and M. Harchol-Balter, "A Stochastic Analysis of Hard Disk Drives," International Journal of Stochastic Analysis, vol. 2011, pp. 1-21, 2011.
13. E. Thereska, M. Abd-El-Malek, J. Wylie, D. Narayanan, and G. Ganger, "Informed data distribution selection in a selfpredicting storage system," in Autonomic Computing, 2006. ICAC '06. IEEE International Conference on, june 2006, pp. 187-198.
14. A. Gulati, G. Shanmuganathan, I. Ahmad, C. Waldspurger, and M. Uysal, "Pesto: online storage performance management in virtualized datacenters," in Proceedings of the 2nd ACM Symposium on Cloud Computing, ser. SOCC '11. New York, NY, USA: ACM, 2011, pp. 19:1-19:14.
15. S. Kraft, G. Casale, D. Krishnamurthy, D. Greer, and P. Kilpatrick, "Io performance prediction in consolidated virtualized environments," SIGSOFT Softw. Eng. Notes, vol. 36, no. 5, pp. 295-306, Sep. 2011.
16. M. Abd-El-Malek, W. V. Courtright, II, C. Cranor, G. R. Ganger, J. Hendricks, A. J. Klosterman, M. Mesnier, M. Prasad, B. Salmon, R. R. Sambasivan, S. Sinnamohideen, J. D. Strunk, E. Thereska, M. Wachs, and J. J. Wylie, "Ursa minor: versatile cluster-based storage," in Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4, ser. FAST'05. Berkeley, CA, USA: USENIX Association, 2005, pp. 5-5.
17. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels, "Dynamo: amazon's highly available key-value store," SIGOPS Oper. Syst. Rev., vol. 41, no. 6, pp. 205-220, Oct. 2007.
18. A. Lakshman and P. Malik, "Cassandra: a decentralized structured storage system," SIGOPS Oper. Syst. Rev., vol. 44, no. 2, pp. 35-40, Apr. 2010.
19. T. Schütt, F. Schintke, and A. Reinefeld, "Scalaris: reliable transactional p2p key/value store," in Proceedings of the 7th ACM SIGPLAN workshop on ERLANG, ser. ERLANG '08. New York, NY, USA: ACM, 2008, pp. 41-48.