Morphus: Supporting online reconfigurations in Sharded NoSQL systems

Proceedings - IEEE International Conference on Autonomic Computing, ICAC 2015

Volumn , Issue , 2015, Pages 1-10

  Ghosh, Mainak ^a   Wang, Wenting ^a   Holla, Gopalakrishna ^a   Gupta, Indranil ^a  

^a University of Illinois ^*  (United States)

Author keywords

Nosql; Reconfiguration; Shard key change

Indexed keywords

DATA TRANSFER; DATABASE SYSTEMS; RECONFIGURABLE HARDWARE; TELECOMMUNICATION NETWORKS;

HIGH AVAILABILITY; NOSQL; ONLINE RECONFIGURATION; OPTIMAL ALGORITHM; RECONFIGURATION; RECONFIGURATION OPERATIONS; SHARD KEY CHANGE; SYSTEMS ARCHITECTURE;

ONLINE SYSTEMS;

EID: 84961848460     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICAC.2015.42     Document Type: Conference Paper

References (34)

1. Altering Cassandra column family primary key. http: //stackoverflow. com/questions/18421668/alter-cassandra-columnfamily-primary-key-using-cassandra-cli-or-cql. visited on 2015-1-5.
2. Change shard key mongodb faq. http://docs. mongodb. org/manual/faq/ sharding/#can-i-change-the-shard-key-after-sharding-a-collection. visited on 2015-1-5.
3. Command to change shard key of a collection. https://jira. mongodb. org/browse/SERVER-4000. visited on 2015-1-5.
4. CouchDB. http://couchdb. Apache. org. visited on 2015-1-5.
5. Emulab. https://wiki. emulab. net/wiki/d710. visited on 2015-1-5.
6. Google Cloud. https://cloud. google. com/. visited on 2015-1-5.
7. The great primary key debate. http://www. Techrepublic. com/article/ the-great-primary-key-debate/. visited on 2015-1-5.
8. HBase. https://hbase. Apache. org. visited on 2015-1-5.
9. How to change the Shard Key. http://stackoverflow. com/questions/ 6622635/how-to-change-the-shard-key. visited on 2015-1-5.
10. Hungarian algorithm. http://en. wikipedia. org/wiki/Hungarian algorithm. visited on 2015-1-5.
11. MongoDB. http://www. mongodb. org. visited on 2015-1-5.
12. Mongodb manual for geo-distributed deployment (2. 4. 9). http://docs. mongodb. org/manual/tutorial/deploy-geographicallydistributed-replica-set/. visited on 2015-1-5.
13. RethinkDB. http://rethinkdb. com/. visited on 2015-1-5.
14. SMG Research Reveals DBA Tools Not Effective for Managing Database Change. http://www. datical. com/news/research-revealsdba-tools-not-effective-for-database-change/. visited on 2015-04-11.
15. Troubles With Sharding-What Can We Learn From The Foursquare Incident? http://highscalability. com/blog/2010/10/15/troubles-withsharding-what-can-we-learn-from-the-foursquare. html. visited on 2015-04-11.
16. NoSQL market forecast 2015-2020, Market Research Media. http: //www. marketresearchmedia. com/?p=568, 2012. visited on 2015-1-5.
17. M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. In Proceedings of 2008 the ACM Conference on Special Interest Group on Data Communication, SIGCOMM '08, pages 63-74, New York, NY, USA, 2008. ACM.
18. M. S. Ardekani and D. B. Terry. A self-configurable geo-replicated cloud storage system. In Proceedings of the 11th USENIX Conference on Operating Systems Design and Implementation, OSDI'14, pages 367-381, Berkeley, CA, USA, 2014. USENIX Association.
19. S. Barker, Y. Chi, H. Hacigümüs, P. Shenoy, and E. Cecchet. Shuttledb: Database-aware elasticity in the cloud. In 11th International Conference on Autonomic Computing (ICAC 14), pages 33-43, Philadelphia, PA, June 2014. USENIX Association.
20. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. In Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation-Volume 7, OSDI '06, pages 15-15, Berkeley, CA, USA, 2006. USENIX Association.
21. M. Chowdhury, M. Zaharia, J. Ma, M. I. Jordan, and I. Stoica. Managing data transfers in computer clusters with Orchestra. In Proceedings of the ACM Special Interest Group on Data Communication 2011 Conference, SIGCOMM '11, pages 98-109, New York, NY, USA, 2011. ACM.
22. B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing, SoCC '10, pages 143-154, New York, NY, USA, 2010. ACM.
23. J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. Spanner: Google's globally distributed database. ACM Trans. Comput. Syst., 31(3):8:1-8:22, Aug. 2013.
24. C. Curino, E. P. C. Jones, R. A. Popa, N. Malviya, E. Wu, S. Madden, H. Balakrishnan, and N. Zeldovich. Relational cloud: A database service for the cloud. In Proceedings of 5th Biennial Conference on Innovative Data Systems Research, pages 235-240, 2011.
25. S. Das, S. Nishimura, D. Agrawal, and A. El Abbadi. Albatross: lightweight elasticity in shared storage databases for the cloud using live data migration. In Proceedings of the Very Large Database Endowment, volume 4, pages 494-505. VLDB Endowment, May 2011.
26. A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Zephyr: Live migration in shared nothing databases for elastic cloud platforms. In Proceedings of the 2011 ACM International Conference on Special Interest Group on Management of Data, SIGMOD '11, pages 301-312, New York, NY, USA, 2011. ACM.
27. M. Ghosh, W. Wang, G. Holla, and I. Gupta. Morphus: Supporting online reconfigurations in sharded nosql systems. Technical report, University of Illinois, Urbana-Champaign, 2014. http://hdl. handle. net/2142/55158.
28. J. Kim, W. J. Dally, and D. Abts. Flattened butterfly: A cost-efficient topology for high-radix networks. In Proceedings of the 34th Annual International Symposium on Computer Architecture, ISCA '07, pages 126-137, New York, NY, USA, 2007. ACM.
29. J. Kim, W. J. Dally, and D. Abts. Efficient topologies for largescale cluster networks. In Proceedings of the 2010 Conference on Optical Fiber Communication (OFC), collocated National Fiber Optic Engineers Conference(OFC/NFOEC), pages 1-3. IEEE, 2010.
30. A. Lakshman and P. Malik. Cassandra: A decentralized structured storage system. ACM SIGOPS Operating Systems Review, 44(2):35-40, Apr. 2010.
31. J. McAuley and J. Leskovec. Hidden factors and hidden topics: Understanding rating dimensions with review text. In Proceedings of the 7th ACM Conference on Recommender Systems, RecSys '13, pages 165-172, New York, NY, USA, 2013. ACM.
32. G. Pang. Latencies gone wild!, AMPLab-UC Berkeley. https: //amplab. cs. berkeley. edu/2011/10/20/latencies-gone-wild/. visited on 2015-1-5.
33. I. Rae, E. Rollins, J. Shute, S. Sodhi, and R. Vingralek. Online, asynchronous schema change in F1. In Proceedings of the Very Large Database Endowment, volume 6, pages 1045-1056. VLDB Endowment, Aug. 2013.
34. D. Sjøberg. Quantifying schema evolution. Information and Software Technology, 35(1):35-44, 1993.