Diamond: Automating data management and storage for wide-area, reactive applications

Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016

Volumn , Issue , 2016, Pages 723-738

  Zhang, Irene ^a   Lebeck, Niel ^a   Fonseca, Pedro ^a   Holt, Brandon ^a   Cheng, Raymond ^a   Norberg, Ariadna ^a   Krishnamurthy, Arvind ^a   Levy, Henry M ^a  

^a UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DIAMONDS; DIGITAL STORAGE; STORAGE MANAGEMENT; SYSTEMS ANALYSIS;

APPLICATION CODES; CLOUD STORAGES; DATA MANAGEMENT SERVICES; DISTRIBUTED DATA; DISTRIBUTED DATA MANAGEMENTS; GOOGLE DOCS; SHARED DATA;

INFORMATION MANAGEMENT;

EID: 85019213906     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (85)

1. Nim, Feb 2016. https://en.wikipedia.org/wiki/Nim#The_100_game.
2. D. Abrahams and S. Seefeld. Boost C++ libraries, 2015. http://www.boost.org/doc/libs/1600/libs/python/doc/html/index.html.
3. A. Adya, G. Cooper, D. Myers, and M. Piatek. Thialfi: a client notification service for internet-scale applications. In Proc. of SOSP, 2011.
4. S. Alvos-Bock. The convergence of iOS and OSX user interface design, July 2015. http://www.solstice-mobile.com/blog/the-convergence-of-ios-and-os-x-user-interface-design.
5. Apple. The Swift programming language, 2016. https://developer.apple.com/library/ios/documentation/Swift/Conceptual/Swift_Programming_Language/#//apple_ref/doc/uid/TP40014097-CH3-ID0.
6. Apple push notification service, 2015. https://developer.apple.com/library/ios/documentation/NetworkingInternet/Conceptual/RemoteNotificationsPG/Chapters/ApplePushService.html.
7. K. Apt. Principles of Constraint Programming. Cambridge University Press, 2003.
8. J. Baker, C. Bond, J. C. Corbett, J. Furman, A. Khorlin, J. Larson, J.-M. Leon, Y. Li, A. Lloyd, and V. Yushprakh. Megastore: Providing scalable, highly available storage for interactive services. In Proc. of CIDR, 2011.
9. N. M. Belaramani, J. Zheng, A. Nayate, R. Soulé, M. Dahlin, and R. Grimm. PADS: A policy architecture for distributed storage systems. In Proc. of NSDI, 2009.
10. J. K. Bennett, J. B. Carter, and W. Zwaenepoel. Munin: Distributed shared memory based on type-specific memory coherence. In Proc. of PPOPP, 1990.
11. P. A. Bernstein, V. Hadzilacos, and N. Goodman. Concurrency Control and Recovery in Database Systems. Addison Wesley, 1987.
12. J. A. Blakeley, P.-A. Larson, and F. W. Tompa. Efficiently updating materialized views. In Proc. of SIGMOD, 1986.
13. J. Callaham. Yes, windows 10 is the next version of windows phone. Windows Central, Sept 2014. http://www.windowscentral.com/yes-windows-10-next-version-windows-phone.
14. S. Chakravarthy. Sentinel: an object-oriented DBMS with event-based rules. In Proc. of SIGMOD, 1997.
15. F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems, 2008.
16. K. Conaway. Pyscrabble. http://pyscrabble.sourceforge.net/.
17. J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. Spanner: Google's globally-distributed database. In Proc. of OSDI, 2012.
18. M. Dahlin, L. Gao, A. Nayate, A. Venkataramana, P. Yalagandula, and J. Zheng. PRACTI replication. In Proc. of NSDI, 2006.
19. DB-engine's ranking of key-value stores, 10 2015. http: //db-engines.com/en/ranking/key-value+store.
20. G. DeCandia, D. Hastorun, M. Jampani, G. Kakulapati, A. Lakshman, A. Pilchin, S. Sivasubramanian, P. Vosshall, and W. Vogels. Dynamo: Amazon's highly available key-value store. In Proc. of SOSP, 2007.
21. Deepstream. deepstream.io: a scalable server for realtime web apps. https://deepstream.io/.
22. Google Drive, 2016. http://drive.google.com.
23. Dropbox, 2015. http://www.dropbox.com.
24. eMarketer. Mobile game revenues to grow 16.5% in 2015, surpassing $3 billion, Feb 2015. http://www.emarketer.com/Article/Mobile-Game-Revenues-Grow-165-2015-Surpassing-3-Billion/1012063.
25. R. T. Fielding. Architectural Styles and the Design of Network-based Software Architectures. PhD thesis, University of California, Irvine, 2000.
26. Firebase, 2015. https://www.firebase.com/.
27. Git, 2015. https://git-scm.com/.
28. Google. Agera. https://github.com/google/agera.
29. Google. Android standalone toolchain, 2016. http://developer.android.com/ndk/guides/standalone_toolchain.html.
30. Google Compute Engine. https://cloud.google.com/products/compute-engine/.
31. M. Herlihy. Optimistic concurrency control for abstract data types. In Proc. of PODC. ACM, 1986.
32. M. Herlihy. Apologizing versus asking permission: Optimistic concurrency control for abstract data types. ACM Transactions on Database Systems, 1990.
33. N. Herman, J. P. Inala, Y. Huang, L. Tsai, E. Kohler, B. Liskov, and L. Shrira. Type-aware transactions for faster concurrent code. In eurosys, 2016.
34. T. Hoff. Playfish's social gaming architecture - 50 million monthly users and growing. High Scalability, Sept 2010. highscalability.com/blog/2010/9/21/playfishs-social-gaming-architecture-50-million-monthly-user.html.
35. T. Hoff. The architecture that Twitter uses to deal with 150m active users, 300k qps, a 22 mb/s firehose, and send tweets in under 5 seconds. High Scalability, July 2013. http://highscalability.com/blog/2013/7/8/the-architecture-twitter-uses-to-deal-with-150m-active-users.html.
36. M. Humphries. Ellen DeGeneres crashes Twitter with Oscar selfie, 2014. http://www.geek.com/mobile/ellen-degeneres-crashes-twitter-with-an-oscars-selfie-1586464/.
37. Apple iCloud, 2016. https://www.icloud.com/.
38. A. Incubator. Apache Usergrid. http://usergrid.apache.org/.
39. JavaCPP: The missing bridge between Java and native C++. github, Mar 2016. https://github.com/bytedeco/javacpp.
40. Jetty web server. http://www.eclipse.org/jetty/.
41. R. K. Jonas Boner, Dave Farley and M. Thompson. The reactive manifesto, Sept 2014. http://www.reactivemanifesto.org/.
42. J. J. Kistler and M. Satyanarayanan. Disconnected operation in the coda file system. ACM Transactions on Computer Systems, 1992.
43. T. Kraska, G. Pang, M. J. Franklin, S. Madden, and A. Fekete. MDCC: multi-data center consistency. In Proc. of EuroSys, 2013.
44. A. Lakshman and P. Malik. Cassandra: A decentralized structured storage system. ACM SIGOPS Operating Systems Review, 2010.
45. C. Leau. Spring Data Redis - Retwis-J, 2013. http://docs.spring.io/spring-data/data-keyvalue/examples/retwisj/current/.
46. K. Li and P. Hudak. Memory coherence in shared virtual memory systems. ACM Transactions on Computer Systems, 1989.
47. B. F. Lieuwen, N. Gehani, and R. Arlein. The Ode active database: trigger semantics and implementation. In Proc. of ICDE, Feb 1996.
48. A. Margara and G. Salvaneschi. We have a DREAM: Distributed reactive programming with consistency guarantees. In Proc. of DEBS. ACM, 2014.
49. Markets and Markets. Backend as a service (BaaS) market worth 28.10 billion USD by 2020. http://www.marketsandmarkets.com/PressReleases/baas.asp.
50. Martypdx. Firebase data consistency across multiple nodes. Stack Overflow, Apr 2015. http://stackoverflow.com/questions/29947898/firebase-data-consistency-across-multiple-nodes.
51. Meteor, 2015. http://www.meteor.com.
52. M. Mode. New mobile apps revolutionize how organizations respond to crises and operations issues, Aug 2014. http://www.missionmode.com/new-mobile-apps-revolutionize-organizations-respond-crises-operations-issues/.
53. MongoDB, 2015. https://www.mongodb.org.
54. I. Moraru, D. G. Andersen, and M. Kaminsky. There is more consensus in egalitarian parliaments. In Proc. of SOSP, 2013.
55. Mozilla. Kinto. http://kinto.readthedocs.org/en/latest/.
56. R. Mulia. Firebase - maintain/guarantee consistency. Stack Overflow, Jan 2016. http://stackoverflow.com/questions/34678083/firebase-maintain-guarantee-data-consistency.
57. A. Muthitacharoen, B. Chen, and D. Mazières. A low-bandwidth network file system. In Proc. of SOSP, 2001.
58. B. M. Oki and B. H. Liskov. Viewstamped replication: A new primary copy method to support highly-available distributed systems. In Proc. of PODC, 1988.
59. Openio. openio.io: object storage grid for apps. http://openio.io/.
60. Parse, 2015. http://www.parse.com.
61. D. Perkins, N. Agrawal, A. Aranya, C. Yu, Y. Go, H. V. Madhyastha, and C. Ungureanu. Simba: tunable end-to-end data consistency for mobile apps. In Proc. of EuroSys, 2015.
62. D. R. K. Ports, A. T. Clements, I. Zhang, S. Madden, and B. Liskov. Transactional consistency and automatic management in an application data cache. In Proc. of OSDI, 2010.
63. PostgreSQL, 2013. http://www.postgresql.org/.
64. React: A JavaScript library for building user interfaces. Github, 2016. https://facebook.github.io/react/.
65. ReactiveX: An api for asynchronous programming with observable streams, 2016. http://reactivex.io/.
66. Redis. Wait numslaves timeout. http://redis.io/commands/WAIT.
67. Redis: Open source data structure server, 2013. http://redis.io/.
68. Riak, 2015. http://basho.com/products/riak-kv/.
69. M. Shapiro, N. Preguiça, C. Baquero, and M. Zawirski. Conflict-free replicated data types. In Proc. of SSS, 2011.
70. Socketcluster.io. socketcluster.io: a scalable framework for realtime apps and microservices. http://socketcluster.io/#! /.
71. Sqlite home page, 2015. https://www.sqlite.org/.
72. Square cash. https://cash.me/.
73. M. Stonebraker and J. M. Hellerstein. Readings in Database Systems. Morgan Kaufmann San Francisco, 1998.
74. J. Strauss, J. M. Paluska, C. Lesniewski-Laas, B. Ford, R. Morris, and M. F. Kaashoek. Eyo: Device-transparent personal storage. In Proc. of USENIX ATC, 2011.
75. J. Stribling, Y. Sovran, I. Zhang, X. Pretzer, J. Li, M. F. Kaashoek, and R. Morris. Flexible, wide-area storage for distributed systems with WheelFS. In Proc. of NSDI, 2009.
76. R. Sumbaly, J. Kreps, L. Gao, A. Feinberg, C. Soman, and S. Shah. Serving large-scale batch computed data with Project Voldemort. In Proc. of FAST, 2012.
77. D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, M. J. Spreitzer, and C. H. Hauser. Managing update conflicts in bayou, a weakly connected replicated storage system. In Proc. of SOSP, 1995.
78. Global social gaming market to reach US$17.4 bn by 2019 propelled by rising popularity of fun games. Transparency Market Research Press Release, Sept 2015. http://www.transparencymarketresearch.com/pressrelease/social-gaming-market.htm.
79. Twimight open-source Twitter client for Android, 2013. http://code.google.com/p/twimight/.
80. Twitter. Twitter developer API, 2014. https://dev.twitter.com/overview/api.
81. Venmo. https://venmo.com/.
82. Z. Wan and P. Hudak. Functional reactive programming from first principles. In Proc. of PLDI, 2000.
83. W. E. Weihl. Local atomicity properties: modular concurrency control for abstract data types. ACM Trans. Prog. Lang. Syst., 1989.
84. I. Zhang, N. K. Sharma, A. Szekeres, A. Krishnamurhty, and D. R. K. Ports. Building consistent transactions with inconsistent replication. In Proc. of SOSP, 2015.
85. I. Zhang, A. Szekeres, D. V. Aken, I. Ackerman, S. D. Gribble, A. Krishnamurthy, and H. M. Levy. Customizable and extensible deployment for mobile/cloud applications. In Proc. of OSDI, 2014.