Building a reliable and high-performance content-based publish/subscribe system

Journal of Parallel and Distributed Computing

Volumn 73, Issue 4, 2013, Pages 371-382

  Zhao, Yaxiong ^a   Wu, Jie ^b  

^a AMAZON   (United States)

^b Temple University   (United States)

Author keywords

Content based publish subscribe; Fault tolerance; High performance system design; Reliable distributed system

Indexed keywords

CONTENT BASED ROUTING; CONTENT-BASED PUBLISH; CONTENT-BASED PUBLISH/SUBSCRIBE SYSTEMS; DHT ROUTING; EXTENSIVE SIMULATIONS; HIGH PERFORMANCE SYSTEMS; INHERENT COMPLEXITY; MESSAGE LOSS; NETWORK STATE; NORMAL OPERATIONS; RELIABLE DISTRIBUTED SYSTEMS; ROUTING METHODS; TRADITIONAL ARCHITECTURE;

FAULT TOLERANT COMPUTER SYSTEMS; NETWORK ARCHITECTURE; OVERLAY NETWORKS; RECOVERY;

FAULT TOLERANCE;

EID: 84872818939     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2012.12.014     Document Type: Article

References (36)

1. B. Beverly Yang, H. Garcia-Molina, Designing a super-peer network, in: Proceedings of 2003 International Conference on Data Engineering, 2003, pp. 49-60. doi: http://dx.doi.org/10.1109/ICDE.2003.1260781.
2. S. Bhola, R.E. Strom, S. Bagchi, Y. Zhao, and J.S. Auerbach Exactly-once delivery in a content-based publish-subscribe system Proceedings of the 2002 International Conference on Dependable Systems and Networks DSN'02 2002 IEEE Computer Society Washington, DC, USA 7 16 URL http://dl.acm.org/citation.cfm?id= 647883.738567
3. S. Bhola, Y. Zhao, J. Auerbach, Scalably supporting durable subscriptions in a publish/subscribe system, in: Dependable Systems and Networks, International Conference on 0, 2003, 57. doi: http://doi.ieeecomputersociety. org/10.1109/DSN.2003.1209916.
4. F. Cao, and J.P. Singh Medym: match-early with dynamic multicast for content-based publish-subscribe networks Proceedings of the ACM/IFIP/USENIX 2005 International Conference on Middleware Middleware'05 2005 Springer-Verlag New York, Inc. New York, NY, USA 292 313 URL http://dl.acm.org/citation.cfm?id= 1515890.1515905 (Pubitemid 43763640)
5. A. Carzaniga, D.S. Rosenblum, and A.L. Wolf Design and evaluation of a wide-area event notification service ACM Trans. Comput. Syst. 19 2001 332 383 URL http://doi.acm.org/10.1145/380749.380767 (Pubitemid 33619857)
6. A. Carzaniga, and A.L. Wolf Forwarding in a content-based network Proceedings of the 2003 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications SIGCOMM'03 2003 ACM New York, NY, USA 163 174 doi: http://doi.acm.org/10.1145/863955.863975
7. R. Chand, and P. Felber Xnet: a reliable content-based publish/subscribe system Proceedings of the 23rd IEEE International Symposium on Reliable Distributed Systems SRDS'04 2004 IEEE Computer Society Washington, DC, USA 264 273 URL http://dl.acm.org/citation.cfm?id=1032662.1034371 (Pubitemid 40449371)
8. P. Costa, M. Migliavacca, G.P. Picco, and G. Cugola Introducing reliability in content-based publish-subscribe through epidemic algorithms Proceedings of the 2nd International Workshop on Distributed Event-Based Systems DEBS'03 2003 ACM New York, NY, USA 1 8 doi: http://doi.acm.org/10.1145/966618. 966629
9. X. Dimitropoulos, D. Krioukov, A. Vahdat, and G. Riley Graph annotations in modeling complex network topologies ACM Transactions on Modeling and Computer Simulation (TOMACS) 4 2009 17
10. C. Esposito, D. Cotroneo, and A. Gokhale Reliable publish/subscribe middleware for time-sensitive internet-scale applications Proceedings of the Third ACM International Conference on Distributed Event-Based Systems DEBS'09 2009 ACM New York, NY, USA 16:1 16:12 doi: http://doi.acm.org/10.1145/1619258. 1619280
11. E. Fidler, H.A. Jacobsen, G. Li, S. Mankovski, The padres distributed publish/subscribe system, in: In 8th International Conference on Feature Interactions in Telecommunications and Software Systems, 2005, pp. 12-30.
12. A.E., M. Gradinariu, A.K. Datta, G. Simon, and A. Virgillito A semantic overlay for self-* peer-to-peer publish/subscribe Proceedings of the 26th IEEE International Conference on Distributed Computing Systems ICDCS'06 2006 IEEE Computer Society Washington, DC, USA 22 doi: http://dx.doi.org/10.1109/ ICDCS.2006.12
13. K. Gummadi, R. Gummadi, S. Gribble, S. Ratnasamy, S. Shenker, and I. Stoica The impact of DHT routing geometry on resilience and proximity Proceedings of the 2003 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications SIGCOMM'03 2003 ACM New York, NY, USA 381 394 doi: http://doi.acm.org/10.1145/863955.863998
14. A. Gupta, O.D. Sahin, D. Agrawal, and A.E. Abbadi Meghdoot: content-based publish/subscribe over p2p networks Proceedings of the 5th ACM/IFIP/USENIX International Conference on Middleware Middleware'04 2004 Springer-Verlag New York, Inc. New York, NY, USA 254 273 URL http://dl.acm.org/citation.cfm?id= 1045658.1045677 (Pubitemid 39738583)
15. H. Jafarpour, S. Mehrotra, and N. Venkatasubramanian A fast and robust content-based publish/subscribe architecture Proceedings of the 2008 Seventh IEEE International Symposium on Network Computing and Applications 2008 IEEE Computer Society Washington, DC, USA 52 59 URL http://dl.acm.org/citation.cfm? id=1443222.1443610
16. R.S. Kazemzadeh, and H.-A. Jacobsen Reliable and highly available distributed publish/subscribe service Proceedings of the 2009 28th IEEE International Symposium on Reliable Distributed Systems 2009 IEEE Computer Society Washington, DC, USA 41 50 URL http://dl.acm.org/citation.cfm?id=1637865. 1638331
17. R.S. Kazemzadeh, H.-A. Jacobsen, Partition-tolerant distributed publish/subscribe systems, Reliable Distributed Systems, in: IEEE Symposium on 0, 2011, pp. 101-110. doi: http://doi.ieeecomputersociety.org/10.1109/SRDS.2011. 21.
18. D. Krioukov, F. Papadopoulos, M. Kitsak, A. Vahdat, M. Bogu?, Hyperbolic geometry of complex networks, Phys. Rev. E (036106).
19. D. Loguinov, A. Kumar, V. Rai, and S. Ganesh Graph-theoretic analysis of structured peer-to-peer systems: routing distances and fault resilience Proceedings of the 2003 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications SIGCOMM'03 2003 ACM New York, NY, USA 395 406 doi: http://doi.acm.org/10.1145/863955.863999
20. G. Muhl, M.A. Jaeger, K. Herrmann, T. Weis, A. Ulbrich, and L. Fiege Self-stabilizing publish/subscribe systems: algorithms and evaluation 17th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management DSOM 2006 LNCS vol. 4269 2005 Springer 233 238
21. G. Pardo-Castellote Omg data-distribution service: architectural overview Proceedings of the 23rd International Conference on Distributed Computing Systems ICDCSW'03 2003 IEEE Computer Society Washington, DC, USA 200 URL http://dl.acm.org/citation.cfm?id=839280.840571
22. G.P. Picco, G. Cugola, and A.L. Murphy Efficient content-based event dispatching in the presence of topological reconfiguration Proceedings of the 23rd International Conference on Distributed Computing Systems ICDCS'03 2003 IEEE Computer Society Washington, DC, USA 234 URL http://dl.acm.org/citation. cfm?id=850929.851945
23. P.R. Pietzuch, and J. Bacon Hermes: A distributed event-based middleware architecture Proceedings of the 22nd International Conference on Distributed Computing Systems ICDCSW'02 2002 IEEE Computer Society Washington, DC, USA 611 618 URL http://dl.acm.org/citation.cfm?id=646854.708058
24. P.R. Pietzuch, and J. Bacon Peer-to-peer overlay broker networks in an event-based middleware Proceedings of the 2nd International Workshop on Distributed Event-based Systems DEBS'03 2003 ACM New York, NY, USA 1 8 doi: http://doi.acm.org/10.1145/966618.966628
25. M.R. Selim, Y. Goto, and J. Cheng A replication oriented approach to event based middleware over structured peer to peer networks Proceedings of the 5th International Workshop on Middleware for Pervasive and Ad-hoc Computing: Held at the ACM/IFIP/USENIX 8th International Middleware Conference MPAC'07 2007 ACM New York, NY, USA 61 66 doi: http://doi.acm.org/10.1145/1376866.1376877
26. A.C. Snoeren, K. Conley, and D.K. Gifford Mesh-based content routing using xml SIGOPS Oper. Syst. Rev. 35 2001 160 173 doi: http://doi.acm.org/10. 1145/502059.502050 (Pubitemid 33612612)
27. Source code of the hybrid CBPS architecture. https://github.com/ justicezyx/cbps.
28. N. Spring, L. Peterson, A. Bavier, and V. Pai Using planetlab for network research: myths, realities, and best practices SIGOPS Oper. Syst. Rev. 40 2006 17 24 doi: http://doi.acm.org/10.1145/1113361.1113368 (Pubitemid 44849572)
29. I. Stoica, R. Morris, D. Liben-Nowell, D.R. Karger, M.F. Kaashoek, F. Dabek, and H. Balakrishnan Chord: a scalable peer-to-peer lookup protocol for internet applications IEEE/ACM Trans. Netw. 11 2003 17 32 doi: http://dx.doi.org/10.1109/TNET.2002.808407
30. D.K. Tam, R. Azimi, and H.-A. Jacobsen Building content-based publish/subscribe systems with distributed hash tables K. Aberer, V. Kalogeraki, M. Koubarakis, DBISP2P Lecture Notes in Computer Science vol. 2944 2003 Springer 138 152 URL http://dblp.uni-trier.de/db/conf/dbisp2p/dbisp2p2003. html#TamAJ03
31. Marketcetera, Open source trading platform, 2012. URL http://www.marketcetera.com/.
32. Twisted matrix labs. URL http://twistedmatrix.com/.
33. CAIDA, Internet topology at router- and as-levels, and the dual router +as internet topology generator. URL http://www.caida.org/research/topology/ generator/.
34. Y. Zhao, D. Sturman, and S. Bhola Subscription propagation in highly-available publish/subscribe middleware Proceedings of the 5th ACM/IFIP/USENIX International Conference on Middleware Middleware'04 2004 Springer-Verlag New York, Inc. New York, NY, USA 274 293 URL http://dl.acm.org/citation.cfm?id=1045658.1045678 (Pubitemid 39738584)
35. Y. Zhao, J. Wu, Towards approximate event processing in a large-scale content-based network, in: Distributed Computing Systems (ICDCS), 2011 31st International Conference on, 2011, pp. 790-799. doi: http://dx.doi.org/10.1109/ ICDCS.2011.67.
36. Y. Zhu, and Y. Hu Ferry: a p2p-based architecture for content-based publish/subscribe services IEEE Trans. Parallel Distrib. Syst. 18 2007 672 685 doi: http://dx.doi.org/10.1109/TPDS.2007.1012 (Pubitemid 46681268)