Load balancing content-based publish/subscribe systems

ACM Transactions on Computer Systems

Volumn 28, Issue 4, 2010, Pages

  Cheung, Alex King Yeung ^a   Jacobsen, Hans Arno ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Content based routing; Load balancing; Load estimation; Offload algorithms; PADRES; Publish subscribe; Subscriber migration; ToPSS

Indexed keywords

CONTENT BASED ROUTING; LOAD ESTIMATION; LOAD-BALANCING; OFFLOAD ALGORITHMS; PADRES; PUBLISH/SUBSCRIBE; SUBSCRIBER MIGRATION; TOPSS;

ALGORITHMS; ESTIMATION; QUALITY OF SERVICE; SERVERS; SYSTEM STABILITY;

PARALLEL ARCHITECTURES;

EID: 78650756638     PISSN: 07342071     EISSN: 15577333     Source Type: Journal    
DOI: 10.1145/1880018.1880020     Document Type: Article

References (77)

1. ADLER, M., GE, Z., KUROSE, J. F., TOWSLEY, D., AND ZABELE, S. 2001. Channelization problem in large scale data dissemination. In Proceedings of the International Conference on Network Protocols (ICNP'01). IEEE Computer Society, Los Alamitos, CA, 100-109.
2. AEKATERINIDIS, I. AND TRIANTAFILLOU, P. 2006. PastryStrings: A comprehensive content-based publish/subscribe DHT network. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS'06). IEEE Computer Society, Los Alamitos, CA, 23-42.
3. ALEKSY, M., KORTHAUS, A., AND SCHADER, M. 2001. Design and implementation of a flexible load balancing service for CORBA-based applications. In Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA'01). IEEE Computer Society, Los Alamitos, CA.
4. ALTINEL, M. AND FRANKLIN, M. J. 2000. Efficient filtering of XML documents for selective dissemination of information. In Proceedings of the International Conference on Very Large Data Bases (VLDB'00). Morgan-Kaufmann Publishers Inc., San Francisco, CA, 53-64.
5. BALDONI, R.,MARCHETTI, C., VIRGILLITO, A., AND VITENBERG, R. 2005. Content-based publishsubscribe over structured overlay networks. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS'05). IEEE Computer Society, Los Alamitos, CA, 437-446.
6. BALDONI, R., BERALDI, R., QUEMA, V., QUERZONI, L., AND TUCCI-PIERGIOVANNI, S. 2007. TERA: Topic-based event routing for peer-to-peer architectures. In Proceedings of the Inaugural International Conference on Distributed Event-Based Systems (DEBS'07). ACM, New York, NY, 2-13.
7. BANAVAR, G., CHANDRA, T.,MUKHERJEE, B., NAGARAJARAO, J., STROM, R. E., AND STURMAN, D. C. 1999. An efficient multicast protocol for content-based publish-subscribe systems. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS'99). IEEE Computer Society, Los Alamitos, CA, 262-272.
8. BARTH, T., FLENDER, G., FREISLEBEN, B., AND THILO, F. 1999. Load distribution in a CORBA environment. In Proceedings of the International Symposium on Distributed Objects and Applications (DOA'99). IEEE Computer Society, Los Alamitos, CA, 158-166.
9. BERMAN, F. AND WOLSKI, R. 1996. Scheduling from the perspective of the application. In Proceedings of the IEEE International Symposium on High Performance Distributed Computing (HPDC'96). IEEE Computer Society, Los Alamitos, CA, 100-111.
10. BHARAMBE, A. R., RAO, S., AND SESHAN, S. 2002. Mercury: A scalable publish-subscribe system for internet games. In Proceedings of the Workshop on Network and System Support for Games (NetGames'02). ACM, New York, NY, 3-9.
11. CAO, F. AND SINGH, J. P. 2004. Efficient event routing in content-based publish-subscribe service networks. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM'04). 924-940.
12. CARDELLINI, V., COLAJANNI, M., AND YU, P. S. 1999a. DNS dispatching algorithms with state estimators for scalable web-server clusters. World Wide Web 2, 3, 101-113.
13. CARDELLINI, V., COLAJANNI, M., AND YU, P. S. 1999b. Dynamic load balancing on web-server systems. IEEE Internet Comput. 3, 3, 28-39.
14. CARZANIGA, A., ROSENBLUM, D. S., AND WOLF, A. L. 2001. Design and evaluation of a wide-area event notification service. ACM Trans. Comput. Syst. 19, 3, 332-383.
15. CASALICCHIO, E. AND MORABITO, F. 2007. Distributed subscriptions clustering with limited knowledge sharing for content-based publish/subscribe systems. In Proceedings of the IEEE International Symposium on Network Computing and Applications. 105-112.
16. CASTELLI, S., COSTA, P., AND PICCO, G. P. 2008. HyperCBR: Large-scale content-based routing in a multidimensional space. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM'08). 1714-1722.
17. CASTRO, M., DRUSCHEL, P., KERMARREC, A.-M., AND ROWSTRON, A. 2002. SCRIBE: A large-scale and decentralized application-level multicast infrastructure. IEEE J. Select. Areas Comm. 20, 1489-1499.
18. CHAND, R. AND FELBER, P. 2005. Semantic peer-to-peer overlays for publish/subscribe networks. In Proceedings of Euro-Par Parallel Processing. Vol. 3648. 1194-1204.
19. CHEN, C., JACOBSEN, H.-A., AND VITENBERG, R. 2010. Divide and conquer algorithms for publish/subscribe overlay design. In Proceedings of the International Conference on Distributed Computing Systems (ICDCS'10). IEEE Computer Society, Los Alamitos, CA, 622-633.
20. CHEN, Y. AND SCHWAN, K. 2005. Opportunistic overlays: Efficient content delivery in mobile ad hoc networks. In Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware'05). Springer-Verlag, Berlin, 354-374.
21. CHEUNG, A. K. Y. 2006. Dynamic load balancing in distributed content-based publish/subscribe. M.A.Sc. dissertation. University of Toronto.
22. CHEUNG, A. K. Y. AND JACOBSEN, H.-A. 2006. Dynamic load balancing in distributed contentbased publish/subscribe. In Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware'06). Springer-Verlag, Berlin, 141-161.
23. COOPER, B. F., RAMAKRISHNAN, R., SRIVASTAVA, U., SILBERSTEIN, A., BOHANNON, P., JACOBSEN, H.-A., PUZ, N.,WEAVER, D., AND YERNENI, R. 2008. PNUTS: Yahoo!'s hosted data serving platform. Proc. VLDB Endow. 1, 2, 1277-1288.
24. CUGOLA, G., DI NITTO, E., AND FUGGETTA, A. 2001. The JEDI event-based infrastructure and its application to the development of the OPSS WFMS. IEEE Trans. Softw. Eng. 27, 9, 827-850.
25. DIAS, D. M., KISH, W., MUKHERJEE, R., AND TEWARI, R. 1996. A scalable and highly available web server. In Proceedings of the IEEE International Computer Conference (COMPCON'96). IEEE Computer Society, Los Alamitos, CA, 85-92.
26. FABRET, F., JACOBSEN, H. A., LLIRBAT, F., PEREIRA, J., ROSS, K. A., AND SHASHA, D. 2001. Filtering algorithms and implementation for very fast publish/subscribe systems. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD'01). ACM, New York, 115-126.
27. FAWCETT, T. AND PROVOST, F. 1999. Activity monitoring: Noticing interesting changes in behavior. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'99). ACM, New York, 53-62.
28. FIDLER, E., JACOBSEN, H. A., LI, G., AND MANKOVSKI, S. 2005. The PADRES distributed publish/subscribe system. In Proceedings of the International Conference on Feature Interactions in Telecommunications and Software Systems. 12-30.
29. GS1. 2008. http://www.gs1.org/docs/gdsn/gdsn brochure.pdf.
30. GUPTA, A., SAHIN, O. D., AGRAWAL, D., AND ABBADI, A. E. 2004. Meghdoot: Content-based publish/subscribe over P2P networks. In Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware'04). Springer-Verlag, Berlin, 254-273.
31. HO, K. S. AND LEONG, H. V. 2000. An extended CORBA event service with support for load balancing and fault-tolerance. In Proceedings of the International Symposium on Distributed Objects and Applications (DOA'00). IEEE Computer Society, Los Alamitos, CA, 49-58.
32. HOU, S. AND JACOBSEN, H.-A. 2006. Predicate-based filtering of XPath expressions. In Proceedings of the International Conference on Data Engineering (ICDE'06). IEEE Computer Society, Los Alamitos, CA, 53-59.
33. HU, S.,MUTHUSAMY, V., LI, G., AND JACOBSEN, H.-A. 2008. Distributed automatic service composition in large-scale systems. In Proceedings of the International Conference on Distributed Event-based Systems (DEBS'08). ACM, New York, 233-244.
34. IBM. 2008. Service Oriented Architecture (SOA). http://www-306.ibm.com/ software/solutions/soa/.
35. IBM, BEA SYSTEMS, MICROSOFT, SAP AL, AND SIEBEL SYSTEMS. 2007. Business process execution language for web services version 1.1. http://www.ibm.com/ developerworks/library/specification/ws-bpel/.
36. JUL, E., LEVY, H., HUTCHINSON, N., AND BLACK, A. 1988. Fine-grained mobility in the emerald system. ACM Trans. Comput. Syst. 6, 1, 109-133.
37. LI, G. AND JACOBSEN, H.-A. 2005. Composite subscriptions in content-based publish/subscribe systems. In Proceedings of the ACM/IFIP/USENIX 2005 International Conference on Middleware (Middleware'05). Springer-Verlag, Berlin, 249-269.
38. LI, G., CHEUNG, A., HOU, S., HU, S., MUTHUSAMY, V., SHERAFAT, R., WUN, A., JACOBSEN, H.-A., AND MANOVSKI, S. 2007. Historic data access in publish/subscribe. In Proceedings of the Inaugural International Conference on Distributed Event-Based Systems (DEBS'07). ACM, New York, 80-84.
39. LI, G., HOU, S., AND JACOBSEN, H.-A. 2008a. Routing of XML and XPath queries in data dissemination networks. In Proceedings of the International Conference on Distributed Computing Systems (ICDCS'08). IEEE Computer Society, Los Alamitos, CA, 627-638.
40. LI, G., MUTHUSAMY, V., AND JACOBSEN, H.-A. 2008b. Adaptive content-based routing in general overlay topologies. In Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware'08). Springer-Verlag, Berlin, 1-21.
41. LI, G.,MUTHUSAMY, V., AND JACOBSEN, H.-A. 2010. A distributed service-oriented architecture for business process execution. ACM Trans. Web 4, 1, 1-33.
42. LINDERMEIER, M. 2000. Load management for distributed object-oriented environments. In Proceedings of the International Symposium on Distributed Objects and Applications (DOA'00). IEEE Computer Society, Los Alamitos, CA, 59-68.
43. LITZKOW, M. J. 1987. Remote Unix: Turning idle workstations into cycle servers. In Summer USENIX Conference Proceedings.
44. MICROSOFT. 2008. Service Oriented Architecture. http://msdn.microsoft. com/en-us/architecture/aa948857.aspx.
45. MSRG. 2008. Padres project. http://msrg.org/projects/padres/.
46. MÜHL, G. 2001. Generic constraints for content-based publish/subscribe. In Proceedings of the International Conference on Cooperative Information Systems (CooplS'01). Springer-Verlag, Berlin, 211-225.
47. MUKHERJEE, B., HEBERLEIN, L. T., AND LEVITT, K. N. 1994. Network intrusion detection. IEEE Netw. 8, 3, 26-41.
48. MUTHUSAMY, V., PETROVIC, M., AND JACOBSEN, H.-A. 2005. Effects of routing computations in content-based routing networks with mobile data sources. In Proceedings of the Annual International Conference on Mobile Computing and Networking (MobiCom'05). ACM, New York, 103-116.
49. MUTHUSAMY, V., JACOBSEN, H.-A., COULTHARD, P., CHAN, A., WATERHOUSE, J., AND LITANI, E. 2007. SLA-driven business process management in SOA. In Proceedings of the 2007 Conference of the Center for Advanced Studies on Collaborative Research (CASCON'07). ACM, New York, 264-267.
50. OKI, B., PFLUEGL, M., SIEGEL, A., AND SKEEN, D. 1993. The information bus: An architecture for extensible distributed systems. In Proceedings of the ACM Symposium on Operating Systems Principles (SOSP'93). ACM, New York, 58-68.
51. OPYRCHAL, L., ASTLEY, M., AUERBACH, J., BANAVAR, G., STROM, R., AND STURMAN, D. 2000. Exploiting IP multicast in content-based publish-subscribe systems. In Proceedings of the ACM/IFIP International Conference on Distributed Systems Platforms (Middleware'00). Springer-Verlag, Berlin, 185-207.
52. OTHMAN, O., BALASUBRAMANIAN, J., AND SCHMIDT, D. C. 2003. The design of an adaptive middleware load balancing and monitoring service. In Proceedings of the International Workshop on Self-Adaptive Software (IWSAS'03). ACM, New York, 205-213.
53. PALLICKARA, S. AND FOX, G. 2003. Naradabrokering: A distributed middleware framework and architecture for enabling durable peer-to-peer grids. In Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware'03). Springer-Verlag, Berlin, 41-61.
54. PATEL, J. A., RIVIÈRE, E., GUPTA, I., AND KERMARREC, A.-M. 2009. Rappel: Exploiting interest and network locality to improve fairness in publish-subscribe systems. Comput. Netw. 53, 13, 2304-2320.
55. PEREIRA, J., FABRET, F., JACOBSEN, H.-A., LLIRBAT, F., AND SHASHA, D. 2001. WebFilter: A high-throughput XML-based publish and subscribe system. In Proceedings of the International Conference on Very Large Data Bases (VLDB'01). Morgan Kaufmann, San Francisco, CA, 723-724.
56. PETROVIC, M., LIU, H., AND JACOBSEN, H.-A. 2005. G-ToPSS: Fast filtering of graph-based metadata. In Proceedings of the International Conference on World Wide Web (WWW'05). ACM, New York, 539-547.
57. PIETZUCH, P. R. AND BACON, J. 2002. Hermes: A distributed event-based middleware architecture. In Proceedings of the International Conference on Distributed Computing Systems (ICDCSW'02). IEEE Computer Society, Los Alamitos, CA, 611-618.
58. REUMANN, J. 2009. Pub/sub at Google. CANOE and EuroSys Summer School.
59. RIABOV, A., LIU, Z., WOLF, J. L., YU, P. S., AND ZHANG, L. 2002. Clustering algorithms for content-based publication-subscription systems. In Proceedings of the International Conference on Distributed Computing Systems (ICDCS'02). IEEE Computer Society, Los Alamitos, CA, 133-142.
60. RIABOV, A., LIU, Z., WOLF, J. L., YU, P. S., AND ZHANG, L. 2003. New algorithms for contentbased publication-subscription systems. In Proceedings of the International Conference on Distributed Computing Systems (ICDCS'03). IEEE Computer Society, Los Alamitos, CA, 678-686.
61. ROSE, I., MURTY, R., PIETZUCH, P., LEDLIE, J., ROUSSOPOULOS, M., AND WELSH, M. 2007. Cobra: Content-based filtering and aggregation of blogs and RSS feeds. In Proceedings of the USENIX Symposium on Networked Systems Design & Implementation (NSDI'07).
62. SACHS, K., KOUNEV, S., BACON, J., AND BUCHMANN, A. 2009. Performance evaluation of message-oriented middleware using the SPECjms2007 benchmark. Perform. Eval. 66, 8, 410-434.
63. SCHULER, C., SCHULDT, H., AND SCHEK, H.-J. 2001. Supporting reliable transactional business processes by publish/subscribe techniques. In Proceedings of the 2nd International Workshop on Technologies for E-Services (TES'01). Springer-Verlag, Berlin, 118-131.
64. SEGALL, B. AND ARNOLD, D. 1997. Elvin has left the building: A publish/subscribe notification service with quenching. In Proceedings of the Australian UNIX and Open Systems User Group Conference (AUUG'97).
65. SHIRRIFF, K. 1997. Building distributed process management on an object-oriented framework. In Proceedings of the Annual Conference on USENIX Annual Technical Conference (ATEC'97). USENIX Association, Berkeley, CA, 9-22.
66. TAM, D., AZIMI, R., AND JACOBSEN, H.-A. 2003. Building content-based publish/subscribe systems with distributed hash tables. In Proceedings of the International Workshop on Databases, Information Systems and Peer-to-Peer Computing. 138-152.
67. TATBUL, N., ÇETINTEMEL, U., AND ZDONIK, S. 2007. Staying FIT: Efficient load shedding techniques for distributed stream processing. In Proceedings of the International Conference on Very Large Data Bases (VLDB'07). VLDB Endowment, 159-170.
68. TERPSTRA, W. W., BEHNEL, S., FIEGE, L., ZEIDLER, A., AND BUCHMANN, A. P. 2003. A peer-topeer approach to content-based publish/subscribe. In Proceedings of the International Workshop on Distributed Event-Based Systems (DEBS'03). ACM, New York, 1-8.
69. TIBCO. 2001. TIBCO software chosen as infrastructure for NASDAQ's supermontage. www.tibco.com.
70. TRIANTAFILLOU, P. AND AEKATERINIDIS, I. 2004. Content-based publish/subscribe systems over structured P2P networks. In Proceedings of the International Workshop on Distributed Event Based Systems (DEBS'04).
71. VITRIA. 2008. http://www.vitria.com/.
72. VOULGARIS, S., RIVIRE, E., KERMARREC, A.-M., AND STEEN, M. V. 2006. Sub-2-Sub: Selforganizing content-based publish subscribe for dynamic large scale collaborative networks. In Proceedings of the International Workshop on Peer-to-Peer Systems (IPTPS06).
73. WONG, T., KATZ, R. H., AND MCCANNE, S. 2000. An evaluation of preference clustering in largescale multicast applications. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM'00). 451-460.
74. YAN, W., HU, S., MUTHUSAMY, V., JACOBSEN, H.-A., AND ZHA, L. 2009. Efficient event-based resource discovery. In Proceedings of the ACM International Conference on Distributed Event- Based Systems (DEBS'09). ACM, New York, 1-12.
75. ZAJCEW, R., ROY, P., BLACK, D., PEAK, C., GUEDES, P., KEMP, B., LOVERSO, J., LEIBENSPERGER, M., BARNETT, M., RABII, F., AND NETTERWALA, D. 1993. An OSF/1 UNIX for massively parallel multicomputers. In Proceedings of the Winter USENIX Conference. 37-55.
76. ZHANG, C., KRISHNAMURTHY, A.,WANG, R. Y., AND SINGH, J. P. 2005. Combining flexibility and scalability in a peer-to-peer publish/subscribe system. In Proceedings of the ACM/IFIP/USENIX 2005 International Conference on Middleware (Middleware'05). Springer-Verlag, Berlin, 102-123.
77. ZHU, Y. AND HU, Y. 2007. Ferry: A P2P-based architecture for content-based publish/subscribe services. IEEE Trans. Parall. Distrib. Syst. 18, 5, 672-685. (Pubitemid 46681268)