Intern
Lehrstuhl für Informatik III

DiRC (funded by Siemens AG)

Performance Evaluation of Architectures for Distributed Real-Time Communication (DiRC)


DiRC Project Team

Heads

Prof. Dr.-Ing. Phuoc Tran-Gia,

Dr. Michael Menth

Researchers Robert Henjes,
Partners

Dieter Hemkemeyer (Siemens AG),

Rainer Zimmermann (Siemens EN GmBH),

Mark Wuwer (Siemens EN GmBH)

Funded period October 2004 - September 2009

Summary

In this project, we focus architectures for distributed real-time communication. In particular, we study eventing systems that are implemented, e.g., according to the publish/subscribe paradigm. They may be used as a middleware in distributed applications.

The Publish/Subscribe Communication Pattern

In publish/subscribe communications, both information providers -- so-called publishers -- and information consumers -- so-called subscribers -- register at a central server. The publishers send messages to the server that forwards them to all subscribers. Optionally, subscribers can install filters on the server that select only a certain subset of messages for them. Currently we study the following problems. 

  • There are no or only insufficient performance evaluation studies about the capacity of JMS servers. We tested several types from different vendors and assessed their capacity in different application scenarios, in particular with and without filters. Our measurement results showed that the capacity of the servers ranges over several orders of magnitude depending on the server type and the application scenario.
  • Eventing systems in large distributed applications must handle an enormous message rate. The applications often have real-time or quasi-real-time requirements, i.e., the delay observed by the messages at the JMS server must be small. As mentioned above, the service time for messages ranges over several orders of magnitude. We considered different application scenarios to assess a reasonable upper bound on the variation of the service time and derived the waiting time distribution for the messages. The results showed that the waiting time is short even at a high server load of 90% if the server capacity is sufficiently large.
  • The capacity of a single server may not suffice to forward the traffic of a large-scale application. Therefore, we look at the performance of server clusters.
  • In case of a failure the subscriptions and their information has to be moved to a backup server. The JMS API itself does not provide any methods by default. So each software implementor has to follow an efficient strategy. In case of ActiveMQ we investigate the Master/Slave and a so-called Network of Brokers mode.

 

The Request/Reply Communication Pattern

 

However the publish/subscribe communcation pattern provides an efficient one-way and decoupled message transmission in certain cases an immediate response on a send request might be necessary in software archictecture. This client/server based communication is supported by several protocols available in the Internet. We focus on such, that support an seamless exchangable integration and supporting decoupling as provided by the publish/subscribe principle. Esp. in the field of service oriented architectures already exist implementations of application layer protocols, e.g. SOAP. As a key element of these protocols one may focus their interface frameworks, which might introduce additional overhead. As an ongoing research we evaluate and compare the performance of different implementations of these message oriented middleware frameworks.

  • One aspect of resarch is the maximum achievable throughput depending on the introduced overhead per message transmission.
  • Another performance impact might be introduced by long lasting connections.
  • The characterization and a comparable model of the introduced overhead for the different alternatives will support the design of future application.

 

Links and Literature

 

General information on publish/subscribe and JMS

 

Software products appropriate for request/reply communication


Publications

  • Throughput Performance of the BEA WebLogic JMS Server. Henjes, Robert; Menth, Michael; Himmler, Valentin. In International Transactions on Systems Science and Applications, Volume 3, Number 3. 2007.
  • Impact of Complex Filters on the Message Throughput of the ActiveMQ JMS Server. Henjes, Robert; Menth, Michael; Himmler, Valentin. In International Teletraffic Congress (ITC). Ottawa, Canada, 2007.
  • Throughput Performance of the ActiveMQ JMS Server. Menth, Michael. ITG/GI Conference on Communication in Distributed Systems (KiVS), Bern, Switzerland, 2007, March 1.
  • Throughput Performance of the ActiveMQ JMS Server. Henjes, Robert; Menth, Michael; Himmler, Valentin. In ITG/GI Symposium Communication in Distributed Systems (KiVS). Bern, Switzerland, 2007.
  • Analysis of the Message Waiting Time for the FioranoMQ JMS Server. Henjes, Robert. ICDCS 2006, Lisbon, Portugal, 2006, July 5.
  • Throughput Performance of Java Messaging Services Using WebsphereMQ. Henjes, Robert. DEBS Workshop, Lisbon, Portugal, 2006, July.
  • Analysis of the Message Waiting Time for the FioranoMQ JMS Server. Menth, Michael; Henjes, Robert. In 26th International Conference on Distributed Computing Systems (ICDCS). Lisboa, Portugal, 2006.
  • Throughput Performance of Java Messaging Services Using WebsphereMQ. Henjes, Robert; Menth, Michael; Zepfel, Christian. In 5th International Workshop on Distributed Event-Based Systems (DEBS). Lisboa, Portugal, 2006.
  • Throughput Performance of Popular JMS Servers. Menth, Michael; Henjes, Robert; Gehrsitz, Sebastian; Zepfel, Christian. In ACM SIGMETRICS Performance Evaluation Review (PER), 34(1). 2006.
  • Throughput Performance of Popular JMS Servers. Menth, Michael; Henjes, Robert; Gehrsitz, Sebastian; Zepfel, Christian. In Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS/Performance). Saint-Malo, France, 2006.
  • Throughput Performance of Java Messaging Services Using Sun Java System Message Queue. Henjes, Robert. HPC&S, Bonn, Germany, 2006, May 29.
  • Throughput Performance of Java Messaging Services Using Sun Java System Message Queue. Henjes, Robert; Menth, Michael; Zepfel, Christian. In Proceedings 20th European Conference on Modelling and Simulation, pp. 684–691. Bonn, Germany, 2006.
  • Throughput Performance of Java Messaging Services Using FioranoMQ. Henjes, Robert. MMB 2006, Nürnberg, Germany, 2006, March 28.
  • Throughput Performance of Java Messaging Services Using FioranoMQ. Henjes, Robert; Menth, Michael; Gehrsitz, Sebastian. In 13th GI/ITG Conference on Measuring, Modelling and Evaluation of Computer and Communication Systems (MMB). Nürnberg, Germany, 2006.