Towards a Standard Event Processing Benchmark

Authors

Abstract

There has been an increasing interest both in academia and industry for systematic methods for evaluating the performance and scalability of event processing systems. A number of performance results have been disclosed over the last years, but there is still a lack of standardized benchmarks that allow an objective comparison of the different systems. In this paper, we present our work in progress: the BiCEP benchmark suite, a set of workloads, datasets and tools for evaluating different performance aspects of event processing platforms. In particular, we introduce Pairs, the first of the BiCEP benchmarks, aimed at assessing the ability of CEP engines in processing progressively larger volumes of events and simultaneous queries while providing quick answers.

Keywords

Benchmark, CEP, Event Processing, Performance, Scalability

Subject

Performance of Event Processing Systems

Related Project

BiCEP - Benchmarking Complex Event Processing systems

Conference

4th ACM/SPEC International Conference on Performance Engineering, April 2013

DOI