A model for continuous query latencies in data streams
- 19 September 2011
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
In this paper we propose a formal model for characterizing latencies affecting the computation of a continuous query either in a Data Stream Management System (DSMS) or in a Complex Event Processing (CEP) system. In the model, a query can be thought of as constructed out of basic Event Processing Units (EPUs) interconnected among themselves. EPUs are modeled considering just few parameters, used to define the EPU processing logic. In order to model the continuous query we use an acyclic directed (data-flow) graph whose nodes are the EPUs and edges represent the flow of information (events) processed by the EPUs themselves. The outcome of this model is to associate with each dataflow graph a set of latency metrics, namely reactivity, activity, and output latencies, and a complexity measure - that we call data-flow graph complexity - representing the input dimension required to produce an output event. The proposed model can be used to compare and contrast different data-flow graphs in order to assess their latency metrics. This is a crucial step in selecting one of such graphs that meets at best the latency requirements imposed by the programmer before its actual submission to a DSMS or to a CEP system. Furthermore, the model can be considered an effective mean through which formally comparing dataflow graphs and predicting their behavior before an actual experimental validation phase.Keywords
This publication has 6 references indexed in Scilit:
- Accurate latency estimation in a distributed event processing systemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- SPADEPublished by Association for Computing Machinery (ACM) ,2008
- Dynamic Load Distribution in the Borealis Stream ProcessorPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Queueing analysis of relational operators for continuous data streamsPublished by Association for Computing Machinery (ACM) ,2003
- Aurora: a new model and architecture for data stream managementThe VLDB Journal, 2003
- Rate-based query optimization for streaming information sourcesPublished by Association for Computing Machinery (ACM) ,2002