Skip to content. | Skip to navigation

Personal tools

Johannes Schützel, Holger Meyer, and Adelinde M Uhrmacher (2014)

A Stream-based Architecture for the Management and On-line Analysis of Unbounded Amounts of Simulation Data

In: Proceedings of the 2nd ACM SIGSIM/PADS Conference on Principles of Advanced Discrete Simulation, pp. 83–94, New York, NY, USA, ACM. SIGSIM-PADS '14 (ISBN: 978-1-4503-2794-7).

Conducting simulation studies can mean to execute a multitude of parameter configurations, for each of these we may need to execute a vast number of replications, and each single replication may mean the need to process a significant amount of data. Here, we propose a stream-based architecture that aligns data processing and buffering with the actual data usage during simulation to make the most of available memory. This turns away from the first-write-then-read approach, often utilizing databases or plain files as temporary storage. Instead, data are processed on the fly. By introducing a processing graph, which distinguishes between buffering and processing nodes, a flexible analysis of simulation data is achieved. As the data are processed close to their generation, the developed architecture fits well to a distributed execution of simulation studies. We illustrate how the stream-based architecture integrates into simulation workflows.

Document Actions