A stream-based architecture for the management and on-line analysis of unbounded amounts of simulation data

Schützel, Johannes and Meyer, Holger and Uhrmacher, Adelinde (2014) A stream-based architecture for the management and on-line analysis of unbounded amounts of simulation data. In: Proceedings of the 2Nd ACM SIGSIM/PADS Conference on Principles of Advanced Discrete Simulation.

Full text not available from this repository.

Abstract

Conducting simulation studies can mean to execute a multitude of parameter configurations, for each of these we may need to execute a vast number of replications, and each single replication may mean the need to process a significant amount of data. Here, we propose a stream-based architecture that aligns data processing and buffering with the actual data usage during simulation to make the most of available memory. This turns away from the first-write-then-read approach, often utilizing databases or plain files as temporary storage. Instead, data are processed on the fly. By introducing a processing graph, which distinguishes between buffering and processing nodes, a flexible analysis of simulation data is achieved. As the data are processed close to their generation, the developed architecture fits well to a distributed execution of simulation studies. We illustrate how the stream-based architecture integrates into simulation workflows.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Subjects: Autorenart > DBIS-Publikationen
Depositing User: Dbis Admin
Date Deposited: 24 Mar 2016 09:54
Last Modified: 24 Mar 2016 09:54
URI: https://eprints.dbis.informatik.uni-rostock.de/id/eprint/370

Actions (login required)

View Item View Item