Big data stream processing

OC Marcu, P Bouvry - 2024 - hal.science
This chapter provides students, industry experts, and researchers a high-level and
comprehensive overview of the end-to-end architectures of big data stream processing …

A systematic map** of performance in distributed stream processing systems

A Vogel, S Henning, O Ertl… - 2023 49th Euromicro …, 2023 - ieeexplore.ieee.org
Several software systems are built upon stream processing architectures to process large
amounts of data in near real-time. Today's distributed stream processing systems (DSPSs) …

To migrate or not to migrate: An analysis of operator migration in distributed stream processing

E Volnes, T Plagemann… - … Communications Surveys & …, 2023 - ieeexplore.ieee.org
One of the most important issues in distributed data stream processing systems is using
operator migration to handle highly variable workloads cost-efficiently and adapt to the …

[HTML][HTML] The Strategic Corporal, the Tactical General, and the Digital Coup d'oeil–Military Decision-Making and Organizational Competences in Future Military …

AT Bollmann, T Heltberg - Scandinavian Journal of Military Studies, 2023 - sjms.nu
The article describes how digitalization and the wide diffusion of knowledge technologies
such as the Internet of (battlefield) things, big data, and artificial intelligence, are …

Daedalus: Self-Adaptive Horizontal Autoscaling for Resource Efficiency of Distributed Stream Processing Systems

BJJ Pfister, D Scheinert, MK Geldenhuys… - Proceedings of the 15th …, 2024 - dl.acm.org
To maintain a stable Quality of Service (QoS), these systems require a sufficient allocation of
resources. At the same time, over-provisioning can result in wasted energy and high …

High-level Stream Processing: A Complementary Analysis of Fault Recovery

A Vogel, S Henning, E Perez-Wohlfeil, O Ertl… - arxiv preprint arxiv …, 2024 - arxiv.org
Parallel computing is very important to accelerate the performance of software systems.
Additionally, considering that a recurring challenge is to process high data volumes …

Performability requirements in making a rescaling decision for streaming applications

P Omoregbee, M Forshaw - European Workshop on Performance …, 2022 - Springer
Maximising the benefits of auto-scaling is difficult due to challenges associated with
precisely estimating resource usage in the face of significant variability in client workload …

Micro-batch and data frequency for stream processing on multi-cores

AM Garcia, D Griebler, C Schepke… - The Journal of …, 2023 - Springer
Latency or throughput is often critical performance metrics in stream processing.
Applications' performance can fluctuate depending on the input stream. This unpredictability …

On improving streaming system autoscaler behaviour using windowing and weighting methods

S Jamieson, M Forshaw - Proceedings of the 17th ACM International …, 2023 - dl.acm.org
Distributed stream processing systems experience highly variable workloads. This presents
a challenge when provisioning compute to meet the needs of these workloads. Rightsizing …

[PDF][PDF] Analyzing performance effects of window size on streaming operator throughput

P Omoregbee, N Thomas… - 39 th Annual UK …, 2023 - researchgate.net
Within window-based streaming applications, a longer window size results in the
accumulation of a greater number of states, and this has been observed to affect the …