[CARTE][B] Parallel programming

T Rauber, G Rünger - 2013 - Springer
Innovations in hardware architecture, such as hyper-threading or multicore processors,
make parallel computing resources available for computer systems in different areas …

A configurable method for benchmarking scalability of cloud-native applications

S Henning, W Hasselbring - Empirical Software Engineering, 2022 - Springer
Cloud-native applications constitute a recent trend for designing large-scale software
systems. However, even though several cloud-native tools and patterns have emerged to …

Due: End-to-end document understanding benchmark

Ł Borchmann, M Pietruszka, T Stanislawek… - Thirty-fifth Conference …, 2021 - openreview.net
Understanding documents with rich layouts plays a vital role in digitization and hyper-
automation but remains a challenging topic in the NLP research community. Additionally, the …

Analysing the impact of workloads on modeling the performance of configurable software systems

S Mühlbauer, F Sattler, C Kaltenecker… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Modern software systems often exhibit numerous configuration options to tailor them to user
requirements, including the system's performance behavior. Performance models derived …

RIbench: a proposed benchmark for the standardized evaluation of indirect methods for reference interval estimation

T Ammer, A Schützenmeister, HU Prokosch… - Clinical …, 2022 - academic.oup.com
Background Indirect methods leverage real-world data for the estimation of reference
intervals. These constitute an active field of research, and several methods have been …

[HTML][HTML] Evaluatology: The science and engineering of evaluation

J Zhan, L Wang, W Gao, H Li, C Wang, Y Huang… - BenchCouncil …, 2024 - Elsevier
Abstract Evaluation is a crucial aspect of human existence and plays a vital role in each
field. However, it is often approached in an empirical and ad-hoc manner, lacking …

[HTML][HTML] Benchmarking scalability of stream processing frameworks deployed as microservices in the cloud

S Henning, W Hasselbring - Journal of Systems and Software, 2024 - Elsevier
Context: The combination of distributed stream processing with microservice architectures is
an emerging pattern for building data-intensive software systems. In such systems, stream …

A systematic approach for benchmarking of container orchestration frameworks

M Straesser, J Mathiasch, A Bauer… - Proceedings of the 2023 …, 2023 - dl.acm.org
Container orchestration frameworks play a critical role in modern cloud computing
paradigms such as cloud-native or serverless computing. They significantly impact the …

Benchmarking as empirical standard in software engineering research

W Hasselbring - Proceedings of the 25th International Conference on …, 2021 - dl.acm.org
In empirical software engineering, benchmarks can be used for comparing different
methods, techniques and tools. However, the recent ACM SIGSOFT Empirical Standards for …

An empirical study of container image configurations and their impact on start times

M Straesser, A Bauer, R Leppich… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
A core selling point of application containers is their fast start times compared to other
virtualization approaches like virtual machines. Predictable and fast container start times are …