Workflows community summit 2022: A roadmap revolution

RF da Silva, RM Badia, V Bala, D Bard… - arxiv preprint arxiv …, 2023 - arxiv.org
Scientific workflows have become integral tools in broad scientific computing use cases.
Science discovery is increasingly dependent on workflows to orchestrate large and complex …

Scheduling of Big Data Workflows in the Hadoop Framework with Heterogeneous Computing Cluster

AM Rahmani, EY Chamzini, M pourshaban… - Arabian Journal for …, 2024 - Springer
Recently, resource allocation in cloud computing has become a popular research topic. Hi-
WAY is a scientific workflow management system that facilitates workflows involving large …

Dynamic Resource Management for Elastic Scientific Workflows using PMIx

R Bhattarai, H Pritchard… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
In current scientific workflows, the computational needs of tasks might not be known when it
is submitted to a system for execution. Current resource management (RM) systems and …

Workflows Community Summit 2022: A Roadmap Revolution

R Ferreira Da Silva, R Badia, V Bala, D Bard… - 2023 - osti.gov
Scientific workflows have become integral tools in broad scientific computing use cases.
Science discovery is increasingly dependent on workflows to orchestrate large and complex …

The Common Workflow Scheduler Interface: Status Quo and Future Plans

F Lehmann, J Bader, L Thamsen, U Leser - arxiv preprint arxiv …, 2023 - arxiv.org
Nowadays, many scientific workflows from different domains, such as Remote Sensing,
Astronomy, and Bioinformatics, are executed on large computing infrastructures managed …

**gle: IoT-Informed Autoscaling for Efficient Resource Management in Edge Computing

Y Wang, A Chandra, J Weissman - 2024 IEEE 24th …, 2024 - ieeexplore.ieee.org
Edge computing is increasingly applied to various systems for its proximity to end-users and
data sources. To facilitate the deployment of diverse edge-native applications, container …

Ponder: Online Prediction of Task Memory Requirements for Scientific Workflows

F Lehmann, J Bader, N De Mecquenem… - 2024 IEEE 20th …, 2024 - ieeexplore.ieee.org
Scientific workflows are used to analyze large amounts of data. These workflows comprise
numerous tasks, many of which are executed repeatedly, running the same custom program …

Novel Approaches Toward Scalable Composable Workflows in Hyper-Heterogeneous Computing Environments

J Bader, J Belak, M Bement, M Berry… - Proceedings of the SC' …, 2023 - dl.acm.org
The annual Workshop on Workflows in Support of Large-Scale Science (WORKS) is a
premier venue for the scientific workflow community to present the latest advances in …

Predicting Dynamic Memory Requirements for Scientific Workflow Tasks

J Bader, N Diedrich, L Thamsen… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
With the increasing amount of data available to scientists in disciplines as diverse as
bioinformatics, physics, and remote sensing, scientific workflow systems are becoming …

Accelerating the Operation of Complex Workflows through Standard Data Interfaces

T Paul, W Regli - arxiv preprint arxiv:2412.13339, 2024 - arxiv.org
In this position paper we argue for standardizing how we share and process data in scientific
workflows at the network-level to maximize step re-use and workflow portability across …