Dynamic steering of HPC scientific workflows: A survey

M Mattoso, J Dias, KACS Ocana, E Ogasawara… - Future Generation …, 2015 - Elsevier
The field of scientific workflow management systems has grown significantly as applications
start using them successfully. In 2007, several active researchers in scientific workflow …

Exploring the role of machine learning in scientific workflows: Opportunities and challenges

A Nouri, PE Davis, P Subedi, M Parashar - arxiv preprint arxiv …, 2021 - arxiv.org
In this survey, we discuss the challenges of executing scientific workflows as well as existing
Machine Learning (ML) techniques to alleviate those challenges. We provide the context …

Capturing and querying workflow runtime provenance with PROV: a practical approach

F Costa, V Silva, D De Oliveira, K Ocaña… - Proceedings of the …, 2013 - dl.acm.org
Scientific workflows are commonly used to model and execute large-scale scientific
experiments. They represent key resources for scientists and are enacted and managed by …

Executing cyclic scientific workflows in the cloud

M Krämer, HM Würz, C Altenhofen - Journal of Cloud Computing, 2021 - Springer
We present an algorithm and a software architecture for a cloud-based system that executes
cyclic scientific workflows whose structure may change during run time. Existing approaches …

Raw data queries during data-intensive parallel workflow execution

V Silva, J Leite, JJ Camata, D De Oliveira… - Future Generation …, 2017 - Elsevier
Computer simulations consume and produce huge amounts of raw data files presented in
different formats, eg, HDF5 in computational fluid dynamics simulations. Users often need to …

User-steering of HPC workflows: state-of-the-art and future directions

M Mattoso, K Ocana, F Horta, J Dias… - Proceedings of the 2nd …, 2013 - dl.acm.org
In 2006 a group of leading researchers was gathered to discuss several challenges to
scientific workflow supporting technologies and many of which still remain open challenges …

Methods and apparatus for analytical processing of provenance data for HPC workflow optimization

AEM Ciarlini, JF Dias, PER Salas - US Patent 10,013,656, 2018 - Google Patents
Methods and apparatus are provided for analytical process ing of provenance data for High
Performance Computing workflow optimization. Prediction models for a workflow composed …

Data-centric iteration in dynamic workflows

J Dias, G Guerra, F Rochinha, ALGA Coutinho… - Future Generation …, 2015 - Elsevier
Dynamic workflows are scientific workflows to support computational science simulations,
typically using dynamic processes based on runtime scientific data analyses. They require …

WorkWays: interacting with scientific workflows

HA Nguyen, D Abramson, T Kipouros… - Concurrency and …, 2015 - Wiley Online Library
WorkWays is a science gateway that supports human‐in‐the‐loop scientific workflows.
Human–workflow interactions are enabled by a dynamic Input Output (IO) model, which …

Data reduction in scientific workflows using provenance monitoring and user steering

R Souza, V Silva, ALGA Coutinho, P Valduriez… - Future Generation …, 2020 - Elsevier
Scientific workflows need to be iteratively, and often interactively, executed for large input
datasets. Reducing data from input datasets is a powerful way to reduce overall execution …