Multiple workflows scheduling in multi-tenant distributed systems: A taxonomy and future directions

MH Hilman, MA Rodriguez, R Buyya - ACM Computing Surveys (CSUR), 2020 - dl.acm.org
Workflows are an application model that enables the automated execution of multiple
interdependent and interconnected tasks. They are widely used by the scientific community …

Exploring the role of machine learning in scientific workflows: Opportunities and challenges

A Nouri, PE Davis, P Subedi, M Parashar - arxiv preprint arxiv …, 2021 - arxiv.org
In this survey, we discuss the challenges of executing scientific workflows as well as existing
Machine Learning (ML) techniques to alleviate those challenges. We provide the context …

The role of machine learning in scientific workflows

E Deelman, A Mandal, M Jiang… - … Journal of High …, 2019 - journals.sagepub.com
Machine learning (ML) is being applied in a number of everyday contexts from image
recognition, to natural language processing, to autonomous vehicles, to product …

Detecting performance anomalies in scientific workflows using hierarchical temporal memory

MA Rodriguez, R Kotagiri, R Buyya - Future Generation Computer Systems, 2018 - Elsevier
Technological advances and the emergence of the Internet of Things have lead to the
collection of vast amounts of scientific data from increasingly powerful scientific instruments …

Mining workflows for anomalous data transfers

H Tu, G Papadimitriou, M Kiran, C Wang… - 2021 IEEE/ACM 18th …, 2021 - ieeexplore.ieee.org
Modern scientific workflows are data-driven and are often executed on distributed,
heterogeneous, high-performance computing infrastructures. Anomalies and failures in the …

Graph neural networks for detecting anomalies in scientific workflows

H **, K Raghavan, G Papadimitriou… - … Journal of High …, 2023 - journals.sagepub.com
Identifying and addressing anomalies in complex, distributed systems can be challenging for
reliable execution of scientific workflows. We model these workflows as directed acyclic …

A system architecture for real-time anomaly detection in large-scale nfv systems

A Gulenko, M Wallschläger, F Schmidt, O Kao… - Procedia Computer …, 2016 - Elsevier
Virtualization as a key IT technology has developed to a predominant model in data centers
in recent years. The flexibility regarding scaling-out and migration of virtual machines for …

Ramp: Real-time anomaly detection in scientific workflows

JD Herath, C Bai, G Yan, P Yang… - 2019 IEEE International …, 2019 - ieeexplore.ieee.org
Research integrity is crucial to ensuring the trustworthiness of scientific discoveries. This
work is aimed at detecting misbehaviors targeting scientific workflows, which are computing …

Detecting anomalous packets in network transfers: investigations using PCA, autoencoder and isolation forest in TCP

M Kiran, C Wang, G Papadimitriou, A Mandal… - Machine Learning, 2020 - Springer
Large-scale scientific workflows rely heavily on high-performance file transfers. These
transfers require strict quality parameters such as guaranteed bandwidth, no packet loss or …

Adaptive real‐time anomaly detection in cloud infrastructures

B Agrawal, T Wiktorski, C Rong - … and Computation: Practice …, 2017 - Wiley Online Library
Cloud computing has become increasingly popular, which has led many individuals and
organizations towards cloud storage systems. This move is motivated by benefits such as …