Orchestrating the development lifecycle of machine learning-based IoT applications: A taxonomy and survey

B Qian, J Su, Z Wen, DN Jha, Y Li, Y Guan… - ACM Computing …, 2020 - dl.acm.org
Machine Learning (ML) and Internet of Things (IoT) are complementary advances: ML
techniques unlock the potential of IoT with intelligence, and IoT applications increasingly …

Lagrange coded computing: Optimal design for resiliency, security, and privacy

Q Yu, S Li, N Raviv, SMM Kalan… - The 22nd …, 2019 - proceedings.mlr.press
We consider a scenario involving computations over a massive dataset stored distributedly
across multiple workers, which is at the core of distributed learning algorithms. We propose …

Machine learning in compiler optimization

Z Wang, M O'Boyle - Proceedings of the IEEE, 2018 - ieeexplore.ieee.org
In the last decade, machine-learning-based compilation has moved from an obscure
research niche to a mainstream activity. In this paper, we describe the relationship between …

Gradient coding from cyclic MDS codes and expander graphs

N Raviv, R Tandon, A Dimakis… - … Conference on Machine …, 2018 - proceedings.mlr.press
Gradient coding is a technique for straggler mitigation in distributed learning. In this paper
we design novel gradient codes using tools from classical coding theory, namely, cyclic …

Collaborative learning based straggler prevention in large‐scale distributed computing framework

S Deshmukh, K Thirupathi Rao… - Security and …, 2021 - Wiley Online Library
Modern big data applications tend to prefer a cluster computing approach as they are linked
to the distributed computing framework that serves users jobs as per demand. It performs …

Straggler mitigation in distributed optimization through data encoding

C Karakus, Y Sun, S Diggavi… - Advances in Neural …, 2017 - proceedings.neurips.cc
Slow running or straggler tasks can significantly reduce computation speed in distributed
computation. Recently, coding-theory-inspired approaches have been applied to mitigate …

Smartharvest: Harvesting idle cpus safely and efficiently in the cloud

Y Wang, K Arya, M Kogias, M Vanga… - Proceedings of the …, 2021 - dl.acm.org
We can increase the efficiency of public cloud datacenters by harvesting allocated but
temporarily idling CPU cores from customer virtual machines (VMs) to run batch or analytics …

A latency-aware task scheduling algorithm for allocating virtual machines in a cost-effective and time-sensitive fog-cloud architecture

P Memari, SS Mohammadi, F Jolai… - The Journal of …, 2022 - Springer
Recently, with the expansion of communications and generated data, the need for
processing this high volume of data in minimum time and maximum speed has increased …

[HTML][HTML] A classification framework for straggler mitigation and management in a heterogeneous Hadoop cluster: A state-of-art survey

KL Bawankule, RK Dewang, AK Singh - Journal of King Saud University …, 2022 - Elsevier
Hadoop is the most economical and cheap software framework that allows distributed
storage and parallel processing of more extensive data sets. Hadoop distributed file system …

Redundancy techniques for straggler mitigation in distributed optimization and learning

C Karakus, Y Sun, S Diggavi, W Yin - Journal of Machine Learning …, 2019 - jmlr.org
Performance of distributed optimization and learning systems is bottlenecked by" straggler"
nodes and slow communication links, which significantly delay computation. We propose a …