Networking for big data: A survey

S Yu, M Liu, W Dou, X Liu… - … Communications Surveys & …, 2016 - ieeexplore.ieee.org
Complementary to the fancy big data applications, networking for big data is an
indispensable supporting platform for these applications in practice. This emerging research …

Load balancing in data center networks: A survey

J Zhang, FR Yu, S Wang, T Huang… - … Surveys & Tutorials, 2018 - ieeexplore.ieee.org
Data center networks usually employ the scale-out model to provide high bisection
bandwidth for applications. A large amount of data is required to be transferred frequently …

Efficient coflow scheduling without prior knowledge

M Chowdhury, I Stoica - ACM SIGCOMM Computer Communication …, 2015 - dl.acm.org
Inter-coflow scheduling improves application-level communication performance in data-
parallel clusters. However, existing efficient schedulers require a priori coflow information …

CODA: Toward automatically identifying and scheduling coflows in the dark

H Zhang, L Chen, B Yi, K Chen, M Chowdhury… - Proceedings of the …, 2016 - dl.acm.org
Leveraging application-level requirements using coflows has recently been shown to
improve application-level communication performance in data-parallel clusters. However …

Sincronia: Near-optimal network design for coflows

S Agarwal, S Rajakrishnan, A Narayan… - Proceedings of the …, 2018 - dl.acm.org
We present Sincronia, a near-optimal network design for coflows that can be implemented
on top on any transport layer (for flows) that supports priority scheduling. Sincronia achieves …

Network-aware locality scheduling for distributed data operators in data centers

L Cheng, Y Wang, Q Liu, DHJ Epema… - … on Parallel and …, 2021 - ieeexplore.ieee.org
Large data centers are currently the mainstream infrastructures for big data processing. As
one of the most fundamental tasks in these environments, the efficient execution of …

[PDF][PDF] Deepweave: Accelerating job completion time with deep reinforcement learning-based coflow scheduling

P Sun, Z Guo, J Wang, J Li, J Lan, Y Hu - Proceedings of the Twenty-Ninth …, 2021 - ijcai.org
To improve the processing efficiency of jobs in distributed computing, the concept of coflow
is proposed. A coflow is a collection of flows that are semantically correlated in a multi-stage …

Loom: Flexible and efficient {NIC} packet scheduling

B Stephens, A Akella, M Swift - 16th USENIX Symposium on Networked …, 2019 - usenix.org
In multi-tenant cloud data centers, operators need to ensure that competing tenants and
applications are isolated from each other and fairly share limited network resources. With …

Towards real-time inference offloading with distributed edge computing: the framework and algorithms

Q Chen, S Guo, K Wang, W Xu, J Li… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
By combining edge computing and parallel computing, distributed edge computing has
emerged as a new paradigm to exploit the booming IoT devices at the edge. To accelerate …

Cluster frameworks for efficient scheduling and resource allocation in data center networks: A survey

K Wang, Q Zhou, S Guo, J Luo - IEEE Communications Surveys …, 2018 - ieeexplore.ieee.org
Data centers are widely used for big data analytics, which often involve data-parallel jobs,
including query and web service. Meanwhile, cluster frameworks are rapidly developed for …