Serverless functions provide elastic scaling and a fine-grained billing model, making
Function-as-a-Service (FaaS) an attractive programming model. However, for distributed …

Message Passing Interface (MPI) programs often experience performance slowdowns due
to collective communication operations, like broadcasting and reductions. As modern CPUs …

The MPI_Allreduce collective operation is a core kernel of many parallel codebases,
particularly for reductions over a single value per process. The commonly used allreduce …

Load balance is essential for high-performance applications. Unbalanced communication
can cause severe performance degradation, even in computation-balanced BSP …

Recent processor advances have made feasible HPC nodes with high core counts, capable
of hosting tens or even, hundreds of processes. Therefore, designing MPI collective …

Collective operations are widely used by MPI applications to realize their communication
patterns. Their efficiency is crucial for both performance and scalability of parallel …

We consider the encrypted all-reduce operation on multi-core clusters. We derive
performance bounds for the encrypted all-reduce operation and develop efficient algorithms …

MPI_Bcast collective communication operation is used by many scientific applications and
tend to limit overall parallel application scalability. This paper investigates the design and …

In Artificial Intelligence (AI) and high-performance computing (HPC), growing data and
model sizes require distributed processing across multiple nodes due to single-node …

In the era of exascale computing, the adoption of a large number of CPU cores and nodes
by high-performance computing (HPC) applications has made MPI collective performance …