Abstract Machine learning techniques have become ubiquitous both in industry and
academic applications. Increasing model sizes and training data volumes necessitate fast …

The de-facto standard topology for modern HPC systems and data-centers are Folded Clos
networks, commonly known as Fat-Trees. The number of network endpoints in these …

Network congestion arising from simultaneous data transfers can be a significant
performance bottleneck for many applications, especially when network resources are …

Understanding the behavior of parallel applications that use the Message Passing Interface
(MPI) is critical for optimizing communication performance. Performance tools for MPI …

Parallel simulation codes often suffer from performance bottlenecks due to network
congestion, leaving millions of dollars of investments underutilized. Given a network …

With the increasing fault rate on high-end supercomputers, the topic of fault tolerance has
been gathering attention. To cope with this situation, various fault-tolerance techniques are …

The state-of-the-art topology for modern supercomputers are Folded Clos networks, aka Fat-
Trees. The node count in these massively parallel systems is steadily increasing. This forces …

Understanding the behavior of parallel applications that use the Message Passing Interface
(MPI) is critical for optimizing communication performance. Performance tools for MPI …

Acquiring and maintaining high performance computing systems represents a substantial,
long term investment. Therefore, it is paramount to optimize their utilization in order to …

Large-scale high-performance systems (HPC), or supercomputers, are composed of
hundreds/thousands of nodes that are interconnected using advanced network topologies …