Despite the various research initiatives and proposed programming models, efficient
solutions for parallel programming in HPC clusters still rely on a complex combination of …

OpenMP has a long and successful history in parallel programming for CPUs, and more
recently GPUs through accelerator offloading. In this work we show that the OpenMP …

In the article, we have proposed a framework that allows programming a parallel application
for a multi‐node system, with one or more graphical processing units (GPUs) per node …

MPI+ X is the most popular hybrid programming model for distributed computation on
modern heterogeneous HPC systems. Nonetheless, for simplicity, HPC developers ideally …

Modern tasking models define applications in a fine-grained manner that necessitates lower
overhead per segment of computation. Fine-grained tasks, if done right, enable higher …

For decades, memory capabilities have scaled up much slower than compute capabilities,
leaving memory utilization as a major bottleneck. Prefetching and cache hierarchies mitigate …

In this work we describe libMPNode, an OpenMP runtime designed for efficient
multithreaded execution across systems composed of multiple non-cache-coherent …

Heterogeneous systems are becoming increasingly relevant, due to their performance and
energy efficiency capabilities, being present in all types of computing platforms, from …

Since the introduction of the “target” directive in the 4.0 specification, the usage of OpenMP
for heterogeneous computing programming has increased significantly. However, the …

The recent trend in computing toward deep learning has resulted in the development of a
variety of highly innovative AI accelerator architectures. One such architecture, the Cerebras …