We present the design, implementation and engineering experience in building and
deploying MegaScale, a production system for training large language models (LLMs) at the …

Over the past few years resilience has became a major issue for high-performance
computing (HPC) systems, in particular in the perspective of large petascale systems and …

Large-scale parallel computing is relying increasingly on clusters with thousands of
processors. At such large counts of compute nodes, faults are becoming common place …

As the number of nodes in high-performance computing environments keeps increasing,
faults are becoming common place. Reactive fault tolerance (FT) often does not scale due to …

This paper describes the datasets and computer vision challenges that form part of the PETS
2016 workshop. PETS 2016 addresses the application of on-board multi sensor surveillance …

Processor virtualization via migratable objects is a powerful technique that enables the
runtime system to carry out intelligent adaptive optimizations like dynamic resource …

Failures are likely to be more frequent in systems with thousands of processors. Therefore,
schemes for dealing with faults become increasingly important. In this paper, we present a …

Function-as-a-Service (FaaS) platforms have recently gained rapid popularity. Many stateful
applications have been migrated to FaaS platforms due to their ease of deployment …

As the scale of cluster computing grows, it is becoming hard for long-running applications to
complete without facing failures on large-scale clusters. To address this issue …

Fault tolerance is a major concern to guarantee availability of critical services as well as
application execution. Traditional approaches for fault tolerance include checkpoint/restart …