Singularity is a research project in Microsoft Research that started with the question: what
would a software platform look like if it was designed from scratch with the primary goal of …

In this paper, we describe ZooKeeper, a service for coordinating processes of distributed
applications. Since ZooKeeper is part of critical infrastructure, ZooKeeper aims to provide a …

This paper describes the design and implementation of Egalitarian Paxos (EPaxos), a new
distributed consensus algorithm based on Paxos. EPaxos achieves three goals:(1) optimal …

Bigtable is a distributed storage system for managing structured data that is designed to
scale to a very large size: petabytes of data across thousands of commodity servers. Many …

We describe our experiences with the Chubby lock service, which is intended to provide
coarse-grained locking as well as reliable (though low-volume) storage for a loosely …

This paper describes Haystack, an object storage system optimized for Facebook's Photos
application. Facebook currently stores over 260 billion images, which translates to over 20 …

Byzantine Fault Tolerant state machine replication (BFT) protocols are replication protocols
that tolerate arbitrary faults of a fraction of the replicas. Although significant efforts have been …

We describe PNUTS, a massively parallel and geographically distributed database system
for Yahoo!'s web applications. PNUTS provides data storage organized as hashed or …

Zab is a crash-recovery atomic broadcast algorithm we designed for the ZooKeeper
coordination service. ZooKeeper implements a primary-backup scheme in which a primary …

We describe our experience in building a fault-tolerant data-base using the Paxos
consensus algorithm. Despite the existing literature in the field, building such a database …