High performance erasure coding for very large stripe sizes

W Haddock, PV Bangalore, ML Curry… - 2019 Spring …, 2019‏ - ieeexplore.ieee.org
Exascale computing demands high bandwidth and low latency I/O on the computing edge.
Object storage systems can provide higher bandwidth and lower latencies than tape archive …

Ecs2: A fast erasure coding library for gpu-accelerated storage systems with parallel & direct io

CJ Chang, J Chou, YC Chou… - 2020 IEEE International …, 2020‏ - ieeexplore.ieee.org
As data volume keeps increasing at a rapid rate, there is an urgent need for large, reliable,
and cost-effective storage systems. Erasure coding has drawn increasing attention because …

Cost analysis of erasure coding for exa-scale storage

DO Kim, HY Kim, YK Kim, JJ Kim - The Journal of Supercomputing, 2019‏ - Springer
With the increasing demand for mass storage, research on exa-scale storage is actively
underway. When the scale of storage grows to the exa-scale, the space efficiency becomes …

System Support for Robust Distributed Learning

AHA Guirguis - 2022‏ - infoscience.epfl.ch
The research presented in this dissertation was conducted in the Distributed Computing
Laboratory at EPFL, under the supervision of Professor Rachid Guerraoui, between 2018 …

Big data technologies in open source software: A survey

T JIANG, J QIAO, X HUANG, J WANG - Science & Technology Review, 2020‏ - kjdb.org
The Google's GFS and Big Table have broken the limitations of the technology of having to
use the relational databases to manage the big data in the past decade. A number of open …

开源软件中的大数据管理技术

江天, 乔嘉林, 黄向东, 王建民 - 科技导报, 2020‏ - kjdb.org
随着谷歌文件系统和宽表结构为代表的技术打破依赖关系数据库管理海量数据的限制,
以Apache Hadoop 为代表的开源大数据管理系统软件新技术与系统不断涌现, 并快速成熟应用 …

[PDF][PDF] Erasure Coding on File Transfer Appliance for Nearline Storage With High Degree Sharding.

W Haddock, ML Curry, PV Bangalore, A Skjellum - 2019‏ - osti.gov
Cloud storage technologies using erasure encoding on object storage can provide a
significant increase to High Performance Computing (HPC) storage capacity especially …

[PDF][PDF] Campaign Storage: Erasure Coding With GPUs.

W Haddock, ML Curry, P Bangalore, A Skjellum - 2017‏ - osti.gov
Legend ISA-L encode 1GB, E5-2680 v4 ISA-L encode 512MB, E5-2680 v4 ISA-L encode
1GB, E5-2660 v3 ISA-L encode 512MB, E5-2660 v3 Jerasure encode 1GB, E5-2680 v4 …