Early evaluation of intel optane non-volatile memory with hpc i/o workloads

K Wu, F Ober, S Hamlin, D Li - arxiv preprint arxiv:1708.02199, 2017 - arxiv.org
High performance computing (HPC) applications have a high requirement on storage speed
and capacity. Non-volatile memory is a promising technology to replace traditional storage …

Performing initiative data prefetching in distributed file systems for cloud computing

J Liao, F Trahay, G **ao, L Li… - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
This paper presents an initiative data prefetching scheme on the storage servers in
distributed file systems for cloud computing. In this prefetching technique, the client …

How file access patterns influence interference among cluster applications

CS Kuo, A Shah, A Nomura… - … Conference on Cluster …, 2014 - ieeexplore.ieee.org
On large-scale clusters, tens to hundreds of applications can simultaneously access a
parallel file system, leading to contention and in its wake to degraded application …

Adaptive replica synchronization for distributed file systems

J Liao, L Li, H Chen, X Liu - IEEE Systems Journal, 2014 - ieeexplore.ieee.org
This paper presents an adaptive replica synchronization mechanism among storage servers
(SSs) without the interference from the metadata server (MDS) in a distributed file system …

Two-level hash/table approach for metadata management in distributed file systems

AF Díaz, M Anguita, HE Camacho, E Nieto… - The Journal of …, 2013 - Springer
AbFS is a distributed file system that makes it possible to efficiently share the inexpensive
devices attached to the commodity computers of a cluster. The implementation of AbFS …

Adaptive metadata rebalance in exascale file system

MH Cha, DO Kim, HY Kim, YK Kim - The Journal of Supercomputing, 2017 - Springer
This paper presents an effective method of metadata rebalance in exascale distributed file
systems. Exponential data growth has led to the need for an adaptive and robust distributed …

A Comparative Experimental Study of Parallel File Systems for Large-Scale Data Processing.

Z Sebepou, K Magoutis, M Marazakis, A Bilas - LASCO, 2008 - usenix.org
Large-scale scientific and business applications require data processing of ever-increasing
amounts of data, fueling a demand for scalable parallel file systems comprising hundreds to …

Analysis of the MPI-IO optimization levels with the PIOViz Jumpshot enhancement

T Ludwig, S Krempel, M Kuhn, J Kunkel… - Recent Advances in …, 2007 - Springer
With MPI-IO we see various alternatives for programming file I/O. The overall program
performance depends on many different factors. A new trace analysis environment provides …

Server‐side prefetching in distributed file systems

J Liao - Concurrency and Computation: Practice and …, 2016 - Wiley Online Library
This paper presents a proactive data prefetching mechanism on storage servers for
distributed file systems to achieve better input/output (I/O) performance. This mechanism …

I/O characterization on a parallel file system

S Narayan, JA Chandy - Proceedings of the 2010 International …, 2010 - ieeexplore.ieee.org
In this paper we present a study of I/O access patterns of scientific and general applications
on a parallel file system. Understanding I/O access patterns is an essential condition to …