Direct lookup and hash-based metadata placement for local file systems

PH Lensing, T Cortes, A Brinkmann - Proceedings of the 6th …, 2013 - dl.acm.org
New challenges to file systems' metadata performance are imposed by the continuously
growing number of files existing in file systems. The total amount of metadata can become …

Improving small file I/O performance for massive digital archives

H Kim, H Yeom - 2017 IEEE 13th International Conference on e …, 2017 - ieeexplore.ieee.org
With the growth of online services, a large amount of files have been generated by users or
by the service itself. To make it easier to service users with different network environments …

Design and implementation of the tianhe-2 data storage and management system

YT Lu, P Cheng, ZG Chen - Journal of Computer Science and Technology, 2020 - Springer
With the convergence of high-performance computing (HPC), big data and artificial
intelligence (AI), the HPC community is pushing for “triple use” systems to expedite scientific …

AsyncFS: Metadata Updates Made Asynchronous for Distributed Filesystems with In-Network Coordination

J Xu, M Dong, Q Tian, Z Tian, T **n, H Chen - arxiv preprint arxiv …, 2024 - arxiv.org
Distributed filesystems typically employ synchronous metadata updates, facing inherent
challenges for access efficiency, load balancing, and directory contention, especially under …

Storage and retrieval of massive heterogeneous IoT data based on hybrid storage

S Wu, L Bao, Z Zhu, F Yi, W Chen - 2017 13th International …, 2017 - ieeexplore.ieee.org
With the rapid development of the Internet of Things (IoT), the IoT is characterized by a wide
variety of data sources, large scale and heterogeneous structure. But those characteristics …

CEFLS: A cost-effective file lookup service in a distributed metadata file system

X Li, B Dong, L **ao, L Ruan… - 2012 12th IEEE/ACM …, 2012 - ieeexplore.ieee.org
As large file systems increasingly grow in size, metadata operations become one of the
major performance bottlenecks that constrain the overall I/O performance. Previous analysis …

Evaluation of applied intra-disk redundancy schemes to improve single disk reliability

M Grawinkel, T Schafer, A Brinkmann… - 2011 IEEE 19th …, 2011 - ieeexplore.ieee.org
Exponentially growing capacities of disk drives have increased the problem that not only a
complete disk can fail, but also individual, small groups of sectors can be erroneous. These …

Dynamically adaptable I/O semantics for high performance computing

M Kuhn - … Computing: 30th International Conference, ISC High …, 2015 - Springer
While an input/output (I/O) interface's syntax describes the available operations, its
semantics determines how these operations behave and which assumptions developers …

Exploiting FastDFS client-based small file merging

H Chen, H Zhang - 2016 International Conference on Artificial …, 2016 - atlantis-press.com
How to store masses of small files is a generally acknowledged problem in industry and
academia. Small file merging is the most successful strategy to solve this problem, which …

A semantics-aware I/O interface for high performance computing

M Kuhn - … Conference, ISC 2013, Leipzig, Germany, June 16-20 …, 2013 - Springer
File systems as well as I/O libraries offer interfaces which can be used to interact with them,
albeit on different levels of abstraction. While an interface's syntax simply describes the …