Datastager: scalable data staging services for petascale applications

H Abbasi, M Wolf, G Eisenhauer, S Klasky… - Proceedings of the 18th …, 2009 - dl.acm.org
Known challenges for petascale machines are that (1) the costs of I/O for high performance
applications can be substantial, especially for output tasks like checkpointing, and (2) noise …

Mercury: Enabling remote procedure call for high-performance computing

J Soumagne, D Kimpe, J Zounmevo… - 2013 IEEE …, 2013 - ieeexplore.ieee.org
Remote procedure call (RPC) is a technique that has been largely adopted by distributed
services. This technique, now more and more used in the context of high-performance …

[PDF][PDF] Exascale software study: Software challenges in extreme scale systems

S Amarasinghe, D Campbell, W Carlson… - DARPA IPTO, Air Force …, 2009 - Citeseer
Extreme Scale processors containing hundreds or even thousands of cores will challenge
current operating system (OS) practices. Many of the fundamental assumptions that underlie …

Ad hoc file systems for high-performance computing

A Brinkmann, K Mohror, W Yu, P Carns… - Journal of Computer …, 2020 - Springer
Storage backends of parallel compute clusters are still based mostly on magnetic disks,
while newer and faster storage technologies such as flash-based SSDs or non-volatile …

Examples of in transit visualization

K Moreland, R Oldfield, P Marion, S Jourdain… - Proceedings of the 2nd …, 2011 - dl.acm.org
One of the most pressing issues with petascale analysis is the transport of simulation results
data to a meaningful analysis. Traditional workflow prescribes storing the simulation results …

Exploring data staging across deep memory hierarchies for coupled data intensive simulation workflows

T **, F Zhang, Q Sun, H Bui… - 2015 IEEE …, 2015 - ieeexplore.ieee.org
As applications target extreme scales, data staging and in-situ/in-transit data processing
have been proposed to address the data challenges and improve scientific discovery …

Extending i/o through high performance data services

H Abbasi, J Lofstead, F Zheng… - 2009 IEEE …, 2009 - ieeexplore.ieee.org
The complexity of HPC systems has increased the burden on the developer as applications
scale to hundreds of thousands of processing cores. Moreover, additional efforts are …

Lightweight I/O for scientific applications

RA Oldfield, L Ward, R Riesen… - 2006 IEEE …, 2006 - ieeexplore.ieee.org
Today's high-end massively parallel processing (MPP) machines have thousands to tens of
thousands of processors, with next-generation systems planned to have in excess of one …

EDO: Improving read performance for scientific applications through elastic data organization

Y Tian, S Klasky, H Abbasi, J Lofstead… - 2011 IEEE …, 2011 - ieeexplore.ieee.org
Large scale scientific applications are often bottlenecked due to the writing of checkpoint-
restart data. Much work has been focused on improving their write performance. With the …

Using cross-layer adaptations for dynamic data management in large scale coupled scientific workflows

T **, F Zhang, Q Sun, H Bui, M Parashar… - Proceedings of the …, 2013 - dl.acm.org
As system scales and application complexity grow, managing and processing simulation
data has become a significant challenge. While recent approaches based on data staging …