Towards securing data transfers against silent data corruption

B Charyyev, A Alhussen, H Sapkota… - 2019 19th IEEE/ACM …, 2019 - ieeexplore.ieee.org
Scientific applications generate large volumes of data that often needs to be moved between
geographically distributed sites for collaboration or backup which has led to a significant …

[PDF][PDF] The Modern Research Data Portal: a design pattern for networked, data-intensive science

K Chard, E Dart, I Foster, D Shifflett, S Tuecke… - PeerJ Computer …, 2018 - peerj.com
We describe best practices for providing convenient, high-speed, secure access to large
data via research data portals. We capture these best practices in a new design pattern, the …

RIVA: Robust integrity verification algorithm for high-speed file transfers

B Charyyev, E Arslan - IEEE Transactions on Parallel and …, 2020 - ieeexplore.ieee.org
End-to-end integrity verification is designed to protect file transfers against silent data
corruption by comparing checksum of files at source and destination end points using …

TCP throughput profiles using measurements over dedicated connections

NSV Rao, Q Liu, S Sen, D Towlsey… - Proceedings of the 26th …, 2017 - dl.acm.org
ide-area data transfers in high-performance computing infrastructures are increasingly being
carried over dynamically provisioned dedicated network connections that provide high …

Learning concave-convex profiles of data transport over dedicated connections

NSV Rao, S Sen, Z Liu, R Kettimuthu… - Machine Learning for …, 2019 - Springer
Dedicated data transport infrastructures are increasingly being deployed to support
distributed big-data and high-performance computing scenarios. These infrastructures …

Advising big data transfer over dedicated connections based on profiling optimization

D Yun, CQ Wu, NSV Rao… - IEEE/ACM Transactions …, 2019 - ieeexplore.ieee.org
Big data transfer in next-generation scientific applications is now commonly carried out over
dedicated channels in high-performance networks (HPNs), where transport protocols play a …

Data transfer advisor with transport profiling optimization

D Yun, CQ Wu, NSV Rao, Q Liu… - 2017 IEEE 42nd …, 2017 - ieeexplore.ieee.org
The network infrastructures have been rapidly upgraded in many high-performance
networks (HPNs). However, such infrastructure investment has not led to corresponding …

Experiments and analyses of data transfers over wide-area dedicated connections

NSV Rao, Q Liu, S Sen, J Hanley… - 2017 26th …, 2017 - ieeexplore.ieee.org
Dedicated wide-area network connections are increasingly employed in high-performance
computing and big data scenarios. One might expect the performance and dynamics of data …

Time series analysis for efficient sample transfers

H Sapkota, BA Pehlivan, E Arslan - … of the ACM Workshop on Systems …, 2019 - dl.acm.org
Real-time transfer optimization approaches offer promising solutions as they can discover
optimal transfer configuration in the runtime without requiring an upfront work or making …

Throughput analytics of data transfer infrastructures

NSV Rao, Q Liu, Z Liu, R Kettimuthu, I Foster - Testbeds and Research …, 2019 - Springer
To support increasingly distributed scientific and big-data applications, powerful data
transfer infrastructures are being built with dedicated networks and software frameworks …