Data placement for scientific applications in distributed environments

A Chervenak, E Deelman, M Livny… - 2007 8th IEEE/ACM …, 2007 - ieeexplore.ieee.org
Scientific applications often perform complex computational analyses that consume and
produce large data sets. We are concerned with data placement policies that distribute data …

[PDF][PDF] CMS computing: Technical Design Report

GL Bayatyan, M Della Negra, A Petrilli - 2005 - cds.cern.ch
Computing and software are of paramount importance to the Compact Muon Solenoid
(CMS) experiment.[1] The LHC experiments have recognised the magnitude and complexity …

[PDF][PDF] The CMS computing model

C Grandi, D Stickland, L Taylor - 2004 - s3.cern.ch
This document provides a top-level description of the CMS Offline Computing systems, with
emphasis on the period immediately following the turn-on of the LHC and CMS. The main …

Bigdata express: Toward schedulable, predictable, and high-performance data transfer

Q Lu, L Zhang, S Sasidharan, W Wu… - 2018 IEEE/ACM …, 2018 - ieeexplore.ieee.org
Big Data has emerged as a driving force for scientific discoveries. Large scientific
instruments (eg, colliders, and telescopes) generate exponentially increasing volumes of …

The Clarens Web service framework for distributed scientific analysis in grid projects

F van Lingen, C Steenberg, M Thomas… - 2005 International …, 2005 - ieeexplore.ieee.org
Large scientific collaborations are moving towards service oriented architectures for
implementation and deployment of globally distributed systems. Clarens is a high …

Exploiting CMS data popularity to model the evolution of data management for Run-2 and beyond

D Bonacorsi, T Boccali, D Giordano… - Journal of Physics …, 2015 - iopscience.iop.org
During the LHC Run-1 data taking, all experiments collected large data volumes from proton-
proton and heavy-ion collisions. The collisions data, together with massive volumes of …

Binary codes for non-uniform sources

A Moffat, VN Anh - Data Compression Conference, 2005 - ieeexplore.ieee.org
In many applications of compression, decoding speed is at least as important as
compression effectiveness. For example, the large inverted indexes associated with text …

[BOOK][B] Distributed computing grid experiences in CMS data challenge

A Fanfani - 2004 - dma.unina.it
Distributed Computing Grid Experiences in CMS Data Challenge Page 1 2nd GGF School on
Grid Computing – July 2004 – n 1 A.Fanfani INFN Bologna ➢ Introduction about LHC and CMS …

Integrating policy with scientific workflow management for data-intensive applications

AL Chervenak, DE Smith, W Chen… - 2012 SC Companion …, 2012 - ieeexplore.ieee.org
As scientific applications generate and consume data at ever-increasing rates, scientific
workflow systems that manage the growing complexity of analyses and data movement will …

A data placement service for petascale applications

AL Chervenak, R Schuler - … of the 2nd international workshop on …, 2007 - dl.acm.org
We examine the use of policy-driven data placement services to improve the performance of
data-intensive, petascale applications in high performance distributed computing …