Algorithms as work designers: How algorithmic management influences the design of jobs

X Parent-Rocheleau, SK Parker - Human resource management review, 2022 - Elsevier
We review the literature on algorithmic management (AM) to bridge the gap between this
emerging research area and the well-established theory and research on work design. First …

Task scheduling in big data platforms: a systematic literature review

M Soualhia, F Khomh, S Tahar - Journal of Systems and Software, 2017 - Elsevier
Abstract Context: Hadoop, Spark, Storm, and Mesos are very well known frameworks in both
research and industrial communities that allow expressing and processing distributed …

Improving performance of heterogeneous mapreduce clusters with adaptive task tuning

D Cheng, J Rao, Y Guo, C Jiang… - IEEE Transactions on …, 2016 - ieeexplore.ieee.org
Datacenter-scale clusters are evolving toward heterogeneous hardware architectures due to
continuous server replacement. Meanwhile, datacenters are commonly shared by many …

Energy efficiency aware task assignment with dvfs in heterogeneous hadoop clusters

D Cheng, X Zhou, P Lama, M Ji… - Ieee transactions on …, 2017 - ieeexplore.ieee.org
While Hadoop ecosystems become increasingly important for practitioners of large-scale
data analysis, they also incur tremendous energy cost. This trend is driving up the need for …

Adaptive scheduling of parallel jobs in spark streaming

D Cheng, Y Chen, X Zhou, D Gmach… - IEEE INFOCOM 2017 …, 2017 - ieeexplore.ieee.org
Streaming data analytics has become increasingly vital in many applications such as
dynamic content delivery (eg, advertisements), Twitter sentiment analysis, and security event …

SLA-based scheduling of spark jobs in hybrid cloud computing environments

MT Islam, H Wu, S Karunasekera… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Big data frameworks such as Apache Spark is becoming prominent to perform large-scale
data analytics jobs in various domains. However, due to limited resource availability, the …

[HTML][HTML] Job schedulers for big data processing in Hadoop environment: testing real-life schedulers using benchmark programs

M Usama, M Liu, M Chen - Digital Communications and Networks, 2017 - Elsevier
At present, big data is very popular, because it has proved to be much successful in many
fields such as social media, E-commerce transactions, etc. Big data describes the tools and …

Transition phase classification and prediction

J Lau, S Schoenmackers… - … Symposium on High …, 2005 - ieeexplore.ieee.org
Most programs are repetitive, where similar behavior can be seen at different execution
times. Proposed on-line systems automatically group these similar intervals of execution into …

When will my {ML} Job finish? Toward providing Completion Time Estimates through {Predictability-Centric} Scheduling

AB Faisal, N Martin, HM Bashir, S Lamelas… - … USENIX Symposium on …, 2024 - usenix.org
In this paper, we make a case for providing job completion time estimates to GPU cluster
users, similar to providing the delivery date of a package or arrival time of a booked ride. Our …

Cross-platform resource scheduling for spark and MapReduce on YARN

D Cheng, X Zhou, P Lama, J Wu… - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
While MapReduce is inherently designed for batch and high throughput processing
workloads, there is an increasing demand for non-batch processes on big data, eg …