Time estimation and resource minimization scheme for apache spark and hadoop big data systems with failures

J Lee, B Kim, JM Chung - Ieee Access, 2019 - ieeexplore.ieee.org
Apache Spark and Hadoop are open source frameworks for big data processing, which
have been adopted by many companies. In order to implement a reliable big data system …

Dawn of big data with Hadoop and machine learning

B Singh, HK Verma - Machine Learning and Data Science …, 2022 - Wiley Online Library
Rapid data development by modern systems has changed the way we perceive the world.
The data is growing fast and so are the expectations. The excessive growth of data has …

[BOOK][B] Computational Science and Its Applications–ICCSA 2020: 20th International Conference, Cagliari, Italy, July 1–4, 2020, Proceedings, Part VII

O Gervasi, B Murgante, S Misra, C Garau, I Blečić… - 2020 - books.google.com
The seven volumes LNCS 12249-12255 constitute the refereed proceedings of the 20th
International Conference on Computational Science and Its Applications, ICCSA 2020, held …

SAF: simulated annealing fair scheduling for Hadoop Yarn clusters

M Ghanavatinasab, M Bahmani, R Azmi - arxiv preprint arxiv:2008.12586, 2020 - arxiv.org
Apache introduced YARN as the next generation of the Hadoop framework, providing
resource management and a central platform to deliver consistent data governance tools …

Data-Driven Low-Carbon Smart Mobility Framework: A Case Study on Electric Vehicle Charging Services

H **e, H Zhang, X Song, Z Shi, G Song, J Peng… - Available at SSRN … - papers.ssrn.com
In order to further reduce environmental pollution, many countries around the world are
advocating and implementing the policies of" carbon peaking" and" carbon neutralization" …

Comparative Performance Analysis of Job Scheduling Algorithms in a Real-World Scientific Application

FE Puntel, AS Charão, A Petry - … Science and Its Applications–ICCSA 2020 …, 2020 - Springer
Abstract In High Performance Computing, it is common to deal with substantial computing
resources, and the use of a Resource Management System (RMS) becomes fundamental …

[PDF][PDF] Implementation of a Big Data Architecture For The Realization of Predictive Models With Great Volumes of Data

EL Huamaní, A Roman-Gonzalez - researchgate.net
The research direction of the University of Sciences and Humanities has integrated a Big
Data architecture to make predictive models with large volumes of data. Therefore it was …

Use of Big Data at Anatel: A Case Study at National Telecommunications Agency

L de Freitas, RAL Torres, UC da Cunha… - 2020 15th Iberian …, 2020 - ieeexplore.ieee.org
The growth in the volume of data generated by applications affects both public and private
institutions. In the National Telecommunications Agency (Anatel), problems related to the …