Demystifying parallel and distributed deep learning: An in-depth concurrency analysis

T Ben-Nun, T Hoefler - ACM Computing Surveys (CSUR), 2019 - dl.acm.org
Deep Neural Networks (DNNs) are becoming an important tool in modern computing
applications. Accelerating their training is a major challenge and techniques range from …

A review on convolutional neural network encodings for neuroevolution

GA Vargas-Hakim, E Mezura-Montes… - IEEE Transactions …, 2021 - ieeexplore.ieee.org
Convolutional neural networks (CNNs) have shown outstanding results in different
application tasks. However, the best performance is obtained when customized CNNs …

Workshop report on basic research needs for scientific machine learning: Core technologies for artificial intelligence

N Baker, F Alexander, T Bremer, A Hagberg… - 2019 - osti.gov
Scientific Machine Learning (SciML) and Artificial Intelligence (AI) will have broad use and
transformative effects across the Department of Energy. Accordingly, the January 2018 Basic …

CosmoFlow: Using deep learning to learn the universe at scale

A Mathuriya, D Bard, P Mendygral… - … Conference for High …, 2018 - ieeexplore.ieee.org
Deep learning is a promising tool to determine the physical model that describes our
universe. To handle the considerable computational cost of this problem, we present …

Measurement of Final-State Correlations in Neutrino Muon-Proton Mesonless Production on Hydrocarbon at

XG Lu, M Betancourt, T Walton, F Akbar, L Aliaga… - Physical review …, 2018 - APS
Final-state kinematic imbalances are measured in mesonless production of ν μ+ A→ μ-+ p+
X in the MINERvA tracker. Initial-and final-state nuclear effects are probed using the …

A modular benchmarking infrastructure for high-performance and reproducible deep learning

T Ben-Nun, M Besta, S Huber… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
We introduce Deep500: the first customizable benchmarking infrastructure that enables fair
comparison of the plethora of deep learning frameworks, algorithms, libraries, and …

A competitive learning scheme for deep neural network pattern classifier training

S Zheng, F Lan, M Castellani - Applied Soft Computing, 2023 - Elsevier
To reduce the computational complexity of training a deep neural network architecture using
large data sets of 3D scenes, a competitive learning scheme was devised. The proposed …

Multi-objective hyperparameter optimization of convolutional neural network for obstructive sleep apnea detection

SS Mostafa, F Mendonca, AG Ravelo-Garcia… - IEEE …, 2020 - ieeexplore.ieee.org
Obstructive sleep apnea (OSA) is a common sleep disorder characterized by interrupted
breathing during sleep. Because of the cost, complexity, and accessibility issue related to …

Decentralized gradient methods: does topology matter?

G Neglia, C Xu, D Towsley… - … Conference on Artificial …, 2020 - proceedings.mlr.press
Consensus-based distributed optimization methods have recently been advocated as
alternatives to parameter server and ring all-reduce paradigms for large scale training of …

Scalable reinforcement-learning-based neural architecture search for cancer deep learning research

P Balaprakash, R Egele, M Salim, S Wild… - Proceedings of the …, 2019 - dl.acm.org
Cancer is a complex disease, the understanding and treatment of which are being aided
through increases in the volume of collected data and in the scale of deployed computing …