Deep ensembles work, but are they necessary?

T Abe, EK Buchanan, G Pleiss… - Advances in …, 2022 - proceedings.neurips.cc
Ensembling neural networks is an effective way to increase accuracy, and can often match
the performance of individual larger models. This observation poses a natural question …

DNA: Domain generalization with diversified neural averaging

X Chu, Y **, W Zhu, Y Wang, X Wang… - International …, 2022 - proceedings.mlr.press
The inaccessibility of the target domain data causes domain generalization (DG) methods
prone to forget target discriminative features, and challenges the pervasive theme in existing …

[HTML][HTML] Ensemble neural networks for the development of storm surge flood modeling: A comprehensive review

SK Nezhad, M Barooni, D Velioglu Sogut… - Journal of Marine …, 2023 - mdpi.com
This review paper focuses on the use of ensemble neural networks (ENN) in the
development of storm surge flood models. Storm surges are a major concern in coastal …

When are ensembles really effective?

R Theisen, H Kim, Y Yang… - Advances in neural …, 2023 - proceedings.neurips.cc
Ensembling has a long history in statistical data analysis, with many impactful applications.
However, in many modern machine learning settings, the benefits of ensembling are less …

An interpretable ensemble structure with a non-iterative training algorithm to improve the predictive accuracy of healthcare data analysis

I Izonin, R Tkachenko, K Yemets, M Havryliuk - Scientific Reports, 2024 - nature.com
The modern development of healthcare is characterized by a set of large volumes of tabular
data for monitoring and diagnosing the patient's condition. In addition, modern methods of …

Joint training of deep ensembles fails due to learner collusion

A Jeffares, T Liu, J Crabbé… - Advances in Neural …, 2023 - proceedings.neurips.cc
Ensembles of machine learning models have been well established as a powerful method of
improving performance over a single model. Traditionally, ensembling algorithms train their …

Verifying generalization in deep learning

G Amir, O Maayan, T Zelazny, G Katz… - … Conference on Computer …, 2023 - Springer
Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the
state of the art in numerous application domains. However, DNN-based decision rules are …

Optimizing starch content prediction in kudzu: Integrating hyperspectral imaging and deep learning with WGAN-GP

H Hu, Y Mei, Y Zhou, Y Zhao, L Fu, H Xu, X Mao… - Food Control, 2024 - Elsevier
Rapid and non-destructive prediction of starch content in kudzu is essential for the food
industry. In this work, we present an approach combining hyperspectral imaging (HSI) and …

Pathologies of predictive diversity in deep ensembles

T Abe, EK Buchanan, G Pleiss… - arxiv preprint arxiv …, 2023 - arxiv.org
Classic results establish that encouraging predictive diversity improves performance in
ensembles of low-capacity models, eg through bagging or boosting. Here we demonstrate …

Pac-bayes-chernoff bounds for unbounded losses

I Casado, LA Ortega, AR Masegosa, A Pérez - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce a new PAC-Bayes oracle bound for unbounded losses. This result can be
understood as a PAC-Bayesian version of the Cram\'er-Chernoff bound. The proof technique …