[HTML][HTML] Machine learning techniques for chronic kidney disease risk prediction

E Dritsas, M Trigka - Big Data and Cognitive Computing, 2022 - mdpi.com
Chronic kidney disease (CKD) is a condition characterized by progressive loss of kidney
function over time. It describes a clinical entity that causes kidney damage and affects the …

Deep learning generalizes because the parameter-function map is biased towards simple functions

G Valle-Perez, CQ Camargo, AA Louis - arxiv preprint arxiv:1805.08522, 2018 - arxiv.org
Deep neural networks (DNNs) generalize remarkably well without explicit regularization
even in the strongly over-parametrized regime where classical learning theory would …

Machine learning meets physics: A two-way street

H Levine, Y Tu - Proceedings of the National Academy of Sciences, 2024 - pnas.org
This article introduces a special issue on the interaction between the rapidly expanding field
of machine learning and ongoing research in physics. The first half of the papers in this …

The inverse variance–flatness relation in stochastic gradient descent is critical for finding flat minima

Y Feng, Y Tu - Proceedings of the National Academy of Sciences, 2021 - pnas.org
Despite tremendous success of the stochastic gradient descent (SGD) algorithm in deep
learning, little is known about how SGD finds generalizable solutions at flat minima of the …

On the different regimes of stochastic gradient descent

A Sclocchi, M Wyart - Proceedings of the National Academy of Sciences, 2024 - pnas.org
Modern deep networks are trained with stochastic gradient descent (SGD) whose key
hyperparameters are the number of data considered at each step or batch size B, and the …

Are all good word vector spaces isomorphic?

I Vulić, S Ruder, A Søgaard - arxiv preprint arxiv:2004.04070, 2020 - arxiv.org
Existing algorithms for aligning cross-lingual word vector spaces assume that vector spaces
are approximately isomorphic. As a result, they perform poorly or fail completely on non …

Insights into machine learning models from chemical physics: an energy landscapes approach (EL for ML)

MP Niroomand, L Dicks, EO Pyzer-Knapp… - Digital Discovery, 2024 - pubs.rsc.org
The study of energy landscapes as a conceptual framework, and a source of novel
computational tools, is an active area of research in chemistry and physics. The energy …

Application of linear regression algorithm and stochastic gradient descent in a machine‐learning environment for predicting biomass higher heating value

JO Ighalo, AG Adeniyi… - Biofuels, Bioproducts and …, 2020 - Wiley Online Library
The higher heating value (HHV) provides information about the quantity of energy contained
in a fuel such as biomass. Correlations and models can be developed to predict biomass …

Stochastic gradient descent introduces an effective landscape-dependent regularization favoring flat solutions

N Yang, C Tang, Y Tu - Physical Review Letters, 2023 - APS
Generalization is one of the most important problems in deep learning, where there exist
many low-loss solutions due to overparametrization. Previous empirical studies showed a …

Dimensionality compression and expansion in deep neural networks

S Recanatesi, M Farrell, M Advani, T Moore… - arxiv preprint arxiv …, 2019 - arxiv.org
Datasets such as images, text, or movies are embedded in high-dimensional spaces.
However, in important cases such as images of objects, the statistical structure in the data …