Partial local entropy and anisotropy in deep weight spaces

D Musso - Physical Review E, 2021 - APS
We refine a recently proposed class of local entropic loss functions by restricting the
smoothening regularization to only a subset of weights. The new loss functions are referred …

[PDF][PDF] Is Evolution an Algorithm? Effects of local entropy in unsupervised learning and protein evolution

M Negri - 2022 - tesidottorato.depositolegale.it
In the present thesis we study artificial neural networks with the lens of statistical mechanics,
field that has proven very useful in understanding the structure of the solution space of …