Generalization bounds: Perspectives from information theory and PAC-Bayes

F Hellström, G Durisi, B Guedj… - … and Trends® in …, 2025 - nowpublishers.com
A fundamental question in theoretical machine learning is generalization. Over the past
decades, the PAC-Bayesian approach has been established as a flexible framework to …

[HTML][HTML] Hutchinson trace estimation for high-dimensional and high-order physics-informed neural networks

Z Hu, Z Shi, GE Karniadakis, K Kawaguchi - Computer Methods in Applied …, 2024 - Elsevier
Abstract Physics-Informed Neural Networks (PINNs) have proven effective in solving partial
differential equations (PDEs), especially when some data are available by seamlessly …

Simple hierarchical planning with diffusion

C Chen, F Deng, K Kawaguchi, C Gulcehre… - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion-based generative methods have proven effective in modeling trajectories with
offline datasets. However, they often face computational challenges and can falter in …

An information-theoretic perspective on variance-invariance-covariance regularization

R Shwartz-Ziv, R Balestriero, K Kawaguchi… - arxiv preprint arxiv …, 2023 - arxiv.org
Variance-Invariance-Covariance Regularization (VICReg) is a self-supervised learning
(SSL) method that has shown promising results on a variety of tasks. However, the …

Last-layer fairness fine-tuning is simple and effective for neural networks

Y Mao, Z Deng, H Yao, T Ye, K Kawaguchi… - arxiv preprint arxiv …, 2023 - arxiv.org
As machine learning has been deployed ubiquitously across applications in modern data
science, algorithmic fairness has become a great concern. Among them, imposing fairness …

Towards continual learning desiderata via hsic-bottleneck orthogonalization and equiangular embedding

D Li, T Wang, J Chen, Q Ren, K Kawaguchi… - Proceedings of the AAAI …, 2024 - ojs.aaai.org
Deep neural networks are susceptible to catastrophic forgetting when trained on sequential
tasks. Various continual learning (CL) methods often rely on exemplar buffers or/and …

VA3: Virtually Assured Amplification Attack on Probabilistic Copyright Protection for Text-to-Image Generative Models

X Li, Q Shen, K Kawaguchi - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
The booming use of text-to-image generative models has raised concerns about their high
risk of producing copyright-infringing content. While probabilistic copyright protection …

Bias-variance trade-off in physics-informed neural networks with randomized smoothing for high-dimensional PDEs

Z Hu, Z Yang, Y Wang, GE Karniadakis… - arxiv preprint arxiv …, 2023 - arxiv.org
While physics-informed neural networks (PINNs) have been proven effective for low-
dimensional partial differential equations (PDEs), the computational cost remains a hurdle in …

Sources of richness and ineffability for phenomenally conscious states

X Ji, E Elmoznino, G Deane, A Constant… - Neuroscience of …, 2024 - academic.oup.com
Conscious states—state that there is something it is like to be in—seem both rich or full of
detail and ineffable or hard to fully describe or recall. The problem of ineffability, in particular …

Can AI be as creative as humans?

H Wang, J Zou, M Mozer, A Goyal, A Lamb… - arxiv preprint arxiv …, 2024 - arxiv.org
Creativity serves as a cornerstone for societal progress and innovation. With the rise of
advanced generative AI models capable of tasks once reserved for human creativity, the …