Monomial matrix group equivariant neural functional networks

H Tran, T Vo, T Huu, T Nguyen - Advances in Neural …, 2025 - proceedings.neurips.cc
Neural functional networks (NFNs) have recently gained significant attention due to their
diverse applications, ranging from predicting network generalization and network editing to …

Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models

T Putterman, D Lim, Y Gelberg, S Jegelka… - arxiv preprint arxiv …, 2024 - arxiv.org
Low-rank adaptations (LoRAs) have revolutionized the finetuning of large foundation
models, enabling efficient adaptation even with limited computational resources. The …

From MLP to NeoMLP: Leveraging Self-Attention for Neural Fields

M Kofinas, S Papa, E Gavves - arxiv preprint arxiv:2412.08731, 2024 - arxiv.org
Neural fields (NeFs) have recently emerged as a state-of-the-art method for encoding spatio-
temporal signals of various modalities. Despite the success of NeFs in reconstructing …

Equivariant Neural Functional Networks for Transformers

VH Tran, TN Vo, AN The, TT Huu… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper systematically explores neural functional networks (NFN) for transformer
architectures. NFN are specialized neural networks that treat the weights, gradients, or …

Equivariant Polynomial Functional Networks

TN Vo, VH Tran, TT Huu, AN The, T Tran… - arxiv preprint arxiv …, 2024 - arxiv.org
Neural Functional Networks (NFNs) have gained increasing interest due to their wide range
of applications, including extracting information from implicit representations of data, editing …

ARC: Anchored Representation Clouds for High-Resolution INR Classification

JS Luijmes - 2024 - repository.tudelft.nl
Implicit neural representations (INRs) exhibit exceptional compression and generalisation
abilities that have enabled striking progress across a variety of applications. These …

Neural Network Weights as a New Data Modality

K Schürholt, G Bouritsas, E Horwitz, D Lim… - ICLR 2025 Workshop … - openreview.net
The ongoing deep learning revolution of the last decade has brought about hundreds of
millions of neural networks (NNs) trained on diverse datasets. At the same time, the recent …