Pure transformers are powerful graph learners

J Kim, D Nguyen, S Min, S Cho… - Advances in Neural …, 2022 - proceedings.neurips.cc
We show that standard Transformers without graph-specific modifications can lead to
promising results in graph learning both in theory and practice. Given a graph, we simply …

Theory for equivariant quantum neural networks

QT Nguyen, L Schatzki, P Braccia, M Ragone, PJ Coles… - PRX Quantum, 2024 - APS
Quantum neural network architectures that have little to no inductive biases are known to
face trainability and generalization issues. Inspired by a similar problem, recent …

Permutation equivariant neural functionals

A Zhou, K Yang, K Burns, A Cardace… - Advances in neural …, 2023 - proceedings.neurips.cc
This work studies the design of neural networks that can process the weights or gradients of
other neural networks, which we refer to as neural functional networks (NFNs). Despite a …

Theoretical guarantees for permutation-equivariant quantum neural networks

L Schatzki, M Larocca, QT Nguyen, F Sauvage… - npj Quantum …, 2024 - nature.com
Despite the great promise of quantum machine learning models, there are several
challenges one must overcome before unlocking their full potential. For instance, models …

Explainable equivariant neural networks for particle physics: PELICAN

A Bogatskiy, T Hoffman, DW Miller… - Journal of High Energy …, 2024 - Springer
A bstract PELICAN is a novel permutation equivariant and Lorentz invariant or covariant
aggregator network designed to overcome common limitations found in architectures …

Unveiling the secrets of new physics through top quark tagging

R Sahu, S Ashanujjaman, K Ghosh - The European Physical Journal …, 2024 - Springer
The ubiquity of top-rich final states in the context of beyond the Standard Model (BSM)
searches has led to their status as extensively studied signatures at the LHC. Over the past …

PELICAN: Permutation equivariant and Lorentz invariant or covariant aggregator network for particle physics

A Bogatskiy, T Hoffman, DW Miller… - arxiv preprint arxiv …, 2022 - arxiv.org
Many current approaches to machine learning in particle physics use generic architectures
that require large numbers of parameters and disregard underlying physics principles …

Universal neural functionals

A Zhou, C Finn, J Harrison - arxiv preprint arxiv:2402.05232, 2024 - arxiv.org
A challenging problem in many modern machine learning tasks is to process weight-space
features, ie, to transform or extract information from the weights and gradients of a neural …

Brauer's group equivariant neural networks

E Pearce-Crump - International Conference on Machine …, 2023 - proceedings.mlr.press
We provide a full characterisation of all of the possible group equivariant neural networks
whose layers are some tensor power of $\mathbb {R}^{n} $ for three symmetry groups that …

19 parameters is all you need: Tiny neural networks for particle physics

A Bogatskiy, T Hoffman, JT Offermann - arxiv preprint arxiv:2310.16121, 2023 - arxiv.org
As particle accelerators increase their collision rates, and deep learning solutions prove
their viability, there is a growing need for lightweight and fast neural network architectures …