On the concrete hardness of learning with errors

MR Albrecht, R Player, S Scott - Journal of Mathematical Cryptology, 2015 - degruyter.com
The learning with errors (LWE) problem has become a central building block of modern
cryptographic constructions. This work collects and presents hardness results for concrete …

Discovering faster matrix multiplication algorithms with reinforcement learning

A Fawzi, M Balog, A Huang, T Hubert… - Nature, 2022 - nature.com
Improving the efficiency of algorithms for fundamental computations can have a widespread
impact, as it can affect the overall speed of a large amount of computations. Matrix …

A refined laser method and faster matrix multiplication

J Alman, VV Williams - TheoretiCS, 2024 - theoretics.episciences.org
The complexity of matrix multiplication is measured in terms of 𝜔, the smallest real number
such that two 𝑛× 𝑛 matrices can be multiplied using 𝑂 (𝑛 𝜔+ 𝜖) field operations for all 𝜖> 0; …

Simple linear attention language models balance the recall-throughput tradeoff

S Arora, S Eyuboglu, M Zhang, A Timalsina… - arxiv preprint arxiv …, 2024 - arxiv.org
Recent work has shown that attention-based language models excel at recall, the ability to
ground generations in tokens previously seen in context. However, the efficiency of attention …

Zoology: Measuring and improving recall in efficient language models

S Arora, S Eyuboglu, A Timalsina, I Johnson… - arxiv preprint arxiv …, 2023 - arxiv.org
Attention-free language models that combine gating and convolutions are growing in
popularity due to their efficiency and increasingly competitive performance. To better …

Tensor attention training: Provably efficient learning of higher-order transformers

Y Liang, Z Shi, Z Song, Y Zhou - arxiv preprint arxiv:2405.16411, 2024 - arxiv.org
Tensor Attention, a multi-view attention that is able to capture high-order correlations among
multiple modalities, can overcome the representational limitations of classical matrix …

Powers of tensors and fast matrix multiplication

F Le Gall - Proceedings of the 39th international symposium on …, 2014 - dl.acm.org
This paper presents a method to analyze the powers of a given trilinear form (a special kind
of algebraic construction also called a tensor) and obtain upper bounds on the asymptotic …

Faster computation of isogenies of large prime degree

DJ Bernstein, L De Feo, A Leroux, B Smith - Open Book Series, 2020 - msp.org
Abstract Let ℰ∕ 𝔽 q be an elliptic curve, and P a point in ℰ (𝔽 q) of prime order ℓ. Vélu's
formulæ let us compute a quotient curve ℰ′= ℰ∕⟨ P⟩ and rational maps defining a …

A faster interior point method for semidefinite programming

H Jiang, T Kathuria, YT Lee… - 2020 IEEE 61st …, 2020 - ieeexplore.ieee.org
Semidefinite programs (SDPs) are a fundamental class of optimization problems with
important recent applications in approximation algorithms, quantum complexity, robust …

Multiplying matrices faster than Coppersmith-Winograd

VV Williams - Proceedings of the forty-fourth annual ACM symposium …, 2012 - dl.acm.org
Multiplying matrices faster than coppersmith-winograd Page 1 Multiplying Matrices Faster Than
Coppersmith-Winograd [Extended Abstract] Virginia Vassilevska Williams University of …