Teaching arithmetic to small transformers

N Lee, K Sreenivasan, JD Lee, K Lee… - arxiv preprint arxiv …, 2023 - arxiv.org
Large language models like GPT-4 exhibit emergent capabilities across general-purpose
tasks, such as basic arithmetic, when trained on extensive text data, even though these tasks …

Adversarial crowdsourcing through robust rank-one matrix completion

Q Ma, A Olshevsky - Advances in Neural Information …, 2020 - proceedings.neurips.cc
We consider the problem of reconstructing a rank-one matrix from a revealed subset of its
entries when some of the revealed entries are corrupted with perturbations that are unknown …

A characterization of deterministic sampling patterns for low-rank matrix completion

DL Pimentel-Alarcón, N Boston… - IEEE Journal of …, 2016 - ieeexplore.ieee.org
Low-rank matrix completion (LRMC) problems arise in a wide variety of applications.
Previous theory mainly provides conditions for completion under missing-at-random …

Active feature acquisition with supervised matrix completion

SJ Huang, M Xu, MK **e, M Sugiyama, G Niu… - Proceedings of the 24th …, 2018 - dl.acm.org
Feature missing is a serious problem in many applications, which may lead to low quality of
training data and further significantly degrade the learning performance. While feature …

Algebraic systems biology: a case study for the Wnt pathway

E Gross, HA Harrington, Z Rosen… - Bulletin of mathematical …, 2016 - Springer
Steady-state analysis of dynamical systems for biological networks gives rise to algebraic
varieties in high-dimensional spaces whose study is of interest in their own right. We …

A guidable nonlocal low-rank approximation model for hyperspectral image denoising

Y Chen, J Zhang, J Zeng, W Lai, X Gui, TX Jiang - Signal Processing, 2024 - Elsevier
Hyperspectral image (HSI) denoising is an essential preprocessing step for improving HSI
applications. Recently, subspace-based nonlocal low-rank approximation (SNLR) methods …

Weighted matrix completion from non-random, non-uniform sampling patterns

S Foucart, D Needell, R Pathak, Y Plan… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
We study the matrix completion problem when the observation pattern is deterministic and
possibly non-uniform. We propose a simple and efficient debiased projection scheme for …

Self-adaptive matrix completion for heart rate estimation from face videos under realistic conditions

N Sebe, X Alameda-Pineda, S Tulyakov… - US Patent …, 2019 - Google Patents
Recent studies in computer vision have shown that, while practically invisible to a human
observer, skin color changes due to blood flow can be captured on face videos and …

A new theory for matrix completion

G Liu, Q Liu, X Yuan - Advances in Neural Information …, 2017 - proceedings.neurips.cc
Prevalent matrix completion theories reply on an assumption that the locations of the
missing data are distributed uniformly and randomly (ie, uniform sampling). Nevertheless …

Efficient identification of butterfly sparse matrix factorizations

L Zheng, E Riccietti, R Gribonval - SIAM Journal on Mathematics of Data …, 2023 - SIAM
Fast transforms correspond to factorizations of the form, where each factor is sparse and
possibly structured. This paper investigates essential uniqueness of such factorizations, ie …