Simplicity bias in transformers and their ability to learn sparse boolean functions

S Bhattamishra, A Patel, V Kanade… - arxiv preprint arxiv …, 2022 - arxiv.org
Despite the widespread success of Transformers on NLP tasks, recent works have found
that they struggle to model several formal languages when compared to recurrent models …

Degree and sensitivity: tails of two distributions

P Gopalan, R Servedio, A Tal, A Wigderson - arxiv preprint arxiv …, 2016 - arxiv.org
The sensitivity of a Boolean function f is the maximum over all inputs x, of the number of
sensitive coordinates of x. The well-known sensitivity conjecture of Nisan (see also Nisan …

Low-sensitivity functions from unambiguous certificates

S Ben-David, P Hatami, A Tal - arxiv preprint arxiv:1605.07084, 2016 - arxiv.org
We provide new query complexity separations against sensitivity for total Boolean functions:
a power $3 $ separation between deterministic (and even randomized or quantum) query …

Sensitivity conjecture and log-rank conjecture for functions with small alternating numbers

C Lin, S Zhang - arxiv preprint arxiv:1602.06627, 2016 - arxiv.org
The Sensitivity Conjecture and the Log-rank Conjecture are among the most important and
challenging problems in concrete complexity. Incidentally, the Sensitivity Conjecture is …

Sensitivity versus certificate complexity of boolean functions

A Ambainis, K Prūsis, J Vihrovs - International Computer Science …, 2016 - Springer
Sensitivity, block sensitivity and certificate complexity are basic complexity measures of
Boolean functions. The famous sensitivity conjecture claims that sensitivity is polynomially …

Smooth boolean functions are easy: Efficient algorithms for low-sensitivity functions

P Gopalan, N Nisan, RA Servedio, K Talwar… - Proceedings of the …, 2016 - dl.acm.org
A natural measure of smoothness of a Boolean function is its sensitivity (the largest number
of Hamming neighbors of a point which differ from it in function value). The structure of …

Relationships between the number of inputs and other complexity measures of Boolean functions

J Wellens - arxiv preprint arxiv:2005.00566, 2020 - arxiv.org
We generalize and extend the ideas in a recent paper of Chiarelli, Hatami and Saks to prove
new bounds on the number of relevant variables for boolean functions in terms of a variety of …

On the sensitivity conjecture for disjunctive normal forms

S Tavenas - arxiv preprint arxiv:1607.05189, 2016 - arxiv.org
The sensitivity conjecture of Nisan and Szegedy [CC'94] asks whether for any Boolean
function $ f $, the maximum sensitivity $ s (f) $, is polynomially related to its block sensitivity …

On the sensitivity conjecture for read-k formulas

M Bafna, SV Lokam, S Tavenas… - … Foundations of Computer …, 2016 - hal.science
Various combinatorial/algebraic parameters are used to quantify the complexity of a
Boolean function. Among them, sensitivity is one of the simplest and block sensitivity is one …

On the sensitivity conjecture

A Tal - … on Automata, Languages, and Programming (ICALP …, 2016 - drops.dagstuhl.de
The sensitivity of a Boolean function f:{0, 1}^ n->{0, 1} is the maximal number of neighbors a
point in the Boolean hypercube has with different f-value. Roughly speaking, the block …