Recent work has improved our ability to detect linguistic knowledge in word representations.
However, current methods for detecting syntactic knowledge do not test whether syntax trees …

Abstract We introduce The Benchmark of Linguistic Minimal Pairs (BLiMP), a challenge set
for evaluating the linguistic knowledge of language models (LMs) on major grammatical …

This paper investigates the ability of artificial neural networks to judge the grammatical
acceptability of a sentence, with the goal of testing their linguistic competence. We introduce …

Humans can attribute beliefs to others. However, it is unknown to what extent this ability
results from an innate biological endowment or from experience accrued through child …

While state-of-the-art neural network models continue to achieve lower perplexity scores on
language modeling benchmarks, it remains unknown whether optimizing for broad …

Human reading behavior is tuned to the statistics of natural language: the time it takes
human subjects to read a word can be predicted from estimates of the word's probability in …

We studied the learnability of English filler-gap dependencies and the “island” constraints on
them by assessing the generalizations made by autoregressive (incremental) language …

To understand what you are reading now, your mind retrieves the meanings of words and
constructions from a linguistic knowledge store (lexico-semantic processing) and identifies …

How should we compare the capabilities of language models (LMs) and humans? In this
article, I draw inspiration from comparative psychology to highlight challenges in these …

Recursive processing in sentence comprehension is considered a hallmark of human
linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We …