Dissociating language and thought in large language models

K Mahowald, AA Ivanova, IA Blank, N Kanwisher… - Trends in cognitive …, 2024 - cell.com
Large language models (LLMs) have come closest among all models to date to mastering
human language, yet opinions about their linguistic and cognitive capabilities remain split …

[PDF][PDF] Language model behavior: A comprehensive survey

TA Chang, BK Bergen - Computational Linguistics, 2024 - direct.mit.edu
Transformer language models have received widespread public attention, yet their
generated text is often surprising even to NLP researchers. In this survey, we discuss over …

[HTML][HTML] Modern language models refute Chomsky's approach to language

ST Piantadosi - From fieldwork to linguistic theory: A tribute to …, 2023 - books.google.com
Modern machine learning has subverted and bypassed the theoretical framework of
Chomsky's generative approach to linguistics, including its core claims to particular insights …

Call for Papers--The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus

A Warstadt, L Choshen, A Mueller, A Williams… - arxiv preprint arxiv …, 2023 - arxiv.org
We present the call for papers for the BabyLM Challenge: Sample-efficient pretraining on a
developmentally plausible corpus. This shared task is intended for participants with an …

Large language models demonstrate the potential of statistical learning in language

P Contreras Kallens… - Cognitive …, 2023 - Wiley Online Library
To what degree can language be acquired from linguistic input alone? This question has
vexed scholars for millennia and is still a major focus of debate in the cognitive science of …

[PDF][PDF] Does ChatGPT resemble humans in language use?

Large language models (LLMs) and LLM-driven chatbots such as ChatGPT have shown
remarkable capacities in comprehending and producing language. However, their internal …

How poor is the stimulus? Evaluating hierarchical generalization in neural networks trained on child-directed speech

A Yedetore, T Linzen, R Frank, RT McCoy - arxiv preprint arxiv …, 2023 - arxiv.org
When acquiring syntax, children consistently choose hierarchical rules over competing non-
hierarchical possibilities. Is this preference due to a learning bias for hierarchical structure …

Mission: Impossible language models

J Kallini, I Papadimitriou, R Futrell, K Mahowald… - arxiv preprint arxiv …, 2024 - arxiv.org
Chomsky and others have very directly claimed that large language models (LLMs) are
equally capable of learning languages that are possible and impossible for humans to learn …

Language models as models of language

R Millière - arxiv preprint arxiv:2408.07144, 2024 - arxiv.org
This chapter critically examines the potential contributions of modern language models to
theoretical linguistics. Despite their focus on engineering goals, these models' ability to …

Why large language models are poor theories of human linguistic cognition: A reply to Piantadosi

R Katzir - Biolinguistics, 2023 - bioling.psychopen.eu
In a recent manuscript entitled “Modern language models refute Chomsky's approach to
language”, Steven Piantadosi proposes that large language models such as GPT-3 can …