Survey on frontiers of language and robotics

T Taniguchi, D Mochihashi, T Nagai, S Uchida… - Advanced …, 2019 - Taylor & Francis
The understanding and acquisition of a language in a real-world environment is an
important task for future robotics services. Natural language processing and cognitive …

[PDF][PDF] Parsing with compositional vector grammars

R Socher, J Bauer, CD Manning… - Proceedings of the 51st …, 2013 - aclanthology.org
Natural language parsing has typically been done with small sets of discrete categories
such as NP and VP, but this representation does not capture the full syntactic nor semantic …

Physics of language models: Part 1, context-free grammar

Z Allen-Zhu, Y Li - arxiv preprint arxiv:2305.13673, 2023 - arxiv.org
We design experiments to study $\textit {how} $ generative language models, like GPT, learn
context-free grammars (CFGs)--diverse language systems with a tree-like structure capturing …

[КНИГА][B] Handbook of natural language processing

N Indurkhya, FJ Damerau - 2010 - taylorfrancis.com
The Handbook of Natural Language Processing, Second Edition presents practical tools
and techniques for implementing natural language processing in computer systems. Along …

Compound probabilistic context-free grammars for grammar induction

Y Kim, C Dyer, AM Rush - arxiv preprint arxiv:1906.10225, 2019 - arxiv.org
We study a formalization of the grammar induction problem that models sentences as being
generated by a compound probabilistic context-free grammar. In contrast to traditional …

[PDF][PDF] Learning accurate, compact, and interpretable tree annotation

S Petrov, L Barrett, R Thibaux… - Proceedings of the 21st …, 2006 - aclanthology.org
We present an automatic approach to tree annotation in which basic nonterminal symbols
are alternately split and merged to maximize the likelihood of a training treebank. Starting …

Unsupervised recurrent neural network grammars

Y Kim, AM Rush, L Yu, A Kuncoro, C Dyer… - arxiv preprint arxiv …, 2019 - arxiv.org
Recurrent neural network grammars (RNNG) are generative models of language which
jointly model syntax and surface structure by incrementally generating a syntax tree and …

A latent variable model for generative dependency parsing

I Titov, J Henderson - Trends in Parsing Technology: Dependency Parsing …, 2010 - Springer
Dependency parsing has been a topic of active research in natural language processing
during the last several years. The CoNLL-2006 shared task (Buchholz and Marsi, 2006) …

[PDF][PDF] Improved inference for unlexicalized parsing

S Petrov, D Klein - … Technologies 2007: The Conference of the …, 2007 - aclanthology.org
We present several improvements to unlexicalized parsing with hierarchically state-split
PCFGs. First, we present a novel coarse-to-fine method in which a grammar's own …

[PDF][PDF] Simple semi-supervised dependency parsing

T Koo, X Carreras, M Collins - Proceedings of ACL-08: HLT, 2008 - aclanthology.org
We present a simple and effective semisupervised method for training dependency parsers.
We focus on the problem of lexical representation, introducing features that incorporate word …