Recent advances in natural language processing via large pre-trained language models: A survey

B Min, H Ross, E Sulem, APB Veyseh… - ACM Computing …, 2023 - dl.acm.org
Large, pre-trained language models (PLMs) such as BERT and GPT have drastically
changed the Natural Language Processing (NLP) field. For numerous NLP tasks …

Joint entity and relation extraction with span pruning and hypergraph neural networks

Z Yan, S Yang, W Liu, K Tu - arxiv preprint arxiv:2310.17238, 2023 - arxiv.org
Entity and Relation Extraction (ERE) is an important task in information extraction. Recent
marker-based pipeline models achieve state-of-the-art performance, but still suffer from the …

Dependency parsing as mrc-based span-span prediction

L Gan, Y Meng, K Kuang, X Sun, C Fan, F Wu… - arxiv preprint arxiv …, 2021 - arxiv.org
Higher-order methods for dependency parsing can partially but not fully address the issue
that edges in dependency trees should be constructed at the text span/subtree level rather …

Dependency parsing via sequence generation

B Lin, Z Yao, J Shi, S Cao, B Tang, S Li… - Findings of the …, 2022 - aclanthology.org
Dependency parsing aims to extract syntactic dependency structure or semantic
dependency structure for sentences. Existing methods for dependency parsing include …

UDapter: Typology-based language adapters for multilingual dependency parsing and sequence labeling

A Üstün, A Bisazza, G Bouma, G Noord - Computational Linguistics, 2022 - direct.mit.edu
Recent advances in multilingual language modeling have brought the idea of a truly
universal parser closer to reality. However, such models are still not immune to the “curse of …

Enhancing structure-aware encoder with extremely limited data for graph-based dependency parsing

Y Tian, Y Song, F **a - … of the 29th International Conference on …, 2022 - aclanthology.org
Dependency parsing is an important fundamental natural language processing task which
analyzes the syntactic structure of an input sentence by illustrating the syntactic relations …

[HTML][HTML] Dependency parsing with bottom-up hierarchical pointer networks

D Fernández-González, C Gómez-Rodríguez - Information Fusion, 2023 - Elsevier
Dependency parsing is a crucial step towards deep language understanding and, therefore,
widely demanded by numerous Natural Language Processing applications. In particular, left …

[HTML][HTML] Improving the performance of graph based dependency parsing by guiding bi-affine layer with augmented global and local features

M Altıntaş, AC Tantuğ - Intelligent Systems with Applications, 2023 - Elsevier
The growing interaction between humans and machines raises the necessity to more
sophisticated tools for natural language understanding. Dependency parsing is crucial for …

Modeling Instance Interactions for Joint Information Extraction with Neural High-Order Conditional Random Field

Z Jia, Z Yan, W Han, Z Zheng, K Tu - arxiv preprint arxiv:2212.08929, 2022 - arxiv.org
Prior works on joint Information Extraction (IE) typically model instance (eg, event triggers,
entities, roles, relations) interactions by representation enhancement, type dependencies …

Headed-span-based projective dependency parsing

S Yang, K Tu - arxiv preprint arxiv:2108.04750, 2021 - arxiv.org
We propose a new method for projective dependency parsing based on headed spans. In a
projective dependency tree, the largest subtree rooted at each word covers a contiguous …