Modular deep learning

J Pfeiffer, S Ruder, I Vulić, EM Ponti - arxiv preprint arxiv:2302.11529, 2023 - arxiv.org
Transfer learning has recently become the dominant paradigm of machine learning. Pre-
trained models fine-tuned for downstream tasks achieve better performance with fewer …

Verb classification across languages

O Majewska, A Korhonen - Annual Review of Linguistics, 2023 - annualreviews.org
Recent developments in language modeling have enabled large text encoders to derive a
wealth of linguistic information from raw text corpora without supervision. Their success …

Cross-lingual event detection via optimized adversarial training

LG Nateras, M Van Nguyen… - Proceedings of the 2022 …, 2022 - aclanthology.org
In this work, we focus on Cross-Lingual Event Detection where a model is trained on data
from a source language but its performance is evaluated on data from a second, target …

Hybrid knowledge transfer for improved cross-lingual event detection via hierarchical sample selection

LG Nateras, F Dernoncourt… - Proceedings of the 61st …, 2023 - aclanthology.org
In this paper, we address the Event Detection task under a zero-shot cross-lingual setting
where a model is trained on a source language but evaluated on a distinct target language …

KCD: Knowledge walks and textual cues enhanced political perspective detection in news media

W Zhang, S Feng, Z Chen, Z Lei, J Li, M Luo - arxiv preprint arxiv …, 2022 - arxiv.org
Political perspective detection has become an increasingly important task that can help
combat echo chambers and political polarization. Previous approaches generally focus on …

Linguistically Guided Multilingual NLP: Current Approaches, Challenges, and Future Perspectives

O Majewska, I Vulić, A Korhonen - Algebraic Structures in Natural …, 2022 - taylorfrancis.com
The neural revolution has redefined–and many would argue, undermined–the place of
traditional linguistics in natural language processing. The pace at which large unsupervised …

Retrieving relevant context to align representations for cross-lingual event detection

C Nguyen, L Ngo, T Nguyen - Findings of the Association for …, 2023 - aclanthology.org
We study the problem of cross-lingual transfer learning for event detection (ED) where
models trained on a source language are expected to perform well on data for a new target …

Complex Question Enhanced Transfer Learning for Zero-Shot Joint Information Extraction

Y Zhang, F Meng, Y Chen, J Xu… - IEEE/ACM Transactions …, 2023 - ieeexplore.ieee.org
Zero-shot information extraction (IE) tasks have attracted great attention recently. However,
how to jointly model multiple IE tasks in the zero-shot scenario is still an open question. In …

Adapter-based Approaches to Knowledge-enhanced Language Models--A Survey

A Fichtl, J Vladika, G Groh - arxiv preprint arxiv:2411.16403, 2024 - arxiv.org
Knowledge-enhanced language models (KELMs) have emerged as promising tools to
bridge the gap between large-scale language models and domain-specific knowledge …

PTEKC: pre-training with event knowledge of ConceptNet for cross-lingual event causality identification

E Zhu, Z Yu, Y Huang, S Gao, Y **an - International Journal of Machine …, 2024 - Springer
Event causality identification (ECI) aims to identify causal relations between events in texts.
Although existing event causality identification works based on fine-tuning pre-trained …