Recent advances in natural language processing via large pre-trained language models: A survey

B Min, H Ross, E Sulem, APB Veyseh… - ACM Computing …, 2023 - dl.acm.org
Large, pre-trained language models (PLMs) such as BERT and GPT have drastically
changed the Natural Language Processing (NLP) field. For numerous NLP tasks …

State-of-the-art generalisation research in NLP: a taxonomy and review

D Hupkes, M Giulianelli, V Dankers, M Artetxe… - arxiv preprint arxiv …, 2022 - arxiv.org
The ability to generalise well is one of the primary desiderata of natural language
processing (NLP). Yet, what'good generalisation'entails and how it should be evaluated is …

Description-driven task-oriented dialog modeling

J Zhao, R Gupta, Y Cao, D Yu, M Wang, H Lee… - arxiv preprint arxiv …, 2022 - arxiv.org
Task-oriented dialogue (TOD) systems are required to identify key information from
conversations for the completion of given tasks. Such information is conventionally specified …

Generative zero-shot prompt learning for cross-domain slot filling with inverse prompting

X Li, L Wang, G Dong, K He, J Zhao, H Lei… - arxiv preprint arxiv …, 2023 - arxiv.org
Zero-shot cross-domain slot filling aims to transfer knowledge from the labeled source
domain to the unlabeled target domain. Existing models either encode slot descriptions and …

[HTML][HTML] Knowledge-aware audio-grounded generative slot filling for limited annotated data

G Sun, C Zhang, I Vulić, P Budzianowski… - Computer Speech & …, 2025 - Elsevier
Manually annotating fine-grained slot-value labels for task-oriented dialogue (ToD) systems
is an expensive and time-consuming endeavour. This motivates research into slot-filling …

A Survey of Ontology Expansion for Conversational Understanding

J Liang, Y Wu, Y Fang, H Fei, L Liao - arxiv preprint arxiv:2410.15019, 2024 - arxiv.org
In the rapidly evolving field of conversational AI, Ontology Expansion (OnExp) is crucial for
enhancing the adaptability and robustness of conversational agents. Traditional models rely …

Compositional task-oriented parsing as abstractive question answering

W Zhao, K Arkoudas, W Sun, C Cardie - arxiv preprint arxiv:2205.02068, 2022 - arxiv.org
Task-oriented parsing (TOP) aims to convert natural language into machine-readable
representations of specific tasks, such as setting an alarm. A popular approach to TOP is to …

Human-in-the-loop evaluation for early misinformation detection: A case study of COVID-19 treatments

E Mendes, Y Chen, W Xu, A Ritter - arxiv preprint arxiv:2212.09683, 2022 - arxiv.org
We present a human-in-the-loop evaluation framework for fact-checking novel
misinformation claims and identifying social media messages that support them. Our …

Qa is the new kr: Question-answer pairs as knowledge bases

WW Cohen, W Chen, M De Jong, N Gupta… - Proceedings of the …, 2023 - ojs.aaai.org
We propose a new knowledge representation (KR) based on knowledge bases (KBs)
derived from text, based on question generation and entity linking. We argue that the …

Zero-shot slot filling with slot-prefix prompting and attention relationship descriptor

Q Luo, L Liu - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
This paper addresses zero-shot slot filling, which tries to build a system that can generalize
to unseen slot types without any training data. The key to zero-shot slot-filling is to match the …