Large language models (LLMs) are a special class of pretrained language models (PLMs)
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …

In this work, we explore how to train task-specific language models aimed towards learning
rich representation of keyphrases from text documents. We experiment with different …

Keyphrase prediction aims to generate phrases (keyphrases) that highly summarizes a
given document. Recently, researchers have conducted in-depth studies on this task from …

Stance detection aims to detect the stance toward a corresponding target. Existing works
use the assumption that the target is known in advance, which is often not the case in the …

Keyphrase generation (KG) aims to summarize the main ideas of a document into a set of
keyphrases. A new setting is recently introduced into this problem, in which, given a …

Transformer-based language models, including ChatGPT, have demonstrated exceptional
performance in various natural language generation tasks. However, there has been limited …

Machine learning (ML) datasets, often perceived as neutral, inherently encapsulate abstract
and disputed social constructs. Dataset curators frequently employ value-laden terms such …

Keyphrase extraction is a subtask of natural language processing referring to the automatic
extraction of salient terms that semantically capture the key themes and topics of a …

Despite recent efforts to develop large language models with robust long-context
capabilities, the lack of long-context benchmarks means that relatively little is known about …

Generating absent keyphrases, which do not appear in the input document, is challenging in
the keyphrase prediction task. Most previous works treat the problem as an autoregressive …