Dense text retrieval based on pretrained language models: A survey

WX Zhao, J Liu, R Ren, JR Wen - ACM Transactions on Information …, 2024 - dl.acm.org
Text retrieval is a long-standing research topic on information seeking, where a system is
required to return relevant information resources to user's queries in natural language. From …

Zero-shot stance detection via contrastive learning

B Liang, Z Chen, L Gui, Y He, M Yang… - Proceedings of the ACM …, 2022 - dl.acm.org
Zero-shot stance detection (ZSSD) is challenging as it requires detecting the stance of
previously unseen targets during the inference stage. Being able to detect the target-related …

Jointcl: A joint contrastive learning framework for zero-shot stance detection

B Liang, Q Zhu, X Li, M Yang, L Gui… - Proceedings of the …, 2022 - wrap.warwick.ac.uk
Zero-shot stance detection (ZSSD) aims to detect the stance for an unseen target during the
inference stage. In this paper, we propose a joint contrastive learning (JointCL) framework …

Contrastive data and learning for natural language processing

R Zhang, Y Ji, Y Zhang… - Proceedings of the 2022 …, 2022 - aclanthology.org
Current NLP models heavily rely on effective representation learning algorithms. Contrastive
learning is one such technique to learn an embedding space such that similar data sample …

Salient phrase aware dense retrieval: can a dense retriever imitate a sparse one?

X Chen, K Lakhotia, B Oğuz, A Gupta, P Lewis… - arxiv preprint arxiv …, 2021 - arxiv.org
Despite their recent popularity and well-known advantages, dense retrievers still lag behind
sparse methods such as BM25 in their ability to reliably match salient phrases and rare …

Retrieval contrastive learning for aspect-level sentiment classification

Z Jian, J Li, Q Wu, J Yao - Information Processing & Management, 2024 - Elsevier
Abstract Aspect-Level Sentiment Classification (ALSC) aims to assign specific sentiments to
a sentence toward different aspects, which is one of the crucial challenges in the field of …

Data augmentation for sample efficient and robust document ranking

A Anand, J Leonhardt, J Singh, K Rudra… - ACM Transactions on …, 2024 - dl.acm.org
Contextual ranking models have delivered impressive performance improvements over
classical models in the document ranking task. However, these highly over-parameterized …

Mixed-modality representation learning and pre-training for joint table-and-text retrieval in openqa

J Huang, W Zhong, Q Liu, M Gong, D Jiang… - arxiv preprint arxiv …, 2022 - arxiv.org
Retrieving evidences from tabular and textual resources is essential for open-domain
question answering (OpenQA), which provides more comprehensive information. However …

Aligning cross-lingual sentence representations with dual momentum contrast

L Wang, W Zhao, J Liu - arxiv preprint arxiv:2109.00253, 2021 - arxiv.org
In this paper, we propose to align sentence representations from different languages into a
unified embedding space, where semantic similarities (both cross-lingual and monolingual) …

Enhancing text comprehension for question answering with contrastive learning

S Lee, M Lee - Proceedings of the 8th Workshop on …, 2023 - aclanthology.org
Abstract Although Question Answering (QA) have advanced to the human-level language
skills in NLP tasks, there is still a problem: the QA model gets confused when there are …