Siamese neural networks: An overview

D Chicco - Artificial neural networks, 2021 - Springer
Similarity has always been a key aspect in computer science and statistics. Any time two
element vectors are compared, many different similarity approaches can be used …

Deep learning--based text classification: a comprehensive review

S Minaee, N Kalchbrenner, E Cambria… - ACM computing …, 2021 - dl.acm.org
Deep learning--based models have surpassed classical machine learning--based
approaches in various text classification tasks, including sentiment analysis, news …

Text and code embeddings by contrastive pre-training

A Neelakantan, T Xu, R Puri, A Radford, JM Han… - arxiv preprint arxiv …, 2022 - arxiv.org
Text embeddings are useful features in many applications such as semantic search and
computing text similarity. Previous work typically trains models customized for different use …

Large dual encoders are generalizable retrievers

J Ni, C Qu, J Lu, Z Dai, GH Ábrego, J Ma… - arxiv preprint arxiv …, 2021 - arxiv.org
It has been shown that dual encoders trained on one domain often fail to generalize to other
domains for retrieval tasks. One widespread belief is that the bottleneck layer of a dual …

Promptagator: Few-shot dense retrieval from 8 examples

Z Dai, VY Zhao, J Ma, Y Luan, J Ni, J Lu… - arxiv preprint arxiv …, 2022 - arxiv.org
Much recent research on information retrieval has focused on how to transfer from one task
(typically with abundant supervised data) to various other tasks where supervision is limited …

Dense passage retrieval for open-domain question answering

V Karpukhin, B Oğuz, S Min, P Lewis, L Wu… - arxiv preprint arxiv …, 2020 - arxiv.org
Open-domain question answering relies on efficient passage retrieval to select candidate
contexts, where traditional sparse vector space models, such as TF-IDF or BM25, are the de …

Convolutional 2d knowledge graph embeddings

T Dettmers, P Minervini, P Stenetorp… - Proceedings of the AAAI …, 2018 - ojs.aaai.org
Link prediction for knowledge graphs is the task of predicting missing relationships between
entities. Previous work on link prediction has focused on shallow, fast models which can …

End-to-end training of multi-document reader and retriever for open-domain question answering

D Singh, S Reddy, W Hamilton… - Advances in Neural …, 2021 - proceedings.neurips.cc
We present an end-to-end differentiable training method for retrieval-augmented open-
domain question answering systems that combine information from multiple retrieved …

Open question answering over tables and text

W Chen, MW Chang, E Schlinger, W Wang… - arxiv preprint arxiv …, 2020 - arxiv.org
In open question answering (QA), the answer to a question is produced by retrieving and
then analyzing documents that might contain answers to the question. Most open QA …

Dense x retrieval: What retrieval granularity should we use?

T Chen, H Wang, S Chen, W Yu, K Ma, X Zhao… - arxiv preprint arxiv …, 2023 - arxiv.org
Dense retrieval has become a prominent method to obtain relevant context or world
knowledge in open-domain NLP tasks. When we use a learned dense retriever on a …