Recent advances in natural language processing via large pre-trained language models: A survey

B Min, H Ross, E Sulem, APB Veyseh… - ACM Computing …, 2023 - dl.acm.org
Large, pre-trained language models (PLMs) such as BERT and GPT have drastically
changed the Natural Language Processing (NLP) field. For numerous NLP tasks …

Natural language reasoning, a survey

F Yu, H Zhang, P Tiwari, B Wang - ACM Computing Surveys, 2024 - dl.acm.org
This survey article proposes a clearer view of Natural Language Reasoning (NLR) in the
field of Natural Language Processing (NLP), both conceptually and practically …

Zeroquant: Efficient and affordable post-training quantization for large-scale transformers

Z Yao, R Yazdani Aminabadi… - Advances in …, 2022 - proceedings.neurips.cc
How to efficiently serve ever-larger trained natural language models in practice has become
exceptionally challenging even for powerful cloud servers due to their prohibitive …

Efficient methods for natural language processing: A survey

M Treviso, JU Lee, T Ji, B Aken, Q Cao… - Transactions of the …, 2023 - direct.mit.edu
Recent work in natural language processing (NLP) has yielded appealing results from
scaling model parameters and training data; however, using only scale to improve …

Cross-lingual ability of multilingual bert: An empirical study

Z Wang, S Mayhew, D Roth - arxiv preprint arxiv:1912.07840, 2019 - arxiv.org
Recent work has exhibited the surprising cross-lingual abilities of multilingual BERT (M-
BERT)--surprising since it is trained without any cross-lingual objective and with no aligned …

Deep learning for entity matching: A design space exploration

S Mudgal, H Li, T Rekatsinas, AH Doan… - Proceedings of the …, 2018 - dl.acm.org
Entity matching (EM) finds data instances that refer to the same real-world entity. In this
paper we examine applying deep learning (DL) to EM, to understand DL's benefits and …

Transformers as soft reasoners over language

P Clark, O Tafjord, K Richardson - arxiv preprint arxiv:2002.05867, 2020 - arxiv.org
Beginning with McCarthy's Advice Taker (1959), AI has pursued the goal of providing a
system with explicit, general knowledge and having the system reason over that knowledge …

Lambada: Backward chaining for automated reasoning in natural language

M Kazemi, N Kim, D Bhatia, X Xu… - arxiv preprint arxiv …, 2022 - arxiv.org
Remarkable progress has been made on automated reasoning with natural text, by using
Language Models (LMs) and methods such as Chain-of-Thought and Selection-Inference …

Explaining answers with entailment trees

B Dalvi, P Jansen, O Tafjord, Z **e, H Smith… - arxiv preprint arxiv …, 2021 - arxiv.org
Our goal, in the context of open-domain textual question-answering (QA), is to explain
answers by showing the line of reasoning from what is known to the answer, rather than …

Hypothesis only baselines in natural language inference

A Poliak, J Naradowsky, A Haldar, R Rudinger… - arxiv preprint arxiv …, 2018 - arxiv.org
We propose a hypothesis only baseline for diagnosing Natural Language Inference (NLI).
Especially when an NLI dataset assumes inference is occurring based purely on the …