Efficient deep learning: A survey on making deep learning models smaller, faster, and better

G Menghani - ACM Computing Surveys, 2023 - dl.acm.org
Deep learning has revolutionized the fields of computer vision, natural language
understanding, speech recognition, information retrieval, and more. However, with the …

The four smarts of Industry 4.0: Evolution of ten years of research and future perspectives

B Meindl, NF Ayala, J Mendonça, AG Frank - … Forecasting and Social …, 2021 - Elsevier
The Industry 4.0 literature has exponentially grown in the past decade. We aim to
understand how this literature has evolved and propose future research opportunities. We …

Image segmentation using text and image prompts

T Lüddecke, A Ecker - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
Image segmentation is usually addressed by training a model for a fixed set of object
classes. Incorporating additional classes or more complex queries later is expensive as it …

Learning word vectors for 157 languages

E Grave, P Bojanowski, P Gupta, A Joulin… - arxiv preprint arxiv …, 2018 - arxiv.org
Distributed word representations, or word vectors, have recently been applied to many tasks
in natural language processing, leading to state-of-the-art performance. A key ingredient to …

Arabert: Transformer-based model for arabic language understanding

W Antoun, F Baly, H Hajj - arxiv preprint arxiv:2003.00104, 2020 - arxiv.org
The Arabic language is a morphologically rich language with relatively few resources and a
less explored syntax compared to English. Given these limitations, Arabic Natural Language …

Prior guided feature enrichment network for few-shot segmentation

Z Tian, H Zhao, M Shu, Z Yang, R Li… - IEEE transactions on …, 2020 - ieeexplore.ieee.org
State-of-the-art semantic segmentation methods require sufficient labeled data to achieve
good results and hardly work on unseen classes without fine-tuning. Few-shot segmentation …

BoolQ: Exploring the surprising difficulty of natural yes/no questions

C Clark, K Lee, MW Chang, T Kwiatkowski… - arxiv preprint arxiv …, 2019 - arxiv.org
In this paper we study yes/no questions that are naturally occurring---meaning that they are
generated in unprompted and unconstrained settings. We build a reading comprehension …

Universal adversarial triggers for attacking and analyzing NLP

E Wallace, S Feng, N Kandpal, M Gardner… - arxiv preprint arxiv …, 2019 - arxiv.org
Adversarial examples highlight model vulnerabilities and are useful for evaluation and
interpretation. We define universal adversarial triggers: input-agnostic sequences of tokens …

What you can cram into a single vector: Probing sentence embeddings for linguistic properties

A Conneau, G Kruszewski, G Lample, L Barrault… - arxiv preprint arxiv …, 2018 - arxiv.org
Although much effort has recently been devoted to training high-quality sentence
embeddings, we still have a poor understanding of what they are capturing." Downstream" …

CCNet: Extracting high quality monolingual datasets from web crawl data

G Wenzek, MA Lachaux, A Conneau… - arxiv preprint arxiv …, 2019 - arxiv.org
Pre-training text representations have led to significant improvements in many areas of
natural language processing. The quality of these models benefits greatly from the size of …