Efficient deep learning: A survey on making deep learning models smaller, faster, and better
G Menghani - ACM Computing Surveys, 2023 - dl.acm.org
Deep learning has revolutionized the fields of computer vision, natural language
understanding, speech recognition, information retrieval, and more. However, with the …
understanding, speech recognition, information retrieval, and more. However, with the …
The four smarts of Industry 4.0: Evolution of ten years of research and future perspectives
The Industry 4.0 literature has exponentially grown in the past decade. We aim to
understand how this literature has evolved and propose future research opportunities. We …
understand how this literature has evolved and propose future research opportunities. We …
Image segmentation using text and image prompts
Image segmentation is usually addressed by training a model for a fixed set of object
classes. Incorporating additional classes or more complex queries later is expensive as it …
classes. Incorporating additional classes or more complex queries later is expensive as it …
Learning word vectors for 157 languages
Distributed word representations, or word vectors, have recently been applied to many tasks
in natural language processing, leading to state-of-the-art performance. A key ingredient to …
in natural language processing, leading to state-of-the-art performance. A key ingredient to …
Arabert: Transformer-based model for arabic language understanding
The Arabic language is a morphologically rich language with relatively few resources and a
less explored syntax compared to English. Given these limitations, Arabic Natural Language …
less explored syntax compared to English. Given these limitations, Arabic Natural Language …
Prior guided feature enrichment network for few-shot segmentation
State-of-the-art semantic segmentation methods require sufficient labeled data to achieve
good results and hardly work on unseen classes without fine-tuning. Few-shot segmentation …
good results and hardly work on unseen classes without fine-tuning. Few-shot segmentation …
BoolQ: Exploring the surprising difficulty of natural yes/no questions
In this paper we study yes/no questions that are naturally occurring---meaning that they are
generated in unprompted and unconstrained settings. We build a reading comprehension …
generated in unprompted and unconstrained settings. We build a reading comprehension …
Universal adversarial triggers for attacking and analyzing NLP
Adversarial examples highlight model vulnerabilities and are useful for evaluation and
interpretation. We define universal adversarial triggers: input-agnostic sequences of tokens …
interpretation. We define universal adversarial triggers: input-agnostic sequences of tokens …
What you can cram into a single vector: Probing sentence embeddings for linguistic properties
Although much effort has recently been devoted to training high-quality sentence
embeddings, we still have a poor understanding of what they are capturing." Downstream" …
embeddings, we still have a poor understanding of what they are capturing." Downstream" …
CCNet: Extracting high quality monolingual datasets from web crawl data
Pre-training text representations have led to significant improvements in many areas of
natural language processing. The quality of these models benefits greatly from the size of …
natural language processing. The quality of these models benefits greatly from the size of …