Algorithms to estimate Shapley value feature attributions
Feature attributions based on the Shapley value are popular for explaining machine
learning models. However, their estimation is complex from both theoretical and …
learning models. However, their estimation is complex from both theoretical and …
[HTML][HTML] Automated machine learning: Review of the state-of-the-art and opportunities for healthcare
J Waring, C Lindvall, R Umeton - Artificial intelligence in medicine, 2020 - Elsevier
Objective This work aims to provide a review of the existing literature in the field of
automated machine learning (AutoML) to help healthcare professionals better utilize …
automated machine learning (AutoML) to help healthcare professionals better utilize …
Emerging properties in self-supervised vision transformers
In this paper, we question if self-supervised learning provides new properties to Vision
Transformer (ViT) that stand out compared to convolutional networks (convnets). Beyond the …
Transformer (ViT) that stand out compared to convolutional networks (convnets). Beyond the …
[PDF][PDF] The computational limits of deep learning
Deep learning's recent history has been one of achievement: from triumphing over humans
in the game of Go to world-leading performance in image classification, voice recognition …
in the game of Go to world-leading performance in image classification, voice recognition …
Lookahead optimizer: k steps forward, 1 step back
The vast majority of successful deep neural networks are trained using variants of stochastic
gradient descent (SGD) algorithms. Recent attempts to improve SGD can be broadly …
gradient descent (SGD) algorithms. Recent attempts to improve SGD can be broadly …
An overview of online fake news: Characterization, detection, and discussion
Over the recent years, the growth of online social media has greatly facilitated the way
people communicate with each other. Users of online social media share information …
people communicate with each other. Users of online social media share information …
A call for clarity in reporting BLEU scores
M Post - arxiv preprint arxiv:1804.08771, 2018 - arxiv.org
The field of machine translation faces an under-recognized problem because of
inconsistency in the reporting of scores from its dominant metric. Although people refer to" …
inconsistency in the reporting of scores from its dominant metric. Although people refer to" …
Hash layers for large sparse models
We investigate the training of sparse layers that use different parameters for different inputs
based on hashing in large Transformer models. Specifically, we modify the feedforward …
based on hashing in large Transformer models. Specifically, we modify the feedforward …
Neural machine translation: A review
F Stahlberg - Journal of Artificial Intelligence Research, 2020 - jair.org
The field of machine translation (MT), the automatic translation of written text from one
natural language into another, has experienced a major paradigm shift in recent years …
natural language into another, has experienced a major paradigm shift in recent years …
Deep learning for intelligent wireless networks: A comprehensive survey
As a promising machine learning tool to handle the accurate pattern recognition from
complex raw data, deep learning (DL) is becoming a powerful method to add intelligence to …
complex raw data, deep learning (DL) is becoming a powerful method to add intelligence to …