Heterogeneous tabular data are the most commonly used form of data and are essential for
numerous critical and computationally demanding applications. On homogeneous datasets …

Attention Model has now become an important concept in neural networks that has been
researched within diverse application domains. This survey provides a structured and …

Large language models have shown promising results in zero-shot settings (Brown et al.,
2020; Radford et al., 2019). For example, they can perform multiple choice tasks simply by …

Recent work in natural language processing (NLP) has yielded appealing results from
scaling model parameters and training data; however, using only scale to improve …

Many approaches have been proposed for time series forecasting, in light of its significance
in wide applications including business demand prediction. However, the existing methods …

Identifying cellular identities is a key use case in single-cell transcriptomics. While machine
learning has been leveraged to automate cell annotation predictions for some time, there …

Nowadays, deep neural networks (DNNs) have become the main instrument for machine
learning tasks within a wide range of domains, including vision, NLP, and speech …

In recent years, larger and deeper models are springing up and continuously pushing state-
of-the-art (SOTA) results across various fields like natural language processing (NLP) and …

Attention mechanisms have become ubiquitous in NLP. Recent architectures, notably the
Transformer, learn powerful context-aware word representations through layered, multi …

Abstract The Mixture-of-Experts (MoE) architecture is showing promising results in improving
parameter sharing in multi-task learning (MTL) and in scaling high-capacity neural networks …