The cosine router in sparse Mixture of Experts (MoE) has recently emerged as an attractive
alternative to the conventional linear router. Indeed, the cosine router demonstrates …

We conduct the convergence analysis of parameter estimation in the contaminated mixture
of experts. This model is motivated from the prompt learning problem where ones utilize …

Mixture-of-experts (MoE) model incorporates the power of multiple submodels via gating
functions to achieve greater performance in numerous regression and classification …

Most reinforcement learning algorithms seek a single optimal strategy that solves a given
task. However, it can often be valuable to learn a diverse set of solutions, for instance, to …