A Unified Analysis of Stochastic Gradient Descent with Arbitrary Data Permutations and Beyond

Y Li, X Lyu, Z Liu - arxiv preprint arxiv:2501.16117, 2025 - arxiv.org
We aim to provide a unified convergence analysis for permutation-based Stochastic
Gradient Descent (SGD), where data examples are permuted before each epoch. By …