Can the Spectrum of the Neural Tangent Kernel Anticipate Fine-Tuning Performance?

ZR Afzal, T Esmaeilbeig, M Soltanalian… - … Models: Evolving AI …, 2024‏ - openreview.net
Parameter-Efficient Fine-tuning (PEFT) offers a scalable and resource-efficient solution for
adaptating large models. Despite its popularity, the mechanisms underlying the performance …