Magnitude and angle dynamics in training single ReLU neurons

[Free GPT-4]
[DeepSeek]
[PDF] arxiv.org

Don't Fear Peculiar Activation Functions: EUAF and Beyond

Q Wang, S Zhang, D Zeng, Z **e, H Guo, FL Fan… - arxiv preprint arxiv …, 2024 - arxiv.org
In this paper, we propose a new super-expressive activation function called the Parametric
Elementary Universal Activation Function (PEUAF). We demonstrate the effectiveness of …
저장 인용 1회 인용 관련 학술자료 전체 2개의 버전 HTML 버전