Eight challenges in develo** theory of intelligence

H Huang - Frontiers in Computational Neuroscience, 2024 - frontiersin.org
A good theory of mathematical beauty is more practical than any current observation, as new
predictions about physical reality can be self-consistently verified. This belief applies to the …

Connectivity structure and dynamics of nonlinear recurrent neural networks

DG Clark, O Marschall, A van Meegen… - arxiv preprint arxiv …, 2024 - arxiv.org
We develop a theory to analyze how structure in connectivity shapes the high-dimensional,
internally generated activity of nonlinear recurrent neural networks. Using two …

An optimization-based equilibrium measure describing fixed points of non-equilibrium dynamics: application to the edge of chaos

J Qiu, H Huang - Communications in Theoretical Physics, 2024 - iopscience.iop.org
Understanding neural dynamics is a central topic in machine learning, non-linear physics,
and neuroscience. However, the dynamics are non-linear, stochastic and particularly non …

Dynamical theory for adaptive systems

TM Pham, K Kaneko - Journal of Statistical Mechanics: Theory …, 2024 - iopscience.iop.org
The study of adaptive dynamics, involving many degrees of freedom on two separated
timescales, one for fast changes of state variables and another for the slow adaptation of …

How high dimensional neural dynamics are confined in phase space

S Wang, H Huang - arxiv preprint arxiv:2410.19348, 2024 - arxiv.org
High dimensional dynamics play a vital role in brain function, ecological systems, and neuro-
inspired machine learning. Where and how these dynamics are confined in the phase space …

Nonequilbrium physics of generative diffusion models

Z Yu, H Huang - Physical Review E, 2025 - APS
Generative diffusion models apply the concept of Langevin dynamics in physics to machine
learning, attracting a lot of interest from engineering, statistics, and physics, but a complete …

Synaptic plasticity alters the nature of chaos transition in neural networks

W Du, H Huang - arxiv preprint arxiv:2412.15592, 2024 - arxiv.org
In realistic neural circuits, both neurons and synapses are coupled in dynamics with
separate time scales. The circuit functions are intimately related to these coupled dynamics …

Network reconstruction may not mean dynamics prediction

Z Yu, H Huang - arxiv preprint arxiv:2409.04240, 2024 - arxiv.org
With an increasing amount of observations on the dynamics of many complex systems, it is
required to reveal the underlying mechanisms behind these complex dynamics, which is …

Fokker-Planck to Callan-Symanzik: evolution of weight matrices under training

W Bu, U Kol, Z Liu - arxiv preprint arxiv:2501.09659, 2025 - arxiv.org
The dynamical evolution of a neural network during training has been an incredibly
fascinating subject of study. First principal derivation of generic evolution of variables in …

Spectral Statistics, Hydrodynamics and Quantum Chaos

M Winer - 2024 - search.proquest.com
One of the central problems in many-body physics, both classical and quantum, is the
relations between different notions of chaos. Ergodicity, mixing, operator growth, the …