[HTML][HTML] Brain-inspired learning in artificial neural networks: a review
Artificial neural networks (ANNs) have emerged as an essential tool in machine learning,
achieving remarkable success across diverse domains, including image and speech …
achieving remarkable success across diverse domains, including image and speech …
General-purpose in-context learning by meta-learning transformers
Modern machine learning requires system designers to specify aspects of the learning
pipeline, such as losses, architectures, and optimizers. Meta-learning, or learning-to-learn …
pipeline, such as losses, architectures, and optimizers. Meta-learning, or learning-to-learn …
Discovering evolution strategies via meta-black-box optimization
Optimizing functions without access to gradients is the remit of black-box methods such as
evolution strategies. While highly general, their learning dynamics are often times heuristic …
evolution strategies. While highly general, their learning dynamics are often times heuristic …
Deep learning: our miraculous year 1990-1991
J Schmidhuber - arxiv preprint arxiv:2005.05744, 2020 - arxiv.org
In 2020-2021, we celebrated that many of the basic ideas behind the deep learning
revolution were published three decades ago within fewer than 12 months in our" Annus …
revolution were published three decades ago within fewer than 12 months in our" Annus …
Deceptive alignment monitoring
As the capabilities of large machine learning models continue to grow, and as the autonomy
afforded to such models continues to expand, the spectre of a new adversary looms: the …
afforded to such models continues to expand, the spectre of a new adversary looms: the …
[HTML][HTML] Scientific integrity and the history of deep learning: The 2021 turing lecture, and the 2018 turing award
J Schmidhuber - 2022 - people.idsia.ch
This is a point-for-point critique of ACM's justification of the ACM AM Turing Award for deep
learning, as well as a critique of the Turing Lecture given by the awardees (published by …
learning, as well as a critique of the Turing Lecture given by the awardees (published by …
[HTML][HTML] Metalearning Machines Learn to Learn (1987)
J Schmidhuber, AI Blog - URL https://people. idsia. ch/juergen …, 2020 - people.idsia.ch
In 2020 we celebrated the 1/3 century anniversary of my first publication on metalearning or
learning to learn: my diploma thesis of 1987[META1](Sec. 1). For its cover I drew a robot that …
learning to learn: my diploma thesis of 1987[META1](Sec. 1). For its cover I drew a robot that …
[HTML][HTML] LeCun's 2022 paper on autonomous machine intelligence rehashes but does not cite essential work of 1990-2015
AI Blog - people.idsia.ch
On 14 June 2022, a science tabloid that published this article[LEC22b](24 June) on LeCun's
report" A Path Towards Autonomous Machine Intelligence"[LEC22a](27 June) sent me a …
report" A Path Towards Autonomous Machine Intelligence"[LEC22a](27 June) sent me a …
[HTML][HTML] Before 1991, no network learned by gradient descent to quickly compute the changes of the fast weight storage of another network or of itself. Such Fast …
J Schmidhuber, AI Blog - people.idsia.ch
End-To-End Differentiable Fast Weights: NNs Learn to Program NNs (1991) Three decades
ago, on 26 March 1991, I described a sequence-processing slow NN that learns by …
ago, on 26 March 1991, I described a sequence-processing slow NN that learns by …