Biological underpinnings for lifelong learning machines
Biological organisms learn from interactions with their environment throughout their lifetime.
For artificial systems to successfully act and adapt in the real world, it is desirable to similarly …
For artificial systems to successfully act and adapt in the real world, it is desirable to similarly …
A survey of convolutional neural networks: analysis, applications, and prospects
A convolutional neural network (CNN) is one of the most significant networks in the deep
learning field. Since CNN made impressive achievements in many areas, including but not …
learning field. Since CNN made impressive achievements in many areas, including but not …
Interpretable machine learning: Fundamental principles and 10 grand challenges
Interpretability in machine learning (ML) is crucial for high stakes decisions and
troubleshooting. In this work, we provide fundamental principles for interpretable ML, and …
troubleshooting. In this work, we provide fundamental principles for interpretable ML, and …
Neurosymbolic AI: the 3rd wave
Abstract Current advances in Artificial Intelligence (AI) and Machine Learning have achieved
unprecedented impact across research communities and industry. Nevertheless, concerns …
unprecedented impact across research communities and industry. Nevertheless, concerns …
The best game in town: The reemergence of the language-of-thought hypothesis across the cognitive sciences
Mental representations remain the central posits of psychology after many decades of
scrutiny. However, there is no consensus about the representational format (s) of biological …
scrutiny. However, there is no consensus about the representational format (s) of biological …
On the binding problem in artificial neural networks
Contemporary neural networks still fall short of human-level generalization, which extends
far beyond our direct experiences. In this paper, we argue that the underlying cause for this …
far beyond our direct experiences. In this paper, we argue that the underlying cause for this …
Generative adversarial transformers
We introduce the GANsformer, a novel and efficient type of transformer, and explore it for the
task of visual generative modeling. The network employs a bipartite structure that enables …
task of visual generative modeling. The network employs a bipartite structure that enables …
Logic tensor networks
Attempts at combining logic and neural networks into neurosymbolic approaches have been
on the increase in recent years. In a neurosymbolic system, symbolic knowledge assists …
on the increase in recent years. In a neurosymbolic system, symbolic knowledge assists …
Subtab: Subsetting features of tabular data for self-supervised representation learning
T Ucar, E Hajiramezanali… - Advances in Neural …, 2021 - proceedings.neurips.cc
Self-supervised learning has been shown to be very effective in learning useful
representations, and yet much of the success is achieved in data types such as images …
representations, and yet much of the success is achieved in data types such as images …
How to represent part-whole hierarchies in a neural network
G Hinton - Neural Computation, 2023 - direct.mit.edu
This article does not describe a working system. Instead, it presents a single idea about
representation that allows advances made by several different groups to be combined into …
representation that allows advances made by several different groups to be combined into …