Biological underpinnings for lifelong learning machines

D Kudithipudi, M Aguilar-Simon, J Babb… - Nature Machine …, 2022 - nature.com
Biological organisms learn from interactions with their environment throughout their lifetime.
For artificial systems to successfully act and adapt in the real world, it is desirable to similarly …

A survey of convolutional neural networks: analysis, applications, and prospects

Z Li, F Liu, W Yang, S Peng… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
A convolutional neural network (CNN) is one of the most significant networks in the deep
learning field. Since CNN made impressive achievements in many areas, including but not …

Interpretable machine learning: Fundamental principles and 10 grand challenges

C Rudin, C Chen, Z Chen, H Huang… - Statistic …, 2022 - projecteuclid.org
Interpretability in machine learning (ML) is crucial for high stakes decisions and
troubleshooting. In this work, we provide fundamental principles for interpretable ML, and …

Neurosymbolic AI: the 3rd wave

AA Garcez, LC Lamb - Artificial Intelligence Review, 2023 - Springer
Abstract Current advances in Artificial Intelligence (AI) and Machine Learning have achieved
unprecedented impact across research communities and industry. Nevertheless, concerns …

The best game in town: The reemergence of the language-of-thought hypothesis across the cognitive sciences

J Quilty-Dunn, N Porot, E Mandelbaum - Behavioral and Brain …, 2023 - cambridge.org
Mental representations remain the central posits of psychology after many decades of
scrutiny. However, there is no consensus about the representational format (s) of biological …

On the binding problem in artificial neural networks

K Greff, S Van Steenkiste, J Schmidhuber - arxiv preprint arxiv …, 2020 - arxiv.org
Contemporary neural networks still fall short of human-level generalization, which extends
far beyond our direct experiences. In this paper, we argue that the underlying cause for this …

Generative adversarial transformers

DA Hudson, L Zitnick - International conference on machine …, 2021 - proceedings.mlr.press
We introduce the GANsformer, a novel and efficient type of transformer, and explore it for the
task of visual generative modeling. The network employs a bipartite structure that enables …

Logic tensor networks

S Badreddine, AA Garcez, L Serafini, M Spranger - Artificial Intelligence, 2022 - Elsevier
Attempts at combining logic and neural networks into neurosymbolic approaches have been
on the increase in recent years. In a neurosymbolic system, symbolic knowledge assists …

Subtab: Subsetting features of tabular data for self-supervised representation learning

T Ucar, E Hajiramezanali… - Advances in Neural …, 2021 - proceedings.neurips.cc
Self-supervised learning has been shown to be very effective in learning useful
representations, and yet much of the success is achieved in data types such as images …

How to represent part-whole hierarchies in a neural network

G Hinton - Neural Computation, 2023 - direct.mit.edu
This article does not describe a working system. Instead, it presents a single idea about
representation that allows advances made by several different groups to be combined into …