Simulation intelligence: Towards a new generation of scientific methods

A Lavin, D Krakauer, H Zenil, J Gottschlich… - arxiv preprint arxiv …, 2021 - arxiv.org
The original" Seven Motifs" set forth a roadmap of essential methods for the field of scientific
computing, where a motif is an algorithmic method that captures a pattern of computation …

On the power of foundation models

Y Yuan - International Conference on Machine Learning, 2023 - proceedings.mlr.press
With infinitely many high-quality data points, infinite computational power, an infinitely large
foundation model with a perfect training algorithm and guaranteed zero generalization error …

[PDF][PDF] Categorical foundations of gradient-based learning

GSH Cruttwell, B Gavranović, N Ghani… - European …, 2022 - library.oapen.org
We propose a categorical semantics of gradient-based machine learning algorithms in terms
of lenses, parametric maps, and reverse derivative categories. This foundation provides a …

An introduction to string diagrams for computer scientists

R Piedeleu, F Zanasi - arxiv preprint arxiv:2305.08768, 2023 - arxiv.org
This document is an elementary introduction to string diagrams. It takes a computer science
perspective: rather than using category theory as a starting point, we build on intuitions from …

Towards compositional interpretability for xai

S Tull, R Lorenz, S Clark, I Khan, B Coecke - arxiv preprint arxiv …, 2024 - arxiv.org
Artificial intelligence (AI) is currently based largely on black-box machine learning models
which lack interpretability. The field of eXplainable AI (XAI) strives to address this major …

A Category-theoretical Meta-analysis of Definitions of Disentanglement

Y Zhang, M Sugiyama - International Conference on …, 2023 - proceedings.mlr.press
Disentangling the factors of variation in data is a fundamental concept in machine learning
and has been studied in various ways by different researchers, leading to a multitude of …

Causal models in string diagrams

R Lorenz, S Tull - arxiv preprint arxiv:2304.07638, 2023 - arxiv.org
The framework of causal models provides a principled approach to causal reasoning,
applied today across many scientific domains. Here we present this framework in the …

Category theory for quantum natural language processing

A Toumi - arxiv preprint arxiv:2212.06615, 2022 - arxiv.org
This thesis introduces quantum natural language processing (QNLP) models based on a
simple yet powerful analogy between computational linguistics and quantum mechanics …

Topos and stacks of deep neural networks

JC Belfiore, D Bennequin - arxiv preprint arxiv:2106.14587, 2021 - arxiv.org
Every known artificial deep neural network (DNN) corresponds to an object in a canonical
Grothendieck's topos; its learning dynamic corresponds to a flow of morphisms in this topos …

Compositionality as we see it, everywhere around us

B Coecke - The Quantum-Like Revolution: A Festschrift for Andrei …, 2023 - Springer
There are different meanings of the term “compositionality” within science: what one
researcher would call compositional, is not at all compositional for another researcher. The …