Can large language models reason about program invariants?

K Pei, D Bieber, K Shi, C Sutton… - … Conference on Machine …, 2023 - proceedings.mlr.press
Identifying invariants is an important program analysis task with applications towards
program understanding, bug finding, vulnerability analysis, and formal verification. Existing …

Traced: Execution-aware pre-training for source code

Y Ding, B Steenhoek, K Pei, G Kaiser, W Le… - Proceedings of the 46th …, 2024 - dl.acm.org
Most existing pre-trained language models for source code focus on learning the static code
text, typically augmented with static code structures (abstract syntax tree, dependency …

Learned interpreters: structural and learned systematicity in neural networks for program execution

D Bieber - 2023 - papyrus.bib.umontreal.ca
General purpose deep neural network architectures have made startling advances in
machine learning for code, advancing code completion, enabling natural language …