Leandojo: Theorem proving with retrieval-augmented language models

K Yang, A Swope, A Gu, R Chalamala… - Advances in …, 2024 - proceedings.neurips.cc
Large language models (LLMs) have shown promise in proving formal theorems using proof
assistants such as Lean. However, existing methods are difficult to reproduce or build on …

Lego-prover: Neural theorem proving with growing libraries

H Wang, H **n, C Zheng, L Li, Z Liu, Q Cao… - arxiv preprint arxiv …, 2023 - arxiv.org
Despite the success of large language models (LLMs), the task of theorem proving still
remains one of the hardest reasoning tasks that is far from being fully solved. Prior methods …

G-llava: Solving geometric problem with multi-modal large language model

J Gao, R Pi, J Zhang, J Ye, W Zhong, Y Wang… - arxiv preprint arxiv …, 2023 - arxiv.org
Large language models (LLMs) have shown remarkable proficiency in human-level
reasoning and generation capabilities, which encourages extensive research on their …

Deepseek-prover-v1. 5: Harnessing proof assistant feedback for reinforcement learning and monte-carlo tree search

H **n, ZZ Ren, J Song, Z Shao, W Zhao… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce DeepSeek-Prover-V1. 5, an open-source language model designed for
theorem proving in Lean 4, which enhances DeepSeek-Prover-V1 by optimizing both …

Lean-github: Compiling github lean repositories for a versatile lean prover

Z Wu, J Wang, D Lin, K Chen - arxiv preprint arxiv:2407.17227, 2024 - arxiv.org
Recently, large language models have presented promising results in aiding formal
mathematical reasoning. However, their performance is restricted due to the scarcity of …

A survey of neural code intelligence: Paradigms, advances and beyond

Q Sun, Z Chen, F Xu, K Cheng, C Ma, Z Yin… - arxiv preprint arxiv …, 2024 - arxiv.org
Neural Code Intelligence--leveraging deep learning to understand, generate, and optimize
code--holds immense potential for transformative impacts on the whole society. Bridging the …

Lyra: Orchestrating dual correction in automated theorem proving

C Zheng, H Wang, E **e, Z Liu, J Sun, H **n… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) present an intriguing avenue for exploration in the field of
formal theorem proving. Nevertheless, their full potential, particularly concerning the …

Sego: Sequential subgoal optimization for mathematical problem-solving

X Zhao, X Huang, W Bi, L Kong - arxiv preprint arxiv:2310.12960, 2023 - arxiv.org
Large Language Models (LLMs) have driven substantial progress in artificial intelligence in
recent years, exhibiting impressive capabilities across a wide range of tasks, including …

A Survey on Deep Learning for Theorem Proving

Z Li, J Sun, L Murphy, Q Su, Z Li, X Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
Theorem proving is a fundamental aspect of mathematics, spanning from informal reasoning
in mathematical language to rigorous derivations in formal systems. In recent years, the …

Beyond autoregression: Discrete diffusion for complex reasoning and planning

J Ye, J Gao, S Gong, L Zheng, X Jiang, Z Li… - arxiv preprint arxiv …, 2024 - arxiv.org
Autoregressive language models, despite their impressive capabilities, struggle with
complex reasoning and long-term planning tasks. We introduce discrete diffusion models as …