Grammar-Aligned Decoding

K Park, J Wang, T Berg-Kirkpatrick… - arxiv preprint arxiv …, 2024 - arxiv.org
Large Language Models (LLMs) struggle with reliably generating highly structured outputs,
such as program code, mathematical formulas, or well-formed markup. Constrained …

Synthetic programming elicitation for text-to-code in very low-resource programming and formal languages

F Mora, J Wong, H Lepe, S Bhatia… - The Thirty-eighth …, 2024 - openreview.net
Recent advances in large language models (LLMs) for code applications have
demonstrated remarkable zero-shot fluency and instruction following on challenging code …

Approximately Aligned Decoding

D Melcer, S Gonugondla, P Perera, H Qian… - arxiv preprint arxiv …, 2024 - arxiv.org
It is common to reject undesired outputs of Large Language Models (LLMs); however,
current methods to do so require an excessive amount of computation, or severely distort the …