Grammar-Aligned Decoding
Large Language Models (LLMs) struggle with reliably generating highly structured outputs,
such as program code, mathematical formulas, or well-formed markup. Constrained …
such as program code, mathematical formulas, or well-formed markup. Constrained …
Synthetic programming elicitation for text-to-code in very low-resource programming and formal languages
Recent advances in large language models (LLMs) for code applications have
demonstrated remarkable zero-shot fluency and instruction following on challenging code …
demonstrated remarkable zero-shot fluency and instruction following on challenging code …
Approximately Aligned Decoding
It is common to reject undesired outputs of Large Language Models (LLMs); however,
current methods to do so require an excessive amount of computation, or severely distort the …
current methods to do so require an excessive amount of computation, or severely distort the …