Controllable text generation for large language models: A survey

X Liang, H Wang, Y Wang, S Song, J Yang… - arxiv preprint arxiv …, 2024 - arxiv.org
In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated
high text generation quality. However, in real-world applications, LLMs must meet …

Can large language models understand real-world complex instructions?

Q He, J Zeng, W Huang, L Chen, J **ao, Q He… - Proceedings of the …, 2024 - ojs.aaai.org
Large language models (LLMs) can understand human instructions, showing their potential
for pragmatic applications beyond traditional NLP tasks. However, they still struggle with …

Prompt engineering a prompt engineer

Q Ye, M Axmed, R Pryzant, F Khani - arxiv preprint arxiv:2311.05661, 2023 - arxiv.org
Prompt engineering is a challenging yet crucial task for optimizing the performance of large
language models on customized tasks. It requires complex reasoning to examine the …

Cold-attack: Jailbreaking llms with stealthiness and controllability

X Guo, F Yu, H Zhang, L Qin, B Hu - arxiv preprint arxiv:2402.08679, 2024 - arxiv.org
Jailbreaks on large language models (LLMs) have recently received increasing attention.
For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with …

Followbench: A multi-level fine-grained constraints following benchmark for large language models

Y Jiang, Y Wang, X Zeng, W Zhong, L Li, F Mi… - arxiv preprint arxiv …, 2023 - arxiv.org
The ability to follow instructions is crucial for Large Language Models (LLMs) to handle
various real-world applications. Existing benchmarks primarily focus on evaluating pure …

From complex to simple: Enhancing multi-constraint complex instruction following ability of large language models

Q He, J Zeng, Q He, J Liang, Y **ao - arxiv preprint arxiv:2404.15846, 2024 - arxiv.org
It is imperative for Large language models (LLMs) to follow instructions with elaborate
requirements (ie Complex Instructions Following). Yet, it remains under-explored how to …

Cfbench: A comprehensive constraints-following benchmark for llms

T Zhang, Y Shen, W Luo, Y Zhang, H Liang… - arxiv preprint arxiv …, 2024 - arxiv.org
The adeptness of Large Language Models (LLMs) in comprehending and following natural
language instructions is critical for their deployment in sophisticated real-world applications …

Inference-time policy adapters (ipa): Tailoring extreme-scale lms without fine-tuning

X Lu, F Brahman, P West, J Jang, K Chandu… - arxiv preprint arxiv …, 2023 - arxiv.org
While extreme-scale language models have demonstrated exceptional performance on a
variety of language tasks, the degree of control over these language models through pure …

Unlocking Anticipatory Text Generation: A Constrained Approach for Large Language Models Decoding

L Tu, S Yavuz, J Qu, J Xu, R Meng, C **ong… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) have demonstrated a powerful ability for text generation.
However, achieving optimal results with a given prompt or instruction can be challenging …