Give us the facts: Enhancing large language models with knowledge graphs for fact-aware language modeling

L Yang, H Chen, Z Li, X Ding… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Recently, ChatGPT, a representative large language model (LLM), has gained considerable
attention. Due to their powerful emergent abilities, recent LLMs are considered as a possible …

Cognitive mirage: A review of hallucinations in large language models

H Ye, T Liu, A Zhang, W Hua, W Jia - arxiv preprint arxiv:2309.06794, 2023 - arxiv.org
As large language models continue to develop in the field of AI, text generation systems are
susceptible to a worrisome phenomenon known as hallucination. In this study, we …

[PDF][PDF] A survey of large language models

WX Zhao, K Zhou, J Li, T Tang… - arxiv preprint arxiv …, 2023 - paper-notes.zhjwpku.com
Ever since the Turing Test was proposed in the 1950s, humans have explored the mastering
of language intelligence by machine. Language is essentially a complex, intricate system of …

Math-shepherd: Verify and reinforce llms step-by-step without human annotations

P Wang, L Li, Z Shao, RX Xu, D Dai, Y Li… - arxiv preprint arxiv …, 2023 - arxiv.org
In this paper, we present an innovative process-oriented math process reward model
called\textbf {Math-Shepherd}, which assigns a reward score to each step of math problem …

[HTML][HTML] Applying large language models and chain-of-thought for automatic scoring

GG Lee, E Latif, X Wu, N Liu, X Zhai - Computers and Education: Artificial …, 2024 - Elsevier
This study investigates the application of large language models (LLMs), specifically GPT-
3.5 and GPT-4, with Chain-of-Though (CoT) in the automatic scoring of student-written …

Igniting language intelligence: The hitchhiker's guide from chain-of-thought reasoning to language agents

Z Zhang, Y Yao, A Zhang, X Tang, X Ma, Z He… - ACM Computing …, 2023 - dl.acm.org
Large language models (LLMs) have dramatically enhanced the field of language
intelligence, as demonstrably evidenced by their formidable empirical performance across a …

Making large language models better reasoners with alignment

P Wang, L Li, L Chen, F Song, B Lin, Y Cao… - arxiv preprint arxiv …, 2023 - arxiv.org
Reasoning is a cognitive process of using evidence to reach a sound conclusion. The
reasoning capability is essential for large language models (LLMs) to serve as the brain of …

InfinityMath: A Scalable Instruction Tuning Dataset in Programmatic Mathematical Reasoning

BW Zhang, Y Yan, L Li, G Liu - Proceedings of the 33rd ACM …, 2024 - dl.acm.org
Recent advancements in Chain-of-Thoughts (CoT) and Program-of-Thoughts (PoT) methods
have greatly enhanced language models' mathematical reasoning capabilities, facilitating …