Scientific large language models: A survey on biological & chemical domains

Q Zhang, K Ding, T Lv, X Wang, Q Yin, Y Zhang… - ACM Computing …, 2024 - dl.acm.org
Large Language Models (LLMs) have emerged as a transformative power in enhancing
natural language comprehension, representing a significant stride toward artificial general …

Continual learning of large language models: A comprehensive survey

H Shi, Z Xu, H Wang, W Qin, W Wang, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The recent success of large language models (LLMs) trained on static, pre-collected,
general datasets has sparked numerous research directions and applications. One such …

Rest-mcts*: Llm self-training via process reward guided tree search

D Zhang, S Zhoubian, Z Hu, Y Yue… - Advances in Neural …, 2025 - proceedings.neurips.cc
Recent methodologies in LLM self-training mostly rely on LLM generating responses and
filtering those with correct output answers as training data. This approach often yields a low …

A survey on knowledge distillation of large language models

X Xu, M Li, C Tao, T Shen, R Cheng, J Li, C Xu… - arxiv preprint arxiv …, 2024 - arxiv.org
In the era of Large Language Models (LLMs), Knowledge Distillation (KD) emerges as a
pivotal methodology for transferring advanced capabilities from leading proprietary LLMs …

Scibench: Evaluating college-level scientific problem-solving abilities of large language models

X Wang, Z Hu, P Lu, Y Zhu, J Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Most of the existing Large Language Model (LLM) benchmarks on scientific problem
reasoning focus on problems grounded in high-school subjects and are confined to …

Leveraging biomolecule and natural language through multi-modal learning: A survey

Q Pei, L Wu, K Gao, J Zhu, Y Wang, Z Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The integration of biomolecular modeling with natural language (BL) has emerged as a
promising interdisciplinary area at the intersection of artificial intelligence, chemistry and …

A comprehensive survey of scientific large language models and their applications in scientific discovery

Y Zhang, X Chen, B **, S Wang, S Ji, W Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
In many scientific fields, large language models (LLMs) have revolutionized the way text and
other modalities of data (eg, molecules and proteins) are handled, achieving superior …

Autore: Document-level relation extraction with large language models

L Xue, D Zhang, Y Dong, J Tang - arxiv preprint arxiv:2403.14888, 2024 - arxiv.org
Large Language Models (LLMs) have demonstrated exceptional abilities in comprehending
and generating text, motivating numerous researchers to utilize them for Information …

Sciagent: Tool-augmented language models for scientific reasoning

Y Ma, Z Gou, J Hao, R Xu, S Wang, L Pan… - arxiv preprint arxiv …, 2024 - arxiv.org
Scientific reasoning poses an excessive challenge for even the most advanced Large
Language Models (LLMs). To make this task more practical and solvable for LLMs, we …

[PDF][PDF] A comprehensive survey of small language models in the era of large language models: Techniques, enhancements, applications, collaboration with llms, and …

F Wang, Z Zhang, X Zhang, Z Wu, T Mo, Q Lu… - arxiv preprint arxiv …, 2024 - ai.radensa.ru
Large language models (LLM) have demonstrated emergent abilities in text generation,
question answering, and reasoning, facilitating various tasks and domains. Despite their …