Challenges and applications of large language models

J Kaddour, J Harris, M Mozes, H Bradley… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) went from non-existent to ubiquitous in the machine
learning discourse within a few years. Due to the fast pace of the field, it is difficult to identify …

Knowledge editing for large language models: A survey

S Wang, Y Zhu, H Liu, Z Zheng, C Chen, J Li - ACM Computing Surveys, 2024 - dl.acm.org
Large Language Models (LLMs) have recently transformed both the academic and industrial
landscapes due to their remarkable capacity to understand, analyze, and generate texts …

Editing large language models: Problems, methods, and opportunities

Y Yao, P Wang, B Tian, S Cheng, Z Li, S Deng… - arxiv preprint arxiv …, 2023 - arxiv.org
Despite the ability to train capable LLMs, the methodology for maintaining their relevancy
and rectifying errors remains elusive. To this end, the past few years have witnessed a surge …

Continual learning of large language models: A comprehensive survey

H Shi, Z Xu, H Wang, W Qin, W Wang, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The recent success of large language models (LLMs) trained on static, pre-collected,
general datasets has sparked numerous research directions and applications. One such …

Myvlm: Personalizing vlms for user-specific queries

Y Alaluf, E Richardson, S Tulyakov, K Aberman… - … on Computer Vision, 2024 - Springer
Recent large-scale vision-language models (VLMs) have demonstrated remarkable
capabilities in understanding and generating textual descriptions for visual content …

Editing factual knowledge and explanatory ability of medical large language models

D Xu, Z Zhang, Z Zhu, Z Lin, Q Liu, X Wu, T Xu… - Proceedings of the 33rd …, 2024 - dl.acm.org
Model editing aims to precisely alter the behaviors of large language models (LLMs) in
relation to specific knowledge, while leaving unrelated knowledge intact. This approach has …

Melo: Enhancing model editing with neuron-indexed dynamic lora

L Yu, Q Chen, J Zhou, L He - Proceedings of the AAAI Conference on …, 2024 - ojs.aaai.org
Large language models (LLMs) have shown great success in various Natural Language
Processing (NLP) tasks, whist they still need updates after deployment to fix errors or keep …

AKEW: Assessing knowledge editing in the wild

X Wu, L Pan, WY Wang, LA Tuan - Proceedings of the 2024 …, 2024 - aclanthology.org
Abstract Knowledge editing injects knowledge updates into language models to keep them
correct and up-to-date. However, its current evaluations deviate significantly from practice …

Trends in integration of knowledge and large language models: A survey and taxonomy of methods, benchmarks, and applications

Z Feng, W Ma, W Yu, L Huang, H Wang, Q Chen… - arxiv preprint arxiv …, 2023 - arxiv.org
Large language models (LLMs) exhibit superior performance on various natural language
tasks, but they are susceptible to issues stemming from outdated data and domain-specific …

Continual learning with pre-trained models: A survey

DW Zhou, HL Sun, J Ning, HJ Ye, DC Zhan - arxiv preprint arxiv …, 2024 - arxiv.org
Nowadays, real-world applications often face streaming data, which requires the learning
system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve …