A literature survey of recent advances in chatbots

G Caldarini, S Jaf, K McGarry - Information, 2022 - mdpi.com
Chatbots are intelligent conversational computer systems designed to mimic human
conversation to enable automated online guidance and support. The increased benefits of …

Continual learning of large language models: A comprehensive survey

H Shi, Z Xu, H Wang, W Qin, W Wang, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The recent success of large language models (LLMs) trained on static, pre-collected,
general datasets has sparked numerous research directions and applications. One such …

Knowledge conflicts for llms: A survey

R Xu, Z Qi, Z Guo, C Wang, H Wang, Y Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
This survey provides an in-depth analysis of knowledge conflicts for large language models
(LLMs), highlighting the complex challenges they encounter when blending contextual and …

Towards continual knowledge learning of language models

J Jang, S Ye, S Yang, J Shin, J Han, G Kim… - arxiv preprint arxiv …, 2021 - arxiv.org
Large Language Models (LMs) are known to encode world knowledge in their parameters
as they pretrain on a vast amount of web corpus, which is often utilized for performing …

Towards lifelong learning of large language models: A survey

J Zheng, S Qiu, C Shi, Q Ma - ACM Computing Surveys, 2024 - dl.acm.org
As the applications of large language models (LLMs) expand across diverse fields, their
ability to adapt to ongoing changes in data, tasks, and user preferences becomes crucial …

Temporalwiki: A lifelong benchmark for training and evaluating ever-evolving language models

J Jang, S Ye, C Lee, S Yang, J Shin, J Han… - arxiv preprint arxiv …, 2022 - arxiv.org
Language Models (LMs) become outdated as the world changes; they often fail to perform
tasks requiring recent factual information which was absent or different during training, a …

Interactive natural language processing

Z Wang, G Zhang, K Yang, N Shi, W Zhou… - arxiv preprint arxiv …, 2023 - arxiv.org
Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within
the field of NLP, aimed at addressing limitations in existing frameworks while aligning with …

BioLORD-2023: semantic textual representations fusing large language models and clinical knowledge graph insights

F Remy, K Demuynck… - Journal of the American …, 2024 - academic.oup.com
Objective In this study, we investigate the potential of large language models (LLMs) to
complement biomedical knowledge graphs in the training of semantic models for the …

Few-shot bot: Prompt-based learning for dialogue systems

A Madotto, Z Lin, GI Winata, P Fung - arxiv preprint arxiv:2110.08118, 2021 - arxiv.org
Learning to converse using only a few examples is a great challenge in conversational AI.
The current best conversational models, which are either good chit-chatters (eg, BlenderBot) …

When do prompting and prefix-tuning work? a theory of capabilities and limitations

A Petrov, PHS Torr, A Bibi - arxiv preprint arxiv:2310.19698, 2023 - arxiv.org
Context-based fine-tuning methods, including prompting, in-context learning, soft prompting
(also known as prompt tuning), and prefix-tuning, have gained popularity due to their ability …