Large language model (llm) for telecommunications: A comprehensive survey on principles, key techniques, and opportunities

H Zhou, C Hu, Y Yuan, Y Cui, Y **… - … Surveys & Tutorials, 2024 - ieeexplore.ieee.org
Large language models (LLMs) have received considerable attention recently due to their
outstanding comprehension and reasoning capabilities, leading to great progress in many …

Llm-based edge intelligence: A comprehensive survey on architectures, applications, security and trustworthiness

O Friha, MA Ferrag, B Kantarci… - IEEE Open Journal …, 2024 - ieeexplore.ieee.org
The integration of Large Language Models (LLMs) and Edge Intelligence (EI) introduces a
groundbreaking paradigm for intelligent edge devices. With their capacity for human-like …

Personal llm agents: Insights and survey about the capability, efficiency and security

Y Li, H Wen, W Wang, X Li, Y Yuan, G Liu, J Liu… - arxiv preprint arxiv …, 2024 - arxiv.org
Since the advent of personal computing devices, intelligent personal assistants (IPAs) have
been one of the key technologies that researchers and engineers have focused on, aiming …

Towards efficient generative large language model serving: A survey from algorithms to systems

X Miao, G Oliaro, Z Zhang, X Cheng, H **… - arxiv preprint arxiv …, 2023 - arxiv.org
In the rapidly evolving landscape of artificial intelligence (AI), generative large language
models (LLMs) stand at the forefront, revolutionizing how we interact with our data. However …

{Cost-Efficient} large language model serving for multi-turn conversations with {CachedAttention}

B Gao, Z He, P Sharma, Q Kang, D Jevdjic… - 2024 USENIX Annual …, 2024 - usenix.org
Interacting with humans through multi-turn conversations is a fundamental feature of large
language models (LLMs). However, existing LLM serving engines executing multi-turn …

Llm inference unveiled: Survey and roofline model insights

Z Yuan, Y Shang, Y Zhou, Z Dong, Z Zhou… - arxiv preprint arxiv …, 2024 - arxiv.org
The field of efficient Large Language Model (LLM) inference is rapidly evolving, presenting a
unique blend of opportunities and challenges. Although the field has expanded and is …

Beyond the limits: A survey of techniques to extend the context length in large language models

X Wang, M Salmani, P Omidi, X Ren… - arxiv preprint arxiv …, 2024 - arxiv.org
Recently, large language models (LLMs) have shown remarkable capabilities including
understanding context, engaging in logical reasoning, and generating responses. However …

Llm as a system service on mobile devices

W Yin, M Xu, Y Li, X Liu - arxiv preprint arxiv:2403.11805, 2024 - arxiv.org
Being more powerful and intrusive into user-device interactions, LLMs are eager for on-
device execution to better preserve user privacy. In this work, we propose a new paradigm of …

Small language models: Survey, measurements, and insights

Z Lu, X Li, D Cai, R Yi, F Liu, X Zhang, ND Lane… - arxiv preprint arxiv …, 2024 - arxiv.org
Small language models (SLMs), despite their widespread adoption in modern smart
devices, have received significantly less academic attention compared to their large …

A Review on edge large language models: Design, Execution, and Applications

Y Zheng, Y Chen, B Qian, X Shi, Y Shu… - ACM Computing …, 2024 - dl.acm.org
Large language models (LLMs) have revolutionized natural language processing with their
exceptional understanding, synthesizing, and reasoning capabilities. However, deploying …