Large Language Models (LLMs) have attracted extensive attention due to their remarkable
performance across various tasks. However, the substantial computational and memory …

Recent advancements in Large Language Models (LLMs) have significantly increased
context window sizes, enabling sophisticated applications but also introducing substantial …

State-of-the-art sequential reasoning in Large Language Models (LLMs) has expanded the
capabilities of Copilots beyond conversational tasks to complex function calling, managing …

The proliferation of Large Language Models (LLMs) with varying capabilities and costs has
created a need for efficient model selection in AI systems. LLM routers address this need by …

The complexity of large language model (LLM) serving workloads has substantially
increased due to the integration with external tool invocations, such as ChatGPT plugins. In …

Recent research in deep learning models has achieved astonishing progress in various
domains, like image classification, text generation, and image generation. With the …

Background. Large Language Models (LLMs) have attracted significant attention from both
academia and industry in recent years. They are revolutionizing many applications …