Selfevolve: A code evolution framework via large language models
Large language models (LLMs) have already revolutionized code generation, after being
pretrained on publicly available code data. However, while various methods have been …
pretrained on publicly available code data. However, while various methods have been …
Multilingual machine translation with large language models: Empirical results and analysis
Large language models (LLMs) have demonstrated remarkable potential in handling
multilingual machine translation (MMT). In this paper, we systematically investigate the …
multilingual machine translation (MMT). In this paper, we systematically investigate the …
Pose: Efficient context window extension of llms via positional skip-wise training
Large Language Models (LLMs) are trained with a pre-defined context length, restricting
their use in scenarios requiring long inputs. Previous efforts for adapting LLMs to a longer …
their use in scenarios requiring long inputs. Previous efforts for adapting LLMs to a longer …
Inference scaling for long-context retrieval augmented generation
The scaling of inference computation has unlocked the potential of long-context large
language models (LLMs) across diverse settings. For knowledge-intensive tasks, the …
language models (LLMs) across diverse settings. For knowledge-intensive tasks, the …
Probing the decision boundaries of in-context learning in large language models
In-context learning is an emergent paradigm in large language models (LLMs) that enables
them to generalize to new tasks and domains by simply prompting these models with a few …
them to generalize to new tasks and domains by simply prompting these models with a few …
Multimodal task vectors enable many-shot multimodal in-context learning
The recent success of interleaved Large Multimodal Models (LMMs) in few-shot learning
suggests that in-context learning (ICL) with many examples can be promising for learning …
suggests that in-context learning (ICL) with many examples can be promising for learning …
Evaluating Large Language Models in Echocardiography Reporting: Opportunities and Challenges
Background The increasing need for diagnostic echocardiography (echo) tests presents
challenges in preserving the quality and promptness of reports. While Large Language …
challenges in preserving the quality and promptness of reports. While Large Language …
More is not always better? Enhancing Many-Shot In-Context Learning with Differentiated and Reweighting Objectives
Large language models (LLMs) excel at few-shot in-context learning (ICL) without requiring
parameter updates. However, as the number of ICL demonstrations increases from a few to …
parameter updates. However, as the number of ICL demonstrations increases from a few to …
Vector-ICL: In-context Learning with Continuous Vector Representations
Large language models (LLMs) have shown remarkable in-context learning (ICL)
capabilities on textual data. We explore whether these capabilities can be extended to …
capabilities on textual data. We explore whether these capabilities can be extended to …
A controlled study on long context extension and generalization in llms
Broad textual understanding and in-context learning require language models that utilize full
document contexts. Due to the implementation challenges associated with directly training …
document contexts. Due to the implementation challenges associated with directly training …