Abstract Language models serve as a cornerstone in natural language processing, utilizing
mathematical methods to generalize language laws and knowledge for prediction and …

What does it take to create the Babel Fish, a tool that can help individuals translate speech
between any two languages? While recent breakthroughs in text-based models have …

Generating text with autoregressive language models (LMs) is of great importance to many
natural language processing (NLP) applications. Previous solutions for this task often …

Current automated systems have crucial limitations that need to be addressed before
artificial intelligence can reach human-like levels and bring new technological revolutions …

Large language models (LLMs) can perform impressive feats with in-context learning or
lightweight finetuning. It is natural to wonder how well these models adapt to genuinely new …

Curation methods for massive vision-language datasets trade off between dataset size and
quality. However even the highest quality of available curated captions are far too short to …

In today's digital age, accessing information across language barriers poses a significant
challenge, with conventional search systems often struggling to interpret and retrieve …

This research paper proposes an approach called Lingua Franca that improves machine
translation quality by utilizing information from a knowledge graph to translate named …

In the current landscape of automatic language generation, there is a need to understand,
evaluate, and mitigate demographic biases as existing models are becoming increasingly …

Benchmark contamination refers to the presence of test datasets in Large Language Model
(LLM) pre-training or post-training data. Contamination can lead to inflated scores on …