Large language models (LLMs) hold promise to serve complex health information needs but
also have the potential to introduce harm and exacerbate health disparities. Reliably …

Due to the cumbersome nature of human evaluation and limitations of code-based
evaluation, Large Language Models (LLMs) are increasingly being used to assist humans in …

The increasing volume of data in relational databases and the expertise needed for writing
SQL queries pose challenges for users to access and analyze data. Text-to-SQL (Text2SQL) …

Large language models can produce creative and diverse responses. However, to integrate
them into current developer workflows, it is essential to constrain their outputs to follow …

Conversational LLMs function as black box systems, leaving users guessing about why they
see the output they do. This lack of transparency is potentially problematic, especially given …

As large language models (LLMs) become more advanced and impactful, it is increasingly
important to scrutinize the data that they rely upon and produce. What is it to be a dataset …

Abstract Large Language Models (LLMs) can have a transformative effect on a variety of
domains, including education, and it is therefore pressing to understand whether these …

We propose using natural language outlines as a novel modality and interaction surface for
providing AI assistance to developers throughout the software development process. An NL …

Large Language Models (LLMs) have gained significant attention but also raised concerns
due to the risk of misuse. Jailbreak prompts, a popular type of adversarial attack towards …

Evaluating large language models (LLMs) presents unique challenges. While automatic
side-by-side evaluation, also known as LLM-as-a-judge, has become a promising solution …