Lawbench: Benchmarking legal knowledge of large language models

Z Fei, X Shen, D Zhu, F Zhou, Z Han, S Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Large language models (LLMs) have demonstrated strong capabilities in various aspects.
However, when applying them to the highly specialized, safe-critical legal domain, it is …

[HTML][HTML] UNIQORN: unified question answering over RDF knowledge graphs and natural language text

S Pramanik, J Alabi, RS Roy, G Weikum - Journal of Web Semantics, 2024 - Elsevier
Question answering over RDF data like knowledge graphs has been greatly advanced, with
a number of good systems providing crisp answers for natural language questions or …

Explainable conversational question answering over heterogeneous sources via iterative graph neural networks

P Christmann, R Saha Roy, G Weikum - Proceedings of the 46th …, 2023 - dl.acm.org
In conversational question answering, users express their information needs through a
series of utterances with incomplete context. Typical ConvQA methods rely on a single …

Product question answering in e-commerce: A survey

Y Deng, W Zhang, Q Yu, W Lam - arxiv preprint arxiv:2302.08092, 2023 - arxiv.org
Product question answering (PQA), aiming to automatically provide instant responses to
customer's questions in E-Commerce platforms, has drawn increasing attention in recent …

DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text

W Zhao, Y Liu, T Niu, Y Wan, PS Yu, S Joty… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) have exhibited impressive generation capabilities, but they
suffer from hallucinations when solely relying on their internal knowledge, especially when …

Compmix: A benchmark for heterogeneous question answering

P Christmann, R Saha Roy, G Weikum - … of the ACM on Web Conference …, 2024 - dl.acm.org
Fact-centric question answering (QA) often requires access to multiple, heterogeneous,
information sources. By jointly considering several sources like a knowledge base (KB), a …

Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation

M Kaiser, R Saha Roy, G Weikum - … on Web Search and Data Mining, 2024 - dl.acm.org
Models for conversational question answering (ConvQA) over knowledge graphs (KGs) are
usually trained and tested on benchmarks of gold QA pairs. This implies that training is …

Neural ranking with weak supervision for open-domain question answering: A survey

X Shen, S Vakulenko, M Del Tredici… - Findings of the …, 2023 - aclanthology.org
Neural ranking (NR) has become a key component for open-domain question-answering in
order to access external knowledge. However, training a good NR model requires …

Assessing" Implicit" Retrieval Robustness of Large Language Models

X Shen, R Blloshmi, D Zhu, J Pei, W Zhang - arxiv preprint arxiv …, 2024 - arxiv.org
Retrieval-augmented generation has gained popularity as a framework to enhance large
language models with external knowledge. However, its effectiveness hinges on the …

xPQA: Cross-Lingual Product Question Answering in 12 Languages

X Shen, A Asai, B Byrne… - Proceedings of the 61st …, 2023 - aclanthology.org
Abstract Product Question Answering (PQA) systems are key in e-commerce applications as
they provide responses to customers' questions as they shop for products. While existing …