ALIGNMEET: A comprehensive tool for meeting annotation, alignment, and evaluation

P Polák, M Singh, A Nedoluzhko, O Bojar - arxiv preprint arxiv …, 2022 - arxiv.org
Summarization is a challenging problem, and even more challenging is to manually create,
correct, and evaluate the summaries. The severity of the problem grows when the inputs are …

Alanno: An active learning annotation system for mortals

J Jukić, F Jelenić, M Bićanić, J Šnajder - arxiv preprint arxiv:2211.06224, 2022 - arxiv.org
Supervised machine learning has become the cornerstone of today's data-driven society,
increasing the need for labeled data. However, the process of acquiring labels is often …

ChatHF: Collecting Rich Human Feedback from Real-time Conversations

A Li, Z Wang, E Mendes, D Le, W Xu… - Proceedings of the 2024 …, 2024 - aclanthology.org
We introduce ChatHF, an interactive annotation framework for chatbot evaluation, which
integrates configurable annotation within a chat interface. ChatHF can be flexibly configured …

BotEval: Facilitating Interactive Human Evaluation

H Cho, T Gowda, Y Huang, Z Lu, T Tong… - arxiv preprint arxiv …, 2024 - arxiv.org
Following the rapid progress in natural language processing (NLP) models, language
models are applied to increasingly more complex interactive tasks such as negotiations and …

Ezcat: an easy conversation annotation tool

G Guibon, L Lefeuvre, M Labeau… - 13th Conference on …, 2022 - hal.science
Users generate content constantly, leading to new data requiring annotation. Among this
data, textual conversations are created every day and come with some specificities: they are …

Toward data-driven collaborative dialogue systems: the JILDA dataset

I Sucameli, A Lenci, B Magnini… - … . Italian Journal of …, 2021 - journals.openedition.org
Today's goal-oriented dialogue systems are designed to operate in restricted domains and
with the implicit assumption that the user goals fit the domain ontology of the system. Under …

Dialogue act and slot recognition in Italian complex dialogues

I Sucameli, M De Quattro, A Eshghi… - Proceedings of the …, 2022 - aclanthology.org
Since the advent of Transformer-based, pretrained language models (LM) such as BERT,
Natural Language Understanding (NLU) components in the form of Dialogue Act …

Multilanguage chatbot with artificial intelligence for client support

JMS Sá - 2023 - search.proquest.com
A inteligência artificial surgiu nos anos 50, com a criação de um espaço de estudo com o
objetivo principal de desenvolver máquinas inteligentes. A sua evolução foi abrupta e hoje …