The gem benchmark: Natural language generation, its evaluation and metrics

S Gehrmann, T Adewumi, K Aggarwal… - ar**
Y Mo, H Zhang, T Kong - 2023 IEEE International Conference …, 2023 - ieeexplore.ieee.org
Language-based communications are essential in human-robot interaction, especially for
the majority of non-expert users. In this paper, we present SeeAsk, an open-world interactive …

Exploring question-specific rewards for generating deep questions

Y **e, L Pan, D Wang, MY Kan, Y Feng - arxiv preprint arxiv:2011.01102, 2020 - arxiv.org
Recent question generation (QG) approaches often utilize the sequence-to-sequence
framework (Seq2Seq) to optimize the log-likelihood of ground-truth questions using teacher …

A spoken language dataset of descriptions for speech-based grounded language learning

GY Kebe, P Higgins, P Jenkins, K Darvish… - Advances in neural …, 2021 - par.nsf.gov
Grounded language acquisition is a major area of research combining aspects of natural
language processing, computer vision, and signal processing, compounded by domain …

Learning better visual dialog agents with pretrained visual-linguistic representation

T Tu, Q **, G Thattai, G Tur… - Proceedings of the …, 2021 - openaccess.thecvf.com
GuessWhat?! is a visual dialog guessing game which incorporates a Questioner agent that
generates a sequence of questions, while an Oracle agent answers the respective questions …

Visual dialogue state tracking for question generation

W Pang, X Wang - Proceedings of the AAAI Conference on Artificial …, 2020 - ojs.aaai.org
GuessWhat?! is a visual dialogue task between a guesser and an oracle. The guesser aims
to locate an object supposed by the oracle oneself in an image by asking a sequence of …

HVLM: Exploring human-like visual cognition and language-memory network for visual dialog

K Sun, C Guo, H Zhang, Y Li - Information Processing & Management, 2022 - Elsevier
Visual dialog, a visual-language task, enables an AI agent to engage in conversation with
humans grounded in a given image. To generate appropriate answers for a series of …

Unified questioner transformer for descriptive question generation in goal-oriented visual dialogue

S Matsumori, K Shingyouchi, Y Abe… - Proceedings of the …, 2021 - openaccess.thecvf.com
Building an interactive artificial intelligence that can ask questions about the real world is
one of the biggest challenges for vision and language problems. In particular, goal-oriented …

Enabling harmonious human-machine interaction with visual-context augmented dialogue system: A review

H Wang, B Guo, Y Zeng, M Chen, Y Ding… - ACM Transactions on …, 2022 - dl.acm.org
The intelligent dialogue system, aiming at communicating with humans harmoniously with
natural language, is brilliant for promoting the advancement of human-machine interaction …