Due to the significance and value in human-computer interaction and natural language
processing, task-oriented dialog systems are attracting more and more attention in both …

With the emergence of various information access systems exhibiting increasing complexity,
there is a critical need for sound and scalable means of automatic evaluation. To address …

In this paper, we survey the methods and concepts developed for the evaluation of dialogue
systems. Evaluation, in and of itself, is a crucial part during the development process. Often …

Conversational information access is an emerging research area. Currently, human
evaluation is used for end-to-end system evaluation, which is both very time and resource …

In this paper, we study the problem of data augmentation for language understanding in task-
oriented dialogue system. In contrast to previous work which augments an utterance without …

Zero-Shot Object Navigation (ZSON) enables agents to navigate towards open-vocabulary
objects in unknown environments. The existing works of ZSON mainly focus on following …

Evaluation is crucial in the development process of task-oriented dialogue systems. As an
evaluation method, user simulation allows us to tackle issues such as scalability and cost …

One of the difficulties in training dialogue systems is the lack of training data. We explore the
possibility of creating dialogue data through the interaction between a dialogue system and …

We present ConvLab, an open-source multi-domain end-to-end dialog system platform, that
enables researchers to quickly set up experiments with reusable components and compare …

Many studies have applied reinforcement learning to train a dialog policy and show great
promise these years. One common approach is to employ a user simulator to obtain a large …