Statistical dialog systems (SDSs) are motivated by the need for a data-driven framework that
reduces the cost of laboriously handcrafting complex dialog managers and that provides …

Paid crowd work offers remarkable opportunities for improving productivity, social mobility,
and the global economy by engaging a geographically distributed workforce to complete …

In this paper we give an introduction to using Amazon's Mechanical Turk crowdsourcing
platform for the purpose of collecting data for human language technologies. We survey the …

Acoustic data collection for automatic speech recognition (ASR) purposes is a particularly
challenging task when working with under-resourced languages, many of which are found in …

Speech transcription is an expensive service with high turnaround time for audio files
containing languages spoken in develo** countries and regional accents of well …

The development of an automatic speech recognizer is typically a highly supervised process
involving the specification of phonetic inventories, lexicons, acoustic and language models …

This paper examines the literature on the use of crowdsourcing for speech-related tasks:
speech acquisition, transcription and annotation as well as the assessment of speech …

摘要本文介绍了对话系统的发展历史以及随着对话系统发展而衍生出的多种对话系统评价方法,
从任务型对话系统与开放域对话系统两个方向进行了调研和总结, 分析了不同评价方法的利弊 …

We propose a collaborative filtering (CF) model to predict user satisfaction in SDS
evaluation. Inspired by the use of CF in recommendation systems, where a user's preference …

In this paper, we propose a two-stage transcription task design for crowdsourcing with an
automatic quality control mechanism embedded in each stage. For the first stage, a support …