The 2011 Dialog System Technology Challenge — formerly the Dialog State Tracking Challenge — is a series of research community challenge tasks for accurately estimating a user’s goal in a spoken dialog system.
The Dialog State Tracking Challenge (DSTC) is an on-going series of research community challenge tasks. Each task released dialog data labeled with dialog state information, such as the user’s desired restaurant search query given all of the dialog history up to the current turn. The challenge is to create a “tracker” that can predict the dialog state for new dialogs. In each challenge, trackers are evaluated using held-out dialog data.
You can find information on the current DTSC8 competition here (opens in new tab).
DSTC1
DSTC1 used human-computer dialogs in the bus timetable domain. Results were presented in a special session at SIGDIAL 2013 (opens in new tab). DSTC1 was organized by Jason D. Williams, Alan Black, Deepak Ramachandran, Antoine Raux.
For DSTC1 data, and more information, see “DSTC1” tabs above.
DSTC2 and DSTC3
DSTC2/3 used human-computer dialogs in the restaurant information domain. Results were presented in special sessions at SIGDIAL 2014 (opens in new tab) and IEEE SLT 2014 (opens in new tab). DSTC2 and 3 were organized by Matthew Henderson, Blaise Thomson, and Jason D. Williams.
For DSTC2 and DSTC3 data, and more information, see the DSTC2/3 website. (opens in new tab)
DSTC4
DSTC4 used human-human dialogs in the tourist information domain. Results were presented at IWSDS 2015 (opens in new tab). DSTC4 was organized by Seokhwan Kim, Luis F. D’Haro, Rafael E Banchs, Matthew Henderson, and Jason D. Williams.
For more information about DSTC4, see the DSTC4 website. (opens in new tab)
DSTC5
DSTC5 used human-human dialogs in the tourist information domain, where training dialogs were provided in one language, and test dialogs were in a different language. Results were presented in a special session at IEEE SLT 2016 (opens in new tab). DSTC5 was organized by Seokhwan Kim, Luis F. D’Haro, Rafael E Banchs, Matthew Henderson, Jason D. Williams, and Koichiro Yoshino.
For more information about DSTC5, see the DSTC5 website. (opens in new tab)
DSTC6
DSTC6 consisted of 3 parallel tracks: End-to-End Goal Oriented Dialog Learning, End-to-End Conversation Modeling, and Dialogue Breakdown Detection. Results will be presented at a workshop immediately after NIPS 2017. DSTC6 is organized by Chiori Hori, Julien Perez, Koichiro Yoshino, and Seokhwan Kim. Tracks were organized by Y-Lan Boureau, Antoine Bordes, Julien Perez, Ryuichi Higashinaka, Chiori Hori, and Takaaki Hori.
For more information about DSTC6, see the DSTC6 website. (opens in new tab)