DSTC11
The Eleventh Dialog System Technology Challenge
News
The DSTC11 workshop was held on September 11 at the SIGdial-INLG 2023 joint conference in Prague. Registration is required for both in-person and remote attendees, but registration is free for remote participants who are not presenting any papers. To access links to Zoom (talks) and Discord (virtual posters), please visit the conference's online participation page. As this page prompts you to create an account, please use the email address associated with your Eventbrite registration.
DSTC11 papers will appear in the ACL anthology soon after the workshop. We will post a link in the news section once they are available.
Sep 11, 2023 - We continue to welcome DSTC12 track proposals (deadline TBA).
Aug 29, 2023 - Workshop program updated to align coffee breaks with other workshops.
Aug 29, 2023 - Presentation instructions for talks and posters posted along the workshop program.
Aug 8, 2023 - List of accepted papers along with presentation format has been posted.
Aug 8, 2023 - List of best papers has been posted.
Older news can be found here.
Overview
Starting as an initiative to provide a common testbed for the task of Dialog State Tracking, the first Dialog State Tracking Challenge (DSTC) was organized in 2013, followed by DSTC2&3 in 2014, DSTC4 in 2015, and DSTC5 in 2016. Given the remarkable success of the first five editions, and understanding both, the complexity of the dialog phenomenon and the interest of the research community in a wider variety of dialog related problems, the DSTC rebranded itself as "Dialog System Technology Challenges" for its sixth edition. Then, DSTC6, DSTC7, DSTC8, DSTC9, and DSTC10 have been completed in in 2017-2021.
In this eleventh challenge, the call for task proposals has resulted into the following 5 different tracks split across two sessions: (1) Ambiguous Candidate Identification and Coreference Resolution for Immersive Multimodal Conversations, (2) Intent Induction from Conversations for Task-Oriented Dialogue, (3) Speech-Aware Dialog Systems Technology Challenge, (4) Robust and Multilingual Automatic Evaluation Metrics for Open-Domain Dialogue Systems and (5) Task-oriented Conversational Modeling with Subjective Knowledge. The objective of these tracks is to invite interested organizations conduct dialog related challenges in specific areas of research and under the umbrella of the DSTC.
We express our gratitude to Amazon for providing financial support to DSTC11.
