Dialog State Tracking: A Neural Reading Comprehension Approach

Dialog Comments

Paper Link

Overview

Architecture

Dialog

A sub-dialog of a dialog D is defined by the values of the constituent slots and hence Dt is defined as .

Encoding

Models

Architecture
  1. Slot Carryover Model - A model to decide if we’ve to carry over the slot value from previous turn or not. This is equal to . Wi is for all slots - the carry over model for all slots is predicted together.
  2. Slot Type Model - For every slot, predict if it belongs to {Yes, No, DontCare, Span}. We concatenate the dialog representation with the question embedding and pass it through a feed forward layer followed by a softmax.
  3. Slot Span Model - The question vector qi acts as the question and the dialog encoding acts as the context. Pick a span within the context that has the slot.

Setup

  1. For slot carry over models, we do a joint prediction and get M binary vector (whether to carry over the value for all slots).
  2. For slot type and slot span models, we treat dialog question pairs (Dt, qi) as separate prediction tasks for each slot.

Results

Paper Accuracy on MultiWoz 2.0
This paper 39.21
HyST (ensemble) 44.22
This paper + JST 47.33

Kaushik Rangadurai

Code. Learn. Explore

Share this post

Comments