Efficient Natural Language Response Suggestion for Smart Reply
- Smart Reply Dual Encoder architecture for GMail-like applications.
- Dual encoder architecture with shared weights across the message and response.
- Instead of choosing negatives for every batch and minimize log loss.
- The negatives would largely include popular labels.
- Offset this by having language model based probability of a label (pre-computed) to combine this with the dual encoder score.
Code. Learn. Explore