Abstract
Although quite natural for human beings to communicate based on their own personality in daily life, it is rather challenging for neural dialog systems to do the same. This is because the general dialog systems are difficult to generate diverse responses while at the same time maintaining consistent persona information. Existing methods basically focus on merely one of them, ignoring either of them will reduce the quality of dialog. In this work, we propose a two-stage generation framework to promote the persona-consistency and diversity of responses. In the first stage, we propose a persona-guided conditional variational autoencoder (persona-guided CVAE) to generate diverse responses, and the main difference when compared with general CVAE-based model is that we use additional dialog attribute to assist the latent variables to encode the effective information in the response and further use it as a guiding vector for response generation. In the second stage, we employ persona-consistency checking module and the response rewriting module to mask the inconsistent word in the generated response prototype and rewrite it to more consistent. Automatic evaluation results demonstrate that the proposed model is able to generate diverse and persona-consistent responses.
| Original language | English |
|---|---|
| Pages (from-to) | 1552-1562 |
| Number of pages | 11 |
| Journal | IEEE Transactions on Neural Networks and Learning Systems |
| Volume | 34 |
| Issue number | 3 |
| Early online date | 30 Aug 2021 |
| DOIs | |
| Publication status | Published - Mar 2023 |
| Externally published | Yes |
Bibliographical note
Publisher Copyright:© 2012 IEEE.
Funding
This work was supported in part by the National Natural Science Foundation of China under Grant 61860206008, Grant 61773081, Grant 61933012, and Grant 61833013.
Keywords
- Persona-consistency check
- persona-guided conditional variational autoencoder (persona-guided CVAE)
- response rewrite
- two-stage generation framework