ID | 116668 |
Author |
Ohta, Kengo
National Institute of Technology, Anan College
|
Keywords | Spoken dialog system
Response type selection
Encoder–decoder model
Multi-task learning
|
Content Type |
Journal Article
|
Description | We propose a method of automatically selecting appropriate responses in conversational spoken dialog systems by explicitly determining the correct response type that is needed first, based on a comparison of the user’s input utterance with many other utterances. Response utterances are then generated based on this response type designation (back channel, changing the topic, expanding the topic, etc.). This allows the generation of more appropriate responses than conventional end-to-end approaches, which only use the user’s input to directly generate response utterances. As a response type selector, we propose an LSTM-based encoder–decoder framework utilizing acoustic and linguistic features extracted from input utterances. In order to extract these features more accurately, we utilize not only input utterances but also response utterances in the training corpus. To do so, multi-task learning using multiple decoders is also investigated.
To evaluate our proposed method, we conducted experiments using a corpus of dialogs between elderly people and an interviewer. Our proposed method outperformed conventional methods using either a point-wise classifier based on Support Vector Machines, or a single-task learning LSTM. The best performance was achieved when our two response type selectors (one trained using acoustic features, and the other trained using linguistic features) were combined, and multi-task learning was also performed. |
Journal Title |
Speech Communication
|
ISSN | 01676393
|
NCID | AA10630135
AA11541653
|
Publisher | Elsevier
|
Volume | 133
|
Start Page | 23
|
End Page | 30
|
Published Date | 2021-07-15
|
Rights | This is an open access article under the CC BY-NC-ND license
(http://creativecommons.org/licenses/by-nc-nd/4.0/). |
EDB ID | |
DOI (Published Version) | |
URL ( Publisher's Version ) | |
FullText File | |
language |
eng
|
TextVersion |
Publisher
|
departments |
Science and Technology
|