Sequence Summarizing Neural Networks for Spoken Language Recognition

Sequence Summarizing Neural Networks for Spoken Language Recognition

Stať ve sborníku v databázi WoS či Scopus

This paper explores the use of Sequence Summarizing NeuralNetworks (SSNNs) as a variant of deep neural networks(DNNs) for classifying sequences. In this work, it is appliedto the task of spoken language recognition. Unlike other classificationtasks in speech processing where the DNN needs toproduce a per-frame output, language is considered constantduring an utterance. We introduce a summarization componentinto the DNN structure producing one set of language posteriorsper utterance. The training of the DNN is performed byan appropriately modified gradient-descent algorithm. In ourinitial experiments, the SSNN results are compared to a singlestate-of-the-art i-vector based baseline system with a similarcomplexity (i.e. no system fusion, etc.). For some conditions,SSNNs is able to provide performance comparable to the baselinesystem. Relative improvement up to 30% is obtained withthe score level fusion of the baseline and the SSNN systems.

This paper explores the use of Sequence Summarizing NeuralNetworks (SSNNs) as a variant of deep neural networks(DNNs) for classifying sequences. In this work, it is appliedto the task of spoken language recognition. Unlike other classificationtasks in speech processing where the DNN needs toproduce a per-frame output, language is considered constantduring an utterance. We introduce a summarization componentinto the DNN structure producing one set of language posteriorsper utterance. The training of the DNN is performed byan appropriately modified gradient-descent algorithm. In ourinitial experiments, the SSNN results are compared to a singlestate-of-the-art i-vector based baseline system with a similarcomplexity (i.e. no system fusion, etc.). For some conditions,SSNNs is able to provide performance comparable to the baselinesystem. Relative improvement up to 30% is obtained withthe score level fusion of the baseline and the SSNN systems.

Sequence Summarizing Neural Network, DNN,i-vectors

Sequence Summarizing Neural Network, DNN,i-vectors

PEŠÁN, J.; BURGET, L.; ČERNOCKÝ, J.

2017

08.09.2016

International Speech Communication Association

San Francisco

978-1-5108-3313-5

Proceedings of Interspeech 2016

3285

3289

5

https://www.researchgate.net/publication/307889421_Sequence_Summarizing_Neural_Networks_for_Spoken_Language_Recognition

pesan_interspeech2016_IS160764