On the Usage of Phonetic Information for Text-independent Speaker Embedding Extraction

On the Usage of Phonetic Information for Text-independent Speaker Embedding Extraction

Stať ve sborníku v databázi WoS či Scopus

Embeddings extracted by deep neural networks have becomethe state-of-the-art utterance representation in speakerrecognition systems. It has recently been shown that incorporatingframe-level phonetic information in the embedding extractorcan improve the speaker recognition performance. On theother hand, in the final embedding, phonetic information is justan additional source of session variability which may be harmfulto the text-independent speaker recognition task. This suggeststhat at the embedding level phonetic information shouldbe suppressed rather than encouraged. To verify this hypothesis,we perform several experiments that encourage or/and suppressphonetic information at various stages in the network. Ourexperiments confirm that multitask learning is beneficial if itis applied at the frame-level stage of the network, whereas adversarialtraining is beneficial if it is used at the segment-levelstage of the network. Additionally, the combination of thesetwo approaches improves the performance further, resulting inan equal error rate of 3.17% on the VoxCeleb dataset.

Embeddings extracted by deep neural networks have becomethe state-of-the-art utterance representation in speakerrecognition systems. It has recently been shown that incorporatingframe-level phonetic information in the embedding extractorcan improve the speaker recognition performance. On theother hand, in the final embedding, phonetic information is justan additional source of session variability which may be harmfulto the text-independent speaker recognition task. This suggeststhat at the embedding level phonetic information shouldbe suppressed rather than encouraged. To verify this hypothesis,we perform several experiments that encourage or/and suppressphonetic information at various stages in the network. Ourexperiments confirm that multitask learning is beneficial if itis applied at the frame-level stage of the network, whereas adversarialtraining is beneficial if it is used at the segment-levelstage of the network. Additionally, the combination of thesetwo approaches improves the performance further, resulting inan equal error rate of 3.17% on the VoxCeleb dataset.

phonetic information, text-independent speakerverification, adversarial training

phonetic information, text-independent speakerverification, adversarial training

WANG, S.; ROHDIN, J.; BURGET, L.; PLCHOT, O.; QIAN, Y.; YU, K.; ČERNOCKÝ, J.

2020

15.09.2019

International Speech Communication Association

Graz

Proceedings of Interspeech

1990-9772

Proceedings of Interspeech

2019

9

Francouzská republika

1148

1152

5

https://www.isca-speech.org/archive/Interspeech_2019/pdfs/3036.pdf

wang_is2019_193036