Learning Speaker Representation for Neural Network Based Multichannel Speaker Extraction

Learning Speaker Representation for Neural Network Based Multichannel Speaker Extraction

Stať ve sborníku v databázi WoS či Scopus

Recently, schemes employing deep neural networks (DNNs) forextracting speech from noisy observation have demonstratedgreat potential for noise robust automatic speech recognition.However, these schemes are not well suited when the interferingnoise is another speaker. To enable extracting a target speakerfrom a mixture of speakers, we have recently proposed to informthe neural network using speaker information extracted froman adaptation utterance from the same speaker. In our previouswork, we explored ways how to inform the network about thespeaker and found a speaker adaptive layer approach to be suitablefor this task. In our experiments, we used speaker featuresdesigned for speaker recognition tasks as the additional speakerinformation, which may not be optimal for the speaker extractiontask. In this paper, we propose a usage of a sequence summarizingscheme enabling to learn the speaker representation jointlywith the network. Furthermore, we extend the previous experimentsto demonstrate the potential of our proposed methodas a front-end for speech recognition and explore the effect ofadditional noise on the performance of the method.

Recently, schemes employing deep neural networks (DNNs) forextracting speech from noisy observation have demonstratedgreat potential for noise robust automatic speech recognition.However, these schemes are not well suited when the interferingnoise is another speaker. To enable extracting a target speakerfrom a mixture of speakers, we have recently proposed to informthe neural network using speaker information extracted froman adaptation utterance from the same speaker. In our previouswork, we explored ways how to inform the network about thespeaker and found a speaker adaptive layer approach to be suitablefor this task. In our experiments, we used speaker featuresdesigned for speaker recognition tasks as the additional speakerinformation, which may not be optimal for the speaker extractiontask. In this paper, we propose a usage of a sequence summarizingscheme enabling to learn the speaker representation jointlywith the network. Furthermore, we extend the previous experimentsto demonstrate the potential of our proposed methodas a front-end for speech recognition and explore the effect ofadditional noise on the performance of the method.

speaker extraction, speaker adaptive neural network, multi-speaker speech recognition, speaker representation learning, beamforming

speaker extraction, speaker adaptive neural network, multi-speaker speech recognition, speaker representation learning, beamforming

ŽMOLÍKOVÁ, K.; DELCROIX, M.; KINOSHITA, K.; HIGUCHI, T.; OGAWA, A.; NAKATANI, T.

2018

16.12.2017

IEEE Signal Processing Society

Okinawa

978-1-5090-4788-8

Proceedings of ASRU 2017

8

15

8

http://www.fit.vutbr.cz/research/groups/speech/publi/2017/zmolikova_asru2017.pdf