Detail publikačního výsledku

Semi-Supervised Bootstrapping Approach For Neural Network Feature Extractor Training

GRÉZL, F.; KARAFIÁT, M.

Originální název

Semi-Supervised Bootstrapping Approach For Neural Network Feature Extractor Training

Anglický název

Semi-Supervised Bootstrapping Approach For Neural Network Feature Extractor Training

Druh

Stať ve sborníku mimo WoS a Scopus

Originální abstrakt

This paper presents bootstrapping approach for training the Bottle-Neck neural networkfeature extractor which provides features  for subsequent GMM-HMM recognizer. One can use this recognizer to automatically transcribe the unsupervised data and assign the confidence of the transcription. Based on the confidence, segmentsare selected and mixed with supervised data and newNNs are trained. The automatic transcription can recover 40-55% in comparison to manually transcribed data. This is 3 to 5% absolute improvement over NN trainedon supervised data only. Using 70-85% of automaticallytranscribed segments with the highest confidence was foundoptimal to achieve this result. Dropping the rest of the data prevents training on low quality transcripts.

Anglický abstrakt

This paper presents bootstrapping approach for training the Bottle-Neck neural networkfeature extractor which provides features  for subsequent GMM-HMM recognizer. One can use this recognizer to automatically transcribe the unsupervised data and assign the confidence of the transcription. Based on the confidence, segmentsare selected and mixed with supervised data and newNNs are trained. The automatic transcription can recover 40-55% in comparison to manually transcribed data. This is 3 to 5% absolute improvement over NN trainedon supervised data only. Using 70-85% of automaticallytranscribed segments with the highest confidence was foundoptimal to achieve this result. Dropping the rest of the data prevents training on low quality transcripts.

Klíčová slova

Semi-supervised training, bootstrapping,bottle-neck features

Klíčová slova v angličtině

Semi-supervised training, bootstrapping,bottle-neck features

Autoři

GRÉZL, F.; KARAFIÁT, M.

Rok RIV

2014

Vydáno

08.12.2013

Nakladatel

IEEE Signal Processing Society

Místo

Olomouc

ISBN

978-1-4799-2755-5

Kniha

Proceedings of ASRU 2013

Strany od

470

Strany do

475

Strany počet

6

URL

http://www.fit.vutbr.cz/research/groups/speech/publi/2013/grezl_asru2013_0000470.pdf

Plný text v Digitální knihovně

http://hdl.handle.net/

BibTex

@inproceedings{BUT105972,
  author="František {Grézl} and Martin {Karafiát}",
  title="Semi-Supervised Bootstrapping Approach For Neural Network Feature Extractor Training",
  booktitle="Proceedings of ASRU 2013",
  year="2013",
  pages="470--475",
  publisher="IEEE Signal Processing Society",
  address="Olomouc",
  isbn="978-1-4799-2755-5",
  url="http://www.fit.vutbr.cz/research/groups/speech/publi/2013/grezl_asru2013_0000470.pdf"
}