Publication detail

Listen only to me! How well can target speech extraction handle false alarms?

DELCROIX, M. KINOSHITA, K. OCHIAI, T. ŽMOLÍKOVÁ, K. SATO, H. NAKATANI, T.

Original Title

Listen only to me! How well can target speech extraction handle false alarms?

Type

conference paper

Language

English

Original Abstract

Target speech extraction (TSE) extracts the speech of a target speaker in a mixture given auxiliary clues characterizing the speaker, such as an enrollment utterance. TSE addresses thus the challenging problem of simultaneously performing separation and speaker identification. There has been much progress in extraction performance following the recent development of neural networks for speech enhancement and separation. Most studies have focused on processing mixtures where the target speaker is actively speaking. However, the target speaker is sometimes silent in practice, i.e., inactive speaker (IS). A typical TSE system will tend to output a signal in IS cases, causing false alarms. This is a severe problem for the practical deployment of TSE systems. This paper aims at understanding better how well TSE systems can handle IS cases. We consider two approaches to deal with IS, (1) training a system to directly output zero signals or (2) detecting IS with an extra speaker verification module. We perform an extensive experimental comparison of these schemes in terms of extraction performance and IS detection using the LibriMix dataset and reveal their pros and cons.

Keywords

Speech enhancement, Target speech extraction, Inactive speaker

Authors

DELCROIX, M.; KINOSHITA, K.; OCHIAI, T.; ŽMOLÍKOVÁ, K.; SATO, H.; NAKATANI, T.

Released

18. 9. 2022

Publisher

International Speech Communication Association

Location

Incheon

ISBN

1990-9772

Periodical

Proceedings of Interspeech

Number

9

State

French Republic

Pages from

216

Pages to

220

Pages count

5

URL

https://www.isca-speech.org/archive/pdfs/interspeech_2022/delcroix22_interspeech.pdf

BibTex

@inproceedings{BUT179867,
  author="DELCROIX, M. and KINOSHITA, K. and OCHIAI, T. and ŽMOLÍKOVÁ, K. and SATO, H. and NAKATANI, T.",
  title="Listen only to me! How well can target speech extraction handle false alarms?",
  booktitle="Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH",
  year="2022",
  journal="Proceedings of Interspeech",
  number="9",
  pages="216--220",
  publisher="International Speech Communication Association",
  address="Incheon",
  doi="10.21437/Interspeech.2022-11252",
  issn="1990-9772",
  url="https://www.isca-speech.org/archive/pdfs/interspeech_2022/delcroix22_interspeech.pdf"
}