Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio

Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio

Paper in proceedings (conference paper)

This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to different spoofing methods. As a pioneering study in spoof diarization, we focus on defining the task, establishing evaluation metrics, and proposing a bench- mark model, namely the Countermeasure-Condition Cluster- ing (3C) model. Utilizing this model, we first explore how to effectively train countermeasures to support spoof diariza- tion using three labeling schemes. We then utilize spoof lo- calization predictions to enhance the diarization performance. This first study reveals the high complexity of the task, even in restricted scenarios where only a single speaker per au- dio file and an oracle number of spoofing methods are con- sidered. Our code is available at https://github.com/ nii-yamagishilab/PartialSpoof.

This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes not only locating spoof regions but also clustering them according to different spoofing methods. As a pioneering study in spoof diarization, we focus on defining the task, establishing evaluation metrics, and proposing a bench- mark model, namely the Countermeasure-Condition Cluster- ing (3C) model. Utilizing this model, we first explore how to effectively train countermeasures to support spoof diariza- tion using three labeling schemes. We then utilize spoof lo- calization predictions to enhance the diarization performance. This first study reveals the high complexity of the task, even in restricted scenarios where only a single speaker per au- dio file and an oracle number of spoofing methods are con- sidered. Our code is available at https://github.com/ nii-yamagishilab/PartialSpoof.

partial spoof, spoof diarization, countermeasure, clustering

partial spoof, spoof diarization, countermeasure, clustering

ZHANG, L.; WANG, X.; COOPER, E.; DIEZ SÁNCHEZ, M.; LANDINI, F.; EVANS, N.; YAMAGISHI, J.

2025

01.09.2024

International Speech Communication Association

Kos

Proceedings of Interspeech 2024

1990-9772

Proceedings of Interspeech

2024

9

French Republic

502

506

5

https://www.isca-archive.org/interspeech_2024/zhang24j_interspeech.pdf

zhang_2024j_interspeech