Publication result detail

Automation-Driven Dataset Preparation for Continuous Czech Sign Language Recognition

ŠNAJDER, J.; KREJSA, J.

Original Title

Automation-Driven Dataset Preparation for Continuous Czech Sign Language Recognition

English Title

Automation-Driven Dataset Preparation for Continuous Czech Sign Language Recognition

Type

Paper in proceedings (conference paper)

Original Abstract

This paper presents an automation-driven solution for preparing a continuous Czech Sign Language dataset, addressing the lack of resources in this area. Manual processing of daily sign language news recordings would be extremely time-consuming, as the videos vary in quality, use different overlays, and have no captions. To streamline this process, we use the Structural Similarity Index Measure (SSIM) to compare key frames and extract relevant parts of the recording, such as weather forecast segments. Automatic speech recognition (ASR) then processes the accompanying audio and generates textual transcriptions of the spoken content. The outcome is the highly automated preparation pipeline and the dataset containing 4699 annotated videos of weather forecast news in Czech Sign Language providing a foundation for future research in sign language recognition.

English abstract

This paper presents an automation-driven solution for preparing a continuous Czech Sign Language dataset, addressing the lack of resources in this area. Manual processing of daily sign language news recordings would be extremely time-consuming, as the videos vary in quality, use different overlays, and have no captions. To streamline this process, we use the Structural Similarity Index Measure (SSIM) to compare key frames and extract relevant parts of the recording, such as weather forecast segments. Automatic speech recognition (ASR) then processes the accompanying audio and generates textual transcriptions of the spoken content. The outcome is the highly automated preparation pipeline and the dataset containing 4699 annotated videos of weather forecast news in Czech Sign Language providing a foundation for future research in sign language recognition.

Keywords

sign language, continuous, dataset, recognition, translation

Key words in English

sign language, continuous, dataset, recognition, translation

Authors

ŠNAJDER, J.; KREJSA, J.

RIV year

2025

Released

04.12.2024

Publisher

Institute of Electrical and Electronics Engineers Inc.

Location

Brno

ISBN

979-8-3503-9489-4

Book

2024 21st International Conference on Mechatronics - Mechatronika (ME)

Edition

1st

Pages from

52

Pages to

56

Pages count

5

URL

https://ieeexplore.ieee.org/document/10789742

BibTex

@inproceedings{BUT196505,
  author="Jan {Šnajder} and Jiří {Krejsa}",
  title="Automation-Driven Dataset Preparation for Continuous Czech Sign Language Recognition",
  booktitle="2024 21st International Conference on Mechatronics - Mechatronika (ME)",
  year="2024",
  series="1st",
  pages="52--56",
  publisher="Institute of Electrical and Electronics Engineers Inc.",
  address="Brno",
  doi="10.1109/ME61309.2024.10789742",
  isbn="979-8-3503-9489-4",
  url="https://ieeexplore.ieee.org/document/10789742"
}