Using Activation Functions for Improving Measure-Level Audio Synchronization

Using Activation Functions for Improving Measure-Level Audio Synchronization

Paper in proceedings outside WoS and Scopus

Audio synchronization aims at aligning multiple recordings of the same piece of music. Traditional synchronization approaches are often based on dynamic time warping using chroma features as an input representation. Previous work has shown how one can integrate onset cues into this pipeline for improving the alignment’s temporal accuracy. Furthermore, recent work based on deep neural networks has led to significant improvements for learning onset, beat, and downbeat activation functions. However, for music with soft onsets and abrupt tempo changes, these functions may be unreliable, leading to unstable results. As the main contribution of this paper, we introduce a combined approach that integrates activation functions into the synchronization pipeline. We show that this approach improves the temporal accuracy thanks to the activation cues while inheriting the robustness of the traditional synchronization approach. Conducting experiments based on string quartet recordings, we evaluate our combined approach where we transfer measure annotations from a reference recording to a target recording.

Audio synchronization aims at aligning multiple recordings of the same piece of music. Traditional synchronization approaches are often based on dynamic time warping using chroma features as an input representation. Previous work has shown how one can integrate onset cues into this pipeline for improving the alignment’s temporal accuracy. Furthermore, recent work based on deep neural networks has led to significant improvements for learning onset, beat, and downbeat activation functions. However, for music with soft onsets and abrupt tempo changes, these functions may be unreliable, leading to unstable results. As the main contribution of this paper, we introduce a combined approach that integrates activation functions into the synchronization pipeline. We show that this approach improves the temporal accuracy thanks to the activation cues while inheriting the robustness of the traditional synchronization approach. Conducting experiments based on string quartet recordings, we evaluate our combined approach where we transfer measure annotations from a reference recording to a target recording.

audio synchronization; music information retrieval; measure transfer; activation functions; beat tracking

audio synchronization; music information retrieval; measure transfer; activation functions; beat tracking

ÖZER, Y.; IŠTVÁNEK, M.; ARIFI-MÜLLER, V.; MÜLLER, M.

2023

07.12.2022

Proceedings of the International Society for Music Information Retrieval Conference (ISMIR)

750

756

7

https://ismir2022program.ismir.net/poster_195.html

2022_OezerIAM_MusicSync_ISMIR