Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SLASH: Self-Supervised Speech Pitch Estimation Leveraging DSP-derived Absolute Pitch

About

We present SLASH, a pitch estimation method of speech signals based on self-supervised learning (SSL). To enhance the performance of conventional SSL-based approaches that primarily depend on the relative pitch difference derived from pitch shifting, our method incorporates absolute pitch values by 1) introducing a prior pitch distribution derived from digital signal processing (DSP), and 2) optimizing absolute pitch through gradient descent with a loss between the target and differentiable DSP-derived spectrograms. To stabilize the optimization, a novel spectrogram generation method is used that skips complicated waveform generation. In addition, the aperiodic components in speech are accurately predicted through differentiable DSP, enhancing the method's applicability to speech signal processing. Experimental results showed that the proposed method outperformed both baseline DSP and SSL-based pitch estimation methods, attributed to the effective integration of SSL and DSP.

Ryo Terashima, Yuma Shirahata, Masaya Kawamura• 2025

Related benchmarks

TaskDatasetResultRank
Voiced/Unvoiced DetectionSpeech
V/UV Recall89.92
50
Fundamental Frequency EstimationSpeech, Singing Voice, and Music Clean
RPA (5 cents)0.1821
12
Fundamental Frequency EstimationSpeech SNR 20 dB
RPA5068.8
10
Fundamental Frequency EstimationSpeech SNR 30 dB
RPA5070.32
10
Fundamental Frequency EstimationSpeech SNR 0 dB
RPA5022.86
10
Fundamental Frequency EstimationSpeech SNR 10 dB
RPA5056.52
10
Fundamental Frequency EstimationSpeech SNR ∞
RPA5068.91
10
Showing 7 of 7 rows

Other info

Follow for update