Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Adaptive Oscillatory Inductive Bias for Modeling Sharp Prosodic Dynamics in Diffusion-Based TTS

About

Diffusion-based text-to-speech (TTS) models have achieved significant improvements in speech quality. However, modeling sharp prosodic transitions and rapid pitch variations in expressive speech remains challenging. Existing diffusion-based TTS decoders commonly utilize periodic nonlinearities such as Snake activation function to capture harmonic structures, but this activation funcation provides limited adaptability when modeling abrupt amplitude and frequency variations. In this paper, we investigate the role of oscillatory inductive bias in diffusion-based TTS decoders and introduce an adaptive oscillatory nonlinearity that enables controllable periodic modulation while maintaining signal stability through a linear bypass component. We refer the resulting TTS system as OscillaTTS. Experiments on the LJSpeech and Emotional Speech Dataset show consistent improvements across objective and subjective evaluations, indicating improved modeling of expressive prosodic dynamics.

Sandipan Dhar, Nirmesh J. Shah, Ashishkumar P. Gudmalwar, Pankaj Wasnik• 2026

Related benchmarks

TaskDatasetResultRank
Text-to-SpeechLJSpeech (test)
CMOS86.67
25
Text-to-SpeechLJ Speech Dataset
AutoPCP4.05
5
Expressive Speech SynthesisEmotional Speech Dataset (ESD) Angry
AutoPCP3.23
2
Expressive Speech SynthesisEmotional Speech Dataset (ESD) Happy
AutoPCP3.21
2
Expressive Speech SynthesisEmotional Speech Dataset (ESD) Sad
AutoPCP3
2
Expressive Speech SynthesisESD Angry
ES MOS70.71
2
Expressive Speech SynthesisESD Happy
ES MOS68.3
2
Expressive Speech SynthesisESD Sad
ES MOS68.32
2
Showing 8 of 8 rows

Other info

Follow for update