Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

BigVSAN: Enhancing GAN-based Neural Vocoders with Slicing Adversarial Network

About

Generative adversarial network (GAN)-based vocoders have been intensively studied because they can synthesize high-fidelity audio waveforms faster than real-time. However, it has been reported that most GANs fail to obtain the optimal projection for discriminating between real and fake data in the feature space. In the literature, it has been demonstrated that slicing adversarial network (SAN), an improved GAN training framework that can find the optimal projection, is effective in the image generation task. In this paper, we investigate the effectiveness of SAN in the vocoding task. For this purpose, we propose a scheme to modify least-squares GAN, which most GAN-based vocoders adopt, so that their loss functions satisfy the requirements of SAN. Through our experiments, we demonstrate that SAN can improve the performance of GAN-based vocoders, including BigVGAN, with small modifications. Our code is available at https://github.com/sony/bigvsan.

Takashi Shibuya, Yuhta Takida, Yuki Mitsufuji• 2023

Related benchmarks

TaskDatasetResultRank
Waveform GenerationMUSDB18 out-of-distribution vocal samples HQ (test)
M-STFT0.8623
19
Audio GenerationLibriTTS (dev)
M-STFT0.7997
18
Speech SynthesisLibriTTS (test)--
17
Text-to-SpeechLibriTTS zero-shot
UTMOS4.0424
14
Waveform GenerationLibriTTS 24,000 Hz (test)
UTMOS3.6948
13
Waveform GenerationLJSpeech
UTMOS4.311
12
Waveform GenerationLibriTTS (dev)
M-STFT0.7134
12
Speech SynthesisLibriTTS 24,000 Hz (test)
MOS4.21
11
Neural Vocoding / Waveform SynthesisMUSDB18 HQ (Out-of-Distribution samples)
Vocal SMOS4.34
10
Waveform GenerationLJSpeech (test)
M-STFT0.9369
8
Showing 10 of 11 rows

Other info

Code

Follow for update