Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Audio Super Resolution using Neural Networks

About

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time, it predicts missing samples within a low-resolution signal in an interpolation process similar to image super-resolution. Our method is simple and does not involve specialized audio processing techniques; in our experiments, it outperforms baselines on standard speech and music benchmarks at upscaling ratios of 2x, 4x, and 6x. The method has practical applications in telephony, compression, and text-to-speech generation; it demonstrates the effectiveness of feed-forward convolutional architectures on an audio generation task.

Volodymyr Kuleshov, S. Zayd Enam, Stefano Ermon• 2017

Related benchmarks

TaskDatasetResultRank
Audio Super-ResolutionPiano (test)
SNR30.1
23
Speech Super-resolutionVCTK 16 kHz target sampling rate 0.92 (test)
LSD1.32
11
Audio Super-ResolutionSingleSpeaker (test)
SNR21.1
8
Audio Super-ResolutionMultiSpeaker (test)
SNR20.7
8
Audio Super-ResolutionVCTK (test)
LSD4.2
7
Audio Super-ResolutionVCTK 8-16 kHz
LSD1.27
6
Audio Super-ResolutionVCTK 4-16 kHz
LSD1.77
6
Binary real/fake audio classificationVCTK 16 to 48 kHz ADSR (test)
Accuracy95
5
Super-ResolutionVCTK
LSD1.32
5
Binary real/fake audio classificationFMA 16 to 48 kHz ADSR small (test)
Accuracy78
4
Showing 10 of 12 rows

Other info

Code

Follow for update