Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

End-to-End Audio Strikes Back: Boosting Augmentations Towards An Efficient Audio Classification Network

About

While efficient architectures and a plethora of augmentations for end-to-end image classification tasks have been suggested and heavily investigated, state-of-the-art techniques for audio classifications still rely on numerous representations of the audio signal together with large architectures, fine-tuned from large datasets. By utilizing the inherited lightweight nature of audio and novel audio augmentations, we were able to present an efficient end-to-end network with strong generalization ability. Experiments on a variety of sound classification sets demonstrate the effectiveness and robustness of our approach, by achieving state-of-the-art results in various settings. Public code is available at: \href{https://github.com/Alibaba-MIIL/AudioClassfication}{this http url}

Avi Gazneli, Gadi Zimerman, Tal Ridnik, Gilad Sharir, Asaf Noy• 2022

Related benchmarks

TaskDatasetResultRank
Audio ClassificationESC-50
Accuracy96.3
374
Audio ClassificationESC-50 (test)
Accuracy96.3
87
Audio ClassificationAudioSet 2M
mAP42.6
79
Keyword SpottingSpeech Commands V2
Accuracy98.15
61
Audio RecognitionSpeech Commands V2
Accuracy98.15
43
Sound classificationAudioSet (evaluation)
mAP42.6
39
Audio ClassificationUrbanSound8K (official 10 fold split)
Accuracy (%)90
15
Audio ClassificationSpeech Commands 35 classes V2 (evaluation)
Accuracy98.15
3
Showing 8 of 8 rows

Other info

Code

Follow for update