Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound

About

The quantification of audio aesthetics remains a complex challenge in audio processing, primarily due to its subjective nature, which is influenced by human perception and cultural context. Traditional methods often depend on human listeners for evaluation, leading to inconsistencies and high resource demands. This paper addresses the growing need for automated systems capable of predicting audio aesthetics without human intervention. Such systems are crucial for applications like data filtering, pseudo-labeling large datasets, and evaluating generative audio models, especially as these models become more sophisticated. In this work, we introduce a novel approach to audio aesthetic evaluation by proposing new annotation guidelines that decompose human listening perspectives into four distinct axes. We develop and train no-reference, per-item prediction models that offer a more nuanced assessment of audio quality. Our models are evaluated against human mean opinion scores (MOS) and existing methods, demonstrating comparable or superior performance. This research not only advances the field of audio aesthetics but also provides open-source models and datasets to facilitate future work and benchmarking. We release our code and pre-trained model at: https://github.com/facebookresearch/audiobox-aesthetics

Andros Tjandra, Yi-Chiao Wu, Baishan Guo, John Hoffman, Brian Ellis, Apoorv Vyas, Bowen Shi, Sanyuan Chen, Matt Le, Nick Zacharov, Carleigh Wood, Ann Lee, Wei-Ning Hsu• 2025

Related benchmarks

TaskDatasetResultRank
Subjective Speech Evaluation PredictionConvTTS (val)
Pearson R0.384
11
Subjective Speech Evaluation PredictionFDX-Conv (out-of-domain)
Pearson Correlation0.236
11
Audio QualitySora 2
Quality Score6.026
10
Audio AestheticVeo 3
Aesthetic Score6.822
6
System-level Audio Aesthetics PredictionAMC 2025 (eval)
PQ MSE0.632
5
Utterance-level Audio Aesthetics PredictionAMC 2025 (eval)
PQ MSE1.184
5
Audio Quality AssessmentSound
PCC Overall0.182
5
Audio Quality AssessmentSpeech
PCC Overall0.227
5
Audio Quality Assessmentmusic
PCC Overall0.111
5
Showing 9 of 9 rows

Other info

Follow for update