Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Fr\'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithms

About

We propose the Fr\'echet Audio Distance (FAD), a novel, reference-free evaluation metric for music enhancement algorithms. We demonstrate how typical evaluation metrics for speech enhancement and blind source separation can fail to accurately measure the perceived effect of a wide variety of distortions. As an alternative, we propose adapting the Fr\'echet Inception Distance (FID) metric used to evaluate generative image models to the audio domain. FAD is validated using a wide variety of artificial distortions and is compared to the signal based metrics signal to distortion ratio (SDR), cosine distance and magnitude L2 distance. We show that, with a correlation coefficient of 0.52, FAD correlates more closely with human perception than either SDR, cosine distance or magnitude L2 distance, with correlation coefficients of 0.39, -0.15 and -0.01 respectively.

Kevin Kilgour, Mauricio Zuluaga, Dominik Roblek, Matthew Sharifi• 2018

Related benchmarks

TaskDatasetResultRank
Audio QualitySora 2
Quality Score11.261
10
Audio QualityVeo 3
Audio Quality Score7.545
4
Showing 2 of 2 rows

Other info

Follow for update