Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

AudioRAG+: Feedback-driven Retrieval-augmented Audio Generation with Large Audio Language Models

About

We propose a general feedback-driven retrieval-augmented generation (RAG) approach that leverages Large Audio Language Models (LALMs) to address the missing or imperfect synthesis of specific sound events in text-to-audio (TTA) generation. Unlike previous RAG-based TTA methods that typically train specialized models from scratch, we utilize LALMs to analyze audio generation outputs, retrieve concepts that pre-trained models struggle to generate from an external database, and incorporate the retrieved information into the generation process. Experimental results show that our method not only enhances the ability of LALMs to identify missing sound events but also delivers improvements across different models, outperforming existing RAG-specialized approaches.

Junqi Zhao, Chenxing Li, Jinzheng Zhao, Rilin Chen, Dong Yu, Mark D. Plumbley, Wenwu Wang• 2025

Related benchmarks

TaskDatasetResultRank
Text-to-Audio GenerationAudioCaps (test)--
138
Text-to-Audio GenerationRiTTA Count OOD (test)
KL Divergence2.18
4
Showing 2 of 2 rows

Other info

Follow for update