Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SpotSound: Enhancing Large Audio-Language Models with Fine-Grained Temporal Grounding

About

Large Audio-Language Models (ALMs) have recently demonstrated remarkable capabilities in holistic audio understanding, yet they remain unreliable for temporal grounding, i.e., the task of pinpointing exactly when an event occurs within long-form audio. This limitation stems from two factors: training data dominated by clip-level supervision lacking precise timestamps, and benchmarks that fail to simulate real-world scenarios where short events are obscured by dense background sounds. In this paper, we introduce SpotSound, an audio language model designed for grounding audio events. SpotSound incorporates a novel training objective, specifically designed to suppress hallucinated timestamps for events absent from the input. Additionally, we present SpotSound-Bench, a challenging temporal grounding benchmark where target events occupy less than ~10\% of each clip, creating a rigorous `needle-in-a-haystack' evaluation. Experiments demonstrate that SpotSound achieves state-of-the-art results on temporal grounding benchmarks while maintaining robust performance across general downstream audio-language tasks. Code, models and benchmark are released on https://loiesun.github.io/spotsound/

Luoyi Sun, Xiao Zhou, Zeqian Li, Ya Zhang, Yanfeng Wang, Weidi Xie• 2026

Related benchmarks

TaskDatasetResultRank
Audio temporal groundingClotho-Moment
R@0.393.6
10
Audio temporal groundingUnAV-100 subset
R1@.388
10
Audio temporal groundingSpotSound-Bench
R1@.369
10
Audio temporal groundingAudioGrounding
R1@.390.1
10
Sound Event DetectionDESED (test)--
8
Sound Event DetectionTUT Sound Events 2017 (test)
R1@0.530.7
6
Audio Event Presence PredictionClotho-Moment
Accuracy (Positive)87.6
5
Audio Event Presence PredictionAudioGrounding
Positive Accuracy93.4
5
Sound Event IdentificationUnAV-100 subset
Positive Accuracy0.94
5
Two-stage joint assessmentClotho-Moment
F1 Score92
5
Showing 10 of 13 rows

Other info

GitHub

Follow for update