Covo-Audio Technical Report
About
In this work, we present Covo-Audio, a 7B-parameter end-to-end LALM that directly processes continuous audio inputs and generates audio outputs within a single unified architecture. Through large-scale curated pretraining and targeted post-training, Covo-Audio achieves state-of-the-art or competitive performance among models of comparable scale across a broad spectrum of tasks, including speech-text modeling, spoken dialogue, speech understanding, audio understanding, and full-duplex voice interaction. Extensive evaluations demonstrate that the pretrained foundation model exhibits strong speech-text comprehension and semantic reasoning capabilities on multiple benchmarks, outperforming representative open-source models of comparable scale. Furthermore, Covo-Audio-Chat, the dialogue-oriented variant, demonstrates strong spoken conversational abilities, including understanding, contextual reasoning, instruction following, and generating contextually appropriate and empathetic responses, validating its applicability to real-world conversational assistant scenarios. Covo-Audio-Chat-FD, the evolved full-duplex model, achieves substantially superior performance on both spoken dialogue capabilities and full-duplex interaction behaviors, demonstrating its competence in practical robustness. To mitigate the high cost of deploying end-to-end LALMs for natural conversational systems, we propose an intelligence-speaker decoupling strategy that separates dialogue intelligence from voice rendering, enabling flexible voice customization with minimal text-to-speech (TTS) data while preserving dialogue performance. Overall, our results highlight the strong potential of 7B-scale models to integrate sophisticated audio intelligence with high-level semantic reasoning, and suggest a scalable path toward more capable and versatile LALMs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Automatic Speech Recognition | LibriSpeech (test-other) | WER4.55 | 966 | |
| Automatic Speech Recognition | LibriSpeech clean (test) | WER1.96 | 833 | |
| Text-to-Speech | Seed-TTS en (test) | WER2.44 | 50 | |
| Text-to-Speech | Seed-TTS zh (test) | WER1.73 | 47 | |
| Audio Understanding | MMAU v05.15.25 (test-mini) | Sound Score78.68 | 28 | |
| Audio Understanding | MMAU v05.15.25 (test) | Sound Score78.68 | 28 | |
| Spoken Dialogue Evaluation | URO-Bench English Basic Track | Repeat Rate92.71 | 16 | |
| Audio Understanding | MMSU (test) | Overall Score66.64 | 15 | |
| Spoken Dialogue | URO-Bench Chinese Basic Track | Repeat Score98.35 | 15 | |
| Automatic Speech Recognition | AISHELL-1 | WER1.96 | 10 |