Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
About
Recent advancements in large language models (LLMs) have driven significant progress in zero-shot text-to-speech (TTS) synthesis. However, existing foundation models rely on multi-stage processing or complex architectures for predicting multiple codebooks, limiting efficiency and integration flexibility. To overcome these challenges, we introduce Spark-TTS, a novel system powered by BiCodec, a single-stream speech codec that decomposes speech into two complementary token types: low-bitrate semantic tokens for linguistic content and fixed-length global tokens for speaker attributes. This disentangled representation, combined with the Qwen2.5 LLM and a chain-of-thought (CoT) generation approach, enables both coarse-grained control (e.g., gender, speaking style) and fine-grained adjustments (e.g., precise pitch values, speaking rate). To facilitate research in controllable TTS, we introduce VoxBox, a meticulously curated 100,000-hour dataset with comprehensive attribute annotations. Extensive experiments demonstrate that Spark-TTS not only achieves state-of-the-art zero-shot voice cloning but also generates highly customizable voices that surpass the limitations of reference-based synthesis. Source code, pre-trained models, and audio samples are available at https://github.com/SparkAudio/Spark-TTS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Automatic Speech Recognition | LibriSpeech clean (test) | WER100.1 | 1410 | |
| Text-to-Speech | Seed-TTS en (test) | WER1.85 | 159 | |
| Text-to-Speech | Seed-TTS zh (test) | WER1.2 | 87 | |
| Speaker Verification | VoxCeleb1 (test) | Cosine EER1.52 | 85 | |
| Speech Reconstruction | LibriTTS clean (test) | -- | 67 | |
| Text-to-Speech | LibriSpeech PC clean (test) | WER2.11 | 66 | |
| Speech Reconstruction | Librispeech (test-clean) | UT MOS4.18 | 64 | |
| Speech Reconstruction | LibriSpeech clean (test) | UTMOS Score4.18 | 60 | |
| Speech Reconstruction | LibriTTS (test-other) | UTMOS4.07 | 57 | |
| Voice Cloning | Seed-TTS en (test) | WER1.98 | 53 |