pyannote.audio: neural building blocks for speaker diarization
About
We introduce pyannote.audio, an open-source toolkit written in Python for speaker diarization. Based on PyTorch machine learning framework, it provides a set of trainable end-to-end neural building blocks that can be combined and jointly optimized to build speaker diarization pipelines. pyannote.audio also comes with pre-trained models covering a wide range of domains for voice activity detection, speaker change detection, overlapped speech detection, and speaker embedding -- reaching state-of-the-art performance for most of them.
Herv\'e Bredin, Ruiqing Yin, Juan Manuel Coria, Gregory Gelly, Pavel Korshunov, Marvin Lavechin, Diego Fustes, Hadrien Titeux, Wassim Bouaziz, Marie-Philippe Gill• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Speaker Diarization | AISHELL-4 | DER (%)6.27 | 20 | |
| Speaker Diarization | AMI | DER15.41 | 15 | |
| Speaker Diarization | RAMC | DER12.97 | 9 | |
| Speaker Diarization | MSDWild | DER12.25 | 6 | |
| Speaker Diarization | VoxConverse | DER6.81 | 6 | |
| Speaker-attributed Automatic Speech Recognition | Movies (test) | CER9.94 | 6 | |
| Speaker Diarization | AliMeeting | DER15.67 | 6 | |
| Speaker-attributed Automatic Speech Recognition | AISHELL-4 (test) | CER0.1818 | 4 | |
| Speaker-attributed Automatic Speech Recognition | Podcast (test) | CER7.93 | 4 | |
| Overlapped Speech Detection | AMI (test) | Precision91.9 | 3 |
Showing 10 of 33 rows