Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Reshape Dimensions Network for Speaker Recognition

About

In this paper, we present Reshape Dimensions Network (ReDimNet), a novel neural network architecture for extracting utterance-level speaker representations. Our approach leverages dimensionality reshaping of 2D feature maps to 1D signal representation and vice versa, enabling the joint usage of 1D and 2D blocks. We propose an original network topology that preserves the volume of channel-timestep-frequency outputs of 1D and 2D blocks, facilitating efficient residual feature maps aggregation. Moreover, ReDimNet is efficiently scalable, and we introduce a range of model sizes, varying from 1 to 15 M parameters and from 0.5 to 20 GMACs. Our experimental results demonstrate that ReDimNet achieves state-of-the-art performance in speaker recognition while reducing computational complexity and the number of model parameters.

Ivan Yakovlev, Rostislav Makarov, Andrei Balykin, Pavel Malov, Anton Okhotnikov, Nikita Torgashov• 2024

Related benchmarks

TaskDatasetResultRank
Speaker VerificationVoxCeleb1-O Cleaned (Original)
EER (%)0.37
53
Speaker VerificationVoxCeleb1 Hard Cleaned
EER0.01
45
Speaker VerificationVoxCeleb1 Cleaned (Extended)
EER (%)0.53
45
Speaker RecognitionSITW (Speakers In The Wild) core-core protocol
EER0.77
9
Speaker RecognitionVOICES from a Distance Challenge (Evaluation Set)
EER3.19
5
Speaker RecognitionVoxCeleb B protocol 1
EER1.66
5
Showing 6 of 6 rows

Other info

Code

Follow for update