Our new X account is live! Follow @wizwand_team for updates

Holistic Evaluation of Audio Representations (HEAR)

76.7CREMA-D

ATST-Frame

Updated 4d ago

Evaluation Results

Method
ATST-Frame 2023.06	76.7	78.1	92.6	95.1	22.3	-	-	64.6	95.8	95.7	89	55.7	94.3	88.3	100	24.4	97.5	96.9	68.6	66.9	-	-	-
ATST-Clip 2023.06	76	78.2	93.1	95.5	18.5	-	-	58.3	95.3	93.7	91.2	59.5	98.8	87.7	99.2	18.9	97.7	96.7	67.8	53.9	-	-	-
HEAR Leaderboard Best 2023.04	75.21	78.53	-	-	22.69	-	-	-	-	-	96.65	65.48	-	-	-	-	-	-	-	-	97.79	72.02	99.23
HEAR Leaderboard (SSL) 2023.04	75.21	78.53	-	-	18.48	-	-	-	-	-	80.5	50.88	-	-	-	-	-	-	-	-	96.87	71.4	96.86
GURA Fuse HuBERT 2023.04	75.21	68.34	-	-	18.48	-	-	-	-	-	74.35	41.32	-	-	-	-	-	-	-	-	94.68	71.4	93.59
Best 2023.06	75.2	78.5	97.6	97.8	21.5	-	-	87.8	97.5	92.5	96.1	64.1	96.7	90.8	99.2	46.9	97.5	94.1	87.8	72.2	-	-	-
Hybrid BYOL-S/CvT 2022.06	67.2	83.5	92.6	95.8	16.3	42.2	66.3	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Hybrid BYOL-S/CvT 2022.06	67.2	83.5	92.6	95.8	16.3	42.2	66.3	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Hybrid BYOL-S/CvT 2022.06	66.7	82.7	92.5	94.8	15.2	34	64.3	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	66.5	86	91.2	93.4	14.2	43	64.8	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Hybrid BYOL-S/CvT 2022.06	66.5	80.6	93.1	94.6	16.2	38	64.8	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	66.4	78.5	92.6	94.3	15.1	41.2	64.7	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S++ 2022.06	66.4	80	93.2	95	15.4	47.8	66.3	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	66.4	78.6	92.6	94.3	15.1	41.2	64.7	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	66.4	84.8	92	93.1	16.2	37	64.9	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Hybrid BYOL-S/Default 2022.06	66.1	81.6	91.6	93.8	14.2	43.8	65.2	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Hybrid BYOL-S/CvT 2022.06	66	84.1	91.9	93.8	14.6	38.7	64.9	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Hybrid BYOL-S/CvT 2022.06	65.8	81.2	92.7	94.7	15.8	39.8	65	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
wav2vec2 2022.06	65.7	67.6	79.7	88.5	7.2	49.7	59.7	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	65.7	81	90	93.1	16	43.1	64.7	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	65.6	81.8	92.2	93.4	14.3	47.3	65.8	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	65.5	83	91.9	94.5	14.8	44.4	65.2	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S/CvT + OS 2022.06	65.4	82.7	77.6	86.9	17.4	29.5	59.9	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
Hybrid BYOL-S/CvT 2022.06	64.4	83.5	89.6	92.7	13.6	35.3	63.2	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
CLAP 2023.04	64.36	77.83	-	-	-	-	-	-	-	-	96.7	58.59	-	-	-	-	-	-	-	-	96.83	-	100
BYOL-S 2022.06	64	78.1	91.3	92.5	11.9	24.3	60.4	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
BYOL-S 2022.06	63.5	77	83.2	88.9	13.3	35.8	60.3	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
LSSD (B.5) 2023.04	63.27	69.16	-	-	11.38	-	-	-	-	-	85.25	52.48	-	-	-	-	-	-	-	-	76.99	27.98	100
LSSD (B.4) 2023.04	63.18	68.88	-	-	10.82	-	-	-	-	-	83.75	51.61	-	-	-	-	-	-	-	-	77.12	28.19	100
Hybrid BYOL-S/CvT 2022.06	62.9	84.4	86.2	90.7	12	27.1	60.6	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
LSSD (B.3) 2023.04	62.79	66.31	-	-	11.55	-	-	-	-	-	85.6	53.69	-	-	-	-	-	-	-	-	83.82	30.35	100
BYOL-A 2022.06	62.3	78.8	89.6	92.4	13.7	39	62.6	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
CP-JKU PaSST 2lvl+mel 2023.04	61.04	66.01	-	-	18.2	-	-	-	-	-	94.75	64.09	-	-	-	-	-	-	-	-	63.87	25.93	97.69
openSMILE (OS) only 2022.06	59.4	66.7	70.1	80.2	13.1	25.1	52.4	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-
CREPE 2022.06	36.2	49.9	16.8	19.6	5.1	15.1	23.8	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-	-