Our new X account is live! Follow @wizwand_team for updates

Commonsense Reasoning on Commonsense Reasoning Suite (test)

0.7418Avg Accuracy

POTARA

Updated 4d ago

Evaluation Results

Method
POTARA 2026.02	0.7418	0.7173	-	0.788	0.878	0.752	-	-	0.7847	-	0.6453	0.6787	0.69
FedDPA 2026.02	0.7233	0.6573	-	0.804	0.876	0.7473	-	-	0.7707	-	0.6147	0.638	0.6787
Local 2026.02	0.7205	0.6893	-	0.7727	0.862	0.7213	-	-	0.754	-	0.6407	0.6627	0.6613
FedIT 2026.02	0.7194	0.6493	-	0.788	0.8593	0.7427	-	-	0.7433	-	0.6053	0.6687	0.6987
FedALT 2026.02	0.7148	0.6833	-	0.79	0.85	0.7273	-	-	0.7667	-	0.6033	0.6427	0.6553
Dense 2025.12	0.714	0.8105	-	0.8226	0.8093	0.5392	-	-	0.442	-	0.738	0.8364	-
FedSA 2026.02	0.7115	0.6493	-	0.7773	0.8467	0.7153	-	-	0.7487	-	0.6467	0.6427	0.6653
FFA-LoRA 2026.02	0.688	0.5773	-	0.7907	0.8553	0.7327	-	-	0.7387	-	0.5413	0.648	0.62
Token Filtering 2025.12	0.6582	0.7664	-	0.7661	0.7614	0.4573	-	-	0.414	-	0.693	0.7498	-
FLAP 2025.12	0.5772	0.5806	-	0.6899	0.67	0.3763	-	-	0.386	-	0.6519	0.6859	-
SlimGPT w/o 2025.12	0.5551	0.6467	-	0.7176	0.5295	0.3439	-	-	0.346	-	0.644	0.6581	-
Token Filtering 2025.12	0.5037	0.6119	-	0.6899	0.4928	0.343	-	-	0.32	-	0.6369	0.4315	-
KromHC 2026.01	0.477	0.364	0.384	0.65	0.578	0.276	0.66	0.3	0.312	0.586	0.548	0.584	-
Residual 2026.01	0.462	0.366	0.354	0.654	0.584	0.264	0.63	0.366	0.326	0.575	0.52	0.44	-
FLAP 2025.12	0.4457	0.4052	-	0.5911	0.4481	0.2477	-	-	0.314	-	0.5616	0.5524	-
mHC 2026.01	0.445	0.362	0.376	0.642	0.586	0.274	0.64	0.324	0.336	0.604	0.532	0.546	-
mHC-lite 2026.01	0.444	0.352	0.362	0.646	0.586	0.272	0.63	0.236	0.304	0.586	0.492	0.416	-
SlimGPT w/o 2025.12	0.432	0.4445	-	0.6413	0.3096	0.2364	-	-	0.312	-	0.5221	0.5587	-
KromHC 2026.01	0.424	0.28	0.278	0.59	0.414	0.23	0.54	0.288	0.254	0.535	0.5	0.608	-
mHC-lite 2026.01	0.423	0.274	0.282	0.564	0.428	0.244	0.53	0.35	0.256	0.534	0.5	0.544	-
mHC 2026.01	0.422	0.264	0.284	0.608	0.428	0.224	0.6	0.23	0.248	0.553	0.504	0.544	-
Residual 2026.01	0.411	0.27	0.29	0.604	0.428	0.218	0.55	0.318	0.238	0.593	0.492	0.374	-