Our new X account is live! Follow @wizwand_team for updates

Logical Reasoning on LogiQA (test)

86Accuracy

Human

Updated 4d ago

Evaluation Results

Method
Human 2022.03	86	-	-	-	-	-
Human Performance 2021.05	86	-	-	-	-	-
Human Performance 2024.05	86	-	-	-	-	-
DetermLR 2023.10	54.19	11.74	-	-	-	-
FOCAL REASONER 2021.05	45.8	-	-	-	-	-
MERIT 2023.06	45.3	-	-	-	-	-
CR 2023.10	45.25	17	-	-	-	-
PathReasoner 2024.05	45.01	-	-	-	-	-
HGN 2021.05	44.2	-	-	-	-	-
IDOL 2023.06	43.8	-	-	-	-	-
LReasoner 2021.05	43.3	-	-	-	-	-
ToT 2023.10	43.02	19.87	-	-	-	-
Logiformer 2023.06	42.6	-	-	-	-	-
Logiformer 2024.05	42.55	-	-2.46	-	-	-
MERIT 2024.05	42.4	-	-2.61	-	-	-
APOLLO 2022.12	42.1	-	-	-	-	-
IDOL 2023.06	41.8	-	-	-	-	-
Genius 2025.04	41.63	-	-	-	-	-
MERIT 2022.12	41.5	-	-	-	-	-
DeBERTa 2021.05	41.5	-	-	-	-	-
MERIT 2023.06	41.5	-	-	-	-	-
SI 2023.10	41.34	14.35	-	-	-	-
ALBERT 2023.06	41.3	-	-	-	-	-
LReasoner 2023.06	41.2	-	-	-	-	-
SCPO 2025.04	41.01	-	-	-	-	-
Genius 2025.04	40.86	-	-	-	-	-
AdaLoGN 2022.03	40.71	-	-	-	-	-
AdaLoGN 2024.05	40.71	-	-4.3	-	-	-
AdaLoGN 2023.06	40.7	-	-	-	-	-
LReasoner 2022.03	40.6	-	-	-	-	-
LRReasoner 2022.12	40.6	-	-	-	-	-
LReasoner 2021.05	40.6	-	-	-	-	-
LReasoner 2023.06	40.6	-	-	-	-	-
LReasoner 2024.05	40.6	-	-4.41	-	-	-
COT-SC 2023.10	40.43	16	-	-	-	-
SCPO 2025.04	40.4	-	-	-	-	-
FOCAL REASONER 2022.12	40.3	-	-	-	-	-
MERIT 2021.05	40.3	-	-	-	-	-
FOCAL REASONER 2021.05	40.3	-	-	-	-	-
Focal Reasoner 2022.03	40.25	-	-	-	-	-
FocalReasoner 2024.05	40.25	-	-4.76	-	-	-
SPIN 2025.04	40.09	-	-	-	-	-
HGN 2021.05	39.9	-	-	-	-	-
Self-Rewarding 2025.04	39.78	-	-	-	-	-
DAGN (Aug) 2021.03	39.32	-	-	-	-	-
DAGN 2022.03	39.32	-	-	-	-	-
DAGN 2024.05	39.32	-	-5.69	-	-	-
DAGN 2021.05	39.3	-	-	-	-	-
LAMBADA 2023.10	39.11	56.24	-	-	-	-
DAGN 2021.03	38.71	-	-	-	-	-
DAGN 2022.12	38.7	-	-	-	-	-
DAGN 2021.05	38.7	-	-	-	-	-
DAGN 2023.06	38.7	-	-	-	-	-
CoH 2025.04	38.56	-	-	-	-	-
COT 2023.10	38.55	1	-	-	-	-
CoH 2025.04	38.4	-	-	-	-	-
DetermLR 2023.10	37.99	13.39	-	-	-	-
Self-Rewarding 2025.04	37.94	-	-	-	-	-
SFT 2025.04	37.78	-	-	-	-	-
RoBERTa 2023.06	36.6	-	-	-	-	-
STaR 2025.04	35.94	-	-	-	-	-
RoBERTa-Large 2021.03	35.33	-	-	-	-	-
RoBERTa 2022.03	35.33	-	-	-	-	-
ROBERTa-Large 2024.05	35.33	-	-9.68	-	-	-
SPIN 2025.04	35.33	-	-	-	-	-
RoBERTa 2022.12	35.3	-	-	-	-	-
RoBERTa 2021.05	35.3	-	-	-	-	-
STaR 2025.04	34.87	-	-	-	-	-
IDOL 2023.06	34.3	-	-	-	-	-
LLaMA3.1-8B-Instruct 2025.04	33.33	-	-	-	-	-
BERT 2023.06	33	-	-	-	-	-
CR 2023.10	31.84	18.93	-	-	-	-
Standard 2023.10	31.69	1	-	-	-	-
BERT-Large 2021.03	31.03	-	-	-	-	-
BERT 2022.03	31.03	-	-	-	-	-
BERT-Large 2024.05	31.03	-	-13.98	-	-	-
SFT 2025.04	29.03	-	-	-	-	-
ToT 2023.10	26.25	19.87	-	-	-	-
Pythia-6.9B 2023.04	25.3	-	-	-	-	-
Random 2024.05	25	-	-	-	-	-
SI 2023.10	24.02	15.16	-	-	-	-
LAMBADA 2023.10	24.02	59.32	-	-	-	-
COT-SC 2023.10	22.91	16	-	-	-	-
Pythia-12B 2023.04	22.4	-	-	-	-	-
COT 2023.10	22.35	1	-	-	-	-
Pythia-1B 2023.04	22.3	-	-	-	-	-
Pythia-410M 2023.04	22	-	-	-	-	-
Pythia-2.8B 2023.04	21.2	-	-	-	-	-
Pythia-70M 2023.04	21	-	-	-	-	-
Pythia-1.4B 2023.04	21	-	-	-	-	-
Pythia-160M 2023.04	19	-	-	-	-	-
Standard 2023.10	16.76	1	-	-	-	-
Prompt based 2025.05	-	-	-	47.6	63	15.4
Prompt based 2025.05	-	-	-	47.6	60	12.4
SFT based 2025.05	-	-	-	50.6	-	-
ReflectEvo 2025.05	-	-	-	47.6	62.4	14.8
ReflectEvo 2025.05	-	-	-	47.6	60.6	13
ReflectEvo 2025.05	-	-	-	47.6	62.6	15
ReflectEvo 2025.05	-	-	-	47.6	63	15.4
Prompt based 2025.05	-	-	-	52	59.2	7.2

Showing 100 of 101 rows