Our new X account is live! Follow @wizwand_team for updates

Common Sense Reasoning on WSC273

91.58Accuracy

OK-Transformer

Updated 4d ago

Evaluation Results

Method	Links
OK-Transformer 2023.05		91.58	-	-	-	-	-
Frozen knowledge 2023.05		90.48	-	-	-	-	-
Batch Partitioning 2023.05		90.48	-	-	-	-	-
RoBERTa 2023.05		90.1	-	-	-	-	-
BERT_WIKI_WSCR 2019.05		72.5	72	75.7	73.2	71	55
BERT_WSCR 2019.05		71.4	69.9	81.1	69.5	70.2	55
BERT_WIKI_WSCR_pairs 2019.05		70.3	69.5	75.7	71.8	71	56.5
GPT_WSCR 2019.05		67.4	65.3	81.1	66.4	58	64.1
OK-Transformer 2023.05		67.4	-	-	-	-	-
Batch Partitioning 2023.05		66.67	-	-	-	-	-
BERT_WIKI_WSCR_no_pairs 2019.05		66.3	66.9	62.2	67.2	64.1	51.1
BERT 2023.05		66.3	-	-	-	-	-
Frozen knowledge 2023.05		65.93	-	-	-	-	-
LM ensemble 2019.05		63.7	60.6	83.8	63.4	53.4	44.3
BERT-base_WSCR 2019.05		62.3	60.6	73	61.1	63.4	44.3
BERT_WIKI 2019.05		61.9	59.7	75.7	57.3	60.3	38.9
BERT 2019.05		61.9	60.2	73	59.5	57.3	45.8
Knowledge Hunter 2019.05		57.1	58.3	50	58.8	58.8	90.1
BERT-base 2019.05		56.4	55.1	64.9	52.7	56.5	44.3
GPT 2019.05		55.3	52.5	73	59.5	51.9	46.6
FairSeq 2022.04		50	-	-	-	-	-
FairSeq 2022.04		40.4	-	-	-	-	-
FairSeq 2022.04		36.5	-	-	-	-	-
FairSeq 2022.04		36.5	-	-	-	-	-
FairSeq 2022.04		36.5	-	-	-	-	-
FairSeq 2022.04		35.6	-	-	-	-	-