XCOPA

Benchmarks

Task Name	Dataset Name	SOTA Result
Causal Reasoning	XCOPA	Accuracy94.4	55
Commonsense Reasoning	XCOPA	Accuracy74.5	35
Causal Reasoning	XCOPA (test)	Accuracy (th)96.4	31
Causal Reasoning	XCOPA	Accuracy (ZH)99	14
Causal Reasoning	XCOPA	Accuracy (zh)55.5	12
Natural Language Understanding	XCOPA 1.0 (test)	Accuracy54.5	11
Performance Prediction	XCOPA	MAE1.96	9
Zero-shot performance prediction	XCOPA	MAE2.59	9
Causal Reasoning	XCOPA ET	Accuracy71.8	8
Causal Reasoning	XCOPA	XCOPA Causal Reasoning Score64.2	8
Multilingual Reasoning	XCOPA	Accuracy73	6
Multilingual Causal Reasoning	XCOPA	Extract Match Score62.9	4
Commonsense Reasoning	XCOPA (test)	Language Democratization99.31	4
Causal Reasoning	XCOPA Thai	Accuracy60	3
Commonsense Reasoning	XCOPA Indonesian	Accuracy60	3
Commonsense Reasoning	XCOPA 74 (test)	Score-	0
Causal Reasoning	XCOPA Māori	Accuracy-	0

Showing 17 of 17 rows