Our new X account is live! Follow @wizwand_team for updates

Story Understanding on STORYWARS (test)

86.79Genre F1: animals

InstructStory

Updated 4d ago

Evaluation Results

Method	Links
InstructStory 2023.05		86.79	50.98	53.33	78.26	84.96	47.4	51.97	66.07	63.55	66.67	61.88	67.18	64.81	68.22	59.38	68.22	78.85	87.23	78	73.79	68.97	70.79	23.57	79.04	68.72	68.82	63.26	47.33	59.62
RoBERTa 2023.05		86.02	47.37	55.64	68.97	85.71	45.3	51.47	62.26	57.14	61.07	61.15	69.57	54.74	81.13	55.56	81.13	72.94	84.78	83.67	69.77	70.1	72.31	23.41	77.74	62.97	75.74	66.6	47.28	59.43
T5 2023.05		82.88	47.95	52.05	70.59	81.97	44.21	47.48	63.41	52.23	62.69	60.15	60.4	48.52	56.21	37.04	56.21	73.27	86.32	67.89	63.24	53.62	62.03	22.94	78.51	67.2	67.35	63.15	46.87	57.56
BERT 2023.05		82.69	43.7	45.67	59.77	78.9	42.67	43.58	55.28	43.48	65.42	51.86	66.67	50.94	61.82	52.17	61.82	67.27	82.61	78.85	72.09	50	64.52	23.19	72.9	65.03	53.54	55.34	31.38	51.9
DeBERTa 2023.05		82.24	48.75	60.15	76	79.65	46.43	48.53	67.27	61.16	67.24	62.2	62.02	58.02	62.3	58.49	62.3	81.82	86	59.38	69.23	68.57	69.08	23.17	80.18	67.61	60.81	56.02	41.09	57.39