Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Rationale Extraction on Movies
Loading...
82.9
Accuracy
GLASS
52.116
60.108
68.1
76.092
Jun 7, 2026
Accuracy
AUROC
AUPRC
Annotation Precision
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
AUROC
AUPRC
Annotation Precision
GLASS
Model=DeBERTa-v3
2026.06
82.9
0.954
0.962
41.8
Direct Prompting (DP)
Model=Llama3 80B
2026.06
81.4
0.907
0.841
24.4
Counterfactual-Sequential (CFS)
Model=Llama3 80B
2026.06
81.4
0.889
0.795
24.3
Counterfactual-Parallel (CFP)
Model=Llama3 80B
2026.06
79.9
0.9
0.845
21.6
Counterfactual-Sequential (CFS)
Model=GPT-4o
2026.06
76.4
0.913
0.864
23.6
Direct Prompting (DP)
Model=GPT-4o
2026.06
74.9
0.916
0.896
24.5
Counterfactual-Parallel (CFP)
Model=GPT-4o
2026.06
53.3
0.809
0.705
22.4
Feedback
Search any
task
Search any
task