ECHR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Document Classification | ECHR | Macro F1 Score57.74 | 16 | |
| Instruction-following clustering | ECHR (C2) | V-measure66.39 | 13 | |
| Instruction-following clustering | ECHR (C1) | V-measure85.79 | 13 | |
| Instruction-following clustering | ECHR (C0) | V-measure85.75 | 13 | |
| Clustering | ECHR C2 | V-measure66.39 | 12 | |
| Clustering | ECHR C1 | V-measure84.8 | 12 | |
| Clustering | ECHR C0 | V-measure84.05 | 12 | |
| Binary violation prediction | ECHR Non-Anonymized (test) | Macro Precision0.904 | 7 | |
| Text Rewriting | ECHR court cases | Linkability Proportion (arity=1)0.1 | 6 | |
| Private Information Tagging | ECHR (test) | F1 Score67.3 | 5 | |
| Document Classification | ECHR (test) | Micro F179.8 | 5 | |
| Binary violation prediction | ECHR anonymized (test) | Macro Precision87 | 5 | |
| Multi-label violation prediction | ECHR frequent labels, >=50 instances (test) | Precision66 | 5 | |
| Multi-label violation prediction | ECHR all labels (test) | Precision65.9 | 5 | |
| Case Importance Prediction | ECHR | MAE0.369 | 5 | |
| Multi-label violation prediction | ECHR few labels, [1,50) instances (test) | Precision43.6 | 4 | |
| Named Entity Recognition | ECHR free-form texts (val) | F1 Score93 | 1 |
Showing 17 of 17 rows