ABCD
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Brain network classification | ABCD-OCD | F1 Score70.62 | 30 | |
| Workflow Extraction | ABCD | Macro Score58.55 | 24 | |
| Classification | ABCD Anx | Accuracy58.16 | 15 | |
| Classification | ABCD-ADHD | Accuracy63.75 | 15 | |
| Brain network classification | ABCD-Anx | F1 Score62.15 | 15 | |
| Brain network classification | ABCD-ADHD | F1 Score65.5 | 15 | |
| Semantic Retrieval | ABCD v1 (test) | Avg Cost per Query0 | 10 | |
| Intelligence score prediction | ABCD Composite Intelligence | MSE81.35 | 9 | |
| Intelligence score prediction | ABCD Crystallized Intelligence | MSE50.47 | 9 | |
| Intelligence score prediction | ABCD Fluid Intelligence | MSE109.61 | 9 | |
| Brain Network Classification | ABCD | AUROC96.2 | 9 | |
| Dialog Workflow Extraction and Evaluation | ABCD 1.0 (test) | Macro Score61.2 | 8 | |
| General intelligence classification | ABCD fMRI | Accuracy0.682 | 7 | |
| T2-weighted 3D MRI Reconstruction | ABCD (test) | PSNR26.53 | 6 | |
| T1-weighted 3D MRI Reconstruction | ABCD (test) | PSNR27.24 | 6 | |
| SUI prediction | ABCD 4-year longitudinal | Accuracy84.71 | 6 | |
| Downstream Trainability | ABCD | MAE2.9 | 6 | |
| Question Answering | ABCD entity-dependent | Accuracy96 | 6 | |
| Question Answering | ABCD overall | Accuracy95 | 6 | |
| Topic Modeling | ABCD | Mean Topic Distance0.0003 | 6 | |
| Sentiment Classification | ABCD | Accuracy100 | 6 | |
| PII Redaction | ABCD | Recall99 | 6 | |
| Intelligence Regression | ABCD | MSE0.932 | 6 | |
| Sex Classification | ABCD | Accuracy80.1 | 6 | |
| Action State Tracking | ABCD in-distribution (test) | B-Slot Acc85.2 | 6 |
Showing 25 of 32 rows