Tasks
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Few-shot Text Classification | 26 few-shot tasks Random -> Random transfer setting (test) | Accuracy48.95 | 84 | |
| Few-shot Text Classification | 26 few-shot tasks Non-Class -> Class transfer setting (test) | Accuracy0.5275 | 84 | |
| Few-shot Text Classification | 26 few-shot tasks Class -> Non-Class transfer setting (test) | Accuracy45.54 | 84 | |
| Image Classification | 14 Tasks Merge | Average Accuracy94.3 | 51 | |
| Zero-shot Evaluation | Tasks Zero-shot (mean) | mAcc76.57 | 25 | |
| Zero-Shot Classification | 21 Tasks | 21 Tasks Avg Score56.4 | 9 | |
| Robot Manipulation | 5 Tasks Unseen Target Setup (train) | Task 1 (Cola Can) Approach100 | 3 | |
| Robot Manipulation | 5 Tasks Unseen Distractor Setup (train) | Task 1 (cola can) App Success100 | 3 | |
| Robot Manipulation | 5 Tasks Basic Setup (train) | Task 1 (cola can) Approach Rate100 | 3 |
Showing 9 of 9 rows