| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| CoMIX-SHIFT Triple shift | ClauseCompose | Exact Match (EM)91.1 | 4 | 18d ago | |
| CoMIX-SHIFT (Template holdout) | ClauseCompose | Exact Match (EM)49.8 | 4 | 18d ago | |
| CoMIX-SHIFT Long shift | ClauseCompose | Exact Match (EM)62.5 | 4 | 18d ago | |
| CoMIX-SHIFT Pair shift | ClauseCompose | EM93.9 | 4 | 18d ago | |
| CoMIX-SHIFT (Unseen) | ClauseCompose | Exact Match (EM)95.7 | 4 | 18d ago | |
| CoMIX-SHIFT (Seen) | Exact Match (EM)100 | 4 | 18d ago | ||
| Manual SNIPS-style (Manual pair shift) | ClauseCompose | Exact Match (EM)0.867 | 3 | 18d ago | |
| Manual SNIPS-style (Manual unseen pairs) | ClauseCompose | EM97.5 | 3 | 18d ago |
