LoTTE
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Information Retrieval | LoTTE pooled (test) | Retrieval Time (ms)1.3 | 41 | |
| Retrieval | LoTTE Average across Sessions 0-9 | Success@548.6 | 14 | |
| Retrieval | LoTTE Session 9 | Success@552.2 | 14 | |
| Retrieval | LoTTE Session 8 | Success@566.7 | 14 | |
| Retrieval | LoTTE Session 7 | Success@548.1 | 14 | |
| Retrieval | LoTTE Session 6 | Success@545.9 | 14 | |
| Retrieval | LoTTE Session 5 | Success@544.8 | 14 | |
| Retrieval | LoTTE Session 4 | Success@558.5 | 14 | |
| Retrieval | LoTTE Session 3 | Success@50.578 | 14 | |
| Retrieval | LoTTE Session 2 | Success@547.8 | 14 | |
| Retrieval | LoTTE Session 1 | Success@547.4 | 14 | |
| Retrieval | LoTTE Session 0 | Success@537.2 | 14 | |
| Continual Retrieval | LoTTE | Success@50.682 | 14 | |
| Information Retrieval | LoTTE Search 1.0 (dev) | Success@5 (Writing)81.7 | 6 | |
| Information Retrieval | LoTTE Forum v1.0 (test) | Success@5 (Writing)76.3 | 6 | |
| Information Retrieval | LoTTE Search v1.0 (test) | Success@5 (Writing)80.1 | 6 | |
| Information Retrieval | LoTTE Forum | Mean Success@50.66 | 4 | |
| Information Retrieval | LoTTE Search | Mean Success@574.7 | 4 | |
| Information Retrieval | LoTTE | Search (pooled) Score73.5 | 3 | |
| Information Retrieval | LoTTE Forum zero-shot | Writing Score83.4 | 2 | |
| Information Retrieval | LoTTE Search zero-shot | Writing Score83.3 | 2 |
Showing 21 of 21 rows