Amazon ESCI
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Token Classification | Amazon ESCI Product Description English (test) | Top-k Accuracy92.1 | 72 | |
| Token Classification | Amazon ESCI Product Title English (test) | Top-k Token Accuracy88.2 | 72 | |
| GenAI Search Optimization Attack Effectiveness | Amazon ESCI | Sr@10100 | 28 | |
| Semantic Search | Amazon ESCI | Precision@132 | 3 | |
| Embedding Model Routing | Amazon ESCI (other) | Gap (Constant Approx)0.074 | 1 | |
| Embedding Model Routing | Amazon ESCI negations | Gap: Constant Approximation0.132 | 1 | |
| Embedding Model Routing | Amazon ESCI parse-pattern | Gap (Constant Approx)0.064 | 1 | |
| Embedding Model Routing | Amazon ESCI behavioral | Constant Gap6.7 | 1 | |
| Embedding Model Routing | Amazon ESCI nlqec | Gap (Constant Model)0.109 | 1 | |
| Embedding Model Routing | Amazon ESCI (all) | Constant Approximation Gap0.078 | 1 |
Showing 10 of 10 rows