OPT
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inference Latency | OPT model family | Latency (ms)6.2 | 79 | |
| Quantization | OPT | Processing Time (s)4.8 | 46 | |
| Quantization | OPT v1 (train) | Processing Time (min)0.08 | 23 | |
| Classification | OPT | Accuracy92.62 | 22 | |
| AI-Generated Text Detection | OPT unseen category | Accuracy89.1 | 18 | |
| Off-policy evaluation for classification error | opt | Bias-0.052 | 15 | |
| Classification | OPT 10-shot | Accuracy92.62 | 13 | |
| Classification | OPT OpenML-CC18 (test) | Accuracy78.94 | 13 | |
| INT2 Quantization | OPT-1.3B | Memory Footprint (GB)4.49 | 12 | |
| INT2 Quantization | OPT-125M | Memory Cost (GB)1.39 | 12 | |
| Block-wise quantization complexity analysis | OPT Models | GFLOPS0.24 | 12 | |
| Linguistic Steganography | OPT-1.3b | Average KLD0 | 10 | |
| INT2 Quantization | OPT-6.7B | Memory Footprint (GB)11.68 | 10 | |
| Open domain dialogue | OPT-66B ZS | RSR74.7 | 9 | |
| Energy Consumption Estimation | OPT-66B | Energy (J)1,786.62 | 8 | |
| Energy Consumption Estimation | OPT-30B | Energy (J)846.54 | 8 | |
| Energy Consumption Estimation | OPT-13B | Energy (J)385.31 | 8 | |
| Energy Consumption Estimation | OPT 6.7B | Energy (J)215.27 | 8 | |
| Energy Consumption Estimation | OPT-2.7B | Energy (J)95.67 | 8 | |
| Energy Consumption Estimation | OPT 1.3B | Energy (J)55.8 | 8 | |
| Energy Consumption Estimation | OPT-350M | Energy (J)20.17 | 8 | |
| Energy Consumption Estimation | OPT-125M | Energy Consumption (J)11.41 | 8 | |
| Generation | OPT 1.3B Generation | SQuAD Score80.4 | 6 | |
| Text-to-Image Generation | OPT-66B ZS user input pool v1.4 (test) | RSR71.34 | 5 | |
| Inference Latency | OPT-30B | Latency (ms)15.7 | 5 |
Showing 25 of 37 rows