Gemma
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Jailbreak attack | Gemma-7b five finetuned variants | Average ASR66.2 | 16 | |
| Jailbreak Attack | gemma-7b v1 (pretrained) | ASR6 | 13 | |
| Output-based feature description evaluation | Gemma-2 MLP SAE features | Score49.9 | 8 | |
| Output-based feature description evaluation | Gemma-2 Residual SAE features | Score66.9 | 8 | |
| Multi-path Speculative Decoding | Gemma (test) | Throughput (tokens/s)13.26 | 6 | |
| Chat Fine-tuning | Gemma 1B Chat | vNMSE0.0012 | 6 | |
| LLM Attack Effectiveness | Gemma3 12B-it | TTFT (s)0.13 | 6 | |
| Multi-path speculative decoding | Gemma held-out (test) | Throughput Ratio Improvement2.17 | 5 | |
| Adversarial Attack | Gemma 4B-it 3 | ASR25 | 5 | |
| Model Lineage Attestation | Gemma family | TPR98 | 1 |
Showing 10 of 10 rows