| Dataset Name | SOTA Method | Metric | Trend | ||
|---|---|---|---|---|---|
| Probe 1 | Anthropic.Claude-3-Haiku | Accuracy96 | 42 | 4d ago | |
| LAMA | BERT | Google-RE P@113.9 | 20 | 4d ago | |
| TempLAMA Unchanged 22/19 | NPM | EM19.5 | 14 | 3d ago | |
| TempLAMA Changed | BM25 + T5 | Exact Match20.1 | 14 | 3d ago | |
| LAMA-UHN | BERT-PELT | P@1 (Google-RE)8.9 | 14 | 4d ago | |
| TempLAMA Average 22/19 | NPM | EM18.5 | 9 | 3d ago | |
| Mineral Groups | GAL 120B | Accuracy29.4 | 8 | 4d ago | |
| Galaxy Clusters | GAL 120B | Accuracy24.2 | 8 | 4d ago | |
| Chemical Reactions | GAL 120B | Accuracy43.1 | 8 | 4d ago | |
| AminoProbe | GAL 30B | Accuracy21 | 8 | 4d ago | |
| mLAMA | mLUKE-E_base | Accuracy (DE)43.7 | 8 | 3d ago | |
| LAMA-CKL (test) | TA (Llama) | Top Accuracy42.9 | 6 | 4d ago | |
| UMLS relation probing (Overall) | KeBioLM | Recall@53.26 | 4 | 4d ago | |
| UMLS relation probing Type 2 | KeBioLM | Recall@51.48 | 4 | 4d ago | |
| UMLS relation probing (Type 1) | KeBioLM | Recall@514.01 | 4 | 4d ago | |
| LAMA-CKL small generation model (Tinyllama 1B) | TA (Llama) | Top-K Acc32.6 | 3 | 4d ago | |
| TempLAMA Average | - | EM- | 0 | 4d ago | |
| TempLAMA Unchanged | - | Exact Match- | 0 | 4d ago |
