Semantic Similarity Evaluation on Insurance Tasks N=1500 (test)
0.869Mean BERT Cosine Similarity
DeepSeek-R1 + Fine-tune
Updated 4d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.02 | 0.869 | 0.159 | 0.929 | 1 | 79.1 | |
2026.02 | 0.799 | 0.16 | 0.857 | 0.977 | 68.5 | |
2026.02 | 0.787 | 0.163 | 0.844 | 0.974 | 65.6 | |
2026.02 | 0.757 | 0.17 | 0.803 | 0.974 | 57.5 | |
2026.02 | 0.749 | 0.163 | 0.793 | 0.977 | 56.1 | |
2026.02 | 0.719 | 0.167 | 0.762 | 1 | 47.2 |