Our new X account is live! Follow @wizwand_team for updates

Semantic Antonym Prediction on Antonym

67Accuracy

ICL baseline

Updated 3d ago

Evaluation Results

Method	Links
ICL baseline 2024.04		67
State vector (inn.) 2024.04		66.2
State vector (mom.) 2024.04		65.9
State vector (mom.) 2024.04		65.8
Function vector 2024.04		65.7
Task vector 2024.04		65.7
State vector (inn.) 2024.04		65.5
Task vector 2024.04		64.8
ICL baseline 2024.04		64.8
State vector (inn.) 2024.04		61
State vector (mom.) 2024.04		60.4
State vector (mom.) 2024.04		59.6
ICL baseline 2024.04		59.2
State vector (inn.) 2024.04		58.7
Task vector 2024.04		58.5
Function vector 2024.04		56.4
Task vector 2024.04		56.2
Function vector 2024.04		54.5
State vector (mom.) 2024.04		47.9
Function vector 2024.04		47.1
State vector (inn.) 2024.04		47
Task vector 2024.04		46
Function vector 2024.04		45.1
State vector (inn.) 2024.04		33.4
Function vector 2024.04		33.1
State vector (mom.) 2024.04		31.1
Task vector 2024.04		23.6
Regular 2024.04		8.1
Regular 2024.04		1.2
Regular 2024.04		1
+ LTV 2025.02		0.656
+ SV 2025.02		0.649
+ ICV 2025.02		0.648
Transformer 2025.02		0.645
+ FV 2025.02		0.618
+ LTV 2025.02		0.535
+ FV 2025.02		0.464
Standard Prompting 2025.02		0.375
Transformer 2025.02		0.352
+ ICV 2025.02		0.352
+ TV 2025.02		0.345
+ SV 2025.02		0.336
+ TV 2025.02		0.317
Standard Prompting 2025.02		0.023