Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Word Relation Prediction on Person-Occupation
Loading...
58.2
Accuracy
State vector (mom.)
-2.328
13.386
29.1
44.814
Apr 17, 2024
Accuracy
Updated 3d ago
Evaluation Results
Method
Method
Links
Accuracy
State vector (mom.)
Model=Llama-2, Evaluat...
2024.04
58.2
State vector (inn.)
Model=Llama-2, Evaluat...
2024.04
57
Task vector
Model=Llama-2, Evaluat...
2024.04
56.4
ICL baseline
Model=Llama-2, Evaluat...
2024.04
56.1
Function vector
Model=Llama-2, Evaluat...
2024.04
54.2
State vector (mom.)
Model=Llama-2, Evaluat...
2024.04
45.6
State vector (inn.)
Model=Llama-2, Evaluat...
2024.04
42.7
State vector (mom.)
Model=GPT-J, Evaluatio...
2024.04
42.4
State vector (mom.)
Model=GPT-J, Evaluatio...
2024.04
30.4
Function vector
Model=GPT-J, Evaluatio...
2024.04
30.3
State vector (inn.)
Model=GPT-J, Evaluatio...
2024.04
30
State vector (inn.)
Model=GPT-J, Evaluatio...
2024.04
29.4
ICL baseline
Model=GPT-J, Evaluatio...
2024.04
29.3
Task vector
Model=GPT-J, Evaluatio...
2024.04
28.3
Task vector
Model=Llama-2, Evaluat...
2024.04
27.9
Task vector
Model=GPT-J, Evaluatio...
2024.04
27.8
Function vector
Model=GPT-J, Evaluatio...
2024.04
11.1
Function vector
Model=Llama-2, Evaluat...
2024.04
0.1
Regular
Model=Llama-2, Evaluat...
2024.04
0
Regular
Model=GPT-J, Evaluatio...
2024.04
0
Feedback
Search any
task
Search any
task