Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Reasoning on BigBench-Hard (Averaged Collection)
Loading...
45.41
Ours Accuracy
Trans-LoRA
43.33
43.87
44.41
44.95
May 27, 2024
Ours Accuracy
Source Model LoRA Accuracy
Target Model No LoRA Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Ours Accuracy
Source Model LoRA Accuracy
Target Model No LoRA Accuracy
Trans-LoRA
Source Model=Llama-2-7...
2024.05
45.41
-
-
Trans-LoRA
Source Model=Llama-2-7...
2024.05
44.12
-
-
Trans-LoRA
Source Model=Gemma-2b,...
2024.05
43.61
-
-
Trans-LoRA
Source Model=Llama-2-7...
2024.05
43.41
-
-
Llama-2-7b (Source Model)
Training=LoRA, Evaluat...
2024.05
-
43.32
-
Gemma-2b (Source Model)
Training=LoRA, Evaluat...
2024.05
-
31.84
-
Llama-2-13b (Target Model)
Training=none, Evaluat...
2024.05
-
-
37.85
Gemma-7b (Target Model)
Training=none, Evaluat...
2024.05
-
-
37.75
Feedback
Search any
task
Search any
task