Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Reasoning on BigBench-Hard (Averaged Collection)
Loading...
45.41
Ours Accuracy
Trans-LoRA
43.33
43.87
44.41
44.95
May 27, 2024
Ours Accuracy
Source Model LoRA Accuracy
Target Model No LoRA Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Ours Accuracy
Source Model LoRA Accuracy
Target Model No LoRA Accuracy
Trans-LoRA
Source Model=Llama-2-7...
2024.05
45.41
-
-
Trans-LoRA
Source Model=Llama-2-7...
2024.05
44.12
-
-
Trans-LoRA
Source Model=Gemma-2b,...
2024.05
43.61
-
-
Trans-LoRA
Source Model=Llama-2-7...
2024.05
43.41
-
-
Llama-2-7b (Source Model)
Training=LoRA, Evaluat...
2024.05
-
43.32
-
Gemma-2b (Source Model)
Training=LoRA, Evaluat...
2024.05
-
31.84
-
Llama-2-13b (Target Model)
Training=none, Evaluat...
2024.05
-
-
37.85
Gemma-7b (Target Model)
Training=none, Evaluat...
2024.05
-
-
37.75
Feedback
Search any
task
Search any
task