Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Language Modeling on Penn Treebank (PTB)
Loading...
7.11
PPL
LoRA
6.6412
9.8056
12.97
16.1344
May 23, 2023
PPL
Updated 4d ago
Evaluation Results
Method
Method
Links
PPL
LoRA
W Bits=16, Model=LLaMA...
2023.05
7.11
LoRA
W Bits=16, Model=LLaMA...
2023.05
7.21
PEQA
W Bits=4, Model=LLaMA 65B
2023.05
7.36
LoRA+OPTQ
W Bits=4, Model=LLaMA 65B
2023.05
7.46
LoRA+OPTQ
W Bits=4, Model=LLaMA 30B
2023.05
7.55
PEQA
W Bits=4, Model=LLaMA 30B
2023.05
7.68
LoRA
W Bits=16, Model=LLaMA...
2023.05
8.52
PEQA
W Bits=4, Model=LLaMA 13B
2023.05
8.64
LoRA+OPTQ
W Bits=4, Model=LLaMA 13B
2023.05
8.83
LoRA
W Bits=16, Model=LLaMA 7B
2023.05
9.14
PEQA
W Bits=4, Model=LLaMA 7B
2023.05
9.69
LoRA+OPTQ
W Bits=4, Model=LLaMA 7B
2023.05
11.22
LoRA
W Bits=16, Model=GPT-J 6B
2023.05
12.92
PEQA
W Bits=4, Model=GPT-J 6B
2023.05
13.3
LoRA+OPTQ
W Bits=4, Model=GPT-J 6B
2023.05
13.46
LoRA
W Bits=16, Model=GPT-N...
2023.05
15.92
PEQA
W Bits=4, Model=GPT-Ne...
2023.05
16.55
LoRA+OPTQ
W Bits=4, Model=GPT-Ne...
2023.05
18.83
Feedback
Search any
task
Search any
task