Share your thoughts, 1 month free Claude Pro on usSee more

Language Modeling on Proof-pile 128 32k (test)

2.28Perplexity

ProLong-13b

Updated 1mo ago

Evaluation Results

Method	Links
ProLong-13b 2024.05		2.28
ProLong-7b 2024.05		2.38
Yarn-13b-64k 2024.05		2.43
Yarn-7b-64k 2024.05		2.6
Code Llama-13b 2024.05		2.71
Code Llama-7b 2024.05		2.84
Llama2-13b 2024.05		14.69
Llama2-7b 2024.05		18.72