Our new X account is live! Follow @wizwand_team for updates

Natural Language Understanding on ARC Easy

78.3Accuracy

Arcana

Updated 4d ago

Evaluation Results

Method	Links
Arcana 2024.10		78.3
Vicuna-v1.5 2024.10		72.8
LLaMA-2-Chat 2024.10		71.6
WizardLM 2024.10		59.6
LLaMA-2 2024.10		56.1
ProDiaL 2024.11		55.18
FT 2024.11		55.09
ProDiaL 2024.11		54.84
FT 2024.11		54.59
ProDiaL 2024.11		54.5
FT 2024.11		54.38
Strong 2024.11		54.17
DoRA 2024.11		54.12
DoRA 2024.11		54.04
LoRA 2024.11		53.87
LoRA 2024.11		53.87
LoRA 2024.11		53.66
DoRA 2024.11		53.66
Full-FT 2024.11		53.54
BitFit 2024.11		52.86