Our new X account is live! Follow @wizwand_team for updates

LLM-as-a-Judge Evaluation on FLASK

0.518Pearson's r

TRACT

Updated 4d ago

Evaluation Results

Method	Links
TRACT 2025.03		0.518	0.501
Prometheus-2-7B 2025.03		0.512	0.493
Mistral-7B-Instruct (RAFT on GPT-4) 2025.03		0.509	0.502
Baseline B.4 (RAFT) 2025.03		0.506	0.493
TRACT 2025.03		0.5	0.493
Baseline B.2 (CE) 2025.03		0.475	0.484
TRACT (Ablation: Objective CE) 2025.03		0.468	0.436
TRACT (Ablation: Stage 1 Init) 2025.03		0.448	0.437
Baseline B.1 (CE) 2025.03		0.435	0.433
TRACT (Ablation: Data GPT-4) 2025.03		0.418	0.419
Mistral-7B-Instruct (CE on GPT-4 CoT) 2025.03		0.413	0.407
Baseline B.3 (RAIL) 2025.03		0.412	0.445
Mistral-7B-Instruct (CE on Self-gen CoT) 2025.03		0.358	0.346
Mistral-7B-Instruct (CE on GPT-4 scores) 2025.03		0.355	0.361
CLoud (Reward model) 2025.03		0.228	0.168
Mistral-7B-Instruct (Zero-shot RAIL) 2025.03		0.2	0.149