Our new X account is live! Follow @wizwand_team for updates

LLM-as-a-judge evaluation on FB Bench (Feedback Bench)

0.932Pearson's r

Mistral-7B-Instruct (RAFT on GPT-4)

Updated 4d ago

Evaluation Results

Method	Links
Mistral-7B-Instruct (RAFT on GPT-4) 2025.03		0.932	0.93
TRACT 2025.03		0.931	0.93
Baseline B.4 (RAFT) 2025.03		0.92	0.918
TRACT 2025.03		0.92	0.917
TRACT (Ablation: Objective CE) 2025.03		0.919	0.917
Mistral-7B-Instruct (CE on GPT-4 scores) 2025.03		0.89	0.891
TRACT (Ablation: Data GPT-4) 2025.03		0.879	0.88
Mistral-7B-Instruct (CE on Self-gen CoT) 2025.03		0.873	0.873
Mistral-7B-Instruct (CE on GPT-4 CoT) 2025.03		0.872	0.872
Baseline B.1 (CE) 2025.03		0.857	0.857
Prometheus-2-7B 2025.03		0.845	0.847
Baseline B.2 (CE) 2025.03		0.835	0.834
Baseline B.3 (RAIL) 2025.03		0.683	0.689
TRACT (Ablation: Stage 1 Init) 2025.03		0.674	0.684
CLoud (Reward model) 2025.03		0.381	0.376
Mistral-7B-Instruct (Zero-shot RAIL) 2025.03		0.197	0.175