Share your thoughts, 1 month free Claude Pro on usSee more

Chain-of-Thought Faithfulness Evaluation on BiasQA

2.4Unfaithful Explanation Rate

DPO + RMD

Updated 18d ago

Evaluation Results

Method	Links
DPO + RMD 2025.04		2.4
DPO + RMC 2025.04		3.9
DPO + RMC 2025.04		7.4
DPO + RMD 2025.04		7.5
DPO + RMD 2025.04		8
DPO + RM 2025.04		9.8
DPO + RMD 2025.04		10.7
DPO + RMC 2025.04		11.7
DPO + RMC 2025.04		12.3
DPO + RM 2025.04		13.2
Base LLAMA-3.1-8B-IT 2025.04		13.7
Base LLAMA-3.1-8B-IT 2025.04		14.1
DPO + RM 2025.04		20.8
DPO + RM 2025.04		25