Share your thoughts, 1 month free Claude Pro on usSee more

Fill-in-the-Middle Code Completion on SAFIM control

41Exact Match (EM)

ORPO

Updated 1mo ago

Evaluation Results

Method	Links
ORPO 2026.06		41	72.7
ORPO 2026.06		41	72.7
SFT 2026.06		39.3	72.3
SFT 2026.06		39.2	72.2
SFT 2026.06		36.4	69.6
SFT 2026.06		36.4	69.8
base 2026.06		35.3	66.7
base 2026.06		34.7	57.7
ORPO 2026.06		34.3	69.5
ORPO 2026.06		34.3	69.7
DPO 2026.06		15	53.2
DPO 2026.06		14	29.1
DPO 2026.06		12	51.8
DPO 2026.06		8.9	16.3
base 2026.06		7.6	51
base 2026.06		4.8	9.9