Share your thoughts, 1 month free Claude Pro on usSee more

Code Generation on HumanEval (HumanEval and Average metrics)

94.51HumanEval Score

FinTool-Qwen3-14B

Updated 2d ago

Evaluation Results

Method
FinTool-Qwen3-14B 2026.03	94.51	-
Qwen3-14B 2026.03	92.68	-
Qwen3-8B 2026.03	89.63	-
FinTool-Qwen3-8B 2026.03	89.02	-
LightMoE 2026.03	55.7	55.3
Original 2026.03	55	37.7
LoRA 2026.03	54.2	55.5
Replace (w/o shared) 2026.03	53.8	52.6
Replace (w. shared) 2026.03	52	52.3
MC-SMoE 2026.03	51.7	53.4
Replace (w/o shared) 2026.03	51.3	50.1
LightMoE 2026.03	51.3	53
MC-SMoE* 2026.03	50.6	50.2
Replace (w. shared) 2026.03	50.1	49.3
Full FT 2026.03	49.7	56.3
MC-SMoE 2026.03	48.4	47.3
LightMoE 2026.03	48.4	48.1
Replace (w/o shared) 2026.03	46.3	44.3
Replace (w. shared) 2026.03	44.5	41.6
MC-SMoE* 2026.03	43.8	45.3
MC-SMoE 2026.03	43.1	42.5
HC-SMoE 2026.03	41.7	46.8
MoBE 2026.03	41.3	50.4
Baseline 2026.04	34.76	46.1
HC-SMoE 2026.03	33.5	38.4
Instruction Tuned 2026.04	30.49	-
DARE Ties 2026.04	30.49	-
Precise Fusion 2026.04	30.49	-
Task Arithmetic 2026.04	29.27	-
MoBE 2026.03	28.6	43
Avg Baseline 2026.04	28.05	-
Ties Merging 2026.04	28.05	-
MoBiE 2026.04	27.12	37.54
GPTQ 2026.04	27.05	37.48
DARE Task Arithmetic 2026.04	26.83	-
HC-SMoE 2026.03	26.5	34
WIDEN 2026.04	26.22	-
MoBiE 2026.04	25.66	-
WIDEN 2026.04	25	-
Baseline 2026.04	24.39	-
WIDEN 2026.04	24.39	-
ARB-LLM 2026.04	23.86	30.6
Avg Baseline 2026.04	23.17	-
Precise Fusion 2026.04	22.56	-
Precise Fusion 2026.04	22.56	-
BiLLM 2026.04	22.12	28.8
Baseline 2026.04	21.34	-
Ties Merging 2026.04	21.34	-
Avg Baseline 2026.04	20.73	-
NoWag 2026.04	20.23	26.94
Code 2026.04	19.51	-
ARB-LLM 2026.04	19.31	-
Base 2026.04	18.9	-
Task Arithmetic 2026.04	18.29	-
MoEQuant 2026.04	18.12	22.56
Precise Fusion 2026.04	17.68	-
BiLLM 2026.04	17.2	-
DARE Ties 2026.04	17.07	-
WIDEN 2026.04	17.07	-
Ties Merging 2026.04	16.46	-
DARE Task Arithmetic 2026.04	16.46	-
Avg Baseline 2026.04	15.85	-
Ties Merging 2026.04	15.85	-
MoBiE 2026.04	15.75	-
Math 2026.04	14.02	-
GPTQ 2026.04	13.88	16.96
DARE Ties 2026.04	13.41	-
DARE Task Arithmetic 2026.04	11.59	-
Task Arithmetic 2026.04	11.59	-
Baseline 2026.04	10.98	33.45
ARB-LLM 2026.04	10.2	-
AWQ 2026.04	9.73	15.1
MoBE 2026.03	9.7	29.9
BiLLM 2026.04	9.02	-
DARE Ties 2026.04	8.54	-
GPTQ 2026.04	7.28	24.85
NoWag 2026.04	6.83	-
MoBiE 2026.04	6.33	24.54
DARE Task Arithmetic 2026.04	5.49	-
Task Arithmetic 2026.04	4.27	-
NoWag 2026.04	3.13	-
MoEQuant 2026.04	2.31	-
ARB-LLM 2026.04	2.01	16.97
BiLLM 2026.04	0.42	14.85
NoWag 2026.04	0.02	11.77
GPTQ 2026.04	0	-
MoEQuant 2026.04	0	-
GPTQ 2026.04	0	-
AWQ 2026.04	0	3.88
AWQ 2026.04	0	1.9
GPTQ 2026.04	0	6.07
MoEQuant 2026.04	0	9.69
AWQ 2026.04	0	12.1