Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code-switching reduction on Arabic source code-switching (evaluation)
Loading...
0.17
CS Rate (ar→zh)
SASFT_Reduce
0.1244
0.4322
0.74
1.0478
Jul 20, 2025
CS Rate (ar→zh)
CS Rate (ar→ru)
CS Rate (ar→ko)
Updated 1mo ago
Evaluation Results
Method
Method
Links
CS Rate (ar→zh)
CS Rate (ar→ru)
CS Rate (ar→ko)
SASFT_Reduce
Model=Qwen3-1.7B-Base
2025.07
0.17
0
0
SASFT_Enhance
Model=Qwen3-1.7B-Base
2025.07
0.26
0.17
0.09
SASFT_Reduce
Model=Gemma-2-2B
2025.07
0.61
0.26
0
SFT+GRPO
Model=Qwen3-1.7B-Base
2025.07
0.61
0.26
0.26
SFT+GRPO
Model=Gemma-2-2B
2025.07
0.79
0.61
0.09
SFT (Baseline)
Model=Qwen3-1.7B-Base
2025.07
1.04
0.26
0.26
SFT (Baseline)
Model=Gemma-2-2B
2025.07
1.14
1.22
0.17
SASFT_Enhance
Model=Gemma-2-2B
2025.07
1.31
0.7
0
Feedback
Search any
task
Search any
task