Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Vectra-Bench

Benchmarks

Task NameDataset NameSOTA ResultTrend
In-Image Machine Translation EvaluationVectra-Bench Overall 1.0 (in-domain)
Pearson Correlation (r)0.738
8
In-Image Machine Translation EvaluationVectra-Bench zh→fr 1.0
Pearson Correlation0.708
8
In-Image Machine Translation EvaluationVectra-Bench zh→ja 1.0
Pearson Correlation (r)0.677
8
In-Image Machine Translation EvaluationVectra-Bench zh→pt 1.0
Pearson Correlation (r)0.773
8
In-Image Machine Translation EvaluationVectra-Bench zh→es 1.0
Pearson R0.732
8
In-Image Machine Translation EvaluationVectra-Bench zh→en 1.0
Pearson Correlation (r)0.8
8
Showing 6 of 6 rows