Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
RTL Generation on RTLLM common subset, N=44 and N=49 v2.0
Loading...
0.48
Coverage
TTT-RTL
0.4384
0.4492
0.46
0.4708
Jun 3, 2026
Coverage
Geometric Mean (N=44)
Arithmetic Mean (N=44)
Count Improved (N=44)
Count Best (N=44)
Geometric Mean Penalty (N=49)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Coverage
Geometric Mean (N=44)
Arithmetic Mean (N=44)
Count Improved (N=44)
Count Best (N=44)
Geometric Mean Penalty (N=49)
TTT-RTL
Backbone LLM=Qwen3-8B,...
2026.06
0.48
0.349
0.527
0.38
33.5
0.341
EvolVE
Backbone LLM=GPT-4o-mi...
2026.06
0.46
0.872
0.909
0.17
0.5
0.892
REvolution
Backbone LLM=GPT-4o-mi...
2026.06
0.45
0.739
0.813
0.29
8
0.762
VeriAgent
Backbone LLM=GPT-4o-mi...
2026.06
0.44
0.813
0.853
0.25
2
0.83
Feedback
Search any
task
Search any
task