Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Summarization on Verilog
Loading...
64.2
LLM PR
ROSUM-MCTS
30.816
39.483
48.15
56.817
Jun 6, 2026
LLM PR
Rouge-L
Updated 1mo ago
Evaluation Results
Method
Method
Links
LLM PR
Rouge-L
ROSUM-MCTS
LLM=GPT-4o
2026.06
64.2
55.4
ROSUM-MCTS
LLM=Llama-3
2026.06
55.6
48.8
CODES
LLM=GPT-4o
2026.06
55
46.9
Vanilla
LLM=GPT-4o
2026.06
52.4
43.1
ROSUM-MCTS
LLM=Granite Code-34b
2026.06
50.3
44.2
CODES
LLM=Llama-3
2026.06
48.7
43.5
Vanilla
LLM=Llama-3
2026.06
45.9
40.2
CODES
LLM=Granite Code-34b
2026.06
43.8
37.8
Vanilla
LLM=Granite Code-34b
2026.06
40.5
33
ROSUM-MCTS
LLM=DeepSeek-Coder-33b
2026.06
40.5
36.7
CODES
LLM=DeepSeek-Coder-33b
2026.06
35.5
31.2
Vanilla
LLM=DeepSeek-Coder-33b
2026.06
32.1
29.5
Feedback
Search any
task
Search any
task