Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Code Summarization on VHDL
Loading...
60.9
LLM PR
ROSUM-MCTS
25.436
34.643
43.85
53.057
Jun 6, 2026
LLM PR
Rouge-L
Updated 1mo ago
Evaluation Results
Method
Method
Links
LLM PR
Rouge-L
ROSUM-MCTS
LLM=GPT-4o
2026.06
60.9
50.8
ROSUM-MCTS
LLM=Llama-3
2026.06
53.2
45.9
CODES
LLM=GPT-4o
2026.06
52.3
43.2
Vanilla
LLM=GPT-4o
2026.06
48.7
39.3
CODES
LLM=Llama-3
2026.06
46.1
39.5
ROSUM-MCTS
LLM=Granite Code-34b
2026.06
45.6
39.3
Vanilla
LLM=Llama-3
2026.06
42.6
34.1
CODES
LLM=Granite Code-34b
2026.06
39.1
33.4
ROSUM-MCTS
LLM=DeepSeek-Coder-33b
2026.06
35.7
33.1
Vanilla
LLM=Granite Code-34b
2026.06
34.2
29.5
CODES
LLM=DeepSeek-Coder-33b
2026.06
29.4
28.6
Vanilla
LLM=DeepSeek-Coder-33b
2026.06
26.8
25.1
Feedback
Search any
task
Search any
task