Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Auto-formalization on FATE-X
Loading...
69
Compiler Success Rate
Aria
2.44
19.72
37
54.28
Oct 6, 2025
Compiler Success Rate
Final Accuracy
Updated 22d ago
Evaluation Results
Method
Method
Links
Compiler Success Rate
Final Accuracy
Aria
2025.10
69
44
Goedel-V2
pass@N=128
2025.10
63
24
Goedel-V2
pass@N=64
2025.10
58
-
Goedel-V2
pass@N=32
2025.10
49
-
Goedel-V2
pass@N=16
2025.10
37
-
Gemini-2.5-Pro
pass@N=1
2025.10
27
21
Goedel-V2
pass@N=1
2025.10
27
16
Herald
pass@N=1
2025.10
8
5
Kimina
pass@N=1
2025.10
5
1
Feedback
Search any
task
Search any
task
