Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Automatic Security Patch Designing on GHArchive 37 unfixed vulnerabilities after Jan 1st, 2024
Loading...
78.38
Fix Rate@1
ChatGPT + SynAT
39.0264
49.2432
59.46
69.6768
Feb 5, 2026
Fix Rate@1
Fix Rate@5
Fix Rate@10
Updated 4d ago
Evaluation Results
Method
Method
Links
Fix Rate@1
Fix Rate@5
Fix Rate@10
ChatGPT + SynAT
Training Strategy=In-C...
2026.02
78.38
81.08
83.78
CodeT5 + SynAT
Training Strategy=Fine...
2026.02
67.57
86.49
89.19
ChatGPT
Training Strategy=In-C...
2026.02
62.16
64.86
64.86
CodeT5
Training Strategy=Fine...
2026.02
40.54
54.05
54.05
Feedback
Search any
task
Search any
task