Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Parts mental model prediction on ParRoT
Loading...
0.7928
Accuracy
ParRoT-Con (Macaw-11B)
0.52812
0.596835
0.66555
0.734265
Dec 20, 2022
Accuracy
Improvement
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
Improvement
ParRoT-Con (Macaw-11B)
# params=11B, Constrai...
2022.12
0.7928
19.84
ParRoT-Con (GPT-3)
# params=175B, Constra...
2022.12
0.7026
16.43
Macaw-11B
# params=11B, Constrai...
2022.12
0.5945
-
GPT-3 (text-davinci-003)
# params=175B, Constra...
2022.12
0.5383
-
Feedback
Search any
task
Search any
task