Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Parts Mental Model Accuracy on ParRoT++
Loading...
60.04
Base LM Accuracy
Macaw-11B
55.3288
56.5519
57.775
58.9981
Dec 20, 2022
Base LM Accuracy
ParRoT-Con Accuracy
Improvement (%)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Base LM Accuracy
ParRoT-Con Accuracy
Improvement (%)
Macaw-11B
# params=11B
2022.12
60.04
82.41
22.38
GPT-3 (text-davinci-003)
# params=175B
2022.12
55.51
71.13
15.62
Feedback
Search any
task
Search any
task
