Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Symbolic Reasoning (Equations) on NoRa Irrelevant Rationales
Loading...
49.3
Accuracy
CD-CoT
7.076
18.038
29
39.962
Oct 31, 2024
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
CD-CoT
Model=Gemini-Pro
2024.10
49.3
SC
Model=Gemini-Pro
2024.10
43.3
CD-CoT
Model=GPT-3.5-turbo
2024.10
42.7
Base
Model=Gemini-Pro
2024.10
38.9
CC
Model=Gemini-Pro
2024.10
37.3
CC
Model=GPT-3.5-turbo
2024.10
32.7
BT
Model=Gemini-Pro
2024.10
29.3
SC
Model=GPT-3.5-turbo
2024.10
28.3
Base
Model=GPT-3.5-turbo
2024.10
25.1
BT
Model=GPT-3.5-turbo
2024.10
22.7
CD-CoT
Model=Mixtral 8x7B
2024.10
22.7
SC
Model=Mixtral 8x7B
2024.10
21.7
CC
Model=Mixtral 8x7B
2024.10
18.5
Base
Model=Mixtral 8x7B
2024.10
17.9
CC
Model=LLaMA2-70B
2024.10
16.3
BT
Model=LLaMA2-70B
2024.10
11.2
SC
Model=LLaMA2-70B
2024.10
10.3
CD-CoT
Model=LLaMA2-70B
2024.10
9.7
BT
Model=Mixtral 8x7B
2024.10
9.7
Base
Model=LLaMA2-70B
2024.10
8.7
Feedback
Search any
task
Search any
task
