Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Symbolic Reasoning on Last Letter Concatenation OOD: 3 (test)
Loading...
94.8
Accuracy
PaLM 540B
-3.792
21.804
47.4
72.996
Dec 16, 2022
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
PaLM 540B
Method=CoT 8-shot
2022.12
94.8
T5 XXL
Method=Baseline
2022.12
0
T5 XXL
Method=CoT Finetuned
2022.12
0
Feedback
Search any
task
Search any
task
