Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Symbolic Reasoning on Last Letter Concatenation OOD: 4 (test)
Loading...
63
Accuracy
PaLM 540B
-2.52
14.49
31.5
48.51
Dec 16, 2022
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
PaLM 540B
Method=CoT 8-shot
2022.12
63
T5 XXL
Method=Baseline
2022.12
0
T5 XXL
Method=CoT Finetuned
2022.12
0
Feedback
Search any
task
Search any
task
