Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Last-letter-concatenation on Last-letter-concatenation 6 words (out-of-distribution)
Loading...
100
Accuracy
SKiC
-4
23
50
77
Aug 1, 2023
Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
Accuracy
SKiC
Model=text-davinci-003...
2023.08
100
SKiC
Model=ChatGPT, #-shots=2
2023.08
100
CoT
Model=ChatGPT, #-shots=4
2023.08
95
LtM
Model=ChatGPT, #-shots=4
2023.08
95
4-shots
Model=ChatGPT, #-shots=4
2023.08
92
LtM
Model=text-davinci-003...
2023.08
90
zero-shot
Model=ChatGPT, #-shots=0
2023.08
88
CoT
Model=text-davinci-003...
2023.08
75
4-shots
Model=text-davinci-003...
2023.08
68
SKiC
Model=LLAMA-65B, #-sho...
2023.08
59
LtM
Model=LLAMA-65B, #-sho...
2023.08
50
CoT
Model=LLAMA-65B, #-sho...
2023.08
42
4-shots
Model=LLAMA-65B, #-sho...
2023.08
26
zero-shot
Model=LLAMA-65B, #-sho...
2023.08
0
zero-shot
Model=text-davinci-003...
2023.08
0
Feedback
Search any
task
Search any
task
