Share your thoughts, 1 month free Claude Pro on usSee more

Last-letter concatenation

Benchmarks

Dataset Name	SOTA Method	Metric
Last-letter-concatenation 12 words (out-of-distribution)	SKiC	Accuracy100	15	1mo ago
Last-letter-concatenation 10 words (out-of-distribution)	SKiC	Accuracy100	15	1mo ago
Last-letter-concatenation 8 words (out-of-distribution)	SKiC	Accuracy100	15	1mo ago
Last-letter-concatenation 6 words (out-of-distribution)	SKiC	Accuracy100	15	1mo ago
Last-letter-concatenation 4 words (out-of-distribution)	SKiC	Accuracy100	15	1mo ago
Last-letter-concatenation 2 words (in-distribution)	SKiC	Accuracy100	15	1mo ago
Last-letter-concatenation 1 word (in-distribution)	CoT	Accuracy100	15	1mo ago
Last-letter-concatenation 100 words (out-of-distribution)	SKiC	Accuracy100	5	1mo ago
Last-letter-concatenation 50 words (out-of-distribution)	SKiC	Accuracy100	5	1mo ago
Wiktionary L = 12	Least-to-Most	Accuracy74	3	1mo ago
Wiktionary L = 10	Least-to-Most	Accuracy76.4	3	1mo ago
Wiktionary L = 8	Least-to-Most	Accuracy83	3	1mo ago
Wiktionary L = 4	Least-to-Most	Accuracy94	3	1mo ago
Wiktionary L=6 (test)	Least-to-Most	Accuracy88.4	3	1mo ago
Last-letter-concatenation 100 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 50 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 12 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 10 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 8 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 6 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 4 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 2 words	-	Accuracy-	0	1mo ago
Last-letter-concatenation 1 word	-	Accuracy-	0	1mo ago
Wiktionary L=12 (test)	-	Accuracy-	0	1mo ago
Wiktionary L=10 (test)	-	Accuracy-	0	1mo ago

Showing 25 of 27 rows