Share your thoughts, 1 month free Claude Pro on usSee more

Logic Reasoning on Tracking Shuffled Objects (BBH)

71.33Accuracy

Role-Play Prompting

Updated 1mo ago

Evaluation Results

Method	Links
Role-Play Prompting 2026.01		71.33
Persona Switch 2026.01		70.4
Top-p 2026.01		64.93
Multinomial 2026.01		64.67
Random Selection 2026.01		64.67
Persona Switch 2026.01		64.53
Role-Play Prompting 2026.01		64.13
Top-k 2026.01		61.33
Random Selection 2026.01		61.15
Self-discover 2024.09		60.03
Greedy 2026.01		58.8
Low-gap Selection 2026.01		58.67
Low-gap Selection 2026.01		58.13
Greedy 2026.01		53.47
Multinomial 2026.01		51.33
Top-p 2026.01		51.07
Top-k 2026.01		46.53
IAP-mv 2024.09		42.4
Prompt #1 2024.09		40
IAP-ss 2024.09		38.8
Persona Switch 2026.01		34.67
Random Selection 2026.01		32.44
Multinomial 2026.01		32.27
Greedy 2026.01		31.87
Low-gap Selection 2026.01		31.07
Top-k 2026.01		30.13
Prompt #2 2024.09		29.6
Top-p 2026.01		29.07
Role-Play Prompting 2026.01		28.4
OPPR 2024.09		28
IAP-mv 2024.09		25.6
Prompt #4 2024.09		24.4
Prompt #6 2024.09		24.4
Prompt #7 2024.09		24
Self-discover 2024.09		24
IAP-ss 2024.09		24
Prompt #3 2024.09		23.2
AMV (#1-7) 2024.09		20.8
OPPR 2024.09		20.8
Prompt #5 2024.09		20
Prompt #6 2024.09		17.6
Prompt #2 2024.09		16.8
Prompt #7 2024.09		16.8
Prompt #8 2024.09		16.8
Prompt #5 2024.09		16
Prompt #4 2024.09		15.6
Prompt #9 2024.09		13.6
Prompt #1 2024.09		13.2
AMV (all) 2024.09		12.6
Prompt #3 2024.09		12.4
Prompt #9 2024.09		10.8
AMV (#1-7) 2024.09		8.8
Prompt #8 2024.09		2
AMV (all) 2024.09		1.44